2024-05-15T15:27:06.388 INFO:root:teuthology version: 0.0.1.dev272+g08ca118 2024-05-15T15:27:06.388 DEBUG:teuthology.run:Teuthology command: teuthology --description fs:fscrypt/{begin/{0-install 1-ceph 2-logrotate 3-modules} bluestore-bitmap clusters/1-mds-1-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} overrides/{ignorelist_health ignorelist_health_more ignorelist_wrongly_marked_down osd pg-warn pg_health} tasks/{0-client 1-tests/fscrypt-common}} --archive /home/teuthworker/archive/pdonnell-2024-05-15_15:16:14-fs:fscrypt-wip-pdonnell-testing-20240515.023933-debug-distro-default-smithi/7707268 --owner scheduled_pdonnell@teuthology --verbose --name pdonnell-2024-05-15_15:16:14-fs:fscrypt-wip-pdonnell-testing-20240515.023933-debug-distro-default-smithi -- /home/teuthworker/archive/pdonnell-2024-05-15_15:16:14-fs:fscrypt-wip-pdonnell-testing-20240515.023933-debug-distro-default-smithi/7707268/orig.config.yaml 2024-05-15T15:27:06.437 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-15T15:27:06.521 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2024-05-15_15:16:14-fs:fscrypt-wip-pdonnell-testing-20240515.023933-debug-distro-default-smithi/7707268 branch: wip-pdonnell-testing-20240515.023933-debug description: fs:fscrypt/{begin/{0-install 1-ceph 2-logrotate 3-modules} bluestore-bitmap clusters/1-mds-1-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} overrides/{ignorelist_health ignorelist_health_more ignorelist_wrongly_marked_down osd pg-warn pg_health} tasks/{0-client 1-tests/fscrypt-common}} email: pdonnell@redhat.com first_in_suite: false job_id: '7707268' kernel: client: branch: testing kdb: 1 sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: pdonnell-2024-05-15_15:16:14-fs:fscrypt-wip-pdonnell-testing-20240515.023933-debug-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-pdonnell-testing-20240515.023933-debug ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mon pg warn min per osd: 0 ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - Reduced data availability - Degraded data redundancy - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy sha1: 43296076bed1da2423ef68e9230eab60284d4c31 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 43296076bed1da2423ef68e9230eab60284d4c31 extra_system_packages: deb: - fscrypt rpm: - fscrypt kclient: syntax: v1 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: i64602 sha1: b8bd437e67ddf964c5c673086ea1e4c237db86fa owner: scheduled_pdonnell@teuthology priority: 65 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - - mon.b - mon.c - mgr.x - mds.b - osd.4 - osd.5 - osd.6 - osd.7 - - client.0 seed: 2176 sha1: 43296076bed1da2423ef68e9230eab60284d4c31 sleep_before_teardown: 0 suite: fs:fscrypt suite_branch: i64602 suite_path: /home/teuthworker/src/github.com_batrick_ceph_b8bd437e67ddf964c5c673086ea1e4c237db86fa/qa suite_relpath: qa suite_repo: https://github.com/batrick/ceph.git suite_sha1: b8bd437e67ddf964c5c673086ea1e4c237db86fa syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi012.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBG2i70EpL77oPbG/6MA++NCF0uVUZz0Qn3hgynP6Ra4eXFERNjfmD4+oGS3/ks6eG9cLo+CrJySNJ851dnkVdTE= smithi084.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKg91V/Kmfd0ek4z720g3qcttaon7aGfKZ+BIb1+EKkDr9Gi4zWlwDedklEjb0y5tvPJuIr5sWgiZgBWyW7yCbU= smithi104.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBA4rmZ4S3yNGHZiN5a6YvUTX8tOaCaaM2ddSiIfEAwKC/OMYTIuvWJ8ySpMZHCU+ukEuoQ7sP/V69xi1K/P4tvk= task: null tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - kclient: null - full_sequential_finally: - sleep: duration: 3600 - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_fscrypt teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end - if not is_kupstream() then reject() end teuthology_branch: install-override-extra_system_packages teuthology_sha1: 08ca1187b5d019c0ae6c90488c6c9faaace42185 timestamp: 2024-05-15_15:16:14 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-05-15T15:27:06.522 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_batrick_ceph_b8bd437e67ddf964c5c673086ea1e4c237db86fa/qa; will attempt to use it 2024-05-15T15:27:06.522 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_batrick_ceph_b8bd437e67ddf964c5c673086ea1e4c237db86fa/qa/tasks 2024-05-15T15:27:06.523 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-05-15T15:27:06.524 INFO:teuthology.task.internal:Checking packages... 2024-05-15T15:27:06.780 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '43296076bed1da2423ef68e9230eab60284d4c31' 2024-05-15T15:27:06.780 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-05-15T15:27:06.780 INFO:teuthology.packaging:ref: None 2024-05-15T15:27:06.780 INFO:teuthology.packaging:tag: None 2024-05-15T15:27:06.780 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20240515.023933-debug 2024-05-15T15:27:06.780 INFO:teuthology.packaging:sha1: 43296076bed1da2423ef68e9230eab60284d4c31 2024-05-15T15:27:06.780 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-pdonnell-testing-20240515.023933-debug 2024-05-15T15:27:06.922 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3709.g43296076 2024-05-15T15:27:06.923 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-05-15T15:27:06.930 INFO:teuthology.task.internal:no buildpackages task found 2024-05-15T15:27:06.930 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-05-15T15:27:06.971 INFO:teuthology.task.internal:Saving configuration 2024-05-15T15:27:06.990 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-05-15T15:27:06.997 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-15T15:27:07.023 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi012.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-05-15_15:16:14-fs:fscrypt-wip-pdonnell-testing-20240515.023933-debug-distro-default-smithi/7707268', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-15 15:22:05.544884', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBG2i70EpL77oPbG/6MA++NCF0uVUZz0Qn3hgynP6Ra4eXFERNjfmD4+oGS3/ks6eG9cLo+CrJySNJ851dnkVdTE='} 2024-05-15T15:27:07.046 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi084.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-05-15_15:16:14-fs:fscrypt-wip-pdonnell-testing-20240515.023933-debug-distro-default-smithi/7707268', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-15 15:22:05.546537', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKg91V/Kmfd0ek4z720g3qcttaon7aGfKZ+BIb1+EKkDr9Gi4zWlwDedklEjb0y5tvPJuIr5sWgiZgBWyW7yCbU='} 2024-05-15T15:27:07.069 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi104.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-05-15_15:16:14-fs:fscrypt-wip-pdonnell-testing-20240515.023933-debug-distro-default-smithi/7707268', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-15 15:22:05.542983', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBA4rmZ4S3yNGHZiN5a6YvUTX8tOaCaaM2ddSiIfEAwKC/OMYTIuvWJ8ySpMZHCU+ukEuoQ7sP/V69xi1K/P4tvk='} 2024-05-15T15:27:07.069 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-05-15T15:27:07.075 INFO:teuthology.task.internal:roles: ubuntu@smithi012.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3'] 2024-05-15T15:27:07.075 INFO:teuthology.task.internal:roles: ubuntu@smithi084.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2024-05-15T15:27:07.075 INFO:teuthology.task.internal:roles: ubuntu@smithi104.front.sepia.ceph.com - ['client.0'] 2024-05-15T15:27:07.075 INFO:teuthology.run_tasks:Running task console_log... 2024-05-15T15:27:07.163 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fc250be7ac0>, signals=[15]) 2024-05-15T15:27:07.163 INFO:teuthology.run_tasks:Running task internal.connect... 2024-05-15T15:27:07.169 INFO:teuthology.task.internal:Opening connections... 2024-05-15T15:27:07.169 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi012.front.sepia.ceph.com 2024-05-15T15:27:07.171 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-15T15:27:07.246 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi084.front.sepia.ceph.com 2024-05-15T15:27:07.247 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-15T15:27:07.320 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi104.front.sepia.ceph.com 2024-05-15T15:27:07.321 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-15T15:27:07.402 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-05-15T15:27:07.408 DEBUG:teuthology.orchestra.run.smithi012:> uname -m 2024-05-15T15:27:07.428 INFO:teuthology.orchestra.run.smithi012.stdout:x86_64 2024-05-15T15:27:07.428 DEBUG:teuthology.orchestra.run.smithi012:> cat /etc/os-release 2024-05-15T15:27:07.485 INFO:teuthology.orchestra.run.smithi012.stdout:NAME="CentOS Stream" 2024-05-15T15:27:07.485 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION="9" 2024-05-15T15:27:07.485 INFO:teuthology.orchestra.run.smithi012.stdout:ID="centos" 2024-05-15T15:27:07.485 INFO:teuthology.orchestra.run.smithi012.stdout:ID_LIKE="rhel fedora" 2024-05-15T15:27:07.485 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION_ID="9" 2024-05-15T15:27:07.485 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM_ID="platform:el9" 2024-05-15T15:27:07.485 INFO:teuthology.orchestra.run.smithi012.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-15T15:27:07.486 INFO:teuthology.orchestra.run.smithi012.stdout:ANSI_COLOR="0;31" 2024-05-15T15:27:07.486 INFO:teuthology.orchestra.run.smithi012.stdout:LOGO="fedora-logo-icon" 2024-05-15T15:27:07.486 INFO:teuthology.orchestra.run.smithi012.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-15T15:27:07.486 INFO:teuthology.orchestra.run.smithi012.stdout:HOME_URL="https://centos.org/" 2024-05-15T15:27:07.486 INFO:teuthology.orchestra.run.smithi012.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-15T15:27:07.486 INFO:teuthology.orchestra.run.smithi012.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-15T15:27:07.486 INFO:teuthology.orchestra.run.smithi012.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-15T15:27:07.487 INFO:teuthology.lock.ops:Updating smithi012.front.sepia.ceph.com on lock server 2024-05-15T15:27:07.510 DEBUG:teuthology.orchestra.run.smithi084:> uname -m 2024-05-15T15:27:07.528 INFO:teuthology.orchestra.run.smithi084.stdout:x86_64 2024-05-15T15:27:07.528 DEBUG:teuthology.orchestra.run.smithi084:> cat /etc/os-release 2024-05-15T15:27:07.585 INFO:teuthology.orchestra.run.smithi084.stdout:NAME="CentOS Stream" 2024-05-15T15:27:07.585 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION="9" 2024-05-15T15:27:07.585 INFO:teuthology.orchestra.run.smithi084.stdout:ID="centos" 2024-05-15T15:27:07.585 INFO:teuthology.orchestra.run.smithi084.stdout:ID_LIKE="rhel fedora" 2024-05-15T15:27:07.585 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION_ID="9" 2024-05-15T15:27:07.585 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM_ID="platform:el9" 2024-05-15T15:27:07.585 INFO:teuthology.orchestra.run.smithi084.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-15T15:27:07.585 INFO:teuthology.orchestra.run.smithi084.stdout:ANSI_COLOR="0;31" 2024-05-15T15:27:07.585 INFO:teuthology.orchestra.run.smithi084.stdout:LOGO="fedora-logo-icon" 2024-05-15T15:27:07.586 INFO:teuthology.orchestra.run.smithi084.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-15T15:27:07.586 INFO:teuthology.orchestra.run.smithi084.stdout:HOME_URL="https://centos.org/" 2024-05-15T15:27:07.586 INFO:teuthology.orchestra.run.smithi084.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-15T15:27:07.586 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-15T15:27:07.586 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-15T15:27:07.586 INFO:teuthology.lock.ops:Updating smithi084.front.sepia.ceph.com on lock server 2024-05-15T15:27:07.610 DEBUG:teuthology.orchestra.run.smithi104:> uname -m 2024-05-15T15:27:07.629 INFO:teuthology.orchestra.run.smithi104.stdout:x86_64 2024-05-15T15:27:07.629 DEBUG:teuthology.orchestra.run.smithi104:> cat /etc/os-release 2024-05-15T15:27:07.687 INFO:teuthology.orchestra.run.smithi104.stdout:NAME="CentOS Stream" 2024-05-15T15:27:07.687 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION="9" 2024-05-15T15:27:07.687 INFO:teuthology.orchestra.run.smithi104.stdout:ID="centos" 2024-05-15T15:27:07.687 INFO:teuthology.orchestra.run.smithi104.stdout:ID_LIKE="rhel fedora" 2024-05-15T15:27:07.687 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION_ID="9" 2024-05-15T15:27:07.687 INFO:teuthology.orchestra.run.smithi104.stdout:PLATFORM_ID="platform:el9" 2024-05-15T15:27:07.687 INFO:teuthology.orchestra.run.smithi104.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-15T15:27:07.687 INFO:teuthology.orchestra.run.smithi104.stdout:ANSI_COLOR="0;31" 2024-05-15T15:27:07.687 INFO:teuthology.orchestra.run.smithi104.stdout:LOGO="fedora-logo-icon" 2024-05-15T15:27:07.688 INFO:teuthology.orchestra.run.smithi104.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-15T15:27:07.688 INFO:teuthology.orchestra.run.smithi104.stdout:HOME_URL="https://centos.org/" 2024-05-15T15:27:07.688 INFO:teuthology.orchestra.run.smithi104.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-15T15:27:07.688 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-15T15:27:07.688 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-15T15:27:07.688 INFO:teuthology.lock.ops:Updating smithi104.front.sepia.ceph.com on lock server 2024-05-15T15:27:07.710 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-05-15T15:27:07.719 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-05-15T15:27:07.725 INFO:teuthology.task.internal:Checking for old test directory... 2024-05-15T15:27:07.725 DEBUG:teuthology.orchestra.run.smithi012:> test '!' -e /home/ubuntu/cephtest 2024-05-15T15:27:07.728 DEBUG:teuthology.orchestra.run.smithi084:> test '!' -e /home/ubuntu/cephtest 2024-05-15T15:27:07.731 DEBUG:teuthology.orchestra.run.smithi104:> test '!' -e /home/ubuntu/cephtest 2024-05-15T15:27:07.746 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-05-15T15:27:07.752 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-05-15T15:27:07.753 DEBUG:teuthology.orchestra.run.smithi012:> test -z $(ls -A /var/lib/ceph) 2024-05-15T15:27:07.785 DEBUG:teuthology.orchestra.run.smithi084:> test -z $(ls -A /var/lib/ceph) 2024-05-15T15:27:07.788 DEBUG:teuthology.orchestra.run.smithi104:> test -z $(ls -A /var/lib/ceph) 2024-05-15T15:27:07.887 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-05-15T15:27:07.966 INFO:teuthology.run_tasks:Running task kernel... 2024-05-15T15:27:08.020 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'} 2024-05-15T15:27:08.020 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}} 2024-05-15T15:27:08.020 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}}, timeout 300 2024-05-15T15:27:08.020 DEBUG:teuthology.orchestra.run.smithi104:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-15T15:27:08.037 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-15T15:27:08.037 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-05-15T15:27:08.218 DEBUG:teuthology.task.kernel:sha1 for client.0 is 42e114f04cb046558abf08b436bd2a0497043042 2024-05-15T15:27:08.219 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "42e114f04cb046558abf08b436bd2a0497043042"... 2024-05-15T15:27:08.219 DEBUG:teuthology.orchestra.run.smithi104:> uname -r 2024-05-15T15:27:08.236 INFO:teuthology.orchestra.run.smithi104.stdout:5.14.0-437.el9.x86_64 2024-05-15T15:27:08.236 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-437.el9.x86_64 vs 42e114f04cb046558abf08b436bd2a0497043042 2024-05-15T15:27:08.237 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-05-15T15:27:08.237 DEBUG:teuthology.orchestra.run.smithi104:> sudo yum upgrade -y linux-firmware 2024-05-15T15:27:10.685 INFO:teuthology.orchestra.run.smithi104.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.1 MB 00:00 2024-05-15T15:27:12.377 INFO:teuthology.orchestra.run.smithi104.stdout:CentOS Stream 9 - AppStream 32 MB/s | 19 MB 00:00 2024-05-15T15:27:16.561 INFO:teuthology.orchestra.run.smithi104.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.2 MB 00:00 2024-05-15T15:27:18.136 INFO:teuthology.orchestra.run.smithi104.stdout:CentOS Stream 9 - Extras packages 66 kB/s | 16 kB 00:00 2024-05-15T15:27:37.662 INFO:teuthology.orchestra.run.smithi104.stdout:Extra Packages for Enterprise Linux 1.1 MB/s | 21 MB 00:19 2024-05-15T15:27:42.908 INFO:teuthology.orchestra.run.smithi104.stdout:lab-extras 20 kB/s | 1.7 kB 00:00 2024-05-15T15:27:44.986 INFO:teuthology.orchestra.run.smithi104.stdout:Dependencies resolved. 2024-05-15T15:27:44.987 INFO:teuthology.orchestra.run.smithi104.stdout:Nothing to do. 2024-05-15T15:27:44.987 INFO:teuthology.orchestra.run.smithi104.stdout:Complete! 2024-05-15T15:27:45.084 INFO:teuthology.task.kernel:Downloading kernel 42e114f04cb046558abf08b436bd2a0497043042 on client.0... 2024-05-15T15:27:45.085 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=42e114f04cb046558abf08b436bd2a0497043042 2024-05-15T15:27:45.229 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/42e114f04cb046558abf08b436bd2a0497043042/centos/9/flavors/default/x86_64/ 2024-05-15T15:27:45.229 DEBUG:teuthology.orchestra.run.smithi104:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.9.0_rc3_g42e114f04cb0-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/42e114f04cb046558abf08b436bd2a0497043042/centos/9/flavors/default/x86_64/ --input-file=- 2024-05-15T15:27:45.232 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi104.front.sepia.ceph.com to complete... 2024-05-15T15:27:59.707 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-15 15:27:59 URL:https://2.chacra.ceph.com/r/kernel/testing/42e114f04cb046558abf08b436bd2a0497043042/centos/9/flavors/default/x86_64/kernel-6.9.0_rc3_g42e114f04cb0-1.x86_64.rpm [357254834/357254834] -> "/tmp/kernel.x86_64.rpm" [1] 2024-05-15T15:27:59.707 INFO:teuthology.orchestra.run.smithi104.stderr:FINISHED --2024-05-15 15:27:59-- 2024-05-15T15:27:59.707 INFO:teuthology.orchestra.run.smithi104.stderr:Total wall clock time: 14s 2024-05-15T15:27:59.707 INFO:teuthology.orchestra.run.smithi104.stderr:Downloaded: 1 files, 341M in 14s (24.2 MB/s) 2024-05-15T15:27:59.710 INFO:teuthology.task.kernel:Installing kernel 42e114f04cb046558abf08b436bd2a0497043042 on client.0... 2024-05-15T15:27:59.710 DEBUG:teuthology.orchestra.run.smithi104:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-05-15T15:28:01.784 INFO:teuthology.orchestra.run.smithi104.stdout:Verifying... ######################################## 2024-05-15T15:28:02.134 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing... ######################################## 2024-05-15T15:28:02.246 INFO:teuthology.orchestra.run.smithi104.stdout:Updating / installing... 2024-05-15T15:28:10.171 INFO:teuthology.orchestra.run.smithi104.stdout:kernel-6.9.0_rc3_g42e114f04cb0-1 ######################################## 2024-05-15T15:28:49.510 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi104.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-05-15T15:28:49.511 DEBUG:teuthology.orchestra.run.smithi104:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-05-15T15:28:49.590 INFO:teuthology.orchestra.run.smithi104.stdout:/boot/System.map-6.9.0-rc3-g42e114f04cb0 2024-05-15T15:28:49.590 INFO:teuthology.orchestra.run.smithi104.stdout:/boot/config-6.9.0-rc3-g42e114f04cb0 2024-05-15T15:28:49.590 INFO:teuthology.orchestra.run.smithi104.stdout:/boot/vmlinuz-6.9.0-rc3-g42e114f04cb0 2024-05-15T15:28:49.591 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/System.map 2024-05-15T15:28:49.591 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/config 2024-05-15T15:28:49.591 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel 2024-05-15T15:28:49.591 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/arch 2024-05-15T15:28:49.591 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/arch/x86 2024-05-15T15:28:49.591 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/arch/x86/crypto 2024-05-15T15:28:49.591 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-05-15T15:28:49.591 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-05-15T15:28:49.591 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-05-15T15:28:49.591 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-05-15T15:28:49.591 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-05-15T15:28:49.591 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-05-15T15:28:49.591 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-05-15T15:28:49.592 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/arch/x86/crypto/crc32c-intel.ko 2024-05-15T15:28:49.592 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-05-15T15:28:49.592 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-05-15T15:28:49.592 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-05-15T15:28:49.592 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-05-15T15:28:49.592 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/arch/x86/crypto/serpent-avx2.ko 2024-05-15T15:28:49.592 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-05-15T15:28:49.592 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-05-15T15:28:49.592 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-05-15T15:28:49.592 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-05-15T15:28:49.592 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-05-15T15:28:49.592 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-05-15T15:28:49.592 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-05-15T15:28:49.593 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/arch/x86/kernel 2024-05-15T15:28:49.593 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/arch/x86/kernel/cpu 2024-05-15T15:28:49.593 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/arch/x86/kernel/cpu/mce 2024-05-15T15:28:49.593 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-05-15T15:28:49.593 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/arch/x86/kvm 2024-05-15T15:28:49.593 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/arch/x86/kvm/kvm-amd.ko 2024-05-15T15:28:49.593 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/arch/x86/kvm/kvm-intel.ko 2024-05-15T15:28:49.593 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/arch/x86/kvm/kvm.ko 2024-05-15T15:28:49.593 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto 2024-05-15T15:28:49.593 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/ansi_cprng.ko 2024-05-15T15:28:49.593 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/anubis.ko 2024-05-15T15:28:49.593 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/arc4.ko 2024-05-15T15:28:49.593 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/async_tx 2024-05-15T15:28:49.594 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/async_tx/async_memcpy.ko 2024-05-15T15:28:49.594 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/async_tx/async_pq.ko 2024-05-15T15:28:49.594 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/async_tx/async_raid6_recov.ko 2024-05-15T15:28:49.594 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/async_tx/async_tx.ko 2024-05-15T15:28:49.594 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/async_tx/async_xor.ko 2024-05-15T15:28:49.594 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/async_tx/raid6test.ko 2024-05-15T15:28:49.594 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/authenc.ko 2024-05-15T15:28:49.594 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/authencesn.ko 2024-05-15T15:28:49.594 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/blake2b_generic.ko 2024-05-15T15:28:49.594 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/blowfish_common.ko 2024-05-15T15:28:49.594 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/blowfish_generic.ko 2024-05-15T15:28:49.594 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/camellia_generic.ko 2024-05-15T15:28:49.595 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/cast5_generic.ko 2024-05-15T15:28:49.595 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/cast6_generic.ko 2024-05-15T15:28:49.595 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/cast_common.ko 2024-05-15T15:28:49.595 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/ccm.ko 2024-05-15T15:28:49.595 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/cmac.ko 2024-05-15T15:28:49.595 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/crc32_generic.ko 2024-05-15T15:28:49.595 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/crypto_engine.ko 2024-05-15T15:28:49.595 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/crypto_user.ko 2024-05-15T15:28:49.595 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/cts.ko 2024-05-15T15:28:49.595 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/des_generic.ko 2024-05-15T15:28:49.595 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/dh_generic.ko 2024-05-15T15:28:49.595 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/echainiv.ko 2024-05-15T15:28:49.595 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/essiv.ko 2024-05-15T15:28:49.595 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/fcrypt.ko 2024-05-15T15:28:49.596 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/khazad.ko 2024-05-15T15:28:49.596 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/lz4.ko 2024-05-15T15:28:49.596 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/lz4hc.ko 2024-05-15T15:28:49.596 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/md4.ko 2024-05-15T15:28:49.596 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/michael_mic.ko 2024-05-15T15:28:49.596 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/pcbc.ko 2024-05-15T15:28:49.596 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/pcrypt.ko 2024-05-15T15:28:49.596 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/rmd160.ko 2024-05-15T15:28:49.596 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/seed.ko 2024-05-15T15:28:49.596 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/serpent_generic.ko 2024-05-15T15:28:49.596 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/tcrypt.ko 2024-05-15T15:28:49.596 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/tea.ko 2024-05-15T15:28:49.596 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/twofish_common.ko 2024-05-15T15:28:49.596 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/twofish_generic.ko 2024-05-15T15:28:49.597 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/vmac.ko 2024-05-15T15:28:49.597 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/wp512.ko 2024-05-15T15:28:49.597 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/xcbc.ko 2024-05-15T15:28:49.597 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/xor.ko 2024-05-15T15:28:49.597 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/crypto/xxhash_generic.ko 2024-05-15T15:28:49.597 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers 2024-05-15T15:28:49.597 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/acpi 2024-05-15T15:28:49.597 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/acpi/acpi_ipmi.ko 2024-05-15T15:28:49.597 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/acpi/acpi_pad.ko 2024-05-15T15:28:49.597 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/acpi/ec_sys.ko 2024-05-15T15:28:49.597 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/acpi/platform_profile.ko 2024-05-15T15:28:49.597 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/acpi/sbs.ko 2024-05-15T15:28:49.597 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/acpi/sbshc.ko 2024-05-15T15:28:49.597 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/acpi/video.ko 2024-05-15T15:28:49.598 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata 2024-05-15T15:28:49.598 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/acard-ahci.ko 2024-05-15T15:28:49.598 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/ahci_platform.ko 2024-05-15T15:28:49.598 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/ata_generic.ko 2024-05-15T15:28:49.598 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/libahci_platform.ko 2024-05-15T15:28:49.598 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/pata_acpi.ko 2024-05-15T15:28:49.598 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/pata_ali.ko 2024-05-15T15:28:49.598 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/pata_amd.ko 2024-05-15T15:28:49.598 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/pata_artop.ko 2024-05-15T15:28:49.598 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/pata_atiixp.ko 2024-05-15T15:28:49.598 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/pata_atp867x.ko 2024-05-15T15:28:49.598 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/pata_cmd640.ko 2024-05-15T15:28:49.599 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/pata_cmd64x.ko 2024-05-15T15:28:49.599 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/pata_cypress.ko 2024-05-15T15:28:49.599 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/pata_efar.ko 2024-05-15T15:28:49.599 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/pata_hpt366.ko 2024-05-15T15:28:49.599 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/pata_hpt37x.ko 2024-05-15T15:28:49.599 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/pata_hpt3x2n.ko 2024-05-15T15:28:49.599 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/pata_hpt3x3.ko 2024-05-15T15:28:49.599 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/pata_it8213.ko 2024-05-15T15:28:49.599 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/pata_it821x.ko 2024-05-15T15:28:49.599 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/pata_jmicron.ko 2024-05-15T15:28:49.599 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/pata_marvell.ko 2024-05-15T15:28:49.599 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/pata_mpiix.ko 2024-05-15T15:28:49.600 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/pata_netcell.ko 2024-05-15T15:28:49.600 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/pata_ninja32.ko 2024-05-15T15:28:49.600 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/pata_ns87410.ko 2024-05-15T15:28:49.600 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/pata_ns87415.ko 2024-05-15T15:28:49.600 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/pata_oldpiix.ko 2024-05-15T15:28:49.600 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/pata_opti.ko 2024-05-15T15:28:49.600 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/pata_optidma.ko 2024-05-15T15:28:49.600 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/pata_pcmcia.ko 2024-05-15T15:28:49.600 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/pata_pdc2027x.ko 2024-05-15T15:28:49.600 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-05-15T15:28:49.600 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/pata_piccolo.ko 2024-05-15T15:28:49.600 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/pata_rdc.ko 2024-05-15T15:28:49.600 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/pata_sch.ko 2024-05-15T15:28:49.600 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/pata_serverworks.ko 2024-05-15T15:28:49.601 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/pata_sil680.ko 2024-05-15T15:28:49.601 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/pata_sis.ko 2024-05-15T15:28:49.601 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/pata_sl82c105.ko 2024-05-15T15:28:49.601 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/pata_triflex.ko 2024-05-15T15:28:49.601 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/pata_via.ko 2024-05-15T15:28:49.601 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/pdc_adma.ko 2024-05-15T15:28:49.601 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/sata_inic162x.ko 2024-05-15T15:28:49.601 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/sata_mv.ko 2024-05-15T15:28:49.601 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/sata_nv.ko 2024-05-15T15:28:49.601 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/sata_promise.ko 2024-05-15T15:28:49.601 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/sata_qstor.ko 2024-05-15T15:28:49.601 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/sata_sil.ko 2024-05-15T15:28:49.602 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/sata_sil24.ko 2024-05-15T15:28:49.602 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/sata_sis.ko 2024-05-15T15:28:49.602 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/sata_svw.ko 2024-05-15T15:28:49.602 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/sata_sx4.ko 2024-05-15T15:28:49.602 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/sata_uli.ko 2024-05-15T15:28:49.602 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/sata_via.ko 2024-05-15T15:28:49.602 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ata/sata_vsc.ko 2024-05-15T15:28:49.602 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/auxdisplay 2024-05-15T15:28:49.602 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/auxdisplay/ks0108.ko 2024-05-15T15:28:49.602 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/base 2024-05-15T15:28:49.603 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/base/regmap 2024-05-15T15:28:49.603 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/base/regmap/regmap-i2c.ko 2024-05-15T15:28:49.603 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/base/regmap/regmap-mmio.ko 2024-05-15T15:28:49.603 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/bcma 2024-05-15T15:28:49.603 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/bcma/bcma.ko 2024-05-15T15:28:49.603 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/block 2024-05-15T15:28:49.603 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/block/aoe 2024-05-15T15:28:49.603 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/block/aoe/aoe.ko 2024-05-15T15:28:49.603 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/block/brd.ko 2024-05-15T15:28:49.603 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/block/drbd 2024-05-15T15:28:49.603 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/block/drbd/drbd.ko 2024-05-15T15:28:49.603 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/block/floppy.ko 2024-05-15T15:28:49.604 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/block/loop.ko 2024-05-15T15:28:49.604 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/block/mtip32xx 2024-05-15T15:28:49.604 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-05-15T15:28:49.604 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/block/nbd.ko 2024-05-15T15:28:49.604 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/block/null_blk 2024-05-15T15:28:49.604 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/block/null_blk/null_blk.ko 2024-05-15T15:28:49.604 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/block/pktcdvd.ko 2024-05-15T15:28:49.604 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/block/rbd.ko 2024-05-15T15:28:49.604 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/block/virtio_blk.ko 2024-05-15T15:28:49.604 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/block/xen-blkback 2024-05-15T15:28:49.604 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-05-15T15:28:49.604 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/block/xen-blkfront.ko 2024-05-15T15:28:49.604 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/block/zram 2024-05-15T15:28:49.605 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/block/zram/zram.ko 2024-05-15T15:28:49.605 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/char 2024-05-15T15:28:49.605 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/char/hangcheck-timer.ko 2024-05-15T15:28:49.605 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/char/hw_random 2024-05-15T15:28:49.605 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/char/hw_random/amd-rng.ko 2024-05-15T15:28:49.605 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/char/hw_random/intel-rng.ko 2024-05-15T15:28:49.605 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-05-15T15:28:49.605 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/char/hw_random/via-rng.ko 2024-05-15T15:28:49.605 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/char/hw_random/virtio-rng.ko 2024-05-15T15:28:49.605 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/char/ipmi 2024-05-15T15:28:49.605 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-05-15T15:28:49.605 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-05-15T15:28:49.605 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-05-15T15:28:49.606 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/char/ipmi/ipmi_si.ko 2024-05-15T15:28:49.606 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-05-15T15:28:49.606 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-05-15T15:28:49.606 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/char/lp.ko 2024-05-15T15:28:49.606 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/char/mwave 2024-05-15T15:28:49.606 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/char/mwave/mwave.ko 2024-05-15T15:28:49.606 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/char/ppdev.ko 2024-05-15T15:28:49.606 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/char/tlclk.ko 2024-05-15T15:28:49.606 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/char/tpm 2024-05-15T15:28:49.606 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/char/tpm/tpm.ko 2024-05-15T15:28:49.606 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/char/tpm/tpm_atmel.ko 2024-05-15T15:28:49.606 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/char/tpm/tpm_infineon.ko 2024-05-15T15:28:49.606 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/char/tpm/tpm_nsc.ko 2024-05-15T15:28:49.607 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/char/tpm/tpm_tis.ko 2024-05-15T15:28:49.607 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-05-15T15:28:49.607 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/char/uv_mmtimer.ko 2024-05-15T15:28:49.607 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/char/virtio_console.ko 2024-05-15T15:28:49.607 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/cpufreq 2024-05-15T15:28:49.607 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-05-15T15:28:49.607 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-05-15T15:28:49.607 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/cpufreq/p4-clockmod.ko 2024-05-15T15:28:49.607 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-05-15T15:28:49.607 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/cpufreq/powernow-k8.ko 2024-05-15T15:28:49.607 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/cpufreq/speedstep-lib.ko 2024-05-15T15:28:49.607 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/crypto 2024-05-15T15:28:49.607 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/crypto/ccp 2024-05-15T15:28:49.608 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-05-15T15:28:49.608 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/crypto/ccp/ccp.ko 2024-05-15T15:28:49.608 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/crypto/intel 2024-05-15T15:28:49.608 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/crypto/intel/qat 2024-05-15T15:28:49.608 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/crypto/intel/qat/qat_common 2024-05-15T15:28:49.608 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-05-15T15:28:49.608 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-05-15T15:28:49.608 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-05-15T15:28:49.608 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/crypto/padlock-aes.ko 2024-05-15T15:28:49.608 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/crypto/padlock-sha.ko 2024-05-15T15:28:49.608 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/crypto/virtio 2024-05-15T15:28:49.608 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-05-15T15:28:49.608 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/dca 2024-05-15T15:28:49.609 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/dca/dca.ko 2024-05-15T15:28:49.609 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/devfreq 2024-05-15T15:28:49.609 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-05-15T15:28:49.609 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/dma 2024-05-15T15:28:49.609 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/dma/dw 2024-05-15T15:28:49.609 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/dma/dw/dw_dmac.ko 2024-05-15T15:28:49.609 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/dma/ioat 2024-05-15T15:28:49.609 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/dma/ioat/ioatdma.ko 2024-05-15T15:28:49.609 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/edac 2024-05-15T15:28:49.609 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/edac/amd64_edac.ko 2024-05-15T15:28:49.609 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/edac/e752x_edac.ko 2024-05-15T15:28:49.609 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/edac/edac_mce_amd.ko 2024-05-15T15:28:49.609 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/edac/i3000_edac.ko 2024-05-15T15:28:49.609 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/edac/i3200_edac.ko 2024-05-15T15:28:49.610 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/edac/i5100_edac.ko 2024-05-15T15:28:49.610 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/edac/i5400_edac.ko 2024-05-15T15:28:49.610 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/edac/i7300_edac.ko 2024-05-15T15:28:49.610 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/edac/i7core_edac.ko 2024-05-15T15:28:49.610 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/edac/i82975x_edac.ko 2024-05-15T15:28:49.610 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/edac/ie31200_edac.ko 2024-05-15T15:28:49.610 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/edac/sb_edac.ko 2024-05-15T15:28:49.610 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/edac/x38_edac.ko 2024-05-15T15:28:49.610 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/firmware 2024-05-15T15:28:49.610 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/firmware/edd.ko 2024-05-15T15:28:49.610 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/firmware/iscsi_ibft.ko 2024-05-15T15:28:49.610 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/gpio 2024-05-15T15:28:49.611 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/gpio/gpio-ich.ko 2024-05-15T15:28:49.611 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/gpio/gpio-viperboard.ko 2024-05-15T15:28:49.611 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid 2024-05-15T15:28:49.611 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-appleir.ko 2024-05-15T15:28:49.611 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-aureal.ko 2024-05-15T15:28:49.611 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-axff.ko 2024-05-15T15:28:49.611 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-dr.ko 2024-05-15T15:28:49.611 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-elecom.ko 2024-05-15T15:28:49.611 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-elo.ko 2024-05-15T15:28:49.611 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-emsff.ko 2024-05-15T15:28:49.611 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-gaff.ko 2024-05-15T15:28:49.611 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-gt683r.ko 2024-05-15T15:28:49.611 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-gyration.ko 2024-05-15T15:28:49.612 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-holtek-kbd.ko 2024-05-15T15:28:49.612 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-holtek-mouse.ko 2024-05-15T15:28:49.612 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-holtekff.ko 2024-05-15T15:28:49.612 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-hyperv.ko 2024-05-15T15:28:49.612 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-icade.ko 2024-05-15T15:28:49.612 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-keytouch.ko 2024-05-15T15:28:49.612 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-kye.ko 2024-05-15T15:28:49.612 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-lcpower.ko 2024-05-15T15:28:49.612 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-led.ko 2024-05-15T15:28:49.612 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-lenovo.ko 2024-05-15T15:28:49.612 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-logitech-dj.ko 2024-05-15T15:28:49.612 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-05-15T15:28:49.613 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-multitouch.ko 2024-05-15T15:28:49.613 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-ortek.ko 2024-05-15T15:28:49.613 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-penmount.ko 2024-05-15T15:28:49.613 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-petalynx.ko 2024-05-15T15:28:49.613 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-picolcd.ko 2024-05-15T15:28:49.613 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-pl.ko 2024-05-15T15:28:49.613 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-plantronics.ko 2024-05-15T15:28:49.613 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-primax.ko 2024-05-15T15:28:49.613 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-rmi.ko 2024-05-15T15:28:49.613 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-roccat-arvo.ko 2024-05-15T15:28:49.613 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-roccat-common.ko 2024-05-15T15:28:49.613 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-roccat-isku.ko 2024-05-15T15:28:49.613 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-roccat-kone.ko 2024-05-15T15:28:49.613 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-05-15T15:28:49.614 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-roccat-konepure.ko 2024-05-15T15:28:49.614 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-05-15T15:28:49.614 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-roccat-lua.ko 2024-05-15T15:28:49.614 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-roccat-pyra.ko 2024-05-15T15:28:49.614 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-roccat-ryos.ko 2024-05-15T15:28:49.614 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-roccat-savu.ko 2024-05-15T15:28:49.614 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-roccat.ko 2024-05-15T15:28:49.614 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-saitek.ko 2024-05-15T15:28:49.614 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-samsung.ko 2024-05-15T15:28:49.614 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-sensor-hub.ko 2024-05-15T15:28:49.614 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-sjoy.ko 2024-05-15T15:28:49.614 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-sony.ko 2024-05-15T15:28:49.614 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-speedlink.ko 2024-05-15T15:28:49.615 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-steelseries.ko 2024-05-15T15:28:49.615 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-sunplus.ko 2024-05-15T15:28:49.615 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-thrustmaster.ko 2024-05-15T15:28:49.615 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-tivo.ko 2024-05-15T15:28:49.615 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-tmff.ko 2024-05-15T15:28:49.615 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-topseed.ko 2024-05-15T15:28:49.615 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-twinhan.ko 2024-05-15T15:28:49.615 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-uclogic.ko 2024-05-15T15:28:49.615 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-waltop.ko 2024-05-15T15:28:49.615 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-wiimote.ko 2024-05-15T15:28:49.615 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-xinmo.ko 2024-05-15T15:28:49.615 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-zpff.ko 2024-05-15T15:28:49.615 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/hid-zydacron.ko 2024-05-15T15:28:49.615 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/uhid.ko 2024-05-15T15:28:49.616 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hid/wacom.ko 2024-05-15T15:28:49.616 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hv 2024-05-15T15:28:49.616 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hv/hv_balloon.ko 2024-05-15T15:28:49.616 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hv/hv_utils.ko 2024-05-15T15:28:49.616 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hv/hv_vmbus.ko 2024-05-15T15:28:49.616 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon 2024-05-15T15:28:49.616 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/abituguru.ko 2024-05-15T15:28:49.616 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/abituguru3.ko 2024-05-15T15:28:49.616 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/acpi_power_meter.ko 2024-05-15T15:28:49.616 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/ad7414.ko 2024-05-15T15:28:49.616 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/ad7418.ko 2024-05-15T15:28:49.616 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/adc128d818.ko 2024-05-15T15:28:49.616 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/adm1025.ko 2024-05-15T15:28:49.617 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/adm1026.ko 2024-05-15T15:28:49.617 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/adm1029.ko 2024-05-15T15:28:49.617 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/adm1031.ko 2024-05-15T15:28:49.617 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/adm9240.ko 2024-05-15T15:28:49.617 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/ads7828.ko 2024-05-15T15:28:49.617 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/adt7410.ko 2024-05-15T15:28:49.617 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/adt7411.ko 2024-05-15T15:28:49.617 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/adt7462.ko 2024-05-15T15:28:49.617 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/adt7470.ko 2024-05-15T15:28:49.617 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/adt7475.ko 2024-05-15T15:28:49.617 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/adt7x10.ko 2024-05-15T15:28:49.617 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/amc6821.ko 2024-05-15T15:28:49.617 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/applesmc.ko 2024-05-15T15:28:49.618 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/asb100.ko 2024-05-15T15:28:49.618 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/asc7621.ko 2024-05-15T15:28:49.618 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/asus_atk0110.ko 2024-05-15T15:28:49.618 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/atxp1.ko 2024-05-15T15:28:49.618 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/coretemp.ko 2024-05-15T15:28:49.618 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-05-15T15:28:49.618 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/dme1737.ko 2024-05-15T15:28:49.618 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/ds1621.ko 2024-05-15T15:28:49.618 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/ds620.ko 2024-05-15T15:28:49.618 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/emc1403.ko 2024-05-15T15:28:49.618 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/emc6w201.ko 2024-05-15T15:28:49.618 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/f71805f.ko 2024-05-15T15:28:49.618 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/f71882fg.ko 2024-05-15T15:28:49.618 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/f75375s.ko 2024-05-15T15:28:49.619 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/fam15h_power.ko 2024-05-15T15:28:49.619 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/fschmd.ko 2024-05-15T15:28:49.619 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/g760a.ko 2024-05-15T15:28:49.619 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/g762.ko 2024-05-15T15:28:49.619 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/gl518sm.ko 2024-05-15T15:28:49.619 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/gl520sm.ko 2024-05-15T15:28:49.619 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/hwmon-vid.ko 2024-05-15T15:28:49.619 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/i5500_temp.ko 2024-05-15T15:28:49.619 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/i5k_amb.ko 2024-05-15T15:28:49.619 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/ibmaem.ko 2024-05-15T15:28:49.619 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/ibmpex.ko 2024-05-15T15:28:49.619 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/ina209.ko 2024-05-15T15:28:49.619 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/ina2xx.ko 2024-05-15T15:28:49.619 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/it87.ko 2024-05-15T15:28:49.620 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/k10temp.ko 2024-05-15T15:28:49.620 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/k8temp.ko 2024-05-15T15:28:49.620 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/lineage-pem.ko 2024-05-15T15:28:49.620 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/lm63.ko 2024-05-15T15:28:49.620 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/lm73.ko 2024-05-15T15:28:49.620 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/lm75.ko 2024-05-15T15:28:49.620 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/lm77.ko 2024-05-15T15:28:49.620 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/lm78.ko 2024-05-15T15:28:49.620 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/lm80.ko 2024-05-15T15:28:49.620 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/lm83.ko 2024-05-15T15:28:49.620 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/lm85.ko 2024-05-15T15:28:49.620 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/lm87.ko 2024-05-15T15:28:49.620 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/lm90.ko 2024-05-15T15:28:49.621 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/lm92.ko 2024-05-15T15:28:49.621 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/lm93.ko 2024-05-15T15:28:49.621 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/lm95234.ko 2024-05-15T15:28:49.621 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/lm95241.ko 2024-05-15T15:28:49.621 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/lm95245.ko 2024-05-15T15:28:49.621 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/ltc2945.ko 2024-05-15T15:28:49.621 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/ltc4151.ko 2024-05-15T15:28:49.621 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/ltc4215.ko 2024-05-15T15:28:49.621 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/ltc4222.ko 2024-05-15T15:28:49.621 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/ltc4245.ko 2024-05-15T15:28:49.621 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/ltc4260.ko 2024-05-15T15:28:49.621 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/ltc4261.ko 2024-05-15T15:28:49.621 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/max16065.ko 2024-05-15T15:28:49.621 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/max1619.ko 2024-05-15T15:28:49.622 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/max1668.ko 2024-05-15T15:28:49.622 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/max197.ko 2024-05-15T15:28:49.622 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/max6639.ko 2024-05-15T15:28:49.622 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/max6650.ko 2024-05-15T15:28:49.622 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/max6697.ko 2024-05-15T15:28:49.622 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/mcp3021.ko 2024-05-15T15:28:49.622 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/nct6683.ko 2024-05-15T15:28:49.622 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/nct6775-core.ko 2024-05-15T15:28:49.622 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/nct6775.ko 2024-05-15T15:28:49.622 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/nct7802.ko 2024-05-15T15:28:49.622 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/pc87360.ko 2024-05-15T15:28:49.622 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/pc87427.ko 2024-05-15T15:28:49.622 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/pcf8591.ko 2024-05-15T15:28:49.623 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/pmbus 2024-05-15T15:28:49.623 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-05-15T15:28:49.623 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-05-15T15:28:49.623 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-05-15T15:28:49.623 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/pmbus/max16064.ko 2024-05-15T15:28:49.623 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/pmbus/max34440.ko 2024-05-15T15:28:49.623 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/pmbus/max8688.ko 2024-05-15T15:28:49.623 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-05-15T15:28:49.623 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-05-15T15:28:49.623 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-05-15T15:28:49.623 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-05-15T15:28:49.623 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-05-15T15:28:49.623 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-05-15T15:28:49.624 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/powr1220.ko 2024-05-15T15:28:49.624 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/sch5627.ko 2024-05-15T15:28:49.624 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/sch5636.ko 2024-05-15T15:28:49.624 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/sch56xx-common.ko 2024-05-15T15:28:49.624 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/sht15.ko 2024-05-15T15:28:49.624 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/sht21.ko 2024-05-15T15:28:49.624 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/shtc1.ko 2024-05-15T15:28:49.624 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/sis5595.ko 2024-05-15T15:28:49.624 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/smsc47b397.ko 2024-05-15T15:28:49.624 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/smsc47m1.ko 2024-05-15T15:28:49.624 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/smsc47m192.ko 2024-05-15T15:28:49.624 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/thmc50.ko 2024-05-15T15:28:49.624 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/tmp102.ko 2024-05-15T15:28:49.624 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/tmp103.ko 2024-05-15T15:28:49.625 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/tmp401.ko 2024-05-15T15:28:49.625 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/tmp421.ko 2024-05-15T15:28:49.625 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/via-cputemp.ko 2024-05-15T15:28:49.625 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/via686a.ko 2024-05-15T15:28:49.625 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/vt1211.ko 2024-05-15T15:28:49.625 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/vt8231.ko 2024-05-15T15:28:49.625 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/w83627ehf.ko 2024-05-15T15:28:49.625 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/w83627hf.ko 2024-05-15T15:28:49.625 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/w83781d.ko 2024-05-15T15:28:49.625 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/w83791d.ko 2024-05-15T15:28:49.625 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/w83792d.ko 2024-05-15T15:28:49.625 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/w83793.ko 2024-05-15T15:28:49.625 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/w83795.ko 2024-05-15T15:28:49.626 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/w83l785ts.ko 2024-05-15T15:28:49.626 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/hwmon/w83l786ng.ko 2024-05-15T15:28:49.626 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/i2c 2024-05-15T15:28:49.626 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/i2c/algos 2024-05-15T15:28:49.626 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-05-15T15:28:49.626 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-05-15T15:28:49.626 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/i2c/busses 2024-05-15T15:28:49.626 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-05-15T15:28:49.626 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-05-15T15:28:49.626 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-05-15T15:28:49.626 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-05-15T15:28:49.627 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-05-15T15:28:49.627 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-05-15T15:28:49.627 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-05-15T15:28:49.627 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-05-15T15:28:49.627 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/i2c/busses/i2c-i801.ko 2024-05-15T15:28:49.627 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/i2c/busses/i2c-isch.ko 2024-05-15T15:28:49.627 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-05-15T15:28:49.627 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-05-15T15:28:49.627 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-05-15T15:28:49.627 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/i2c/busses/i2c-parport.ko 2024-05-15T15:28:49.627 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-05-15T15:28:49.627 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-05-15T15:28:49.627 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-05-15T15:28:49.628 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-05-15T15:28:49.628 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-05-15T15:28:49.628 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-05-15T15:28:49.628 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/i2c/busses/i2c-via.ko 2024-05-15T15:28:49.628 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-05-15T15:28:49.628 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-05-15T15:28:49.628 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/i2c/i2c-dev.ko 2024-05-15T15:28:49.628 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/i2c/i2c-mux.ko 2024-05-15T15:28:49.628 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-05-15T15:28:49.628 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/i2c/i2c-smbus.ko 2024-05-15T15:28:49.628 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/i2c/i2c-stub.ko 2024-05-15T15:28:49.628 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/infiniband 2024-05-15T15:28:49.628 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/infiniband/core 2024-05-15T15:28:49.628 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/infiniband/core/ib_cm.ko 2024-05-15T15:28:49.629 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/infiniband/core/ib_core.ko 2024-05-15T15:28:49.629 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/infiniband/core/ib_umad.ko 2024-05-15T15:28:49.629 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-05-15T15:28:49.629 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/infiniband/core/iw_cm.ko 2024-05-15T15:28:49.629 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/infiniband/core/rdma_cm.ko 2024-05-15T15:28:49.629 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-05-15T15:28:49.629 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/infiniband/hw 2024-05-15T15:28:49.629 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/infiniband/hw/cxgb4 2024-05-15T15:28:49.629 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-05-15T15:28:49.629 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/infiniband/hw/mlx4 2024-05-15T15:28:49.629 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-05-15T15:28:49.629 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/infiniband/hw/mlx5 2024-05-15T15:28:49.630 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-05-15T15:28:49.630 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/infiniband/hw/mthca 2024-05-15T15:28:49.630 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-05-15T15:28:49.630 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/infiniband/ulp 2024-05-15T15:28:49.630 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/infiniband/ulp/ipoib 2024-05-15T15:28:49.630 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-05-15T15:28:49.630 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/infiniband/ulp/iser 2024-05-15T15:28:49.630 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-05-15T15:28:49.630 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/infiniband/ulp/isert 2024-05-15T15:28:49.630 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-05-15T15:28:49.630 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/infiniband/ulp/srp 2024-05-15T15:28:49.630 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-05-15T15:28:49.630 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/infiniband/ulp/srpt 2024-05-15T15:28:49.631 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-05-15T15:28:49.631 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/input 2024-05-15T15:28:49.631 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/input/gameport 2024-05-15T15:28:49.631 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-05-15T15:28:49.631 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/input/gameport/fm801-gp.ko 2024-05-15T15:28:49.631 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/input/gameport/gameport.ko 2024-05-15T15:28:49.631 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/input/joydev.ko 2024-05-15T15:28:49.631 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/input/keyboard 2024-05-15T15:28:49.631 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/input/keyboard/gpio_keys.ko 2024-05-15T15:28:49.631 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/input/mouse 2024-05-15T15:28:49.631 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/input/mouse/appletouch.ko 2024-05-15T15:28:49.631 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/input/mouse/bcm5974.ko 2024-05-15T15:28:49.631 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/input/mouse/cyapatp.ko 2024-05-15T15:28:49.632 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/input/mouse/elan_i2c.ko 2024-05-15T15:28:49.632 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/input/mouse/sermouse.ko 2024-05-15T15:28:49.632 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-05-15T15:28:49.632 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/input/mouse/synaptics_usb.ko 2024-05-15T15:28:49.632 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/input/mouse/vsxxxaa.ko 2024-05-15T15:28:49.632 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/input/rmi4 2024-05-15T15:28:49.632 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/input/rmi4/rmi_core.ko 2024-05-15T15:28:49.632 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/input/serio 2024-05-15T15:28:49.632 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/input/serio/altera_ps2.ko 2024-05-15T15:28:49.632 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/input/serio/arc_ps2.ko 2024-05-15T15:28:49.632 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-05-15T15:28:49.632 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/input/serio/serio_raw.ko 2024-05-15T15:28:49.632 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/input/sparse-keymap.ko 2024-05-15T15:28:49.633 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/leds 2024-05-15T15:28:49.633 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/leds/leds-blinkm.ko 2024-05-15T15:28:49.633 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/leds/leds-lm3530.ko 2024-05-15T15:28:49.633 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/leds/leds-lp3944.ko 2024-05-15T15:28:49.633 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/leds/leds-ss4200.ko 2024-05-15T15:28:49.633 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/leds/trigger 2024-05-15T15:28:49.633 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-05-15T15:28:49.633 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-05-15T15:28:49.633 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-05-15T15:28:49.633 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-05-15T15:28:49.633 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-05-15T15:28:49.633 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-05-15T15:28:49.633 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-05-15T15:28:49.633 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-05-15T15:28:49.634 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-05-15T15:28:49.634 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/md 2024-05-15T15:28:49.634 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/md/bcache 2024-05-15T15:28:49.634 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/md/bcache/bcache.ko 2024-05-15T15:28:49.634 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/md/dm-bio-prison.ko 2024-05-15T15:28:49.634 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/md/dm-cache-smq.ko 2024-05-15T15:28:49.634 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/md/dm-cache.ko 2024-05-15T15:28:49.634 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/md/dm-crypt.ko 2024-05-15T15:28:49.634 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/md/dm-delay.ko 2024-05-15T15:28:49.634 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/md/dm-flakey.ko 2024-05-15T15:28:49.634 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/md/dm-log-userspace.ko 2024-05-15T15:28:49.634 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/md/dm-multipath.ko 2024-05-15T15:28:49.634 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/md/dm-queue-length.ko 2024-05-15T15:28:49.634 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/md/dm-raid.ko 2024-05-15T15:28:49.635 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/md/dm-round-robin.ko 2024-05-15T15:28:49.635 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/md/dm-service-time.ko 2024-05-15T15:28:49.635 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/md/dm-switch.ko 2024-05-15T15:28:49.635 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/md/dm-thin-pool.ko 2024-05-15T15:28:49.635 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/md/dm-verity.ko 2024-05-15T15:28:49.635 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/md/persistent-data 2024-05-15T15:28:49.635 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-05-15T15:28:49.635 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/md/raid0.ko 2024-05-15T15:28:49.635 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/md/raid1.ko 2024-05-15T15:28:49.635 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/md/raid10.ko 2024-05-15T15:28:49.635 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/md/raid456.ko 2024-05-15T15:28:49.635 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/message 2024-05-15T15:28:49.635 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/message/fusion 2024-05-15T15:28:49.636 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/message/fusion/mptbase.ko 2024-05-15T15:28:49.636 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/message/fusion/mptctl.ko 2024-05-15T15:28:49.636 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/message/fusion/mptfc.ko 2024-05-15T15:28:49.636 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/message/fusion/mptlan.ko 2024-05-15T15:28:49.636 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/message/fusion/mptsas.ko 2024-05-15T15:28:49.636 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/message/fusion/mptscsih.ko 2024-05-15T15:28:49.636 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/message/fusion/mptspi.ko 2024-05-15T15:28:49.636 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/mfd 2024-05-15T15:28:49.636 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/mfd/lpc_ich.ko 2024-05-15T15:28:49.636 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/mfd/lpc_sch.ko 2024-05-15T15:28:49.637 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/mfd/mfd-core.ko 2024-05-15T15:28:49.637 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/mfd/sm501.ko 2024-05-15T15:28:49.637 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/mfd/viperboard.ko 2024-05-15T15:28:49.637 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/mfd/vx855.ko 2024-05-15T15:28:49.637 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/mfd/wl1273-core.ko 2024-05-15T15:28:49.637 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/misc 2024-05-15T15:28:49.637 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/misc/altera-stapl 2024-05-15T15:28:49.637 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-05-15T15:28:49.637 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/misc/apds9802als.ko 2024-05-15T15:28:49.637 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/misc/apds990x.ko 2024-05-15T15:28:49.637 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/misc/bh1770glc.ko 2024-05-15T15:28:49.637 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/misc/cb710 2024-05-15T15:28:49.637 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/misc/cb710/cb710.ko 2024-05-15T15:28:49.637 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/misc/eeprom 2024-05-15T15:28:49.638 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/misc/eeprom/at24.ko 2024-05-15T15:28:49.638 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-05-15T15:28:49.638 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/misc/eeprom/max6875.ko 2024-05-15T15:28:49.638 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/misc/enclosure.ko 2024-05-15T15:28:49.638 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/misc/hpilo.ko 2024-05-15T15:28:49.638 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/misc/isl29003.ko 2024-05-15T15:28:49.638 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/misc/isl29020.ko 2024-05-15T15:28:49.638 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/misc/lis3lv02d 2024-05-15T15:28:49.638 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-05-15T15:28:49.638 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-05-15T15:28:49.638 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/misc/mei 2024-05-15T15:28:49.638 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/misc/mei/mei-me.ko 2024-05-15T15:28:49.638 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/misc/mei/mei-txe.ko 2024-05-15T15:28:49.639 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/misc/mei/mei.ko 2024-05-15T15:28:49.639 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/misc/sgi-gru 2024-05-15T15:28:49.639 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/misc/sgi-gru/gru.ko 2024-05-15T15:28:49.639 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/misc/sgi-xp 2024-05-15T15:28:49.639 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/misc/sgi-xp/xp.ko 2024-05-15T15:28:49.639 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/misc/sgi-xp/xpc.ko 2024-05-15T15:28:49.639 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-05-15T15:28:49.639 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/misc/tifm_7xx1.ko 2024-05-15T15:28:49.639 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/misc/tifm_core.ko 2024-05-15T15:28:49.639 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/misc/tsl2550.ko 2024-05-15T15:28:49.639 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/misc/vmw_balloon.ko 2024-05-15T15:28:49.639 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/misc/vmw_vmci 2024-05-15T15:28:49.639 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-05-15T15:28:49.639 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net 2024-05-15T15:28:49.640 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/bonding 2024-05-15T15:28:49.640 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/bonding/bonding.ko 2024-05-15T15:28:49.640 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/dsa 2024-05-15T15:28:49.640 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/dsa/b53 2024-05-15T15:28:49.640 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/dsa/b53/b53_common.ko 2024-05-15T15:28:49.640 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/dsa/bcm-sf2.ko 2024-05-15T15:28:49.640 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/dsa/mv88e6060.ko 2024-05-15T15:28:49.640 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/dsa/mv88e6xxx 2024-05-15T15:28:49.640 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-05-15T15:28:49.640 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/dummy.ko 2024-05-15T15:28:49.640 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/eql.ko 2024-05-15T15:28:49.640 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet 2024-05-15T15:28:49.640 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/3com 2024-05-15T15:28:49.640 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-05-15T15:28:49.641 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-05-15T15:28:49.641 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-05-15T15:28:49.641 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-05-15T15:28:49.641 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/8390 2024-05-15T15:28:49.641 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/8390/8390.ko 2024-05-15T15:28:49.641 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-05-15T15:28:49.641 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-05-15T15:28:49.641 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-05-15T15:28:49.641 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/adaptec 2024-05-15T15:28:49.641 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-05-15T15:28:49.641 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/agere 2024-05-15T15:28:49.641 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/agere/et131x.ko 2024-05-15T15:28:49.641 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/alteon 2024-05-15T15:28:49.641 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-05-15T15:28:49.642 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/altera 2024-05-15T15:28:49.642 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-05-15T15:28:49.642 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/amd 2024-05-15T15:28:49.642 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-05-15T15:28:49.642 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-05-15T15:28:49.642 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-05-15T15:28:49.642 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/atheros 2024-05-15T15:28:49.642 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/atheros/alx 2024-05-15T15:28:49.642 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-05-15T15:28:49.642 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/atheros/atl1c 2024-05-15T15:28:49.642 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-05-15T15:28:49.642 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/atheros/atl1e 2024-05-15T15:28:49.642 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-05-15T15:28:49.643 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/atheros/atlx 2024-05-15T15:28:49.643 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-05-15T15:28:49.643 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-05-15T15:28:49.643 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/broadcom 2024-05-15T15:28:49.643 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-05-15T15:28:49.643 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-05-15T15:28:49.643 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-05-15T15:28:49.643 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-05-15T15:28:49.643 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-05-15T15:28:49.643 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/broadcom/genet 2024-05-15T15:28:49.643 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-05-15T15:28:49.643 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-05-15T15:28:49.643 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/brocade 2024-05-15T15:28:49.644 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/brocade/bna 2024-05-15T15:28:49.644 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-05-15T15:28:49.644 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/chelsio 2024-05-15T15:28:49.644 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/chelsio/cxgb 2024-05-15T15:28:49.644 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-05-15T15:28:49.644 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-05-15T15:28:49.644 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-05-15T15:28:49.644 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-05-15T15:28:49.644 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-05-15T15:28:49.644 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-05-15T15:28:49.644 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-05-15T15:28:49.644 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-05-15T15:28:49.644 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-05-15T15:28:49.645 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/cisco 2024-05-15T15:28:49.645 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/cisco/enic 2024-05-15T15:28:49.645 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-05-15T15:28:49.645 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/dec 2024-05-15T15:28:49.645 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/dec/tulip 2024-05-15T15:28:49.645 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-05-15T15:28:49.645 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-05-15T15:28:49.645 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-05-15T15:28:49.645 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-05-15T15:28:49.645 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-05-15T15:28:49.645 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-05-15T15:28:49.645 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/dlink 2024-05-15T15:28:49.645 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-05-15T15:28:49.646 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-05-15T15:28:49.646 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/dnet.ko 2024-05-15T15:28:49.646 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/emulex 2024-05-15T15:28:49.646 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/emulex/benet 2024-05-15T15:28:49.646 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-05-15T15:28:49.646 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/ethoc.ko 2024-05-15T15:28:49.646 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/fealnx.ko 2024-05-15T15:28:49.646 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/intel 2024-05-15T15:28:49.646 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/intel/e100.ko 2024-05-15T15:28:49.646 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/intel/e1000 2024-05-15T15:28:49.646 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-05-15T15:28:49.646 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/intel/e1000e 2024-05-15T15:28:49.646 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-05-15T15:28:49.646 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/intel/fm10k 2024-05-15T15:28:49.647 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-05-15T15:28:49.647 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/intel/i40e 2024-05-15T15:28:49.647 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-05-15T15:28:49.647 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/intel/iavf 2024-05-15T15:28:49.647 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-05-15T15:28:49.647 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/intel/igb 2024-05-15T15:28:49.647 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-05-15T15:28:49.647 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/intel/igbvf 2024-05-15T15:28:49.647 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-05-15T15:28:49.647 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/intel/ixgbe 2024-05-15T15:28:49.647 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-05-15T15:28:49.647 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/intel/ixgbevf 2024-05-15T15:28:49.647 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-05-15T15:28:49.647 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/jme.ko 2024-05-15T15:28:49.648 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/marvell 2024-05-15T15:28:49.648 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-05-15T15:28:49.648 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/marvell/skge.ko 2024-05-15T15:28:49.648 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-05-15T15:28:49.648 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/mellanox 2024-05-15T15:28:49.648 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/mellanox/mlx4 2024-05-15T15:28:49.648 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-05-15T15:28:49.648 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-05-15T15:28:49.648 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/mellanox/mlx5 2024-05-15T15:28:49.648 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-05-15T15:28:49.648 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-05-15T15:28:49.648 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/micrel 2024-05-15T15:28:49.648 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-05-15T15:28:49.648 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/myricom 2024-05-15T15:28:49.648 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/myricom/myri10ge 2024-05-15T15:28:49.649 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-05-15T15:28:49.649 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/natsemi 2024-05-15T15:28:49.649 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-05-15T15:28:49.649 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-05-15T15:28:49.649 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/neterion 2024-05-15T15:28:49.649 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-05-15T15:28:49.649 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/nvidia 2024-05-15T15:28:49.649 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-05-15T15:28:49.649 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/packetengines 2024-05-15T15:28:49.649 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-05-15T15:28:49.649 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-05-15T15:28:49.649 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/qlogic 2024-05-15T15:28:49.650 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/qlogic/netxen 2024-05-15T15:28:49.650 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-05-15T15:28:49.650 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-05-15T15:28:49.650 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-05-15T15:28:49.650 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-05-15T15:28:49.650 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/rdc 2024-05-15T15:28:49.650 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-05-15T15:28:49.650 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/realtek 2024-05-15T15:28:49.650 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-05-15T15:28:49.650 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-05-15T15:28:49.650 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/realtek/atp.ko 2024-05-15T15:28:49.650 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-05-15T15:28:49.651 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/rocker 2024-05-15T15:28:49.651 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-05-15T15:28:49.651 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/sfc 2024-05-15T15:28:49.651 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-05-15T15:28:49.651 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/silan 2024-05-15T15:28:49.651 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-05-15T15:28:49.651 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/sis 2024-05-15T15:28:49.651 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/sis/sis190.ko 2024-05-15T15:28:49.651 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/sis/sis900.ko 2024-05-15T15:28:49.651 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/smsc 2024-05-15T15:28:49.651 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-05-15T15:28:49.652 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-05-15T15:28:49.652 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-05-15T15:28:49.652 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-05-15T15:28:49.652 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/stmicro 2024-05-15T15:28:49.652 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/stmicro/stmmac 2024-05-15T15:28:49.652 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-05-15T15:28:49.652 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-05-15T15:28:49.652 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/sun 2024-05-15T15:28:49.652 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/sun/cassini.ko 2024-05-15T15:28:49.652 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/sun/niu.ko 2024-05-15T15:28:49.652 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/sun/sungem.ko 2024-05-15T15:28:49.652 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-05-15T15:28:49.652 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/tehuti 2024-05-15T15:28:49.653 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-05-15T15:28:49.653 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/ti 2024-05-15T15:28:49.653 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/ti/tlan.ko 2024-05-15T15:28:49.653 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/via 2024-05-15T15:28:49.653 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-05-15T15:28:49.653 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-05-15T15:28:49.653 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/wiznet 2024-05-15T15:28:49.653 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-05-15T15:28:49.653 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-05-15T15:28:49.653 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/xircom 2024-05-15T15:28:49.653 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-05-15T15:28:49.653 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/geneve.ko 2024-05-15T15:28:49.653 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/hyperv 2024-05-15T15:28:49.653 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-05-15T15:28:49.654 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ieee802154 2024-05-15T15:28:49.654 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ieee802154/fakelb.ko 2024-05-15T15:28:49.654 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ifb.ko 2024-05-15T15:28:49.654 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ipvlan 2024-05-15T15:28:49.654 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ipvlan/ipvlan.ko 2024-05-15T15:28:49.654 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/macvlan.ko 2024-05-15T15:28:49.654 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/macvtap.ko 2024-05-15T15:28:49.654 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/mdio 2024-05-15T15:28:49.654 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/mdio.ko 2024-05-15T15:28:49.654 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-05-15T15:28:49.654 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-05-15T15:28:49.655 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/mdio/mdio-regmap.ko 2024-05-15T15:28:49.655 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/mii.ko 2024-05-15T15:28:49.655 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/net_failover.ko 2024-05-15T15:28:49.655 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/netconsole.ko 2024-05-15T15:28:49.655 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/nlmon.ko 2024-05-15T15:28:49.655 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/pcs 2024-05-15T15:28:49.655 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/pcs/pcs-lynx.ko 2024-05-15T15:28:49.655 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-05-15T15:28:49.655 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/phy 2024-05-15T15:28:49.655 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/phy/amd.ko 2024-05-15T15:28:49.655 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-05-15T15:28:49.655 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-05-15T15:28:49.655 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/phy/bcm7xxx.ko 2024-05-15T15:28:49.656 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/phy/bcm87xx.ko 2024-05-15T15:28:49.656 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/phy/broadcom.ko 2024-05-15T15:28:49.656 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/phy/cicada.ko 2024-05-15T15:28:49.656 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/phy/davicom.ko 2024-05-15T15:28:49.656 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/phy/dp83640.ko 2024-05-15T15:28:49.656 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/phy/et1011c.ko 2024-05-15T15:28:49.656 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/phy/icplus.ko 2024-05-15T15:28:49.656 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/phy/lxt.ko 2024-05-15T15:28:49.656 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/phy/marvell.ko 2024-05-15T15:28:49.656 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/phy/micrel.ko 2024-05-15T15:28:49.656 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/phy/national.ko 2024-05-15T15:28:49.656 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/phy/phylink.ko 2024-05-15T15:28:49.656 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/phy/qsemi.ko 2024-05-15T15:28:49.656 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/phy/realtek.ko 2024-05-15T15:28:49.657 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/phy/smsc.ko 2024-05-15T15:28:49.657 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/phy/ste10Xp.ko 2024-05-15T15:28:49.657 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/phy/vitesse.ko 2024-05-15T15:28:49.657 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ppp 2024-05-15T15:28:49.657 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ppp/bsd_comp.ko 2024-05-15T15:28:49.657 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ppp/ppp_async.ko 2024-05-15T15:28:49.657 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ppp/ppp_deflate.ko 2024-05-15T15:28:49.657 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ppp/ppp_generic.ko 2024-05-15T15:28:49.657 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ppp/ppp_mppe.ko 2024-05-15T15:28:49.657 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ppp/ppp_synctty.ko 2024-05-15T15:28:49.657 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ppp/pppoe.ko 2024-05-15T15:28:49.657 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ppp/pppox.ko 2024-05-15T15:28:49.657 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/ppp/pptp.ko 2024-05-15T15:28:49.658 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/slip 2024-05-15T15:28:49.658 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/slip/slhc.ko 2024-05-15T15:28:49.658 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/slip/slip.ko 2024-05-15T15:28:49.658 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/sungem_phy.ko 2024-05-15T15:28:49.658 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/tap.ko 2024-05-15T15:28:49.658 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/team 2024-05-15T15:28:49.658 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/team/team.ko 2024-05-15T15:28:49.658 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/team/team_mode_activebackup.ko 2024-05-15T15:28:49.658 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/team/team_mode_broadcast.ko 2024-05-15T15:28:49.658 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-05-15T15:28:49.658 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/team/team_mode_random.ko 2024-05-15T15:28:49.658 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-05-15T15:28:49.658 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/tun.ko 2024-05-15T15:28:49.658 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/veth.ko 2024-05-15T15:28:49.659 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/virtio_net.ko 2024-05-15T15:28:49.659 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/vmxnet3 2024-05-15T15:28:49.659 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-05-15T15:28:49.659 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/vxlan 2024-05-15T15:28:49.659 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/vxlan/vxlan.ko 2024-05-15T15:28:49.659 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/xen-netback 2024-05-15T15:28:49.659 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/xen-netback/xen-netback.ko 2024-05-15T15:28:49.659 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/net/xen-netfront.ko 2024-05-15T15:28:49.659 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ntb 2024-05-15T15:28:49.659 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ntb/ntb.ko 2024-05-15T15:28:49.659 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/nvme 2024-05-15T15:28:49.659 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/nvme/host 2024-05-15T15:28:49.659 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/nvme/host/nvme-core.ko 2024-05-15T15:28:49.659 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/nvme/host/nvme.ko 2024-05-15T15:28:49.660 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/parport 2024-05-15T15:28:49.660 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/parport/parport.ko 2024-05-15T15:28:49.660 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/parport/parport_cs.ko 2024-05-15T15:28:49.660 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/parport/parport_pc.ko 2024-05-15T15:28:49.660 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/parport/parport_serial.ko 2024-05-15T15:28:49.660 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/pci 2024-05-15T15:28:49.660 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/pci/hotplug 2024-05-15T15:28:49.660 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-05-15T15:28:49.660 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/pci/pcie 2024-05-15T15:28:49.660 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/pci/pcie/aer_inject.ko 2024-05-15T15:28:49.660 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/pci/xen-pcifront.ko 2024-05-15T15:28:49.660 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/pcmcia 2024-05-15T15:28:49.661 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/pcmcia/i82092.ko 2024-05-15T15:28:49.661 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/pcmcia/pd6729.ko 2024-05-15T15:28:49.661 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/pcmcia/yenta_socket.ko 2024-05-15T15:28:49.661 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/pinctrl 2024-05-15T15:28:49.661 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/pinctrl/intel 2024-05-15T15:28:49.661 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-05-15T15:28:49.661 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/platform 2024-05-15T15:28:49.661 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/platform/x86 2024-05-15T15:28:49.661 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/platform/x86/acer-wmi.ko 2024-05-15T15:28:49.661 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/platform/x86/acerhdf.ko 2024-05-15T15:28:49.661 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/platform/x86/apple-gmux.ko 2024-05-15T15:28:49.661 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/platform/x86/asus-laptop.ko 2024-05-15T15:28:49.661 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-05-15T15:28:49.661 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/platform/x86/asus-wmi.ko 2024-05-15T15:28:49.662 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/platform/x86/classmate-laptop.ko 2024-05-15T15:28:49.662 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-05-15T15:28:49.662 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-05-15T15:28:49.662 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-05-15T15:28:49.662 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-05-15T15:28:49.662 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/platform/x86/hdaps.ko 2024-05-15T15:28:49.662 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/platform/x86/intel 2024-05-15T15:28:49.662 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-05-15T15:28:49.662 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/platform/x86/intel_ips.ko 2024-05-15T15:28:49.662 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/platform/x86/msi-wmi.ko 2024-05-15T15:28:49.662 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/platform/x86/mxm-wmi.ko 2024-05-15T15:28:49.662 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-05-15T15:28:49.662 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/platform/x86/samsung-laptop.ko 2024-05-15T15:28:49.662 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/platform/x86/samsung-q10.ko 2024-05-15T15:28:49.663 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/platform/x86/topstar-laptop.ko 2024-05-15T15:28:49.663 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-05-15T15:28:49.663 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/platform/x86/toshiba_haps.ko 2024-05-15T15:28:49.663 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/platform/x86/wmi-bmof.ko 2024-05-15T15:28:49.663 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/platform/x86/wmi.ko 2024-05-15T15:28:49.663 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/powercap 2024-05-15T15:28:49.663 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/powercap/intel_rapl_common.ko 2024-05-15T15:28:49.663 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/powercap/intel_rapl_msr.ko 2024-05-15T15:28:49.663 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/pps 2024-05-15T15:28:49.663 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/pps/clients 2024-05-15T15:28:49.663 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/pps/clients/pps-gpio.ko 2024-05-15T15:28:49.663 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/pps/clients/pps-ldisc.ko 2024-05-15T15:28:49.663 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/pps/clients/pps_parport.ko 2024-05-15T15:28:49.663 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/pps/pps_core.ko 2024-05-15T15:28:49.663 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ptp 2024-05-15T15:28:49.664 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ptp/ptp.ko 2024-05-15T15:28:49.664 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ptp/ptp_kvm.ko 2024-05-15T15:28:49.664 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ras 2024-05-15T15:28:49.664 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ras/amd 2024-05-15T15:28:49.664 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ras/amd/atl 2024-05-15T15:28:49.664 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-05-15T15:28:49.664 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ras/amd/fmpm.ko 2024-05-15T15:28:49.664 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/rtc 2024-05-15T15:28:49.664 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/rtc/rtc-bq32k.ko 2024-05-15T15:28:49.664 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/rtc/rtc-ds1286.ko 2024-05-15T15:28:49.664 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/rtc/rtc-ds1307.ko 2024-05-15T15:28:49.664 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/rtc/rtc-ds1374.ko 2024-05-15T15:28:49.665 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/rtc/rtc-ds1511.ko 2024-05-15T15:28:49.665 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/rtc/rtc-ds1553.ko 2024-05-15T15:28:49.665 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/rtc/rtc-ds1672.ko 2024-05-15T15:28:49.665 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/rtc/rtc-ds1742.ko 2024-05-15T15:28:49.665 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/rtc/rtc-ds2404.ko 2024-05-15T15:28:49.665 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/rtc/rtc-ds3232.ko 2024-05-15T15:28:49.665 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/rtc/rtc-em3027.ko 2024-05-15T15:28:49.665 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/rtc/rtc-fm3130.ko 2024-05-15T15:28:49.665 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/rtc/rtc-isl12022.ko 2024-05-15T15:28:49.665 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/rtc/rtc-isl1208.ko 2024-05-15T15:28:49.665 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/rtc/rtc-m41t80.ko 2024-05-15T15:28:49.665 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/rtc/rtc-m48t35.ko 2024-05-15T15:28:49.665 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/rtc/rtc-m48t59.ko 2024-05-15T15:28:49.665 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/rtc/rtc-max6900.ko 2024-05-15T15:28:49.666 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/rtc/rtc-msm6242.ko 2024-05-15T15:28:49.666 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/rtc/rtc-pcf2127.ko 2024-05-15T15:28:49.666 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/rtc/rtc-pcf85063.ko 2024-05-15T15:28:49.666 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/rtc/rtc-pcf8523.ko 2024-05-15T15:28:49.666 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/rtc/rtc-pcf8563.ko 2024-05-15T15:28:49.666 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/rtc/rtc-pcf8583.ko 2024-05-15T15:28:49.666 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/rtc/rtc-rp5c01.ko 2024-05-15T15:28:49.666 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/rtc/rtc-rs5c372.ko 2024-05-15T15:28:49.666 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-05-15T15:28:49.666 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/rtc/rtc-rx8025.ko 2024-05-15T15:28:49.666 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/rtc/rtc-rx8581.ko 2024-05-15T15:28:49.666 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-05-15T15:28:49.666 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/rtc/rtc-x1205.ko 2024-05-15T15:28:49.667 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi 2024-05-15T15:28:49.667 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/3w-9xxx.ko 2024-05-15T15:28:49.667 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/3w-sas.ko 2024-05-15T15:28:49.667 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/3w-xxxx.ko 2024-05-15T15:28:49.667 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/BusLogic.ko 2024-05-15T15:28:49.667 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/a100u2w.ko 2024-05-15T15:28:49.667 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/aacraid 2024-05-15T15:28:49.667 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/aacraid/aacraid.ko 2024-05-15T15:28:49.667 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/advansys.ko 2024-05-15T15:28:49.667 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/aic7xxx 2024-05-15T15:28:49.667 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-05-15T15:28:49.667 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-05-15T15:28:49.667 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/am53c974.ko 2024-05-15T15:28:49.667 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/arcmsr 2024-05-15T15:28:49.667 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-05-15T15:28:49.667 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/atp870u.ko 2024-05-15T15:28:49.668 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/be2iscsi 2024-05-15T15:28:49.668 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-05-15T15:28:49.668 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/bfa 2024-05-15T15:28:49.668 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/bfa/bfa.ko 2024-05-15T15:28:49.668 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/bnx2fc 2024-05-15T15:28:49.668 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-05-15T15:28:49.668 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/bnx2i 2024-05-15T15:28:49.668 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-05-15T15:28:49.668 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/ch.ko 2024-05-15T15:28:49.668 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/csiostor 2024-05-15T15:28:49.668 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/csiostor/csiostor.ko 2024-05-15T15:28:49.668 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/cxgbi 2024-05-15T15:28:49.668 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/cxgbi/cxgb3i 2024-05-15T15:28:49.669 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-05-15T15:28:49.669 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/cxgbi/cxgb4i 2024-05-15T15:28:49.669 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-05-15T15:28:49.669 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-05-15T15:28:49.669 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/dc395x.ko 2024-05-15T15:28:49.669 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/device_handler 2024-05-15T15:28:49.669 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-05-15T15:28:49.669 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-05-15T15:28:49.669 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-05-15T15:28:49.669 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-05-15T15:28:49.669 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/dmx3191d.ko 2024-05-15T15:28:49.669 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/esas2r 2024-05-15T15:28:49.669 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/esas2r/esas2r.ko 2024-05-15T15:28:49.670 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/esp_scsi.ko 2024-05-15T15:28:49.670 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/fcoe 2024-05-15T15:28:49.670 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/fcoe/fcoe.ko 2024-05-15T15:28:49.670 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-05-15T15:28:49.670 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/fnic 2024-05-15T15:28:49.670 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/fnic/fnic.ko 2024-05-15T15:28:49.670 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/hpsa.ko 2024-05-15T15:28:49.670 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/hptiop.ko 2024-05-15T15:28:49.670 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/hv_storvsc.ko 2024-05-15T15:28:49.670 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/initio.ko 2024-05-15T15:28:49.670 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/ipr.ko 2024-05-15T15:28:49.670 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/ips.ko 2024-05-15T15:28:49.670 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/isci 2024-05-15T15:28:49.671 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/isci/isci.ko 2024-05-15T15:28:49.671 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-05-15T15:28:49.671 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/iscsi_tcp.ko 2024-05-15T15:28:49.671 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/libfc 2024-05-15T15:28:49.671 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/libfc/libfc.ko 2024-05-15T15:28:49.671 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/libiscsi.ko 2024-05-15T15:28:49.671 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/libiscsi_tcp.ko 2024-05-15T15:28:49.671 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/libsas 2024-05-15T15:28:49.671 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/libsas/libsas.ko 2024-05-15T15:28:49.671 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/lpfc 2024-05-15T15:28:49.671 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/lpfc/lpfc.ko 2024-05-15T15:28:49.671 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/megaraid 2024-05-15T15:28:49.671 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/megaraid.ko 2024-05-15T15:28:49.671 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-05-15T15:28:49.671 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-05-15T15:28:49.672 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-05-15T15:28:49.672 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/mpt3sas 2024-05-15T15:28:49.672 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-05-15T15:28:49.672 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/mvsas 2024-05-15T15:28:49.672 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/mvsas/mvsas.ko 2024-05-15T15:28:49.672 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/mvumi.ko 2024-05-15T15:28:49.672 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/pm8001 2024-05-15T15:28:49.672 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-05-15T15:28:49.672 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/pmcraid.ko 2024-05-15T15:28:49.672 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/qla1280.ko 2024-05-15T15:28:49.672 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/qla2xxx 2024-05-15T15:28:49.672 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-05-15T15:28:49.672 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-05-15T15:28:49.672 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/qla4xxx 2024-05-15T15:28:49.672 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-05-15T15:28:49.673 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/raid_class.ko 2024-05-15T15:28:49.673 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/scsi_debug.ko 2024-05-15T15:28:49.673 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/scsi_transport_fc.ko 2024-05-15T15:28:49.673 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-05-15T15:28:49.673 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/scsi_transport_sas.ko 2024-05-15T15:28:49.673 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/scsi_transport_spi.ko 2024-05-15T15:28:49.673 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/scsi_transport_srp.ko 2024-05-15T15:28:49.673 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/ses.ko 2024-05-15T15:28:49.673 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/st.ko 2024-05-15T15:28:49.673 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/stex.ko 2024-05-15T15:28:49.673 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/sym53c8xx_2 2024-05-15T15:28:49.673 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-05-15T15:28:49.673 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/virtio_scsi.ko 2024-05-15T15:28:49.673 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/vmw_pvscsi.ko 2024-05-15T15:28:49.674 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/scsi/wd719x.ko 2024-05-15T15:28:49.674 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ssb 2024-05-15T15:28:49.674 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ssb/ssb.ko 2024-05-15T15:28:49.674 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/target 2024-05-15T15:28:49.674 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/target/iscsi 2024-05-15T15:28:49.674 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-05-15T15:28:49.674 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/target/loopback 2024-05-15T15:28:49.674 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/target/loopback/tcm_loop.ko 2024-05-15T15:28:49.674 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/target/target_core_file.ko 2024-05-15T15:28:49.674 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/target/target_core_iblock.ko 2024-05-15T15:28:49.674 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/target/target_core_mod.ko 2024-05-15T15:28:49.674 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/target/target_core_pscsi.ko 2024-05-15T15:28:49.675 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/target/target_core_user.ko 2024-05-15T15:28:49.675 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/target/tcm_fc 2024-05-15T15:28:49.675 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-05-15T15:28:49.675 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/thermal 2024-05-15T15:28:49.675 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/thermal/intel 2024-05-15T15:28:49.675 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/thermal/intel/int340x_thermal 2024-05-15T15:28:49.675 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-05-15T15:28:49.675 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-05-15T15:28:49.675 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-05-15T15:28:49.675 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-05-15T15:28:49.675 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-05-15T15:28:49.675 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-05-15T15:28:49.675 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-05-15T15:28:49.675 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-05-15T15:28:49.676 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-05-15T15:28:49.676 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-05-15T15:28:49.676 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-05-15T15:28:49.676 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-05-15T15:28:49.676 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-05-15T15:28:49.676 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-05-15T15:28:49.676 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-05-15T15:28:49.676 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-05-15T15:28:49.676 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-05-15T15:28:49.676 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-05-15T15:28:49.676 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/tty 2024-05-15T15:28:49.676 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/tty/ipwireless 2024-05-15T15:28:49.676 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-05-15T15:28:49.677 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/tty/n_gsm.ko 2024-05-15T15:28:49.677 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/tty/n_hdlc.ko 2024-05-15T15:28:49.677 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/tty/nozomi.ko 2024-05-15T15:28:49.677 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/tty/serial 2024-05-15T15:28:49.677 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/tty/serial/8250 2024-05-15T15:28:49.677 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-05-15T15:28:49.677 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/tty/serial/arc_uart.ko 2024-05-15T15:28:49.677 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/tty/serial/jsm 2024-05-15T15:28:49.677 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/tty/serial/jsm/jsm.ko 2024-05-15T15:28:49.677 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ufs 2024-05-15T15:28:49.677 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ufs/core 2024-05-15T15:28:49.677 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ufs/core/ufshcd-core.ko 2024-05-15T15:28:49.677 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ufs/host 2024-05-15T15:28:49.677 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-05-15T15:28:49.678 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/uio 2024-05-15T15:28:49.678 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/uio/uio.ko 2024-05-15T15:28:49.678 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/uio/uio_aec.ko 2024-05-15T15:28:49.678 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/uio/uio_cif.ko 2024-05-15T15:28:49.678 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/uio/uio_pci_generic.ko 2024-05-15T15:28:49.678 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/uio/uio_sercos3.ko 2024-05-15T15:28:49.678 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb 2024-05-15T15:28:49.678 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/class 2024-05-15T15:28:49.678 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/class/cdc-acm.ko 2024-05-15T15:28:49.678 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/class/cdc-wdm.ko 2024-05-15T15:28:49.678 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/class/usblp.ko 2024-05-15T15:28:49.678 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/class/usbtmc.ko 2024-05-15T15:28:49.678 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/host 2024-05-15T15:28:49.679 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/host/sl811-hcd.ko 2024-05-15T15:28:49.679 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/image 2024-05-15T15:28:49.679 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/image/mdc800.ko 2024-05-15T15:28:49.679 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/image/microtek.ko 2024-05-15T15:28:49.679 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/misc 2024-05-15T15:28:49.679 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/misc/adutux.ko 2024-05-15T15:28:49.679 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/misc/appledisplay.ko 2024-05-15T15:28:49.679 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/misc/emi26.ko 2024-05-15T15:28:49.679 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/misc/emi62.ko 2024-05-15T15:28:49.679 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/misc/ezusb.ko 2024-05-15T15:28:49.679 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/misc/idmouse.ko 2024-05-15T15:28:49.679 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/misc/iowarrior.ko 2024-05-15T15:28:49.679 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/misc/isight_firmware.ko 2024-05-15T15:28:49.680 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/misc/ldusb.ko 2024-05-15T15:28:49.680 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/misc/legousbtower.ko 2024-05-15T15:28:49.680 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/misc/sisusbvga 2024-05-15T15:28:49.680 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-05-15T15:28:49.680 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/misc/trancevibrator.ko 2024-05-15T15:28:49.680 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/misc/usb3503.ko 2024-05-15T15:28:49.680 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/misc/usblcd.ko 2024-05-15T15:28:49.680 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/misc/usbsevseg.ko 2024-05-15T15:28:49.680 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/misc/uss720.ko 2024-05-15T15:28:49.680 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/misc/yurex.ko 2024-05-15T15:28:49.680 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/phy 2024-05-15T15:28:49.680 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/phy/phy-generic.ko 2024-05-15T15:28:49.680 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial 2024-05-15T15:28:49.680 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/aircable.ko 2024-05-15T15:28:49.681 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/ark3116.ko 2024-05-15T15:28:49.681 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/belkin_sa.ko 2024-05-15T15:28:49.681 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/ch341.ko 2024-05-15T15:28:49.681 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/cp210x.ko 2024-05-15T15:28:49.681 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/cyberjack.ko 2024-05-15T15:28:49.681 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/cypress_m8.ko 2024-05-15T15:28:49.681 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/digi_acceleport.ko 2024-05-15T15:28:49.681 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/empeg.ko 2024-05-15T15:28:49.681 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/ftdi_sio.ko 2024-05-15T15:28:49.681 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/garmin_gps.ko 2024-05-15T15:28:49.681 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/io_edgeport.ko 2024-05-15T15:28:49.681 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/io_ti.ko 2024-05-15T15:28:49.681 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/ipaq.ko 2024-05-15T15:28:49.681 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/ipw.ko 2024-05-15T15:28:49.682 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/ir-usb.ko 2024-05-15T15:28:49.682 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-05-15T15:28:49.682 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/keyspan.ko 2024-05-15T15:28:49.682 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/keyspan_pda.ko 2024-05-15T15:28:49.682 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/kl5kusb105.ko 2024-05-15T15:28:49.682 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/kobil_sct.ko 2024-05-15T15:28:49.682 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/mct_u232.ko 2024-05-15T15:28:49.682 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/mos7720.ko 2024-05-15T15:28:49.682 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/mos7840.ko 2024-05-15T15:28:49.682 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/navman.ko 2024-05-15T15:28:49.682 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/omninet.ko 2024-05-15T15:28:49.682 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/opticon.ko 2024-05-15T15:28:49.682 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/option.ko 2024-05-15T15:28:49.682 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/oti6858.ko 2024-05-15T15:28:49.683 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/pl2303.ko 2024-05-15T15:28:49.683 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/qcaux.ko 2024-05-15T15:28:49.683 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/qcserial.ko 2024-05-15T15:28:49.683 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/quatech2.ko 2024-05-15T15:28:49.683 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/safe_serial.ko 2024-05-15T15:28:49.683 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/sierra.ko 2024-05-15T15:28:49.683 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/spcp8x5.ko 2024-05-15T15:28:49.683 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/ssu100.ko 2024-05-15T15:28:49.683 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/symbolserial.ko 2024-05-15T15:28:49.683 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-05-15T15:28:49.683 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-05-15T15:28:49.683 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/usb_debug.ko 2024-05-15T15:28:49.683 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/usb_wwan.ko 2024-05-15T15:28:49.684 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/visor.ko 2024-05-15T15:28:49.684 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/whiteheat.ko 2024-05-15T15:28:49.684 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/serial/xsens_mt.ko 2024-05-15T15:28:49.684 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/storage 2024-05-15T15:28:49.684 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/storage/uas.ko 2024-05-15T15:28:49.684 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/storage/ums-alauda.ko 2024-05-15T15:28:49.684 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/storage/ums-cypress.ko 2024-05-15T15:28:49.684 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/storage/ums-datafab.ko 2024-05-15T15:28:49.684 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-05-15T15:28:49.684 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/storage/ums-freecom.ko 2024-05-15T15:28:49.684 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/storage/ums-isd200.ko 2024-05-15T15:28:49.684 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-05-15T15:28:49.685 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/storage/ums-karma.ko 2024-05-15T15:28:49.685 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/storage/ums-onetouch.ko 2024-05-15T15:28:49.685 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/storage/ums-realtek.ko 2024-05-15T15:28:49.685 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/storage/ums-sddr09.ko 2024-05-15T15:28:49.685 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/storage/ums-sddr55.ko 2024-05-15T15:28:49.685 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/storage/ums-usbat.ko 2024-05-15T15:28:49.685 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/storage/usb-storage.ko 2024-05-15T15:28:49.685 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/usbip 2024-05-15T15:28:49.685 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/usbip/usbip-core.ko 2024-05-15T15:28:49.685 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/usbip/usbip-host.ko 2024-05-15T15:28:49.685 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-05-15T15:28:49.685 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/vfio 2024-05-15T15:28:49.685 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/vfio/pci 2024-05-15T15:28:49.685 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-05-15T15:28:49.686 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/vfio/pci/vfio-pci.ko 2024-05-15T15:28:49.686 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/vfio/vfio.ko 2024-05-15T15:28:49.686 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-05-15T15:28:49.686 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/vhost 2024-05-15T15:28:49.686 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/vhost/vhost.ko 2024-05-15T15:28:49.686 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/vhost/vhost_iotlb.ko 2024-05-15T15:28:49.686 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/vhost/vhost_net.ko 2024-05-15T15:28:49.686 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/vhost/vhost_scsi.ko 2024-05-15T15:28:49.686 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/video 2024-05-15T15:28:49.686 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/video/backlight 2024-05-15T15:28:49.686 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/video/backlight/apple_bl.ko 2024-05-15T15:28:49.686 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/video/backlight/lcd.ko 2024-05-15T15:28:49.686 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/video/backlight/platform_lcd.ko 2024-05-15T15:28:49.687 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/virtio 2024-05-15T15:28:49.687 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/virtio/virtio.ko 2024-05-15T15:28:49.687 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/virtio/virtio_balloon.ko 2024-05-15T15:28:49.687 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/virtio/virtio_mmio.ko 2024-05-15T15:28:49.687 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/virtio/virtio_pci.ko 2024-05-15T15:28:49.687 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-05-15T15:28:49.687 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-05-15T15:28:49.687 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/virtio/virtio_ring.ko 2024-05-15T15:28:49.687 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/w1 2024-05-15T15:28:49.687 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/w1/masters 2024-05-15T15:28:49.687 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/w1/masters/ds2482.ko 2024-05-15T15:28:49.687 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/w1/masters/ds2490.ko 2024-05-15T15:28:49.687 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/w1/slaves 2024-05-15T15:28:49.687 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-05-15T15:28:49.688 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-05-15T15:28:49.688 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-05-15T15:28:49.688 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-05-15T15:28:49.688 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-05-15T15:28:49.688 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-05-15T15:28:49.688 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-05-15T15:28:49.688 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-05-15T15:28:49.688 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-05-15T15:28:49.688 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/w1/slaves/w1_smem.ko 2024-05-15T15:28:49.688 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/w1/slaves/w1_therm.ko 2024-05-15T15:28:49.688 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/w1/wire.ko 2024-05-15T15:28:49.688 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/watchdog 2024-05-15T15:28:49.688 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/watchdog/alim1535_wdt.ko 2024-05-15T15:28:49.689 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/watchdog/alim7101_wdt.ko 2024-05-15T15:28:49.689 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/watchdog/f71808e_wdt.ko 2024-05-15T15:28:49.689 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/watchdog/hpwdt.ko 2024-05-15T15:28:49.689 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/watchdog/i6300esb.ko 2024-05-15T15:28:49.689 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-05-15T15:28:49.689 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/watchdog/iTCO_wdt.ko 2024-05-15T15:28:49.689 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/watchdog/ib700wdt.ko 2024-05-15T15:28:49.689 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/watchdog/ibmasr.ko 2024-05-15T15:28:49.689 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-05-15T15:28:49.689 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/watchdog/it8712f_wdt.ko 2024-05-15T15:28:49.689 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/watchdog/it87_wdt.ko 2024-05-15T15:28:49.689 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/watchdog/machzwd.ko 2024-05-15T15:28:49.689 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/watchdog/nv_tco.ko 2024-05-15T15:28:49.689 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/watchdog/pcwd_pci.ko 2024-05-15T15:28:49.690 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/watchdog/pcwd_usb.ko 2024-05-15T15:28:49.690 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-05-15T15:28:49.690 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/watchdog/sch311x_wdt.ko 2024-05-15T15:28:49.690 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/watchdog/softdog.ko 2024-05-15T15:28:49.690 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/watchdog/sp5100_tco.ko 2024-05-15T15:28:49.690 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/watchdog/via_wdt.ko 2024-05-15T15:28:49.690 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-05-15T15:28:49.690 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/watchdog/w83877f_wdt.ko 2024-05-15T15:28:49.690 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/watchdog/w83977f_wdt.ko 2024-05-15T15:28:49.690 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/watchdog/wdt_pci.ko 2024-05-15T15:28:49.690 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/watchdog/xen_wdt.ko 2024-05-15T15:28:49.690 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/xen 2024-05-15T15:28:49.690 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/xen/xen-acpi-processor.ko 2024-05-15T15:28:49.691 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/xen/xen-evtchn.ko 2024-05-15T15:28:49.691 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/xen/xen-gntalloc.ko 2024-05-15T15:28:49.691 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/xen/xen-gntdev.ko 2024-05-15T15:28:49.691 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/xen/xen-pciback 2024-05-15T15:28:49.691 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-05-15T15:28:49.691 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/xen/xen-privcmd.ko 2024-05-15T15:28:49.691 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/xen/xenfs 2024-05-15T15:28:49.691 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/drivers/xen/xenfs/xenfs.ko 2024-05-15T15:28:49.691 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs 2024-05-15T15:28:49.691 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/9p 2024-05-15T15:28:49.691 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/9p/9p.ko 2024-05-15T15:28:49.691 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/affs 2024-05-15T15:28:49.691 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/affs/affs.ko 2024-05-15T15:28:49.691 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/befs 2024-05-15T15:28:49.691 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/befs/befs.ko 2024-05-15T15:28:49.692 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/binfmt_misc.ko 2024-05-15T15:28:49.692 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/btrfs 2024-05-15T15:28:49.692 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/btrfs/btrfs.ko 2024-05-15T15:28:49.692 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/cachefiles 2024-05-15T15:28:49.692 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/cachefiles/cachefiles.ko 2024-05-15T15:28:49.692 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/ceph 2024-05-15T15:28:49.692 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/ceph/ceph.ko 2024-05-15T15:28:49.692 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/coda 2024-05-15T15:28:49.692 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/coda/coda.ko 2024-05-15T15:28:49.692 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/cramfs 2024-05-15T15:28:49.692 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/cramfs/cramfs.ko 2024-05-15T15:28:49.692 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/dlm 2024-05-15T15:28:49.692 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/dlm/dlm.ko 2024-05-15T15:28:49.692 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/ecryptfs 2024-05-15T15:28:49.693 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/ecryptfs/ecryptfs.ko 2024-05-15T15:28:49.693 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/f2fs 2024-05-15T15:28:49.693 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/f2fs/f2fs.ko 2024-05-15T15:28:49.693 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/fat 2024-05-15T15:28:49.693 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/fat/fat.ko 2024-05-15T15:28:49.693 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/fat/msdos.ko 2024-05-15T15:28:49.693 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/fat/vfat.ko 2024-05-15T15:28:49.693 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/fuse 2024-05-15T15:28:49.693 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/fuse/cuse.ko 2024-05-15T15:28:49.693 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/fuse/fuse.ko 2024-05-15T15:28:49.693 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/gfs2 2024-05-15T15:28:49.693 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/gfs2/gfs2.ko 2024-05-15T15:28:49.694 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/hfs 2024-05-15T15:28:49.694 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/hfs/hfs.ko 2024-05-15T15:28:49.694 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/hfsplus 2024-05-15T15:28:49.694 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/hfsplus/hfsplus.ko 2024-05-15T15:28:49.694 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/isofs 2024-05-15T15:28:49.694 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/isofs/isofs.ko 2024-05-15T15:28:49.694 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/jfs 2024-05-15T15:28:49.694 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/jfs/jfs.ko 2024-05-15T15:28:49.694 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/lockd 2024-05-15T15:28:49.694 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/lockd/lockd.ko 2024-05-15T15:28:49.694 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/minix 2024-05-15T15:28:49.694 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/minix/minix.ko 2024-05-15T15:28:49.694 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/netfs 2024-05-15T15:28:49.695 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/netfs/netfs.ko 2024-05-15T15:28:49.695 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nfs 2024-05-15T15:28:49.695 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nfs/blocklayout 2024-05-15T15:28:49.695 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-05-15T15:28:49.695 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nfs/filelayout 2024-05-15T15:28:49.695 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-05-15T15:28:49.695 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nfs/flexfilelayout 2024-05-15T15:28:49.695 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-05-15T15:28:49.695 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nfs/nfs.ko 2024-05-15T15:28:49.695 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nfs/nfsv3.ko 2024-05-15T15:28:49.695 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nfs/nfsv4.ko 2024-05-15T15:28:49.695 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nfs_common 2024-05-15T15:28:49.695 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nfs_common/grace.ko 2024-05-15T15:28:49.695 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nfs_common/nfs_acl.ko 2024-05-15T15:28:49.696 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nfsd 2024-05-15T15:28:49.696 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nfsd/nfsd.ko 2024-05-15T15:28:49.696 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nilfs2 2024-05-15T15:28:49.696 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nilfs2/nilfs2.ko 2024-05-15T15:28:49.696 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls 2024-05-15T15:28:49.696 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/mac-celtic.ko 2024-05-15T15:28:49.696 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/mac-centeuro.ko 2024-05-15T15:28:49.696 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/mac-croatian.ko 2024-05-15T15:28:49.696 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/mac-cyrillic.ko 2024-05-15T15:28:49.696 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/mac-gaelic.ko 2024-05-15T15:28:49.696 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/mac-greek.ko 2024-05-15T15:28:49.696 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/mac-iceland.ko 2024-05-15T15:28:49.696 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/mac-inuit.ko 2024-05-15T15:28:49.696 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/mac-roman.ko 2024-05-15T15:28:49.696 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/mac-romanian.ko 2024-05-15T15:28:49.697 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/mac-turkish.ko 2024-05-15T15:28:49.697 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/nls_cp1250.ko 2024-05-15T15:28:49.697 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/nls_cp1251.ko 2024-05-15T15:28:49.697 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/nls_cp1255.ko 2024-05-15T15:28:49.697 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/nls_cp737.ko 2024-05-15T15:28:49.697 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/nls_cp775.ko 2024-05-15T15:28:49.697 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/nls_cp850.ko 2024-05-15T15:28:49.697 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/nls_cp852.ko 2024-05-15T15:28:49.697 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/nls_cp855.ko 2024-05-15T15:28:49.697 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/nls_cp857.ko 2024-05-15T15:28:49.697 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/nls_cp860.ko 2024-05-15T15:28:49.697 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/nls_cp861.ko 2024-05-15T15:28:49.698 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/nls_cp862.ko 2024-05-15T15:28:49.698 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/nls_cp863.ko 2024-05-15T15:28:49.698 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/nls_cp864.ko 2024-05-15T15:28:49.698 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/nls_cp865.ko 2024-05-15T15:28:49.698 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/nls_cp866.ko 2024-05-15T15:28:49.698 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/nls_cp869.ko 2024-05-15T15:28:49.698 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/nls_cp874.ko 2024-05-15T15:28:49.698 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/nls_cp932.ko 2024-05-15T15:28:49.698 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/nls_cp936.ko 2024-05-15T15:28:49.698 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/nls_cp949.ko 2024-05-15T15:28:49.698 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/nls_cp950.ko 2024-05-15T15:28:49.698 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/nls_euc-jp.ko 2024-05-15T15:28:49.698 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/nls_iso8859-1.ko 2024-05-15T15:28:49.699 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/nls_iso8859-13.ko 2024-05-15T15:28:49.699 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/nls_iso8859-14.ko 2024-05-15T15:28:49.699 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/nls_iso8859-15.ko 2024-05-15T15:28:49.699 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/nls_iso8859-2.ko 2024-05-15T15:28:49.699 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/nls_iso8859-3.ko 2024-05-15T15:28:49.699 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/nls_iso8859-4.ko 2024-05-15T15:28:49.699 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/nls_iso8859-5.ko 2024-05-15T15:28:49.699 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/nls_iso8859-6.ko 2024-05-15T15:28:49.699 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/nls_iso8859-7.ko 2024-05-15T15:28:49.699 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/nls_iso8859-9.ko 2024-05-15T15:28:49.699 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/nls_koi8-r.ko 2024-05-15T15:28:49.699 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/nls_koi8-ru.ko 2024-05-15T15:28:49.699 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/nls_koi8-u.ko 2024-05-15T15:28:49.699 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/nls_ucs2_utils.ko 2024-05-15T15:28:49.700 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/nls/nls_utf8.ko 2024-05-15T15:28:49.700 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/ocfs2 2024-05-15T15:28:49.700 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/ocfs2/cluster 2024-05-15T15:28:49.700 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-05-15T15:28:49.700 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/ocfs2/dlm 2024-05-15T15:28:49.700 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-05-15T15:28:49.700 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/ocfs2/dlmfs 2024-05-15T15:28:49.700 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-05-15T15:28:49.700 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/ocfs2/ocfs2.ko 2024-05-15T15:28:49.700 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-05-15T15:28:49.700 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-05-15T15:28:49.700 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-05-15T15:28:49.700 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/overlayfs 2024-05-15T15:28:49.700 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/overlayfs/overlay.ko 2024-05-15T15:28:49.701 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/pstore 2024-05-15T15:28:49.701 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/pstore/ramoops.ko 2024-05-15T15:28:49.701 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/reiserfs 2024-05-15T15:28:49.701 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/reiserfs/reiserfs.ko 2024-05-15T15:28:49.701 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/romfs 2024-05-15T15:28:49.701 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/romfs/romfs.ko 2024-05-15T15:28:49.701 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/smb 2024-05-15T15:28:49.701 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/smb/client 2024-05-15T15:28:49.701 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/smb/client/cifs.ko 2024-05-15T15:28:49.701 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/smb/common 2024-05-15T15:28:49.701 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/smb/common/cifs_arc4.ko 2024-05-15T15:28:49.701 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/smb/common/cifs_md4.ko 2024-05-15T15:28:49.701 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/squashfs 2024-05-15T15:28:49.702 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/squashfs/squashfs.ko 2024-05-15T15:28:49.702 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/sysv 2024-05-15T15:28:49.702 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/sysv/sysv.ko 2024-05-15T15:28:49.702 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/udf 2024-05-15T15:28:49.702 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/udf/udf.ko 2024-05-15T15:28:49.702 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/ufs 2024-05-15T15:28:49.702 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/ufs/ufs.ko 2024-05-15T15:28:49.702 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/xfs 2024-05-15T15:28:49.702 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/fs/xfs/xfs.ko 2024-05-15T15:28:49.702 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/kernel 2024-05-15T15:28:49.702 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/kernel/rcu 2024-05-15T15:28:49.703 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/kernel/rcu/rcutorture.ko 2024-05-15T15:28:49.703 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/kernel/torture.ko 2024-05-15T15:28:49.703 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/kernel/trace 2024-05-15T15:28:49.703 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-05-15T15:28:49.703 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/lib 2024-05-15T15:28:49.703 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/lib/asn1_encoder.ko 2024-05-15T15:28:49.703 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/lib/crc-itu-t.ko 2024-05-15T15:28:49.703 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/lib/crc8.ko 2024-05-15T15:28:49.703 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/lib/crypto 2024-05-15T15:28:49.703 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/lib/crypto/libarc4.ko 2024-05-15T15:28:49.703 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/lib/crypto/libdes.ko 2024-05-15T15:28:49.703 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/lib/libcrc32c.ko 2024-05-15T15:28:49.704 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/lib/lru_cache.ko 2024-05-15T15:28:49.704 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/lib/lz4 2024-05-15T15:28:49.704 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/lib/lz4/lz4_compress.ko 2024-05-15T15:28:49.704 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/lib/lz4/lz4hc_compress.ko 2024-05-15T15:28:49.704 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/lib/math 2024-05-15T15:28:49.704 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/lib/math/cordic.ko 2024-05-15T15:28:49.704 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/lib/raid6 2024-05-15T15:28:49.704 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/lib/raid6/raid6_pq.ko 2024-05-15T15:28:49.704 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/lib/reed_solomon 2024-05-15T15:28:49.704 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/lib/reed_solomon/reed_solomon.ko 2024-05-15T15:28:49.704 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/lib/ts_bm.ko 2024-05-15T15:28:49.704 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/lib/ts_fsm.ko 2024-05-15T15:28:49.704 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/lib/ts_kmp.ko 2024-05-15T15:28:49.704 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/lib/zstd 2024-05-15T15:28:49.705 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/lib/zstd/zstd_compress.ko 2024-05-15T15:28:49.705 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/mm 2024-05-15T15:28:49.705 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/mm/hwpoison-inject.ko 2024-05-15T15:28:49.705 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net 2024-05-15T15:28:49.705 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/6lowpan 2024-05-15T15:28:49.705 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/6lowpan/6lowpan.ko 2024-05-15T15:28:49.705 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/6lowpan/nhc_dest.ko 2024-05-15T15:28:49.705 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/6lowpan/nhc_fragment.ko 2024-05-15T15:28:49.705 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/6lowpan/nhc_hop.ko 2024-05-15T15:28:49.705 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/6lowpan/nhc_ipv6.ko 2024-05-15T15:28:49.705 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/6lowpan/nhc_mobility.ko 2024-05-15T15:28:49.705 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/6lowpan/nhc_routing.ko 2024-05-15T15:28:49.705 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/6lowpan/nhc_udp.ko 2024-05-15T15:28:49.705 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/802 2024-05-15T15:28:49.706 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/802/garp.ko 2024-05-15T15:28:49.706 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/802/mrp.ko 2024-05-15T15:28:49.706 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/802/p8022.ko 2024-05-15T15:28:49.706 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/802/psnap.ko 2024-05-15T15:28:49.706 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/802/stp.ko 2024-05-15T15:28:49.706 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/8021q 2024-05-15T15:28:49.706 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/8021q/8021q.ko 2024-05-15T15:28:49.706 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/9p 2024-05-15T15:28:49.706 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/9p/9pnet.ko 2024-05-15T15:28:49.706 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/9p/9pnet_fd.ko 2024-05-15T15:28:49.706 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/9p/9pnet_rdma.ko 2024-05-15T15:28:49.707 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/9p/9pnet_virtio.ko 2024-05-15T15:28:49.707 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/batman-adv 2024-05-15T15:28:49.707 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/batman-adv/batman-adv.ko 2024-05-15T15:28:49.707 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/bridge 2024-05-15T15:28:49.707 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/bridge/br_netfilter.ko 2024-05-15T15:28:49.707 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/bridge/bridge.ko 2024-05-15T15:28:49.707 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/bridge/netfilter 2024-05-15T15:28:49.707 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-05-15T15:28:49.707 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/bridge/netfilter/ebt_among.ko 2024-05-15T15:28:49.707 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/bridge/netfilter/ebt_arp.ko 2024-05-15T15:28:49.707 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-05-15T15:28:49.707 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-05-15T15:28:49.707 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/bridge/netfilter/ebt_ip.ko 2024-05-15T15:28:49.708 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-05-15T15:28:49.708 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/bridge/netfilter/ebt_limit.ko 2024-05-15T15:28:49.708 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/bridge/netfilter/ebt_log.ko 2024-05-15T15:28:49.708 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/bridge/netfilter/ebt_mark.ko 2024-05-15T15:28:49.708 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-05-15T15:28:49.708 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-05-15T15:28:49.708 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-05-15T15:28:49.708 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-05-15T15:28:49.708 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/bridge/netfilter/ebt_snat.ko 2024-05-15T15:28:49.708 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/bridge/netfilter/ebt_stp.ko 2024-05-15T15:28:49.708 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-05-15T15:28:49.708 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-05-15T15:28:49.708 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-05-15T15:28:49.709 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-05-15T15:28:49.709 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/bridge/netfilter/ebtables.ko 2024-05-15T15:28:49.709 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-05-15T15:28:49.709 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-05-15T15:28:49.709 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-05-15T15:28:49.709 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ceph 2024-05-15T15:28:49.709 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ceph/libceph.ko 2024-05-15T15:28:49.709 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/core 2024-05-15T15:28:49.709 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/core/failover.ko 2024-05-15T15:28:49.709 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/core/pktgen.ko 2024-05-15T15:28:49.709 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/dccp 2024-05-15T15:28:49.709 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/dccp/dccp.ko 2024-05-15T15:28:49.709 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/dccp/dccp_diag.ko 2024-05-15T15:28:49.710 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/dccp/dccp_ipv4.ko 2024-05-15T15:28:49.710 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/dccp/dccp_ipv6.ko 2024-05-15T15:28:49.710 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/dns_resolver 2024-05-15T15:28:49.710 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/dns_resolver/dns_resolver.ko 2024-05-15T15:28:49.710 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/dsa 2024-05-15T15:28:49.710 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/dsa/dsa_core.ko 2024-05-15T15:28:49.710 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/dsa/tag_brcm.ko 2024-05-15T15:28:49.710 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/dsa/tag_dsa.ko 2024-05-15T15:28:49.710 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/dsa/tag_none.ko 2024-05-15T15:28:49.710 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/dsa/tag_trailer.ko 2024-05-15T15:28:49.710 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ieee802154 2024-05-15T15:28:49.710 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ieee802154/6lowpan 2024-05-15T15:28:49.710 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-05-15T15:28:49.711 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ieee802154/ieee802154.ko 2024-05-15T15:28:49.711 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ieee802154/ieee802154_socket.ko 2024-05-15T15:28:49.711 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4 2024-05-15T15:28:49.711 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/ah4.ko 2024-05-15T15:28:49.711 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/esp4.ko 2024-05-15T15:28:49.711 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/fou.ko 2024-05-15T15:28:49.711 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/gre.ko 2024-05-15T15:28:49.711 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/inet_diag.ko 2024-05-15T15:28:49.711 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/ip_gre.ko 2024-05-15T15:28:49.711 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/ip_tunnel.ko 2024-05-15T15:28:49.711 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/ip_vti.ko 2024-05-15T15:28:49.712 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/ipcomp.ko 2024-05-15T15:28:49.712 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/ipip.ko 2024-05-15T15:28:49.712 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/netfilter 2024-05-15T15:28:49.712 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/netfilter/arp_tables.ko 2024-05-15T15:28:49.712 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-05-15T15:28:49.712 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-05-15T15:28:49.712 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-05-15T15:28:49.712 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-05-15T15:28:49.712 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-05-15T15:28:49.712 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-05-15T15:28:49.712 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-05-15T15:28:49.712 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-05-15T15:28:49.712 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-05-15T15:28:49.713 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/netfilter/iptable_security.ko 2024-05-15T15:28:49.713 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-05-15T15:28:49.713 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-05-15T15:28:49.713 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-05-15T15:28:49.713 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-05-15T15:28:49.713 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-05-15T15:28:49.713 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-05-15T15:28:49.713 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-05-15T15:28:49.713 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-05-15T15:28:49.713 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-05-15T15:28:49.713 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-05-15T15:28:49.713 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/tcp_bic.ko 2024-05-15T15:28:49.713 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/tcp_dctcp.ko 2024-05-15T15:28:49.714 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/tcp_diag.ko 2024-05-15T15:28:49.714 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/tcp_highspeed.ko 2024-05-15T15:28:49.714 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/tcp_htcp.ko 2024-05-15T15:28:49.714 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/tcp_hybla.ko 2024-05-15T15:28:49.714 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/tcp_illinois.ko 2024-05-15T15:28:49.714 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/tcp_lp.ko 2024-05-15T15:28:49.714 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/tcp_scalable.ko 2024-05-15T15:28:49.714 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/tcp_vegas.ko 2024-05-15T15:28:49.714 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/tcp_veno.ko 2024-05-15T15:28:49.714 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/tcp_westwood.ko 2024-05-15T15:28:49.714 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/tcp_yeah.ko 2024-05-15T15:28:49.714 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/tunnel4.ko 2024-05-15T15:28:49.715 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/udp_diag.ko 2024-05-15T15:28:49.715 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/udp_tunnel.ko 2024-05-15T15:28:49.715 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv4/xfrm4_tunnel.ko 2024-05-15T15:28:49.715 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv6 2024-05-15T15:28:49.715 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv6/ah6.ko 2024-05-15T15:28:49.715 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv6/esp6.ko 2024-05-15T15:28:49.715 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv6/fou6.ko 2024-05-15T15:28:49.715 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv6/ip6_tunnel.ko 2024-05-15T15:28:49.715 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-05-15T15:28:49.715 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv6/ip6_vti.ko 2024-05-15T15:28:49.715 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv6/ipcomp6.ko 2024-05-15T15:28:49.715 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv6/netfilter 2024-05-15T15:28:49.715 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-05-15T15:28:49.715 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-05-15T15:28:49.716 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-05-15T15:28:49.716 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-05-15T15:28:49.716 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-05-15T15:28:49.716 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-05-15T15:28:49.716 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-05-15T15:28:49.716 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-05-15T15:28:49.716 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-05-15T15:28:49.716 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-05-15T15:28:49.716 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-05-15T15:28:49.716 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-05-15T15:28:49.716 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-05-15T15:28:49.716 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-05-15T15:28:49.716 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-05-15T15:28:49.716 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-05-15T15:28:49.717 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-05-15T15:28:49.717 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-05-15T15:28:49.717 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-05-15T15:28:49.717 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-05-15T15:28:49.717 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-05-15T15:28:49.717 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-05-15T15:28:49.717 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-05-15T15:28:49.717 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-05-15T15:28:49.717 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv6/sit.ko 2024-05-15T15:28:49.717 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv6/tunnel6.ko 2024-05-15T15:28:49.717 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/ipv6/xfrm6_tunnel.ko 2024-05-15T15:28:49.717 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/key 2024-05-15T15:28:49.717 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/key/af_key.ko 2024-05-15T15:28:49.717 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/l2tp 2024-05-15T15:28:49.718 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/l2tp/l2tp_core.ko 2024-05-15T15:28:49.718 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/l2tp/l2tp_debugfs.ko 2024-05-15T15:28:49.718 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/l2tp/l2tp_eth.ko 2024-05-15T15:28:49.718 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/l2tp/l2tp_ip.ko 2024-05-15T15:28:49.718 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/l2tp/l2tp_ip6.ko 2024-05-15T15:28:49.718 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/l2tp/l2tp_netlink.ko 2024-05-15T15:28:49.718 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/l2tp/l2tp_ppp.ko 2024-05-15T15:28:49.718 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/llc 2024-05-15T15:28:49.718 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/llc/llc.ko 2024-05-15T15:28:49.718 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/mac802154 2024-05-15T15:28:49.718 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/mac802154/mac802154.ko 2024-05-15T15:28:49.718 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/mpls 2024-05-15T15:28:49.719 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/mpls/mpls_gso.ko 2024-05-15T15:28:49.719 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter 2024-05-15T15:28:49.719 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/ipset 2024-05-15T15:28:49.719 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/ipset/ip_set.ko 2024-05-15T15:28:49.719 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-05-15T15:28:49.719 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-05-15T15:28:49.719 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-05-15T15:28:49.719 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-05-15T15:28:49.719 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-05-15T15:28:49.719 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-05-15T15:28:49.719 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-05-15T15:28:49.719 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-05-15T15:28:49.719 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-05-15T15:28:49.720 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-05-15T15:28:49.720 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-05-15T15:28:49.720 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-05-15T15:28:49.720 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-05-15T15:28:49.720 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-05-15T15:28:49.720 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-05-15T15:28:49.720 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/ipvs 2024-05-15T15:28:49.720 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/ipvs/ip_vs.ko 2024-05-15T15:28:49.720 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-05-15T15:28:49.720 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-05-15T15:28:49.720 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-05-15T15:28:49.720 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-05-15T15:28:49.720 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-05-15T15:28:49.720 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-05-15T15:28:49.721 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-05-15T15:28:49.721 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-05-15T15:28:49.721 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-05-15T15:28:49.721 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-05-15T15:28:49.721 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-05-15T15:28:49.721 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-05-15T15:28:49.721 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-05-15T15:28:49.721 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nf_conncount.ko 2024-05-15T15:28:49.721 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nf_conntrack.ko 2024-05-15T15:28:49.721 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-05-15T15:28:49.721 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-05-15T15:28:49.721 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-05-15T15:28:49.721 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nf_conntrack_h323.ko 2024-05-15T15:28:49.721 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nf_conntrack_irc.ko 2024-05-15T15:28:49.722 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-05-15T15:28:49.722 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-05-15T15:28:49.722 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-05-15T15:28:49.722 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nf_conntrack_sane.ko 2024-05-15T15:28:49.722 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nf_conntrack_sip.ko 2024-05-15T15:28:49.722 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-05-15T15:28:49.722 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-05-15T15:28:49.722 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nf_dup_netdev.ko 2024-05-15T15:28:49.722 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nf_flow_table.ko 2024-05-15T15:28:49.722 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nf_flow_table_inet.ko 2024-05-15T15:28:49.722 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nf_log_syslog.ko 2024-05-15T15:28:49.722 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nf_nat.ko 2024-05-15T15:28:49.722 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nf_nat_amanda.ko 2024-05-15T15:28:49.722 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nf_nat_ftp.ko 2024-05-15T15:28:49.723 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nf_nat_irc.ko 2024-05-15T15:28:49.723 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nf_nat_sip.ko 2024-05-15T15:28:49.723 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nf_nat_tftp.ko 2024-05-15T15:28:49.723 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nf_synproxy_core.ko 2024-05-15T15:28:49.723 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nf_tables.ko 2024-05-15T15:28:49.723 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nfnetlink.ko 2024-05-15T15:28:49.723 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nfnetlink_acct.ko 2024-05-15T15:28:49.723 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nfnetlink_log.ko 2024-05-15T15:28:49.723 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nfnetlink_osf.ko 2024-05-15T15:28:49.723 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nfnetlink_queue.ko 2024-05-15T15:28:49.723 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nft_chain_nat.ko 2024-05-15T15:28:49.723 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nft_compat.ko 2024-05-15T15:28:49.723 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nft_ct.ko 2024-05-15T15:28:49.723 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nft_dup_netdev.ko 2024-05-15T15:28:49.724 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nft_fib.ko 2024-05-15T15:28:49.724 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nft_fwd_netdev.ko 2024-05-15T15:28:49.724 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nft_hash.ko 2024-05-15T15:28:49.724 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nft_limit.ko 2024-05-15T15:28:49.724 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nft_log.ko 2024-05-15T15:28:49.724 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nft_masq.ko 2024-05-15T15:28:49.724 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nft_nat.ko 2024-05-15T15:28:49.724 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nft_numgen.ko 2024-05-15T15:28:49.724 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nft_queue.ko 2024-05-15T15:28:49.724 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nft_quota.ko 2024-05-15T15:28:49.724 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nft_redir.ko 2024-05-15T15:28:49.724 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nft_reject.ko 2024-05-15T15:28:49.725 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nft_reject_inet.ko 2024-05-15T15:28:49.725 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nft_socket.ko 2024-05-15T15:28:49.725 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/nft_tunnel.ko 2024-05-15T15:28:49.725 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_AUDIT.ko 2024-05-15T15:28:49.725 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_CHECKSUM.ko 2024-05-15T15:28:49.725 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_CLASSIFY.ko 2024-05-15T15:28:49.725 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-05-15T15:28:49.725 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_CT.ko 2024-05-15T15:28:49.725 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_DSCP.ko 2024-05-15T15:28:49.725 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_HL.ko 2024-05-15T15:28:49.725 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_HMARK.ko 2024-05-15T15:28:49.725 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_IDLETIMER.ko 2024-05-15T15:28:49.725 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_LED.ko 2024-05-15T15:28:49.725 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_LOG.ko 2024-05-15T15:28:49.726 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_MASQUERADE.ko 2024-05-15T15:28:49.726 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_NETMAP.ko 2024-05-15T15:28:49.726 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_NFLOG.ko 2024-05-15T15:28:49.726 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_NFQUEUE.ko 2024-05-15T15:28:49.726 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_RATEEST.ko 2024-05-15T15:28:49.726 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_REDIRECT.ko 2024-05-15T15:28:49.726 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_SECMARK.ko 2024-05-15T15:28:49.726 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_TCPMSS.ko 2024-05-15T15:28:49.726 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-05-15T15:28:49.726 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_TEE.ko 2024-05-15T15:28:49.726 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_TPROXY.ko 2024-05-15T15:28:49.727 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_TRACE.ko 2024-05-15T15:28:49.727 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_addrtype.ko 2024-05-15T15:28:49.727 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_bpf.ko 2024-05-15T15:28:49.727 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_cgroup.ko 2024-05-15T15:28:49.727 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_cluster.ko 2024-05-15T15:28:49.727 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_comment.ko 2024-05-15T15:28:49.727 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_connbytes.ko 2024-05-15T15:28:49.727 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_connlabel.ko 2024-05-15T15:28:49.727 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_connlimit.ko 2024-05-15T15:28:49.727 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_connmark.ko 2024-05-15T15:28:49.727 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_conntrack.ko 2024-05-15T15:28:49.727 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_cpu.ko 2024-05-15T15:28:49.727 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_dccp.ko 2024-05-15T15:28:49.727 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_devgroup.ko 2024-05-15T15:28:49.728 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_dscp.ko 2024-05-15T15:28:49.728 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_ecn.ko 2024-05-15T15:28:49.728 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_esp.ko 2024-05-15T15:28:49.728 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_hashlimit.ko 2024-05-15T15:28:49.728 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_helper.ko 2024-05-15T15:28:49.728 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_hl.ko 2024-05-15T15:28:49.728 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_ipcomp.ko 2024-05-15T15:28:49.728 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_iprange.ko 2024-05-15T15:28:49.728 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_ipvs.ko 2024-05-15T15:28:49.728 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_l2tp.ko 2024-05-15T15:28:49.728 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_length.ko 2024-05-15T15:28:49.728 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_limit.ko 2024-05-15T15:28:49.728 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_mac.ko 2024-05-15T15:28:49.728 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_mark.ko 2024-05-15T15:28:49.729 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_multiport.ko 2024-05-15T15:28:49.729 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_nat.ko 2024-05-15T15:28:49.729 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_nfacct.ko 2024-05-15T15:28:49.729 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_osf.ko 2024-05-15T15:28:49.729 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_owner.ko 2024-05-15T15:28:49.729 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_physdev.ko 2024-05-15T15:28:49.729 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_pkttype.ko 2024-05-15T15:28:49.729 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_policy.ko 2024-05-15T15:28:49.729 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_quota.ko 2024-05-15T15:28:49.729 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_rateest.ko 2024-05-15T15:28:49.729 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_realm.ko 2024-05-15T15:28:49.729 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_recent.ko 2024-05-15T15:28:49.729 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_sctp.ko 2024-05-15T15:28:49.730 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_set.ko 2024-05-15T15:28:49.730 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_socket.ko 2024-05-15T15:28:49.730 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_state.ko 2024-05-15T15:28:49.730 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_statistic.ko 2024-05-15T15:28:49.730 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_string.ko 2024-05-15T15:28:49.730 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_tcpmss.ko 2024-05-15T15:28:49.730 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_time.ko 2024-05-15T15:28:49.730 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netfilter/xt_u32.ko 2024-05-15T15:28:49.730 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netlink 2024-05-15T15:28:49.730 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/netlink/netlink_diag.ko 2024-05-15T15:28:49.730 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/nsh 2024-05-15T15:28:49.730 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/nsh/nsh.ko 2024-05-15T15:28:49.730 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/openvswitch 2024-05-15T15:28:49.730 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/openvswitch/openvswitch.ko 2024-05-15T15:28:49.731 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/openvswitch/vport-geneve.ko 2024-05-15T15:28:49.731 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/openvswitch/vport-gre.ko 2024-05-15T15:28:49.731 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/openvswitch/vport-vxlan.ko 2024-05-15T15:28:49.731 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/packet 2024-05-15T15:28:49.731 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/packet/af_packet_diag.ko 2024-05-15T15:28:49.731 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/rds 2024-05-15T15:28:49.731 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/rds/rds.ko 2024-05-15T15:28:49.731 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/rds/rds_rdma.ko 2024-05-15T15:28:49.731 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/rds/rds_tcp.ko 2024-05-15T15:28:49.731 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched 2024-05-15T15:28:49.731 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/act_csum.ko 2024-05-15T15:28:49.731 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/act_gact.ko 2024-05-15T15:28:49.731 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/act_mirred.ko 2024-05-15T15:28:49.731 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/act_nat.ko 2024-05-15T15:28:49.732 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/act_pedit.ko 2024-05-15T15:28:49.732 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/act_police.ko 2024-05-15T15:28:49.732 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/act_simple.ko 2024-05-15T15:28:49.732 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/act_skbedit.ko 2024-05-15T15:28:49.732 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/act_vlan.ko 2024-05-15T15:28:49.732 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/cls_basic.ko 2024-05-15T15:28:49.732 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/cls_bpf.ko 2024-05-15T15:28:49.732 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/cls_flow.ko 2024-05-15T15:28:49.732 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/cls_fw.ko 2024-05-15T15:28:49.732 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/cls_route.ko 2024-05-15T15:28:49.732 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/cls_u32.ko 2024-05-15T15:28:49.732 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/em_cmp.ko 2024-05-15T15:28:49.732 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/em_ipset.ko 2024-05-15T15:28:49.732 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/em_meta.ko 2024-05-15T15:28:49.733 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/em_nbyte.ko 2024-05-15T15:28:49.733 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/em_text.ko 2024-05-15T15:28:49.733 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/em_u32.ko 2024-05-15T15:28:49.733 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/sch_choke.ko 2024-05-15T15:28:49.733 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/sch_codel.ko 2024-05-15T15:28:49.733 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/sch_drr.ko 2024-05-15T15:28:49.733 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/sch_fq.ko 2024-05-15T15:28:49.733 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/sch_gred.ko 2024-05-15T15:28:49.733 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/sch_hfsc.ko 2024-05-15T15:28:49.733 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/sch_hhf.ko 2024-05-15T15:28:49.733 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/sch_htb.ko 2024-05-15T15:28:49.733 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/sch_ingress.ko 2024-05-15T15:28:49.733 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/sch_mqprio.ko 2024-05-15T15:28:49.734 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/sch_mqprio_lib.ko 2024-05-15T15:28:49.734 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/sch_multiq.ko 2024-05-15T15:28:49.734 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/sch_netem.ko 2024-05-15T15:28:49.734 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/sch_pie.ko 2024-05-15T15:28:49.734 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/sch_plug.ko 2024-05-15T15:28:49.734 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/sch_prio.ko 2024-05-15T15:28:49.734 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/sch_qfq.ko 2024-05-15T15:28:49.734 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/sch_red.ko 2024-05-15T15:28:49.734 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/sch_sfb.ko 2024-05-15T15:28:49.734 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/sch_sfq.ko 2024-05-15T15:28:49.734 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/sch_tbf.ko 2024-05-15T15:28:49.734 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sched/sch_teql.ko 2024-05-15T15:28:49.734 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sctp 2024-05-15T15:28:49.735 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sctp/sctp.ko 2024-05-15T15:28:49.735 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sctp/sctp_diag.ko 2024-05-15T15:28:49.735 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sunrpc 2024-05-15T15:28:49.735 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sunrpc/auth_gss 2024-05-15T15:28:49.735 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-05-15T15:28:49.735 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-05-15T15:28:49.735 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sunrpc/sunrpc.ko 2024-05-15T15:28:49.735 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sunrpc/xprtrdma 2024-05-15T15:28:49.735 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-05-15T15:28:49.735 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/tipc 2024-05-15T15:28:49.735 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/tipc/tipc.ko 2024-05-15T15:28:49.735 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/tipc/tipc_diag.ko 2024-05-15T15:28:49.735 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/unix 2024-05-15T15:28:49.736 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/unix/unix_diag.ko 2024-05-15T15:28:49.736 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/vmw_vsock 2024-05-15T15:28:49.736 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-05-15T15:28:49.736 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-05-15T15:28:49.736 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/vmw_vsock/vsock.ko 2024-05-15T15:28:49.736 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/vmw_vsock/vsock_diag.ko 2024-05-15T15:28:49.736 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/vmw_vsock/vsock_loopback.ko 2024-05-15T15:28:49.736 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/xfrm 2024-05-15T15:28:49.736 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/net/xfrm/xfrm_ipcomp.ko 2024-05-15T15:28:49.736 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/security 2024-05-15T15:28:49.736 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/security/keys 2024-05-15T15:28:49.736 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/security/keys/encrypted-keys 2024-05-15T15:28:49.736 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-05-15T15:28:49.736 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/security/keys/trusted-keys 2024-05-15T15:28:49.737 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/kernel/security/keys/trusted-keys/trusted.ko 2024-05-15T15:28:49.737 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/modules.alias 2024-05-15T15:28:49.737 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/modules.alias.bin 2024-05-15T15:28:49.737 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/modules.builtin 2024-05-15T15:28:49.737 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/modules.builtin.alias.bin 2024-05-15T15:28:49.737 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/modules.builtin.bin 2024-05-15T15:28:49.737 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/modules.builtin.modinfo 2024-05-15T15:28:49.737 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/modules.dep 2024-05-15T15:28:49.737 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/modules.dep.bin 2024-05-15T15:28:49.737 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/modules.devname 2024-05-15T15:28:49.737 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/modules.order 2024-05-15T15:28:49.737 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/modules.softdep 2024-05-15T15:28:49.737 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/modules.symbols 2024-05-15T15:28:49.737 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/modules.symbols.bin 2024-05-15T15:28:49.738 INFO:teuthology.orchestra.run.smithi104.stdout:/lib/modules/6.9.0-rc3-g42e114f04cb0/vmlinuz 2024-05-15T15:28:49.742 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-rc3-g42e114f04cb0 2024-05-15T15:28:49.742 DEBUG:teuthology.orchestra.run.smithi104:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-05-15T15:28:49.764 INFO:teuthology.orchestra.run.smithi104.stdout:postinstall scriptlet (using /bin/sh): 2024-05-15T15:28:49.765 INFO:teuthology.orchestra.run.smithi104.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-05-15T15:28:49.765 INFO:teuthology.orchestra.run.smithi104.stdout: /usr/bin/kernel-install add 6.9.0-rc3-g42e114f04cb0 /lib/modules/6.9.0-rc3-g42e114f04cb0/vmlinuz 2024-05-15T15:28:49.765 INFO:teuthology.orchestra.run.smithi104.stdout:fi 2024-05-15T15:28:49.765 INFO:teuthology.orchestra.run.smithi104.stdout:for file in vmlinuz System.map config; do 2024-05-15T15:28:49.765 INFO:teuthology.orchestra.run.smithi104.stdout: if ! cmp --silent "/lib/modules/6.9.0-rc3-g42e114f04cb0/${file}" "/boot/${file}-6.9.0-rc3-g42e114f04cb0"; then 2024-05-15T15:28:49.765 INFO:teuthology.orchestra.run.smithi104.stdout: cp "/lib/modules/6.9.0-rc3-g42e114f04cb0/${file}" "/boot/${file}-6.9.0-rc3-g42e114f04cb0" 2024-05-15T15:28:49.765 INFO:teuthology.orchestra.run.smithi104.stdout: fi 2024-05-15T15:28:49.765 INFO:teuthology.orchestra.run.smithi104.stdout:done 2024-05-15T15:28:49.765 INFO:teuthology.orchestra.run.smithi104.stdout:if [ -d "/lib/modules/6.9.0-rc3-g42e114f04cb0/dtb" ] && \ 2024-05-15T15:28:49.765 INFO:teuthology.orchestra.run.smithi104.stdout: ! diff -rq "/lib/modules/6.9.0-rc3-g42e114f04cb0/dtb" "/boot/dtb-6.9.0-rc3-g42e114f04cb0" >/dev/null 2>&1; then 2024-05-15T15:28:49.765 INFO:teuthology.orchestra.run.smithi104.stdout: rm -rf "/boot/dtb-6.9.0-rc3-g42e114f04cb0" 2024-05-15T15:28:49.765 INFO:teuthology.orchestra.run.smithi104.stdout: cp -r "/lib/modules/6.9.0-rc3-g42e114f04cb0/dtb" "/boot/dtb-6.9.0-rc3-g42e114f04cb0" 2024-05-15T15:28:49.765 INFO:teuthology.orchestra.run.smithi104.stdout:fi 2024-05-15T15:28:49.766 INFO:teuthology.orchestra.run.smithi104.stdout:if [ ! -e "/lib/modules/6.9.0-rc3-g42e114f04cb0/modules.dep" ]; then 2024-05-15T15:28:49.766 INFO:teuthology.orchestra.run.smithi104.stdout: /usr/sbin/depmod 6.9.0-rc3-g42e114f04cb0 2024-05-15T15:28:49.766 INFO:teuthology.orchestra.run.smithi104.stdout:fi 2024-05-15T15:28:49.766 INFO:teuthology.orchestra.run.smithi104.stdout:preuninstall scriptlet (using /bin/sh): 2024-05-15T15:28:49.766 INFO:teuthology.orchestra.run.smithi104.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-05-15T15:28:49.766 INFO:teuthology.orchestra.run.smithi104.stdout:kernel-install remove 6.9.0-rc3-g42e114f04cb0 2024-05-15T15:28:49.766 INFO:teuthology.orchestra.run.smithi104.stdout:fi 2024-05-15T15:28:49.767 DEBUG:teuthology.orchestra.run.smithi104:> sudo rpm -qi grub2-tools 2024-05-15T15:28:49.840 INFO:teuthology.orchestra.run.smithi104.stdout:Name : grub2-tools 2024-05-15T15:28:49.840 INFO:teuthology.orchestra.run.smithi104.stdout:Epoch : 1 2024-05-15T15:28:49.840 INFO:teuthology.orchestra.run.smithi104.stdout:Version : 2.06 2024-05-15T15:28:49.840 INFO:teuthology.orchestra.run.smithi104.stdout:Release : 68.el9 2024-05-15T15:28:49.840 INFO:teuthology.orchestra.run.smithi104.stdout:Architecture: x86_64 2024-05-15T15:28:49.840 INFO:teuthology.orchestra.run.smithi104.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-05-15T15:28:49.840 INFO:teuthology.orchestra.run.smithi104.stdout:Group : Unspecified 2024-05-15T15:28:49.840 INFO:teuthology.orchestra.run.smithi104.stdout:Size : 8264254 2024-05-15T15:28:49.840 INFO:teuthology.orchestra.run.smithi104.stdout:License : GPLv3+ 2024-05-15T15:28:49.840 INFO:teuthology.orchestra.run.smithi104.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-05-15T15:28:49.841 INFO:teuthology.orchestra.run.smithi104.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-05-15T15:28:49.841 INFO:teuthology.orchestra.run.smithi104.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-05-15T15:28:49.841 INFO:teuthology.orchestra.run.smithi104.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-05-15T15:28:49.841 INFO:teuthology.orchestra.run.smithi104.stdout:Packager : builder@centos.org 2024-05-15T15:28:49.841 INFO:teuthology.orchestra.run.smithi104.stdout:Vendor : CentOS 2024-05-15T15:28:49.841 INFO:teuthology.orchestra.run.smithi104.stdout:URL : http://www.gnu.org/software/grub/ 2024-05-15T15:28:49.841 INFO:teuthology.orchestra.run.smithi104.stdout:Summary : Support tools for GRUB. 2024-05-15T15:28:49.841 INFO:teuthology.orchestra.run.smithi104.stdout:Description : 2024-05-15T15:28:49.841 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-15T15:28:49.841 INFO:teuthology.orchestra.run.smithi104.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-05-15T15:28:49.841 INFO:teuthology.orchestra.run.smithi104.stdout:customizable bootloader with modular architecture. It supports a rich 2024-05-15T15:28:49.841 INFO:teuthology.orchestra.run.smithi104.stdout:variety of kernel formats, file systems, computer architectures and 2024-05-15T15:28:49.841 INFO:teuthology.orchestra.run.smithi104.stdout:hardware devices. 2024-05-15T15:28:49.841 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-15T15:28:49.841 INFO:teuthology.orchestra.run.smithi104.stdout:This subpackage provides tools for support of all platforms. 2024-05-15T15:28:49.842 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-05-15T15:28:49.842 INFO:teuthology.task.kernel:Updating grub on smithi104 to boot 6.9.0-rc3-g42e114f04cb0 2024-05-15T15:28:49.843 DEBUG:teuthology.orchestra.run.smithi104:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-05-15T15:28:50.378 INFO:teuthology.orchestra.run.smithi104.stderr:Generating grub configuration file ... 2024-05-15T15:28:51.685 INFO:teuthology.orchestra.run.smithi104.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-05-15T15:28:51.721 INFO:teuthology.orchestra.run.smithi104.stderr:done 2024-05-15T15:28:51.724 DEBUG:teuthology.orchestra.run.smithi104:> mktemp 2024-05-15T15:28:51.740 INFO:teuthology.orchestra.run.smithi104.stdout:/tmp/tmp.2TEYiOfvo8 2024-05-15T15:28:51.740 DEBUG:teuthology.orchestra.run.smithi104:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.2TEYiOfvo8 2024-05-15T15:28:51.805 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod 0666 /tmp/tmp.2TEYiOfvo8 2024-05-15T15:28:51.942 DEBUG:teuthology.orchestra.remote:smithi104:/tmp/tmp.2TEYiOfvo8 is 6KB 2024-05-15T15:28:51.991 DEBUG:teuthology.orchestra.run.smithi104:> rm -fr /tmp/tmp.2TEYiOfvo8 2024-05-15T15:28:52.005 DEBUG:teuthology.orchestra.run.smithi104:> sudo /bin/ls /boot/loader/entries || true 2024-05-15T15:28:52.077 INFO:teuthology.orchestra.run.smithi104.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-05-15T15:28:52.077 INFO:teuthology.orchestra.run.smithi104.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-05-15T15:28:52.078 INFO:teuthology.orchestra.run.smithi104.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-05-15T15:28:52.078 INFO:teuthology.orchestra.run.smithi104.stdout:7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-g42e114f04cb0.conf 2024-05-15T15:28:52.079 DEBUG:teuthology.orchestra.run.smithi104:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-g42e114f04cb0 2024-05-15T15:28:52.226 DEBUG:teuthology.orchestra.run.smithi104:> sudo shutdown -r now 2024-05-15T15:29:22.229 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-05-15T15:29:22.229 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi104.front.sepia.ceph.com' 2024-05-15T15:29:22.230 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-15T15:30:22.232 DEBUG:teuthology.orchestra.remote:timed out 2024-05-15T15:30:31.233 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi104.front.sepia.ceph.com' 2024-05-15T15:30:31.235 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-15T15:30:38.980 DEBUG:teuthology.orchestra.run.smithi104:> true 2024-05-15T15:30:39.635 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi104.front.sepia.ceph.com' 2024-05-15T15:30:39.635 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.9.0-rc3-g42e114f04cb0"... 2024-05-15T15:30:39.635 DEBUG:teuthology.orchestra.run.smithi104:> uname -r 2024-05-15T15:30:39.687 INFO:teuthology.orchestra.run.smithi104.stdout:6.9.0-rc3-g42e114f04cb0 2024-05-15T15:30:39.687 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-rc3-g42e114f04cb0 vs 6.9.0-rc3-g42e114f04cb0 2024-05-15T15:30:39.687 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-15T15:30:39.688 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-05-15T15:30:40.692 DEBUG:teuthology.parallel:result is None 2024-05-15T15:30:40.692 INFO:teuthology.run_tasks:Running task internal.base... 2024-05-15T15:30:40.704 INFO:teuthology.task.internal:Creating test directory... 2024-05-15T15:30:40.704 DEBUG:teuthology.orchestra.run.smithi012:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-15T15:30:40.706 DEBUG:teuthology.orchestra.run.smithi084:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-15T15:30:40.709 DEBUG:teuthology.orchestra.run.smithi104:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-15T15:30:40.759 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-05-15T15:30:40.765 INFO:teuthology.run_tasks:Running task internal.archive... 2024-05-15T15:30:40.776 INFO:teuthology.task.internal:Creating archive directory... 2024-05-15T15:30:40.776 DEBUG:teuthology.orchestra.run.smithi012:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-15T15:30:40.778 DEBUG:teuthology.orchestra.run.smithi084:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-15T15:30:40.781 DEBUG:teuthology.orchestra.run.smithi104:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-15T15:30:40.844 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-05-15T15:30:40.852 INFO:teuthology.task.internal:Enabling coredump saving... 2024-05-15T15:30:40.852 DEBUG:teuthology.orchestra.run.smithi012:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-15T15:30:40.868 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-15T15:30:40.869 DEBUG:teuthology.orchestra.run.smithi084:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-15T15:30:40.884 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-15T15:30:40.885 DEBUG:teuthology.orchestra.run.smithi012:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-15T15:30:40.911 DEBUG:teuthology.orchestra.run.smithi084:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-15T15:30:40.927 DEBUG:teuthology.orchestra.run.smithi104:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-15T15:30:40.943 INFO:teuthology.orchestra.run.smithi012.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-15T15:30:40.957 INFO:teuthology.orchestra.run.smithi084.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-15T15:30:40.960 INFO:teuthology.orchestra.run.smithi012.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-15T15:30:40.988 INFO:teuthology.orchestra.run.smithi084.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-15T15:30:41.057 INFO:teuthology.orchestra.run.smithi104.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-15T15:30:41.117 INFO:teuthology.orchestra.run.smithi104.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-15T15:30:41.121 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-05-15T15:30:41.129 INFO:teuthology.task.internal:Configuring sudo... 2024-05-15T15:30:41.129 DEBUG:teuthology.orchestra.run.smithi012:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-15T15:30:41.131 DEBUG:teuthology.orchestra.run.smithi084:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-15T15:30:41.134 DEBUG:teuthology.orchestra.run.smithi104:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-15T15:30:41.198 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-05-15T15:30:41.228 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-05-15T15:30:41.228 DEBUG:teuthology.orchestra.run.smithi012:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-15T15:30:41.231 DEBUG:teuthology.orchestra.run.smithi084:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-15T15:30:41.233 DEBUG:teuthology.orchestra.run.smithi104:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-15T15:30:41.283 DEBUG:teuthology.orchestra.run.smithi012:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-15T15:30:41.332 DEBUG:teuthology.orchestra.run.smithi012:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-15T15:30:41.384 DEBUG:teuthology.orchestra.run.smithi012:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-15T15:30:41.470 DEBUG:teuthology.orchestra.run.smithi012:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-15T15:30:41.511 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-05-15T15:30:41.512 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-15T15:30:41.578 DEBUG:teuthology.orchestra.run.smithi084:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-15T15:30:41.622 DEBUG:teuthology.orchestra.run.smithi084:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-15T15:30:41.673 DEBUG:teuthology.orchestra.run.smithi084:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-15T15:30:41.753 DEBUG:teuthology.orchestra.run.smithi084:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-15T15:30:41.797 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-05-15T15:30:41.797 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-15T15:30:41.863 DEBUG:teuthology.orchestra.run.smithi104:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-15T15:30:41.935 DEBUG:teuthology.orchestra.run.smithi104:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-15T15:30:42.013 DEBUG:teuthology.orchestra.run.smithi104:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-15T15:30:42.088 DEBUG:teuthology.orchestra.run.smithi104:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-15T15:30:42.158 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-05-15T15:30:42.158 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-15T15:30:42.240 DEBUG:teuthology.orchestra.run.smithi012:> sudo service rsyslog restart 2024-05-15T15:30:42.242 DEBUG:teuthology.orchestra.run.smithi084:> sudo service rsyslog restart 2024-05-15T15:30:42.245 DEBUG:teuthology.orchestra.run.smithi104:> sudo service rsyslog restart 2024-05-15T15:30:42.280 INFO:teuthology.orchestra.run.smithi084.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-15T15:30:42.286 INFO:teuthology.orchestra.run.smithi012.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-15T15:30:42.352 INFO:teuthology.orchestra.run.smithi104.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-15T15:30:42.746 INFO:teuthology.run_tasks:Running task internal.timer... 2024-05-15T15:30:42.754 INFO:teuthology.task.internal:Starting timer... 2024-05-15T15:30:42.754 INFO:teuthology.run_tasks:Running task pcp... 2024-05-15T15:30:42.775 INFO:teuthology.run_tasks:Running task selinux... 2024-05-15T15:30:42.817 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-05-15T15:30:42.818 DEBUG:teuthology.orchestra.run.smithi012:> sudo service auditd rotate 2024-05-15T15:30:42.875 INFO:teuthology.orchestra.run.smithi012.stdout:Rotating logs: 2024-05-15T15:30:42.877 DEBUG:teuthology.orchestra.run.smithi084:> sudo service auditd rotate 2024-05-15T15:30:42.944 INFO:teuthology.orchestra.run.smithi084.stdout:Rotating logs: 2024-05-15T15:30:42.946 DEBUG:teuthology.orchestra.run.smithi104:> sudo service auditd rotate 2024-05-15T15:30:43.063 INFO:teuthology.orchestra.run.smithi104.stdout:Rotating logs: 2024-05-15T15:30:43.068 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-05-15T15:30:43.068 DEBUG:teuthology.orchestra.run.smithi012:> /usr/sbin/getenforce 2024-05-15T15:30:43.093 INFO:teuthology.orchestra.run.smithi012.stdout:Permissive 2024-05-15T15:30:43.093 DEBUG:teuthology.orchestra.run.smithi084:> /usr/sbin/getenforce 2024-05-15T15:30:43.115 INFO:teuthology.orchestra.run.smithi084.stdout:Permissive 2024-05-15T15:30:43.116 DEBUG:teuthology.orchestra.run.smithi104:> /usr/sbin/getenforce 2024-05-15T15:30:43.160 INFO:teuthology.orchestra.run.smithi104.stdout:Permissive 2024-05-15T15:30:43.161 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi012.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi084.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi104.front.sepia.ceph.com': 'permissive'} 2024-05-15T15:30:43.161 DEBUG:teuthology.orchestra.run.smithi012:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-15T15:30:43.190 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-15T15:30:43.190 DEBUG:teuthology.orchestra.run.smithi084:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-15T15:30:43.218 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-15T15:30:43.219 DEBUG:teuthology.orchestra.run.smithi104:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-15T15:30:43.282 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-15T15:30:43.282 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-05-15T15:30:43.283 DEBUG:teuthology.orchestra.run.smithi012:> sudo /usr/sbin/setenforce permissive 2024-05-15T15:30:43.309 DEBUG:teuthology.orchestra.run.smithi084:> sudo /usr/sbin/setenforce permissive 2024-05-15T15:30:43.335 DEBUG:teuthology.orchestra.run.smithi104:> sudo /usr/sbin/setenforce permissive 2024-05-15T15:30:43.481 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-05-15T15:30:43.491 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-05-15T15:30:43.502 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-05-15T15:30:43.503 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi012.front.sepia.ceph.com,smithi084.front.sepia.ceph.com,smithi104.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-05-15T15:36:46.694 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi012.front.sepia.ceph.com'), Remote(name='ubuntu@smithi084.front.sepia.ceph.com'), Remote(name='ubuntu@smithi104.front.sepia.ceph.com')] 2024-05-15T15:36:46.696 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi012.front.sepia.ceph.com' 2024-05-15T15:36:46.697 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-15T15:36:46.778 DEBUG:teuthology.orchestra.run.smithi012:> true 2024-05-15T15:36:46.860 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi012.front.sepia.ceph.com' 2024-05-15T15:36:46.860 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi084.front.sepia.ceph.com' 2024-05-15T15:36:46.861 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-15T15:36:46.935 DEBUG:teuthology.orchestra.run.smithi084:> true 2024-05-15T15:36:47.019 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi084.front.sepia.ceph.com' 2024-05-15T15:36:47.020 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi104.front.sepia.ceph.com' 2024-05-15T15:36:47.020 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-15T15:36:47.128 DEBUG:teuthology.orchestra.run.smithi104:> true 2024-05-15T15:36:47.284 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi104.front.sepia.ceph.com' 2024-05-15T15:36:47.285 INFO:teuthology.run_tasks:Running task clock... 2024-05-15T15:36:47.333 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-05-15T15:36:47.334 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-15T15:36:47.334 DEBUG:teuthology.orchestra.run.smithi012:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-15T15:36:47.337 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-15T15:36:47.337 DEBUG:teuthology.orchestra.run.smithi084:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-15T15:36:47.339 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-15T15:36:47.339 DEBUG:teuthology.orchestra.run.smithi104:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-15T15:36:47.369 INFO:teuthology.orchestra.run.smithi084.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-15T15:36:47.370 INFO:teuthology.orchestra.run.smithi012.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-15T15:36:47.384 INFO:teuthology.orchestra.run.smithi084.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-15T15:36:47.384 INFO:teuthology.orchestra.run.smithi012.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-15T15:36:47.408 INFO:teuthology.orchestra.run.smithi084.stderr:sudo: ntpd: command not found 2024-05-15T15:36:47.410 INFO:teuthology.orchestra.run.smithi012.stderr:sudo: ntpd: command not found 2024-05-15T15:36:47.419 INFO:teuthology.orchestra.run.smithi084.stdout:506 Cannot talk to daemon 2024-05-15T15:36:47.422 INFO:teuthology.orchestra.run.smithi012.stdout:506 Cannot talk to daemon 2024-05-15T15:36:47.433 INFO:teuthology.orchestra.run.smithi084.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-15T15:36:47.433 INFO:teuthology.orchestra.run.smithi104.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-15T15:36:47.436 INFO:teuthology.orchestra.run.smithi012.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-15T15:36:47.446 INFO:teuthology.orchestra.run.smithi084.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-15T15:36:47.451 INFO:teuthology.orchestra.run.smithi012.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-15T15:36:47.471 INFO:teuthology.orchestra.run.smithi104.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-15T15:36:47.501 INFO:teuthology.orchestra.run.smithi084.stderr:bash: line 1: ntpq: command not found 2024-05-15T15:36:47.504 INFO:teuthology.orchestra.run.smithi084.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-15T15:36:47.504 INFO:teuthology.orchestra.run.smithi084.stdout:=============================================================================== 2024-05-15T15:36:47.504 INFO:teuthology.orchestra.run.smithi084.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-15T15:36:47.504 INFO:teuthology.orchestra.run.smithi084.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-15T15:36:47.504 INFO:teuthology.orchestra.run.smithi084.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-15T15:36:47.505 INFO:teuthology.orchestra.run.smithi084.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-15T15:36:47.509 INFO:teuthology.orchestra.run.smithi012.stderr:bash: line 1: ntpq: command not found 2024-05-15T15:36:47.512 INFO:teuthology.orchestra.run.smithi012.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-15T15:36:47.512 INFO:teuthology.orchestra.run.smithi012.stdout:=============================================================================== 2024-05-15T15:36:47.512 INFO:teuthology.orchestra.run.smithi012.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-15T15:36:47.513 INFO:teuthology.orchestra.run.smithi012.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-15T15:36:47.513 INFO:teuthology.orchestra.run.smithi012.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-15T15:36:47.513 INFO:teuthology.orchestra.run.smithi012.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-15T15:36:47.540 INFO:teuthology.orchestra.run.smithi104.stderr:sudo: ntpd: command not found 2024-05-15T15:36:47.571 INFO:teuthology.orchestra.run.smithi104.stdout:506 Cannot talk to daemon 2024-05-15T15:36:47.611 INFO:teuthology.orchestra.run.smithi104.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-15T15:36:47.650 INFO:teuthology.orchestra.run.smithi104.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-15T15:36:47.775 INFO:teuthology.orchestra.run.smithi104.stderr:bash: line 1: ntpq: command not found 2024-05-15T15:36:47.783 INFO:teuthology.orchestra.run.smithi104.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-15T15:36:47.784 INFO:teuthology.orchestra.run.smithi104.stdout:=============================================================================== 2024-05-15T15:36:47.784 INFO:teuthology.orchestra.run.smithi104.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-15T15:36:47.784 INFO:teuthology.orchestra.run.smithi104.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-15T15:36:47.784 INFO:teuthology.orchestra.run.smithi104.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-15T15:36:47.784 INFO:teuthology.orchestra.run.smithi104.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-15T15:36:47.785 INFO:teuthology.run_tasks:Running task install... 2024-05-15T15:36:47.793 DEBUG:teuthology.task.install:project ceph 2024-05-15T15:36:47.794 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '43296076bed1da2423ef68e9230eab60284d4c31'}, 'extra_system_packages': {'deb': ['fscrypt'], 'rpm': ['fscrypt']}} 2024-05-15T15:36:47.794 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib', 'fscrypt'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib', 'fscrypt']}, 'flavor': 'default', 'sha1': '43296076bed1da2423ef68e9230eab60284d4c31'} 2024-05-15T15:36:47.794 INFO:teuthology.task.install:Using flavor: default 2024-05-15T15:36:47.831 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-05-15T15:36:47.832 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-05-15T15:36:47.833 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib', 'fscrypt'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib', 'fscrypt']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '43296076bed1da2423ef68e9230eab60284d4c31', 'tag': None, 'wait_for_package': False} 2024-05-15T15:36:47.833 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=43296076bed1da2423ef68e9230eab60284d4c31 2024-05-15T15:36:47.836 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib', 'fscrypt'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib', 'fscrypt']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '43296076bed1da2423ef68e9230eab60284d4c31', 'tag': None, 'wait_for_package': False} 2024-05-15T15:36:47.837 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=43296076bed1da2423ef68e9230eab60284d4c31 2024-05-15T15:36:47.838 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib', 'fscrypt'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib', 'fscrypt']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '43296076bed1da2423ef68e9230eab60284d4c31', 'tag': None, 'wait_for_package': False} 2024-05-15T15:36:47.838 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=43296076bed1da2423ef68e9230eab60284d4c31 2024-05-15T15:36:47.992 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240515.023933-debug/43296076bed1da2423ef68e9230eab60284d4c31/centos/9/flavors/default/ 2024-05-15T15:36:47.992 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3709.g43296076 2024-05-15T15:36:47.996 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240515.023933-debug/43296076bed1da2423ef68e9230eab60284d4c31/centos/9/flavors/default/ 2024-05-15T15:36:47.996 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3709.g43296076 2024-05-15T15:36:48.071 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240515.023933-debug/43296076bed1da2423ef68e9230eab60284d4c31/centos/9/flavors/default/ 2024-05-15T15:36:48.072 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3709.g43296076 2024-05-15T15:36:48.109 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240515.023933-debug/43296076bed1da2423ef68e9230eab60284d4c31/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240515.023933-debug/43296076bed1da2423ef68e9230eab60284d4c31/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240515.023933-debug/43296076bed1da2423ef68e9230eab60284d4c31/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-15T15:36:48.110 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-05-15T15:36:48.110 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-15T15:36:48.134 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, fscrypt, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, fscrypt, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, fscrypt, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, fscrypt on remote rpm x86_64 2024-05-15T15:36:48.135 DEBUG:teuthology.orchestra.run.smithi084:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/43296076bed1da2423ef68e9230eab60284d4c31/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-15T15:36:48.175 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240515.023933-debug/43296076bed1da2423ef68e9230eab60284d4c31/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240515.023933-debug/43296076bed1da2423ef68e9230eab60284d4c31/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240515.023933-debug/43296076bed1da2423ef68e9230eab60284d4c31/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-15T15:36:48.175 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-05-15T15:36:48.175 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-15T15:36:48.195 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240515.023933-debug/43296076bed1da2423ef68e9230eab60284d4c31/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240515.023933-debug/43296076bed1da2423ef68e9230eab60284d4c31/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240515.023933-debug/43296076bed1da2423ef68e9230eab60284d4c31/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-15T15:36:48.195 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-05-15T15:36:48.195 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-15T15:36:48.199 DEBUG:teuthology.orchestra.run.smithi084:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-15T15:36:48.227 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, fscrypt, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, fscrypt, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, fscrypt, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, fscrypt, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, fscrypt on remote rpm x86_64 2024-05-15T15:36:48.227 DEBUG:teuthology.orchestra.run.smithi012:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/43296076bed1da2423ef68e9230eab60284d4c31/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-15T15:36:48.264 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, fscrypt, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, fscrypt, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, fscrypt, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, fscrypt, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, fscrypt, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, fscrypt on remote rpm x86_64 2024-05-15T15:36:48.264 DEBUG:teuthology.orchestra.run.smithi104:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/43296076bed1da2423ef68e9230eab60284d4c31/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-15T15:36:48.272 DEBUG:teuthology.orchestra.run.smithi084:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-15T15:36:48.293 DEBUG:teuthology.orchestra.run.smithi012:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-15T15:36:48.334 INFO:teuthology.orchestra.run.smithi084.stdout:check_obsoletes = 1 2024-05-15T15:36:48.336 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum clean all 2024-05-15T15:36:48.370 DEBUG:teuthology.orchestra.run.smithi012:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-15T15:36:48.392 DEBUG:teuthology.orchestra.run.smithi104:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-15T15:36:48.435 INFO:teuthology.orchestra.run.smithi012.stdout:check_obsoletes = 1 2024-05-15T15:36:48.437 DEBUG:teuthology.orchestra.run.smithi012:> sudo yum clean all 2024-05-15T15:36:48.501 DEBUG:teuthology.orchestra.run.smithi104:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-15T15:36:48.564 INFO:teuthology.orchestra.run.smithi084.stdout:57 files removed 2024-05-15T15:36:48.577 INFO:teuthology.orchestra.run.smithi104.stdout:check_obsoletes = 1 2024-05-15T15:36:48.581 DEBUG:teuthology.orchestra.run.smithi104:> sudo yum clean all 2024-05-15T15:36:48.591 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib fscrypt bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib fscrypt bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib fscrypt bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib fscrypt bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib fscrypt bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib fscrypt 2024-05-15T15:36:48.677 INFO:teuthology.orchestra.run.smithi012.stdout:57 files removed 2024-05-15T15:36:48.705 DEBUG:teuthology.orchestra.run.smithi012:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib fscrypt bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib fscrypt bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib fscrypt bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib fscrypt bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib fscrypt bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib fscrypt 2024-05-15T15:36:48.922 INFO:teuthology.orchestra.run.smithi104.stdout:57 files removed 2024-05-15T15:36:48.960 DEBUG:teuthology.orchestra.run.smithi104:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib fscrypt bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib fscrypt bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib fscrypt bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib fscrypt bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib fscrypt bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib fscrypt 2024-05-15T15:36:49.306 INFO:teuthology.orchestra.run.smithi084.stdout:ceph packages for x86_64 184 kB/s | 84 kB 00:00 2024-05-15T15:36:49.449 INFO:teuthology.orchestra.run.smithi012.stdout:ceph packages for x86_64 178 kB/s | 84 kB 00:00 2024-05-15T15:36:49.815 INFO:teuthology.orchestra.run.smithi084.stdout:ceph noarch packages 25 kB/s | 12 kB 00:00 2024-05-15T15:36:49.992 INFO:teuthology.orchestra.run.smithi012.stdout:ceph noarch packages 24 kB/s | 12 kB 00:00 2024-05-15T15:36:50.146 INFO:teuthology.orchestra.run.smithi104.stdout:ceph packages for x86_64 111 kB/s | 84 kB 00:00 2024-05-15T15:36:50.332 INFO:teuthology.orchestra.run.smithi084.stdout:ceph source packages 3.9 kB/s | 1.9 kB 00:00 2024-05-15T15:36:50.517 INFO:teuthology.orchestra.run.smithi012.stdout:ceph source packages 3.9 kB/s | 1.9 kB 00:00 2024-05-15T15:36:50.838 INFO:teuthology.orchestra.run.smithi104.stdout:ceph noarch packages 20 kB/s | 12 kB 00:00 2024-05-15T15:36:51.372 INFO:teuthology.orchestra.run.smithi104.stdout:ceph source packages 4.2 kB/s | 1.9 kB 00:00 2024-05-15T15:36:51.726 INFO:teuthology.orchestra.run.smithi012.stdout:CentOS Stream 9 - BaseOS 6.9 MB/s | 8.1 MB 00:01 2024-05-15T15:36:51.882 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS Stream 9 - BaseOS 5.3 MB/s | 8.1 MB 00:01 2024-05-15T15:36:53.585 INFO:teuthology.orchestra.run.smithi012.stdout:CentOS Stream 9 - AppStream 26 MB/s | 19 MB 00:00 2024-05-15T15:36:54.591 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS Stream 9 - AppStream 12 MB/s | 19 MB 00:01 2024-05-15T15:36:55.945 INFO:teuthology.orchestra.run.smithi104.stdout:CentOS Stream 9 - BaseOS 1.8 MB/s | 8.1 MB 00:04 2024-05-15T15:36:57.819 INFO:teuthology.orchestra.run.smithi012.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.2 MB 00:00 2024-05-15T15:36:58.084 INFO:teuthology.orchestra.run.smithi104.stdout:CentOS Stream 9 - AppStream 21 MB/s | 19 MB 00:00 2024-05-15T15:36:59.142 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS Stream 9 - CRB 6.4 MB/s | 6.2 MB 00:00 2024-05-15T15:37:00.136 INFO:teuthology.orchestra.run.smithi012.stdout:CentOS Stream 9 - Extras packages 15 kB/s | 16 kB 00:01 2024-05-15T15:37:00.592 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS Stream 9 - Extras packages 58 kB/s | 16 kB 00:00 2024-05-15T15:37:02.172 INFO:teuthology.orchestra.run.smithi084.stdout:Extra Packages for Enterprise Linux 15 MB/s | 21 MB 00:01 2024-05-15T15:37:02.671 INFO:teuthology.orchestra.run.smithi104.stdout:CentOS Stream 9 - CRB 9.8 MB/s | 6.2 MB 00:00 2024-05-15T15:37:04.121 INFO:teuthology.orchestra.run.smithi012.stdout:Extra Packages for Enterprise Linux 5.5 MB/s | 21 MB 00:03 2024-05-15T15:37:04.830 INFO:teuthology.orchestra.run.smithi104.stdout:CentOS Stream 9 - Extras packages 21 kB/s | 16 kB 00:00 2024-05-15T15:37:06.677 INFO:teuthology.orchestra.run.smithi104.stdout:Extra Packages for Enterprise Linux 13 MB/s | 21 MB 00:01 2024-05-15T15:37:07.335 INFO:teuthology.orchestra.run.smithi084.stdout:lab-extras 17 kB/s | 1.7 kB 00:00 2024-05-15T15:37:09.429 INFO:teuthology.orchestra.run.smithi012.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-05-15T15:37:09.669 INFO:teuthology.orchestra.run.smithi084.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-15T15:37:09.670 INFO:teuthology.orchestra.run.smithi084.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-15T15:37:09.681 INFO:teuthology.orchestra.run.smithi084.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-05-15T15:37:09.681 INFO:teuthology.orchestra.run.smithi084.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-05-15T15:37:09.682 INFO:teuthology.orchestra.run.smithi084.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-05-15T15:37:09.683 INFO:teuthology.orchestra.run.smithi084.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-05-15T15:37:09.685 INFO:teuthology.orchestra.run.smithi084.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-05-15T15:37:09.687 INFO:teuthology.orchestra.run.smithi084.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-05-15T15:37:09.688 INFO:teuthology.orchestra.run.smithi084.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-05-15T15:37:09.749 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2024-05-15T15:37:09.764 INFO:teuthology.orchestra.run.smithi084.stdout:======================================================================================= 2024-05-15T15:37:09.764 INFO:teuthology.orchestra.run.smithi084.stdout: Package Arch Version Repository Size 2024-05-15T15:37:09.764 INFO:teuthology.orchestra.run.smithi084.stdout:======================================================================================= 2024-05-15T15:37:09.764 INFO:teuthology.orchestra.run.smithi084.stdout:Installing: 2024-05-15T15:37:09.765 INFO:teuthology.orchestra.run.smithi084.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-05-15T15:37:09.765 INFO:teuthology.orchestra.run.smithi084.stdout: ceph x86_64 2:19.0.0-3709.g43296076.el9 ceph 6.6 k 2024-05-15T15:37:09.765 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-base x86_64 2:19.0.0-3709.g43296076.el9 ceph 5.4 M 2024-05-15T15:37:09.765 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-fuse x86_64 2:19.0.0-3709.g43296076.el9 ceph 863 k 2024-05-15T15:37:09.765 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3709.g43296076.el9 ceph 147 k 2024-05-15T15:37:09.765 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr x86_64 2:19.0.0-3709.g43296076.el9 ceph 1.5 M 2024-05-15T15:37:09.765 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3709.g43296076.el9 ceph-noarch 143 k 2024-05-15T15:37:09.765 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3709.g43296076.el9 ceph-noarch 3.5 M 2024-05-15T15:37:09.765 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3709.g43296076.el9 ceph-noarch 7.4 M 2024-05-15T15:37:09.765 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-rook noarch 2:19.0.0-3709.g43296076.el9 ceph-noarch 49 k 2024-05-15T15:37:09.765 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-radosgw x86_64 2:19.0.0-3709.g43296076.el9 ceph 10 M 2024-05-15T15:37:09.765 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-test x86_64 2:19.0.0-3709.g43296076.el9 ceph 43 M 2024-05-15T15:37:09.766 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-volume noarch 2:19.0.0-3709.g43296076.el9 ceph-noarch 273 k 2024-05-15T15:37:09.766 INFO:teuthology.orchestra.run.smithi084.stdout: cephadm noarch 2:19.0.0-3709.g43296076.el9 ceph-noarch 763 k 2024-05-15T15:37:09.766 INFO:teuthology.orchestra.run.smithi084.stdout: cephfs-mirror x86_64 2:19.0.0-3709.g43296076.el9 ceph 224 k 2024-05-15T15:37:09.766 INFO:teuthology.orchestra.run.smithi084.stdout: cephfs-shell x86_64 2:19.0.0-3709.g43296076.el9 ceph 27 k 2024-05-15T15:37:09.766 INFO:teuthology.orchestra.run.smithi084.stdout: cephfs-top noarch 2:19.0.0-3709.g43296076.el9 ceph-noarch 18 k 2024-05-15T15:37:09.766 INFO:teuthology.orchestra.run.smithi084.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-05-15T15:37:09.766 INFO:teuthology.orchestra.run.smithi084.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-05-15T15:37:09.766 INFO:teuthology.orchestra.run.smithi084.stdout: fscrypt x86_64 0.3.4-2.el9 epel 2.0 M 2024-05-15T15:37:09.766 INFO:teuthology.orchestra.run.smithi084.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-05-15T15:37:09.766 INFO:teuthology.orchestra.run.smithi084.stdout: libcephfs-devel x86_64 2:19.0.0-3709.g43296076.el9 ceph 32 k 2024-05-15T15:37:09.766 INFO:teuthology.orchestra.run.smithi084.stdout: libcephfs2 x86_64 2:19.0.0-3709.g43296076.el9 ceph 756 k 2024-05-15T15:37:09.767 INFO:teuthology.orchestra.run.smithi084.stdout: librados-devel x86_64 2:19.0.0-3709.g43296076.el9 ceph 127 k 2024-05-15T15:37:09.767 INFO:teuthology.orchestra.run.smithi084.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-05-15T15:37:09.767 INFO:teuthology.orchestra.run.smithi084.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-05-15T15:37:09.767 INFO:teuthology.orchestra.run.smithi084.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-05-15T15:37:09.767 INFO:teuthology.orchestra.run.smithi084.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-05-15T15:37:09.767 INFO:teuthology.orchestra.run.smithi084.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-05-15T15:37:09.767 INFO:teuthology.orchestra.run.smithi084.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-05-15T15:37:09.767 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cephfs x86_64 2:19.0.0-3709.g43296076.el9 ceph 162 k 2024-05-15T15:37:09.767 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rados x86_64 2:19.0.0-3709.g43296076.el9 ceph 320 k 2024-05-15T15:37:09.767 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rbd x86_64 2:19.0.0-3709.g43296076.el9 ceph 300 k 2024-05-15T15:37:09.767 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rgw x86_64 2:19.0.0-3709.g43296076.el9 ceph 99 k 2024-05-15T15:37:09.767 INFO:teuthology.orchestra.run.smithi084.stdout: rbd-fuse x86_64 2:19.0.0-3709.g43296076.el9 ceph 86 k 2024-05-15T15:37:09.768 INFO:teuthology.orchestra.run.smithi084.stdout: rbd-mirror x86_64 2:19.0.0-3709.g43296076.el9 ceph 3.0 M 2024-05-15T15:37:09.768 INFO:teuthology.orchestra.run.smithi084.stdout: rbd-nbd x86_64 2:19.0.0-3709.g43296076.el9 ceph 169 k 2024-05-15T15:37:09.768 INFO:teuthology.orchestra.run.smithi084.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-05-15T15:37:09.768 INFO:teuthology.orchestra.run.smithi084.stdout:Upgrading: 2024-05-15T15:37:09.768 INFO:teuthology.orchestra.run.smithi084.stdout: NetworkManager x86_64 1:1.47.90-1.el9 baseos 2.3 M 2024-05-15T15:37:09.768 INFO:teuthology.orchestra.run.smithi084.stdout: NetworkManager-libnm x86_64 1:1.47.90-1.el9 baseos 1.8 M 2024-05-15T15:37:09.768 INFO:teuthology.orchestra.run.smithi084.stdout: NetworkManager-team x86_64 1:1.47.90-1.el9 baseos 41 k 2024-05-15T15:37:09.768 INFO:teuthology.orchestra.run.smithi084.stdout: NetworkManager-tui x86_64 1:1.47.90-1.el9 baseos 248 k 2024-05-15T15:37:09.768 INFO:teuthology.orchestra.run.smithi084.stdout: librados2 x86_64 2:19.0.0-3709.g43296076.el9 ceph 3.3 M 2024-05-15T15:37:09.768 INFO:teuthology.orchestra.run.smithi084.stdout: librbd1 x86_64 2:19.0.0-3709.g43296076.el9 ceph 3.1 M 2024-05-15T15:37:09.768 INFO:teuthology.orchestra.run.smithi084.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-05-15T15:37:09.768 INFO:teuthology.orchestra.run.smithi084.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-05-15T15:37:09.769 INFO:teuthology.orchestra.run.smithi084.stdout:Installing dependencies: 2024-05-15T15:37:09.769 INFO:teuthology.orchestra.run.smithi084.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-05-15T15:37:09.769 INFO:teuthology.orchestra.run.smithi084.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-05-15T15:37:09.769 INFO:teuthology.orchestra.run.smithi084.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-15T15:37:09.769 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-common x86_64 2:19.0.0-3709.g43296076.el9 ceph 20 M 2024-05-15T15:37:09.769 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3709.g43296076.el9 ceph-noarch 34 k 2024-05-15T15:37:09.769 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mds x86_64 2:19.0.0-3709.g43296076.el9 ceph 2.3 M 2024-05-15T15:37:09.769 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3709.g43296076.el9 ceph-noarch 274 k 2024-05-15T15:37:09.769 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mon x86_64 2:19.0.0-3709.g43296076.el9 ceph 4.9 M 2024-05-15T15:37:09.769 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-osd x86_64 2:19.0.0-3709.g43296076.el9 ceph 18 M 2024-05-15T15:37:09.769 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3709.g43296076.el9 ceph-noarch 16 k 2024-05-15T15:37:09.769 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-selinux x86_64 2:19.0.0-3709.g43296076.el9 ceph 25 k 2024-05-15T15:37:09.770 INFO:teuthology.orchestra.run.smithi084.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-15T15:37:09.770 INFO:teuthology.orchestra.run.smithi084.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-15T15:37:09.770 INFO:teuthology.orchestra.run.smithi084.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-15T15:37:09.770 INFO:teuthology.orchestra.run.smithi084.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-15T15:37:09.770 INFO:teuthology.orchestra.run.smithi084.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-15T15:37:09.770 INFO:teuthology.orchestra.run.smithi084.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-05-15T15:37:09.770 INFO:teuthology.orchestra.run.smithi084.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-15T15:37:09.770 INFO:teuthology.orchestra.run.smithi084.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-15T15:37:09.770 INFO:teuthology.orchestra.run.smithi084.stdout: libcephsqlite x86_64 2:19.0.0-3709.g43296076.el9 ceph 157 k 2024-05-15T15:37:09.770 INFO:teuthology.orchestra.run.smithi084.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-15T15:37:09.770 INFO:teuthology.orchestra.run.smithi084.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-15T15:37:09.770 INFO:teuthology.orchestra.run.smithi084.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-15T15:37:09.771 INFO:teuthology.orchestra.run.smithi084.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-15T15:37:09.771 INFO:teuthology.orchestra.run.smithi084.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-15T15:37:09.771 INFO:teuthology.orchestra.run.smithi084.stdout: libradosstriper1 x86_64 2:19.0.0-3709.g43296076.el9 ceph 497 k 2024-05-15T15:37:09.771 INFO:teuthology.orchestra.run.smithi084.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-15T15:37:09.771 INFO:teuthology.orchestra.run.smithi084.stdout: librgw2 x86_64 2:19.0.0-3709.g43296076.el9 ceph 5.2 M 2024-05-15T15:37:09.771 INFO:teuthology.orchestra.run.smithi084.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-15T15:37:09.771 INFO:teuthology.orchestra.run.smithi084.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-05-15T15:37:09.771 INFO:teuthology.orchestra.run.smithi084.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-15T15:37:09.771 INFO:teuthology.orchestra.run.smithi084.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-05-15T15:37:09.771 INFO:teuthology.orchestra.run.smithi084.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-05-15T15:37:09.771 INFO:teuthology.orchestra.run.smithi084.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-05-15T15:37:09.771 INFO:teuthology.orchestra.run.smithi084.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-15T15:37:09.771 INFO:teuthology.orchestra.run.smithi084.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-15T15:37:09.772 INFO:teuthology.orchestra.run.smithi084.stdout: pam_fscrypt x86_64 0.3.4-2.el9 epel 1.8 M 2024-05-15T15:37:09.772 INFO:teuthology.orchestra.run.smithi084.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-15T15:37:09.772 INFO:teuthology.orchestra.run.smithi084.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-05-15T15:37:09.772 INFO:teuthology.orchestra.run.smithi084.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-05-15T15:37:09.772 INFO:teuthology.orchestra.run.smithi084.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-05-15T15:37:09.772 INFO:teuthology.orchestra.run.smithi084.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-15T15:37:09.772 INFO:teuthology.orchestra.run.smithi084.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-05-15T15:37:09.772 INFO:teuthology.orchestra.run.smithi084.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-15T15:37:09.772 INFO:teuthology.orchestra.run.smithi084.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-15T15:37:09.772 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-15T15:37:09.772 INFO:teuthology.orchestra.run.smithi084.stdout: python3-ceph-argparse x86_64 2:19.0.0-3709.g43296076.el9 ceph 45 k 2024-05-15T15:37:09.772 INFO:teuthology.orchestra.run.smithi084.stdout: python3-ceph-common x86_64 2:19.0.0-3709.g43296076.el9 ceph 136 k 2024-05-15T15:37:09.772 INFO:teuthology.orchestra.run.smithi084.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-15T15:37:09.773 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-15T15:37:09.773 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-15T15:37:09.773 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-15T15:37:09.773 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-05-15T15:37:09.773 INFO:teuthology.orchestra.run.smithi084.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-05-15T15:37:09.773 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-15T15:37:09.773 INFO:teuthology.orchestra.run.smithi084.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-15T15:37:09.773 INFO:teuthology.orchestra.run.smithi084.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-15T15:37:09.774 INFO:teuthology.orchestra.run.smithi084.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-05-15T15:37:09.774 INFO:teuthology.orchestra.run.smithi084.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-05-15T15:37:09.774 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-15T15:37:09.774 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-15T15:37:09.774 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-05-15T15:37:09.774 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-15T15:37:09.774 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-15T15:37:09.774 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-05-15T15:37:09.774 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-15T15:37:09.774 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-15T15:37:09.774 INFO:teuthology.orchestra.run.smithi084.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-15T15:37:09.775 INFO:teuthology.orchestra.run.smithi084.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-15T15:37:09.775 INFO:teuthology.orchestra.run.smithi084.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-15T15:37:09.775 INFO:teuthology.orchestra.run.smithi084.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-15T15:37:09.775 INFO:teuthology.orchestra.run.smithi084.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-15T15:37:09.775 INFO:teuthology.orchestra.run.smithi084.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-15T15:37:09.775 INFO:teuthology.orchestra.run.smithi084.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-15T15:37:09.775 INFO:teuthology.orchestra.run.smithi084.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-15T15:37:09.775 INFO:teuthology.orchestra.run.smithi084.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-15T15:37:09.775 INFO:teuthology.orchestra.run.smithi084.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-05-15T15:37:09.775 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-15T15:37:09.775 INFO:teuthology.orchestra.run.smithi084.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-15T15:37:09.775 INFO:teuthology.orchestra.run.smithi084.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-15T15:37:09.775 INFO:teuthology.orchestra.run.smithi084.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-15T15:37:09.776 INFO:teuthology.orchestra.run.smithi084.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-05-15T15:37:09.776 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-15T15:37:09.776 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-15T15:37:09.776 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-15T15:37:09.776 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-15T15:37:09.776 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-05-15T15:37:09.776 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-15T15:37:09.776 INFO:teuthology.orchestra.run.smithi084.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-15T15:37:09.776 INFO:teuthology.orchestra.run.smithi084.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-15T15:37:09.776 INFO:teuthology.orchestra.run.smithi084.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-15T15:37:09.776 INFO:teuthology.orchestra.run.smithi084.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-15T15:37:09.776 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-15T15:37:09.776 INFO:teuthology.orchestra.run.smithi084.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-15T15:37:09.777 INFO:teuthology.orchestra.run.smithi084.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-15T15:37:09.777 INFO:teuthology.orchestra.run.smithi084.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-15T15:37:09.777 INFO:teuthology.orchestra.run.smithi084.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-15T15:37:09.777 INFO:teuthology.orchestra.run.smithi084.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-15T15:37:09.777 INFO:teuthology.orchestra.run.smithi084.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-05-15T15:37:09.777 INFO:teuthology.orchestra.run.smithi084.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-15T15:37:09.777 INFO:teuthology.orchestra.run.smithi084.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-15T15:37:09.777 INFO:teuthology.orchestra.run.smithi084.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-15T15:37:09.777 INFO:teuthology.orchestra.run.smithi084.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-15T15:37:09.777 INFO:teuthology.orchestra.run.smithi084.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-05-15T15:37:09.777 INFO:teuthology.orchestra.run.smithi084.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-05-15T15:37:09.777 INFO:teuthology.orchestra.run.smithi084.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-15T15:37:09.778 INFO:teuthology.orchestra.run.smithi084.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-15T15:37:09.778 INFO:teuthology.orchestra.run.smithi084.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-15T15:37:09.778 INFO:teuthology.orchestra.run.smithi084.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-05-15T15:37:09.778 INFO:teuthology.orchestra.run.smithi084.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-15T15:37:09.778 INFO:teuthology.orchestra.run.smithi084.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-05-15T15:37:09.778 INFO:teuthology.orchestra.run.smithi084.stdout:Installing weak dependencies: 2024-05-15T15:37:09.778 INFO:teuthology.orchestra.run.smithi084.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-05-15T15:37:09.778 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-05-15T15:37:09.778 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction Summary 2024-05-15T15:37:09.778 INFO:teuthology.orchestra.run.smithi084.stdout:======================================================================================= 2024-05-15T15:37:09.778 INFO:teuthology.orchestra.run.smithi084.stdout:Install 150 Packages 2024-05-15T15:37:09.778 INFO:teuthology.orchestra.run.smithi084.stdout:Upgrade 8 Packages 2024-05-15T15:37:09.778 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-05-15T15:37:09.779 INFO:teuthology.orchestra.run.smithi084.stdout:Total download size: 223 M 2024-05-15T15:37:09.779 INFO:teuthology.orchestra.run.smithi084.stdout:Downloading Packages: 2024-05-15T15:37:10.936 INFO:teuthology.orchestra.run.smithi084.stdout:(1/158): ceph-19.0.0-3709.g43296076.el9.x86_64. 24 kB/s | 6.6 kB 00:00 2024-05-15T15:37:11.211 INFO:teuthology.orchestra.run.smithi084.stdout:(2/158): ceph-base-19.0.0-3709.g43296076.el9.x8 9.7 MB/s | 5.4 MB 00:00 2024-05-15T15:37:11.295 INFO:teuthology.orchestra.run.smithi084.stdout:(3/158): ceph-immutable-object-cache-19.0.0-370 1.7 MB/s | 147 kB 00:00 2024-05-15T15:37:11.453 INFO:teuthology.orchestra.run.smithi084.stdout:(4/158): ceph-mds-19.0.0-3709.g43296076.el9.x86 14 MB/s | 2.3 MB 00:00 2024-05-15T15:37:11.528 INFO:teuthology.orchestra.run.smithi084.stdout:(5/158): ceph-fuse-19.0.0-3709.g43296076.el9.x8 1.4 MB/s | 863 kB 00:00 2024-05-15T15:37:11.570 INFO:teuthology.orchestra.run.smithi084.stdout:(6/158): ceph-mgr-19.0.0-3709.g43296076.el9.x86 13 MB/s | 1.5 MB 00:00 2024-05-15T15:37:11.781 INFO:teuthology.orchestra.run.smithi012.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-15T15:37:11.781 INFO:teuthology.orchestra.run.smithi012.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-15T15:37:11.793 INFO:teuthology.orchestra.run.smithi012.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-05-15T15:37:11.794 INFO:teuthology.orchestra.run.smithi012.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-05-15T15:37:11.794 INFO:teuthology.orchestra.run.smithi012.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-05-15T15:37:11.795 INFO:teuthology.orchestra.run.smithi012.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-05-15T15:37:11.797 INFO:teuthology.orchestra.run.smithi012.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-05-15T15:37:11.799 INFO:teuthology.orchestra.run.smithi012.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-05-15T15:37:11.800 INFO:teuthology.orchestra.run.smithi012.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-05-15T15:37:11.865 INFO:teuthology.orchestra.run.smithi012.stdout:Dependencies resolved. 2024-05-15T15:37:11.887 INFO:teuthology.orchestra.run.smithi012.stdout:======================================================================================= 2024-05-15T15:37:11.887 INFO:teuthology.orchestra.run.smithi012.stdout: Package Arch Version Repository Size 2024-05-15T15:37:11.887 INFO:teuthology.orchestra.run.smithi012.stdout:======================================================================================= 2024-05-15T15:37:11.887 INFO:teuthology.orchestra.run.smithi012.stdout:Installing: 2024-05-15T15:37:11.887 INFO:teuthology.orchestra.run.smithi012.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-05-15T15:37:11.888 INFO:teuthology.orchestra.run.smithi012.stdout: ceph x86_64 2:19.0.0-3709.g43296076.el9 ceph 6.6 k 2024-05-15T15:37:11.888 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-base x86_64 2:19.0.0-3709.g43296076.el9 ceph 5.4 M 2024-05-15T15:37:11.888 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-fuse x86_64 2:19.0.0-3709.g43296076.el9 ceph 863 k 2024-05-15T15:37:11.888 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3709.g43296076.el9 ceph 147 k 2024-05-15T15:37:11.888 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr x86_64 2:19.0.0-3709.g43296076.el9 ceph 1.5 M 2024-05-15T15:37:11.888 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3709.g43296076.el9 ceph-noarch 143 k 2024-05-15T15:37:11.888 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3709.g43296076.el9 ceph-noarch 3.5 M 2024-05-15T15:37:11.888 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3709.g43296076.el9 ceph-noarch 7.4 M 2024-05-15T15:37:11.888 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-rook noarch 2:19.0.0-3709.g43296076.el9 ceph-noarch 49 k 2024-05-15T15:37:11.888 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-radosgw x86_64 2:19.0.0-3709.g43296076.el9 ceph 10 M 2024-05-15T15:37:11.888 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-test x86_64 2:19.0.0-3709.g43296076.el9 ceph 43 M 2024-05-15T15:37:11.888 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-volume noarch 2:19.0.0-3709.g43296076.el9 ceph-noarch 273 k 2024-05-15T15:37:11.888 INFO:teuthology.orchestra.run.smithi012.stdout: cephadm noarch 2:19.0.0-3709.g43296076.el9 ceph-noarch 763 k 2024-05-15T15:37:11.889 INFO:teuthology.orchestra.run.smithi012.stdout: cephfs-mirror x86_64 2:19.0.0-3709.g43296076.el9 ceph 224 k 2024-05-15T15:37:11.889 INFO:teuthology.orchestra.run.smithi012.stdout: cephfs-shell x86_64 2:19.0.0-3709.g43296076.el9 ceph 27 k 2024-05-15T15:37:11.889 INFO:teuthology.orchestra.run.smithi012.stdout: cephfs-top noarch 2:19.0.0-3709.g43296076.el9 ceph-noarch 18 k 2024-05-15T15:37:11.889 INFO:teuthology.orchestra.run.smithi012.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-05-15T15:37:11.889 INFO:teuthology.orchestra.run.smithi012.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-05-15T15:37:11.889 INFO:teuthology.orchestra.run.smithi012.stdout: fscrypt x86_64 0.3.4-2.el9 epel 2.0 M 2024-05-15T15:37:11.889 INFO:teuthology.orchestra.run.smithi012.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-05-15T15:37:11.889 INFO:teuthology.orchestra.run.smithi012.stdout: libcephfs-devel x86_64 2:19.0.0-3709.g43296076.el9 ceph 32 k 2024-05-15T15:37:11.889 INFO:teuthology.orchestra.run.smithi012.stdout: libcephfs2 x86_64 2:19.0.0-3709.g43296076.el9 ceph 756 k 2024-05-15T15:37:11.889 INFO:teuthology.orchestra.run.smithi012.stdout: librados-devel x86_64 2:19.0.0-3709.g43296076.el9 ceph 127 k 2024-05-15T15:37:11.889 INFO:teuthology.orchestra.run.smithi012.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-05-15T15:37:11.889 INFO:teuthology.orchestra.run.smithi012.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-05-15T15:37:11.889 INFO:teuthology.orchestra.run.smithi012.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-05-15T15:37:11.890 INFO:teuthology.orchestra.run.smithi012.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-05-15T15:37:11.890 INFO:teuthology.orchestra.run.smithi012.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-05-15T15:37:11.890 INFO:teuthology.orchestra.run.smithi012.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-05-15T15:37:11.890 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cephfs x86_64 2:19.0.0-3709.g43296076.el9 ceph 162 k 2024-05-15T15:37:11.890 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rados x86_64 2:19.0.0-3709.g43296076.el9 ceph 320 k 2024-05-15T15:37:11.890 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rbd x86_64 2:19.0.0-3709.g43296076.el9 ceph 300 k 2024-05-15T15:37:11.890 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rgw x86_64 2:19.0.0-3709.g43296076.el9 ceph 99 k 2024-05-15T15:37:11.890 INFO:teuthology.orchestra.run.smithi012.stdout: rbd-fuse x86_64 2:19.0.0-3709.g43296076.el9 ceph 86 k 2024-05-15T15:37:11.890 INFO:teuthology.orchestra.run.smithi012.stdout: rbd-mirror x86_64 2:19.0.0-3709.g43296076.el9 ceph 3.0 M 2024-05-15T15:37:11.890 INFO:teuthology.orchestra.run.smithi012.stdout: rbd-nbd x86_64 2:19.0.0-3709.g43296076.el9 ceph 169 k 2024-05-15T15:37:11.890 INFO:teuthology.orchestra.run.smithi012.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-05-15T15:37:11.890 INFO:teuthology.orchestra.run.smithi012.stdout:Upgrading: 2024-05-15T15:37:11.891 INFO:teuthology.orchestra.run.smithi012.stdout: NetworkManager x86_64 1:1.47.90-1.el9 baseos 2.3 M 2024-05-15T15:37:11.891 INFO:teuthology.orchestra.run.smithi012.stdout: NetworkManager-libnm x86_64 1:1.47.90-1.el9 baseos 1.8 M 2024-05-15T15:37:11.891 INFO:teuthology.orchestra.run.smithi012.stdout: NetworkManager-team x86_64 1:1.47.90-1.el9 baseos 41 k 2024-05-15T15:37:11.891 INFO:teuthology.orchestra.run.smithi012.stdout: NetworkManager-tui x86_64 1:1.47.90-1.el9 baseos 248 k 2024-05-15T15:37:11.891 INFO:teuthology.orchestra.run.smithi012.stdout: librados2 x86_64 2:19.0.0-3709.g43296076.el9 ceph 3.3 M 2024-05-15T15:37:11.891 INFO:teuthology.orchestra.run.smithi012.stdout: librbd1 x86_64 2:19.0.0-3709.g43296076.el9 ceph 3.1 M 2024-05-15T15:37:11.891 INFO:teuthology.orchestra.run.smithi012.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-05-15T15:37:11.891 INFO:teuthology.orchestra.run.smithi012.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-05-15T15:37:11.891 INFO:teuthology.orchestra.run.smithi012.stdout:Installing dependencies: 2024-05-15T15:37:11.891 INFO:teuthology.orchestra.run.smithi012.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-05-15T15:37:11.891 INFO:teuthology.orchestra.run.smithi012.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-05-15T15:37:11.891 INFO:teuthology.orchestra.run.smithi012.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-15T15:37:11.891 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-common x86_64 2:19.0.0-3709.g43296076.el9 ceph 20 M 2024-05-15T15:37:11.892 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3709.g43296076.el9 ceph-noarch 34 k 2024-05-15T15:37:11.892 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mds x86_64 2:19.0.0-3709.g43296076.el9 ceph 2.3 M 2024-05-15T15:37:11.892 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3709.g43296076.el9 ceph-noarch 274 k 2024-05-15T15:37:11.892 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mon x86_64 2:19.0.0-3709.g43296076.el9 ceph 4.9 M 2024-05-15T15:37:11.892 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-osd x86_64 2:19.0.0-3709.g43296076.el9 ceph 18 M 2024-05-15T15:37:11.892 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3709.g43296076.el9 ceph-noarch 16 k 2024-05-15T15:37:11.892 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-selinux x86_64 2:19.0.0-3709.g43296076.el9 ceph 25 k 2024-05-15T15:37:11.892 INFO:teuthology.orchestra.run.smithi012.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-15T15:37:11.892 INFO:teuthology.orchestra.run.smithi012.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-15T15:37:11.892 INFO:teuthology.orchestra.run.smithi012.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-15T15:37:11.892 INFO:teuthology.orchestra.run.smithi012.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-15T15:37:11.892 INFO:teuthology.orchestra.run.smithi012.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-15T15:37:11.892 INFO:teuthology.orchestra.run.smithi012.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-05-15T15:37:11.892 INFO:teuthology.orchestra.run.smithi012.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-15T15:37:11.893 INFO:teuthology.orchestra.run.smithi012.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-15T15:37:11.893 INFO:teuthology.orchestra.run.smithi012.stdout: libcephsqlite x86_64 2:19.0.0-3709.g43296076.el9 ceph 157 k 2024-05-15T15:37:11.893 INFO:teuthology.orchestra.run.smithi012.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-15T15:37:11.893 INFO:teuthology.orchestra.run.smithi012.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-15T15:37:11.893 INFO:teuthology.orchestra.run.smithi012.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-15T15:37:11.893 INFO:teuthology.orchestra.run.smithi012.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-15T15:37:11.893 INFO:teuthology.orchestra.run.smithi012.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-15T15:37:11.893 INFO:teuthology.orchestra.run.smithi012.stdout: libradosstriper1 x86_64 2:19.0.0-3709.g43296076.el9 ceph 497 k 2024-05-15T15:37:11.893 INFO:teuthology.orchestra.run.smithi012.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-15T15:37:11.893 INFO:teuthology.orchestra.run.smithi012.stdout: librgw2 x86_64 2:19.0.0-3709.g43296076.el9 ceph 5.2 M 2024-05-15T15:37:11.893 INFO:teuthology.orchestra.run.smithi012.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-15T15:37:11.893 INFO:teuthology.orchestra.run.smithi012.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-05-15T15:37:11.893 INFO:teuthology.orchestra.run.smithi012.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-15T15:37:11.894 INFO:teuthology.orchestra.run.smithi012.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-05-15T15:37:11.894 INFO:teuthology.orchestra.run.smithi012.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-05-15T15:37:11.894 INFO:teuthology.orchestra.run.smithi012.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-05-15T15:37:11.894 INFO:teuthology.orchestra.run.smithi012.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-15T15:37:11.894 INFO:teuthology.orchestra.run.smithi012.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-15T15:37:11.894 INFO:teuthology.orchestra.run.smithi012.stdout: pam_fscrypt x86_64 0.3.4-2.el9 epel 1.8 M 2024-05-15T15:37:11.894 INFO:teuthology.orchestra.run.smithi012.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-15T15:37:11.894 INFO:teuthology.orchestra.run.smithi012.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-05-15T15:37:11.894 INFO:teuthology.orchestra.run.smithi012.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-05-15T15:37:11.894 INFO:teuthology.orchestra.run.smithi012.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-05-15T15:37:11.894 INFO:teuthology.orchestra.run.smithi012.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-15T15:37:11.894 INFO:teuthology.orchestra.run.smithi012.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-05-15T15:37:11.894 INFO:teuthology.orchestra.run.smithi012.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-15T15:37:11.895 INFO:teuthology.orchestra.run.smithi012.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-15T15:37:11.895 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-15T15:37:11.895 INFO:teuthology.orchestra.run.smithi012.stdout: python3-ceph-argparse x86_64 2:19.0.0-3709.g43296076.el9 ceph 45 k 2024-05-15T15:37:11.895 INFO:teuthology.orchestra.run.smithi012.stdout: python3-ceph-common x86_64 2:19.0.0-3709.g43296076.el9 ceph 136 k 2024-05-15T15:37:11.895 INFO:teuthology.orchestra.run.smithi012.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-15T15:37:11.895 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-15T15:37:11.895 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-15T15:37:11.895 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-15T15:37:11.895 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-05-15T15:37:11.895 INFO:teuthology.orchestra.run.smithi012.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-05-15T15:37:11.895 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-15T15:37:11.895 INFO:teuthology.orchestra.run.smithi012.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-15T15:37:11.895 INFO:teuthology.orchestra.run.smithi012.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-15T15:37:11.896 INFO:teuthology.orchestra.run.smithi012.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-05-15T15:37:11.896 INFO:teuthology.orchestra.run.smithi012.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-05-15T15:37:11.896 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-15T15:37:11.896 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-15T15:37:11.896 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-05-15T15:37:11.896 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-15T15:37:11.896 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-15T15:37:11.896 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-05-15T15:37:11.896 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-15T15:37:11.896 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-15T15:37:11.896 INFO:teuthology.orchestra.run.smithi012.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-15T15:37:11.896 INFO:teuthology.orchestra.run.smithi012.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-15T15:37:11.896 INFO:teuthology.orchestra.run.smithi012.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-15T15:37:11.897 INFO:teuthology.orchestra.run.smithi012.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-15T15:37:11.897 INFO:teuthology.orchestra.run.smithi012.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-15T15:37:11.897 INFO:teuthology.orchestra.run.smithi012.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-15T15:37:11.897 INFO:teuthology.orchestra.run.smithi012.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-15T15:37:11.897 INFO:teuthology.orchestra.run.smithi012.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-15T15:37:11.897 INFO:teuthology.orchestra.run.smithi012.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-15T15:37:11.897 INFO:teuthology.orchestra.run.smithi012.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-05-15T15:37:11.897 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-15T15:37:11.897 INFO:teuthology.orchestra.run.smithi012.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-15T15:37:11.897 INFO:teuthology.orchestra.run.smithi012.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-15T15:37:11.897 INFO:teuthology.orchestra.run.smithi012.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-15T15:37:11.897 INFO:teuthology.orchestra.run.smithi012.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-05-15T15:37:11.897 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-15T15:37:11.897 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-15T15:37:11.898 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-15T15:37:11.898 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-15T15:37:11.898 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-05-15T15:37:11.898 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-15T15:37:11.898 INFO:teuthology.orchestra.run.smithi012.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-15T15:37:11.898 INFO:teuthology.orchestra.run.smithi012.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-15T15:37:11.898 INFO:teuthology.orchestra.run.smithi012.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-15T15:37:11.898 INFO:teuthology.orchestra.run.smithi012.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-15T15:37:11.898 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-15T15:37:11.898 INFO:teuthology.orchestra.run.smithi012.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-15T15:37:11.898 INFO:teuthology.orchestra.run.smithi012.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-15T15:37:11.898 INFO:teuthology.orchestra.run.smithi012.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-15T15:37:11.898 INFO:teuthology.orchestra.run.smithi012.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-15T15:37:11.898 INFO:teuthology.orchestra.run.smithi012.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-15T15:37:11.899 INFO:teuthology.orchestra.run.smithi012.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-05-15T15:37:11.899 INFO:teuthology.orchestra.run.smithi012.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-15T15:37:11.899 INFO:teuthology.orchestra.run.smithi012.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-15T15:37:11.899 INFO:teuthology.orchestra.run.smithi012.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-15T15:37:11.899 INFO:teuthology.orchestra.run.smithi012.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-15T15:37:11.899 INFO:teuthology.orchestra.run.smithi012.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-05-15T15:37:11.899 INFO:teuthology.orchestra.run.smithi012.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-05-15T15:37:11.899 INFO:teuthology.orchestra.run.smithi012.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-15T15:37:11.899 INFO:teuthology.orchestra.run.smithi012.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-15T15:37:11.899 INFO:teuthology.orchestra.run.smithi012.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-15T15:37:11.899 INFO:teuthology.orchestra.run.smithi012.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-05-15T15:37:11.899 INFO:teuthology.orchestra.run.smithi012.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-15T15:37:11.899 INFO:teuthology.orchestra.run.smithi012.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-05-15T15:37:11.899 INFO:teuthology.orchestra.run.smithi012.stdout:Installing weak dependencies: 2024-05-15T15:37:11.900 INFO:teuthology.orchestra.run.smithi012.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-05-15T15:37:11.900 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-05-15T15:37:11.900 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction Summary 2024-05-15T15:37:11.900 INFO:teuthology.orchestra.run.smithi012.stdout:======================================================================================= 2024-05-15T15:37:11.900 INFO:teuthology.orchestra.run.smithi012.stdout:Install 150 Packages 2024-05-15T15:37:11.900 INFO:teuthology.orchestra.run.smithi012.stdout:Upgrade 8 Packages 2024-05-15T15:37:11.900 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-05-15T15:37:11.901 INFO:teuthology.orchestra.run.smithi012.stdout:Total download size: 223 M 2024-05-15T15:37:11.901 INFO:teuthology.orchestra.run.smithi012.stdout:Downloading Packages: 2024-05-15T15:37:12.839 INFO:teuthology.orchestra.run.smithi104.stdout:lab-extras 24 kB/s | 1.7 kB 00:00 2024-05-15T15:37:13.055 INFO:teuthology.orchestra.run.smithi012.stdout:(1/158): ceph-19.0.0-3709.g43296076.el9.x86_64. 23 kB/s | 6.6 kB 00:00 2024-05-15T15:37:13.129 INFO:teuthology.orchestra.run.smithi084.stdout:(7/158): ceph-osd-19.0.0-3709.g43296076.el9.x86 11 MB/s | 18 MB 00:01 2024-05-15T15:37:13.812 INFO:teuthology.orchestra.run.smithi084.stdout:(8/158): ceph-radosgw-19.0.0-3709.g43296076.el9 15 MB/s | 10 MB 00:00 2024-05-15T15:37:13.854 INFO:teuthology.orchestra.run.smithi012.stdout:(2/158): ceph-fuse-19.0.0-3709.g43296076.el9.x8 1.1 MB/s | 863 kB 00:00 2024-05-15T15:37:13.862 INFO:teuthology.orchestra.run.smithi084.stdout:(9/158): ceph-selinux-19.0.0-3709.g43296076.el9 506 kB/s | 25 kB 00:00 2024-05-15T15:37:13.963 INFO:teuthology.orchestra.run.smithi012.stdout:(3/158): ceph-immutable-object-cache-19.0.0-370 1.3 MB/s | 147 kB 00:00 2024-05-15T15:37:14.380 INFO:teuthology.orchestra.run.smithi012.stdout:(4/158): ceph-base-19.0.0-3709.g43296076.el9.x8 3.3 MB/s | 5.4 MB 00:01 2024-05-15T15:37:14.839 INFO:teuthology.orchestra.run.smithi012.stdout:(5/158): ceph-mgr-19.0.0-3709.g43296076.el9.x86 3.3 MB/s | 1.5 MB 00:00 2024-05-15T15:37:15.271 INFO:teuthology.orchestra.run.smithi084.stdout:(10/158): ceph-common-19.0.0-3709.g43296076.el9 4.2 MB/s | 20 MB 00:04 2024-05-15T15:37:15.424 INFO:teuthology.orchestra.run.smithi104.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-15T15:37:15.425 INFO:teuthology.orchestra.run.smithi104.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-15T15:37:15.446 INFO:teuthology.orchestra.run.smithi104.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-05-15T15:37:15.447 INFO:teuthology.orchestra.run.smithi104.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-05-15T15:37:15.449 INFO:teuthology.orchestra.run.smithi104.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-05-15T15:37:15.450 INFO:teuthology.orchestra.run.smithi104.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-05-15T15:37:15.453 INFO:teuthology.orchestra.run.smithi104.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-05-15T15:37:15.456 INFO:teuthology.orchestra.run.smithi104.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-05-15T15:37:15.457 INFO:teuthology.orchestra.run.smithi104.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-05-15T15:37:15.530 INFO:teuthology.orchestra.run.smithi084.stdout:(11/158): ceph-mon-19.0.0-3709.g43296076.el9.x8 1.2 MB/s | 4.9 MB 00:04 2024-05-15T15:37:15.530 INFO:teuthology.orchestra.run.smithi104.stdout:Dependencies resolved. 2024-05-15T15:37:15.548 INFO:teuthology.orchestra.run.smithi104.stdout:======================================================================================= 2024-05-15T15:37:15.548 INFO:teuthology.orchestra.run.smithi104.stdout: Package Arch Version Repository Size 2024-05-15T15:37:15.548 INFO:teuthology.orchestra.run.smithi104.stdout:======================================================================================= 2024-05-15T15:37:15.548 INFO:teuthology.orchestra.run.smithi104.stdout:Installing: 2024-05-15T15:37:15.548 INFO:teuthology.orchestra.run.smithi104.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-05-15T15:37:15.548 INFO:teuthology.orchestra.run.smithi104.stdout: ceph x86_64 2:19.0.0-3709.g43296076.el9 ceph 6.6 k 2024-05-15T15:37:15.548 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-base x86_64 2:19.0.0-3709.g43296076.el9 ceph 5.4 M 2024-05-15T15:37:15.548 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-fuse x86_64 2:19.0.0-3709.g43296076.el9 ceph 863 k 2024-05-15T15:37:15.549 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3709.g43296076.el9 ceph 147 k 2024-05-15T15:37:15.549 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr x86_64 2:19.0.0-3709.g43296076.el9 ceph 1.5 M 2024-05-15T15:37:15.549 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3709.g43296076.el9 ceph-noarch 143 k 2024-05-15T15:37:15.549 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3709.g43296076.el9 ceph-noarch 3.5 M 2024-05-15T15:37:15.549 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3709.g43296076.el9 ceph-noarch 7.4 M 2024-05-15T15:37:15.549 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-rook noarch 2:19.0.0-3709.g43296076.el9 ceph-noarch 49 k 2024-05-15T15:37:15.549 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-radosgw x86_64 2:19.0.0-3709.g43296076.el9 ceph 10 M 2024-05-15T15:37:15.549 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-test x86_64 2:19.0.0-3709.g43296076.el9 ceph 43 M 2024-05-15T15:37:15.549 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-volume noarch 2:19.0.0-3709.g43296076.el9 ceph-noarch 273 k 2024-05-15T15:37:15.549 INFO:teuthology.orchestra.run.smithi104.stdout: cephadm noarch 2:19.0.0-3709.g43296076.el9 ceph-noarch 763 k 2024-05-15T15:37:15.549 INFO:teuthology.orchestra.run.smithi104.stdout: cephfs-mirror x86_64 2:19.0.0-3709.g43296076.el9 ceph 224 k 2024-05-15T15:37:15.549 INFO:teuthology.orchestra.run.smithi104.stdout: cephfs-shell x86_64 2:19.0.0-3709.g43296076.el9 ceph 27 k 2024-05-15T15:37:15.550 INFO:teuthology.orchestra.run.smithi104.stdout: cephfs-top noarch 2:19.0.0-3709.g43296076.el9 ceph-noarch 18 k 2024-05-15T15:37:15.550 INFO:teuthology.orchestra.run.smithi104.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-05-15T15:37:15.550 INFO:teuthology.orchestra.run.smithi104.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-05-15T15:37:15.550 INFO:teuthology.orchestra.run.smithi104.stdout: fscrypt x86_64 0.3.4-2.el9 epel 2.0 M 2024-05-15T15:37:15.550 INFO:teuthology.orchestra.run.smithi104.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-05-15T15:37:15.550 INFO:teuthology.orchestra.run.smithi104.stdout: libcephfs-devel x86_64 2:19.0.0-3709.g43296076.el9 ceph 32 k 2024-05-15T15:37:15.550 INFO:teuthology.orchestra.run.smithi104.stdout: libcephfs2 x86_64 2:19.0.0-3709.g43296076.el9 ceph 756 k 2024-05-15T15:37:15.550 INFO:teuthology.orchestra.run.smithi104.stdout: librados-devel x86_64 2:19.0.0-3709.g43296076.el9 ceph 127 k 2024-05-15T15:37:15.550 INFO:teuthology.orchestra.run.smithi104.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-05-15T15:37:15.550 INFO:teuthology.orchestra.run.smithi104.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-05-15T15:37:15.550 INFO:teuthology.orchestra.run.smithi104.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-05-15T15:37:15.550 INFO:teuthology.orchestra.run.smithi104.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-05-15T15:37:15.550 INFO:teuthology.orchestra.run.smithi104.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-05-15T15:37:15.551 INFO:teuthology.orchestra.run.smithi104.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-05-15T15:37:15.551 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cephfs x86_64 2:19.0.0-3709.g43296076.el9 ceph 162 k 2024-05-15T15:37:15.551 INFO:teuthology.orchestra.run.smithi104.stdout: python3-rados x86_64 2:19.0.0-3709.g43296076.el9 ceph 320 k 2024-05-15T15:37:15.551 INFO:teuthology.orchestra.run.smithi104.stdout: python3-rbd x86_64 2:19.0.0-3709.g43296076.el9 ceph 300 k 2024-05-15T15:37:15.551 INFO:teuthology.orchestra.run.smithi104.stdout: python3-rgw x86_64 2:19.0.0-3709.g43296076.el9 ceph 99 k 2024-05-15T15:37:15.551 INFO:teuthology.orchestra.run.smithi104.stdout: rbd-fuse x86_64 2:19.0.0-3709.g43296076.el9 ceph 86 k 2024-05-15T15:37:15.551 INFO:teuthology.orchestra.run.smithi104.stdout: rbd-mirror x86_64 2:19.0.0-3709.g43296076.el9 ceph 3.0 M 2024-05-15T15:37:15.551 INFO:teuthology.orchestra.run.smithi104.stdout: rbd-nbd x86_64 2:19.0.0-3709.g43296076.el9 ceph 169 k 2024-05-15T15:37:15.551 INFO:teuthology.orchestra.run.smithi104.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-05-15T15:37:15.551 INFO:teuthology.orchestra.run.smithi104.stdout:Upgrading: 2024-05-15T15:37:15.551 INFO:teuthology.orchestra.run.smithi104.stdout: NetworkManager x86_64 1:1.47.90-1.el9 baseos 2.3 M 2024-05-15T15:37:15.551 INFO:teuthology.orchestra.run.smithi104.stdout: NetworkManager-libnm x86_64 1:1.47.90-1.el9 baseos 1.8 M 2024-05-15T15:37:15.551 INFO:teuthology.orchestra.run.smithi104.stdout: NetworkManager-team x86_64 1:1.47.90-1.el9 baseos 41 k 2024-05-15T15:37:15.552 INFO:teuthology.orchestra.run.smithi104.stdout: NetworkManager-tui x86_64 1:1.47.90-1.el9 baseos 248 k 2024-05-15T15:37:15.552 INFO:teuthology.orchestra.run.smithi104.stdout: librados2 x86_64 2:19.0.0-3709.g43296076.el9 ceph 3.3 M 2024-05-15T15:37:15.552 INFO:teuthology.orchestra.run.smithi104.stdout: librbd1 x86_64 2:19.0.0-3709.g43296076.el9 ceph 3.1 M 2024-05-15T15:37:15.552 INFO:teuthology.orchestra.run.smithi104.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-05-15T15:37:15.552 INFO:teuthology.orchestra.run.smithi104.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-05-15T15:37:15.552 INFO:teuthology.orchestra.run.smithi104.stdout:Installing dependencies: 2024-05-15T15:37:15.552 INFO:teuthology.orchestra.run.smithi104.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-05-15T15:37:15.552 INFO:teuthology.orchestra.run.smithi104.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-05-15T15:37:15.552 INFO:teuthology.orchestra.run.smithi104.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-15T15:37:15.552 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-common x86_64 2:19.0.0-3709.g43296076.el9 ceph 20 M 2024-05-15T15:37:15.552 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3709.g43296076.el9 ceph-noarch 34 k 2024-05-15T15:37:15.552 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mds x86_64 2:19.0.0-3709.g43296076.el9 ceph 2.3 M 2024-05-15T15:37:15.552 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3709.g43296076.el9 ceph-noarch 274 k 2024-05-15T15:37:15.553 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mon x86_64 2:19.0.0-3709.g43296076.el9 ceph 4.9 M 2024-05-15T15:37:15.553 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-osd x86_64 2:19.0.0-3709.g43296076.el9 ceph 18 M 2024-05-15T15:37:15.553 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3709.g43296076.el9 ceph-noarch 16 k 2024-05-15T15:37:15.553 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-selinux x86_64 2:19.0.0-3709.g43296076.el9 ceph 25 k 2024-05-15T15:37:15.553 INFO:teuthology.orchestra.run.smithi104.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-15T15:37:15.553 INFO:teuthology.orchestra.run.smithi104.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-15T15:37:15.553 INFO:teuthology.orchestra.run.smithi104.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-15T15:37:15.553 INFO:teuthology.orchestra.run.smithi104.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-15T15:37:15.553 INFO:teuthology.orchestra.run.smithi104.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-15T15:37:15.553 INFO:teuthology.orchestra.run.smithi104.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-05-15T15:37:15.553 INFO:teuthology.orchestra.run.smithi104.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-15T15:37:15.553 INFO:teuthology.orchestra.run.smithi104.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-15T15:37:15.553 INFO:teuthology.orchestra.run.smithi104.stdout: libcephsqlite x86_64 2:19.0.0-3709.g43296076.el9 ceph 157 k 2024-05-15T15:37:15.554 INFO:teuthology.orchestra.run.smithi104.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-15T15:37:15.554 INFO:teuthology.orchestra.run.smithi104.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-15T15:37:15.554 INFO:teuthology.orchestra.run.smithi104.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-15T15:37:15.554 INFO:teuthology.orchestra.run.smithi104.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-15T15:37:15.554 INFO:teuthology.orchestra.run.smithi104.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-15T15:37:15.554 INFO:teuthology.orchestra.run.smithi104.stdout: libradosstriper1 x86_64 2:19.0.0-3709.g43296076.el9 ceph 497 k 2024-05-15T15:37:15.554 INFO:teuthology.orchestra.run.smithi104.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-15T15:37:15.554 INFO:teuthology.orchestra.run.smithi104.stdout: librgw2 x86_64 2:19.0.0-3709.g43296076.el9 ceph 5.2 M 2024-05-15T15:37:15.554 INFO:teuthology.orchestra.run.smithi104.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-15T15:37:15.554 INFO:teuthology.orchestra.run.smithi104.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-05-15T15:37:15.554 INFO:teuthology.orchestra.run.smithi104.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-15T15:37:15.554 INFO:teuthology.orchestra.run.smithi104.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-05-15T15:37:15.554 INFO:teuthology.orchestra.run.smithi104.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-05-15T15:37:15.555 INFO:teuthology.orchestra.run.smithi104.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-05-15T15:37:15.555 INFO:teuthology.orchestra.run.smithi104.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-15T15:37:15.555 INFO:teuthology.orchestra.run.smithi104.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-15T15:37:15.555 INFO:teuthology.orchestra.run.smithi104.stdout: pam_fscrypt x86_64 0.3.4-2.el9 epel 1.8 M 2024-05-15T15:37:15.555 INFO:teuthology.orchestra.run.smithi104.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-15T15:37:15.555 INFO:teuthology.orchestra.run.smithi104.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-05-15T15:37:15.555 INFO:teuthology.orchestra.run.smithi104.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-05-15T15:37:15.555 INFO:teuthology.orchestra.run.smithi104.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-05-15T15:37:15.555 INFO:teuthology.orchestra.run.smithi104.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-15T15:37:15.555 INFO:teuthology.orchestra.run.smithi104.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-05-15T15:37:15.555 INFO:teuthology.orchestra.run.smithi104.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-15T15:37:15.555 INFO:teuthology.orchestra.run.smithi104.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-15T15:37:15.555 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-15T15:37:15.556 INFO:teuthology.orchestra.run.smithi104.stdout: python3-ceph-argparse x86_64 2:19.0.0-3709.g43296076.el9 ceph 45 k 2024-05-15T15:37:15.556 INFO:teuthology.orchestra.run.smithi104.stdout: python3-ceph-common x86_64 2:19.0.0-3709.g43296076.el9 ceph 136 k 2024-05-15T15:37:15.556 INFO:teuthology.orchestra.run.smithi104.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-15T15:37:15.556 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-15T15:37:15.556 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-15T15:37:15.556 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-15T15:37:15.556 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-05-15T15:37:15.556 INFO:teuthology.orchestra.run.smithi104.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-05-15T15:37:15.556 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-15T15:37:15.556 INFO:teuthology.orchestra.run.smithi104.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-15T15:37:15.556 INFO:teuthology.orchestra.run.smithi104.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-15T15:37:15.556 INFO:teuthology.orchestra.run.smithi104.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-05-15T15:37:15.556 INFO:teuthology.orchestra.run.smithi104.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-05-15T15:37:15.557 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-15T15:37:15.557 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-15T15:37:15.557 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-05-15T15:37:15.557 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-15T15:37:15.557 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-15T15:37:15.557 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-05-15T15:37:15.557 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-15T15:37:15.557 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-15T15:37:15.557 INFO:teuthology.orchestra.run.smithi104.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-15T15:37:15.557 INFO:teuthology.orchestra.run.smithi104.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-15T15:37:15.557 INFO:teuthology.orchestra.run.smithi104.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-15T15:37:15.557 INFO:teuthology.orchestra.run.smithi104.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-15T15:37:15.557 INFO:teuthology.orchestra.run.smithi104.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-15T15:37:15.558 INFO:teuthology.orchestra.run.smithi104.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-15T15:37:15.558 INFO:teuthology.orchestra.run.smithi104.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-15T15:37:15.558 INFO:teuthology.orchestra.run.smithi104.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-15T15:37:15.558 INFO:teuthology.orchestra.run.smithi104.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-15T15:37:15.558 INFO:teuthology.orchestra.run.smithi104.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-05-15T15:37:15.558 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-15T15:37:15.558 INFO:teuthology.orchestra.run.smithi104.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-15T15:37:15.558 INFO:teuthology.orchestra.run.smithi104.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-15T15:37:15.558 INFO:teuthology.orchestra.run.smithi104.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-15T15:37:15.558 INFO:teuthology.orchestra.run.smithi104.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-05-15T15:37:15.558 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-15T15:37:15.558 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-15T15:37:15.558 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-15T15:37:15.559 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-15T15:37:15.559 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-05-15T15:37:15.559 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-15T15:37:15.559 INFO:teuthology.orchestra.run.smithi104.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-15T15:37:15.559 INFO:teuthology.orchestra.run.smithi104.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-15T15:37:15.559 INFO:teuthology.orchestra.run.smithi104.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-15T15:37:15.559 INFO:teuthology.orchestra.run.smithi104.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-15T15:37:15.559 INFO:teuthology.orchestra.run.smithi104.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-15T15:37:15.559 INFO:teuthology.orchestra.run.smithi104.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-15T15:37:15.559 INFO:teuthology.orchestra.run.smithi104.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-15T15:37:15.559 INFO:teuthology.orchestra.run.smithi104.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-15T15:37:15.559 INFO:teuthology.orchestra.run.smithi104.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-15T15:37:15.559 INFO:teuthology.orchestra.run.smithi104.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-15T15:37:15.560 INFO:teuthology.orchestra.run.smithi104.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-05-15T15:37:15.560 INFO:teuthology.orchestra.run.smithi104.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-15T15:37:15.560 INFO:teuthology.orchestra.run.smithi104.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-15T15:37:15.560 INFO:teuthology.orchestra.run.smithi104.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-15T15:37:15.560 INFO:teuthology.orchestra.run.smithi104.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-15T15:37:15.560 INFO:teuthology.orchestra.run.smithi104.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-05-15T15:37:15.560 INFO:teuthology.orchestra.run.smithi104.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-05-15T15:37:15.560 INFO:teuthology.orchestra.run.smithi104.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-15T15:37:15.560 INFO:teuthology.orchestra.run.smithi104.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-15T15:37:15.560 INFO:teuthology.orchestra.run.smithi104.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-15T15:37:15.560 INFO:teuthology.orchestra.run.smithi104.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-05-15T15:37:15.560 INFO:teuthology.orchestra.run.smithi104.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-15T15:37:15.560 INFO:teuthology.orchestra.run.smithi104.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-05-15T15:37:15.560 INFO:teuthology.orchestra.run.smithi104.stdout:Installing weak dependencies: 2024-05-15T15:37:15.561 INFO:teuthology.orchestra.run.smithi104.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-05-15T15:37:15.561 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-15T15:37:15.561 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction Summary 2024-05-15T15:37:15.561 INFO:teuthology.orchestra.run.smithi104.stdout:======================================================================================= 2024-05-15T15:37:15.561 INFO:teuthology.orchestra.run.smithi104.stdout:Install 150 Packages 2024-05-15T15:37:15.561 INFO:teuthology.orchestra.run.smithi104.stdout:Upgrade 8 Packages 2024-05-15T15:37:15.561 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-15T15:37:15.562 INFO:teuthology.orchestra.run.smithi084.stdout:(12/158): cephfs-mirror-19.0.0-3709.g43296076.e 791 kB/s | 224 kB 00:00 2024-05-15T15:37:15.562 INFO:teuthology.orchestra.run.smithi104.stdout:Total download size: 223 M 2024-05-15T15:37:15.562 INFO:teuthology.orchestra.run.smithi104.stdout:Downloading Packages: 2024-05-15T15:37:15.622 INFO:teuthology.orchestra.run.smithi084.stdout:(13/158): cephfs-shell-19.0.0-3709.g43296076.el 293 kB/s | 27 kB 00:00 2024-05-15T15:37:15.647 INFO:teuthology.orchestra.run.smithi084.stdout:(14/158): libcephfs-devel-19.0.0-3709.g43296076 344 kB/s | 32 kB 00:00 2024-05-15T15:37:15.689 INFO:teuthology.orchestra.run.smithi012.stdout:(6/158): ceph-mds-19.0.0-3709.g43296076.el9.x86 1.3 MB/s | 2.3 MB 00:01 2024-05-15T15:37:15.748 INFO:teuthology.orchestra.run.smithi084.stdout:(15/158): libcephsqlite-19.0.0-3709.g43296076.e 1.5 MB/s | 157 kB 00:00 2024-05-15T15:37:15.806 INFO:teuthology.orchestra.run.smithi012.stdout:(7/158): ceph-mon-19.0.0-3709.g43296076.el9.x86 5.0 MB/s | 4.9 MB 00:00 2024-05-15T15:37:16.006 INFO:teuthology.orchestra.run.smithi084.stdout:(16/158): libcephfs2-19.0.0-3709.g43296076.el9. 1.9 MB/s | 756 kB 00:00 2024-05-15T15:37:16.056 INFO:teuthology.orchestra.run.smithi084.stdout:(17/158): librados-devel-19.0.0-3709.g43296076. 411 kB/s | 127 kB 00:00 2024-05-15T15:37:16.373 INFO:teuthology.orchestra.run.smithi084.stdout:(18/158): libradosstriper1-19.0.0-3709.g4329607 1.3 MB/s | 497 kB 00:00 2024-05-15T15:37:16.523 INFO:teuthology.orchestra.run.smithi084.stdout:(19/158): python3-ceph-argparse-19.0.0-3709.g43 301 kB/s | 45 kB 00:00 2024-05-15T15:37:16.807 INFO:teuthology.orchestra.run.smithi104.stdout:(1/158): ceph-19.0.0-3709.g43296076.el9.x86_64. 13 kB/s | 6.6 kB 00:00 2024-05-15T15:37:17.240 INFO:teuthology.orchestra.run.smithi084.stdout:(20/158): librgw2-19.0.0-3709.g43296076.el9.x86 4.4 MB/s | 5.2 MB 00:01 2024-05-15T15:37:17.357 INFO:teuthology.orchestra.run.smithi084.stdout:(21/158): python3-cephfs-19.0.0-3709.g43296076. 1.4 MB/s | 162 kB 00:00 2024-05-15T15:37:17.457 INFO:teuthology.orchestra.run.smithi084.stdout:(22/158): python3-ceph-common-19.0.0-3709.g4329 145 kB/s | 136 kB 00:00 2024-05-15T15:37:17.508 INFO:teuthology.orchestra.run.smithi084.stdout:(23/158): python3-rados-19.0.0-3709.g43296076.e 2.1 MB/s | 320 kB 00:00 2024-05-15T15:37:17.556 INFO:teuthology.orchestra.run.smithi012.stdout:(8/158): ceph-radosgw-19.0.0-3709.g43296076.el9 5.8 MB/s | 10 MB 00:01 2024-05-15T15:37:17.614 INFO:teuthology.orchestra.run.smithi012.stdout:(9/158): ceph-selinux-19.0.0-3709.g43296076.el9 434 kB/s | 25 kB 00:00 2024-05-15T15:37:17.631 INFO:teuthology.orchestra.run.smithi104.stdout:(2/158): ceph-base-19.0.0-3709.g43296076.el9.x8 4.1 MB/s | 5.4 MB 00:01 2024-05-15T15:37:17.699 INFO:teuthology.orchestra.run.smithi104.stdout:(3/158): ceph-immutable-object-cache-19.0.0-370 2.2 MB/s | 147 kB 00:00 2024-05-15T15:37:17.882 INFO:teuthology.orchestra.run.smithi104.stdout:(4/158): ceph-fuse-19.0.0-3709.g43296076.el9.x8 803 kB/s | 863 kB 00:01 2024-05-15T15:37:17.883 INFO:teuthology.orchestra.run.smithi084.stdout:(24/158): ceph-test-19.0.0-3709.g43296076.el9.x 11 MB/s | 43 MB 00:04 2024-05-15T15:37:17.908 INFO:teuthology.orchestra.run.smithi084.stdout:(25/158): python3-rgw-19.0.0-3709.g43296076.el9 248 kB/s | 99 kB 00:00 2024-05-15T15:37:17.934 INFO:teuthology.orchestra.run.smithi084.stdout:(26/158): python3-rbd-19.0.0-3709.g43296076.el9 631 kB/s | 300 kB 00:00 2024-05-15T15:37:18.009 INFO:teuthology.orchestra.run.smithi084.stdout:(27/158): rbd-fuse-19.0.0-3709.g43296076.el9.x8 688 kB/s | 86 kB 00:00 2024-05-15T15:37:18.134 INFO:teuthology.orchestra.run.smithi084.stdout:(28/158): ceph-grafana-dashboards-19.0.0-3709.g 274 kB/s | 34 kB 00:00 2024-05-15T15:37:18.159 INFO:teuthology.orchestra.run.smithi084.stdout:(29/158): rbd-nbd-19.0.0-3709.g43296076.el9.x86 750 kB/s | 169 kB 00:00 2024-05-15T15:37:18.235 INFO:teuthology.orchestra.run.smithi084.stdout:(30/158): ceph-mgr-cephadm-19.0.0-3709.g4329607 1.4 MB/s | 143 kB 00:00 2024-05-15T15:37:18.274 INFO:teuthology.orchestra.run.smithi104.stdout:(5/158): ceph-mds-19.0.0-3709.g43296076.el9.x86 3.9 MB/s | 2.3 MB 00:00 2024-05-15T15:37:18.382 INFO:teuthology.orchestra.run.smithi104.stdout:(6/158): ceph-mgr-19.0.0-3709.g43296076.el9.x86 3.0 MB/s | 1.5 MB 00:00 2024-05-15T15:37:18.560 INFO:teuthology.orchestra.run.smithi084.stdout:(31/158): rbd-mirror-19.0.0-3709.g43296076.el9. 4.7 MB/s | 3.0 MB 00:00 2024-05-15T15:37:18.943 INFO:teuthology.orchestra.run.smithi084.stdout:(32/158): ceph-mgr-modules-core-19.0.0-3709.g43 716 kB/s | 274 kB 00:00 2024-05-15T15:37:19.060 INFO:teuthology.orchestra.run.smithi084.stdout:(33/158): ceph-mgr-rook-19.0.0-3709.g43296076.e 424 kB/s | 49 kB 00:00 2024-05-15T15:37:19.161 INFO:teuthology.orchestra.run.smithi084.stdout:(34/158): ceph-prometheus-alerts-19.0.0-3709.g4 164 kB/s | 16 kB 00:00 2024-05-15T15:37:19.519 INFO:teuthology.orchestra.run.smithi084.stdout:(35/158): ceph-mgr-diskprediction-local-19.0.0- 5.8 MB/s | 7.4 MB 00:01 2024-05-15T15:37:19.545 INFO:teuthology.orchestra.run.smithi084.stdout:(36/158): ceph-volume-19.0.0-3709.g43296076.el9 712 kB/s | 273 kB 00:00 2024-05-15T15:37:19.620 INFO:teuthology.orchestra.run.smithi084.stdout:(37/158): cephfs-top-19.0.0-3709.g43296076.el9. 243 kB/s | 18 kB 00:00 2024-05-15T15:37:19.632 INFO:teuthology.orchestra.run.smithi104.stdout:(7/158): ceph-mon-19.0.0-3709.g43296076.el9.x86 3.6 MB/s | 4.9 MB 00:01 2024-05-15T15:37:19.662 INFO:teuthology.orchestra.run.smithi084.stdout:(38/158): cephadm-19.0.0-3709.g43296076.el9.noa 5.2 MB/s | 763 kB 00:00 2024-05-15T15:37:19.770 INFO:teuthology.orchestra.run.smithi084.stdout:(39/158): fuse-2.9.9-15.el9.x86_64.rpm 535 kB/s | 80 kB 00:00 2024-05-15T15:37:19.837 INFO:teuthology.orchestra.run.smithi084.stdout:(40/158): libquadmath-11.4.1-3.el9.x86_64.rpm 2.9 MB/s | 195 kB 00:00 2024-05-15T15:37:19.887 INFO:teuthology.orchestra.run.smithi084.stdout:(41/158): libgfortran-11.4.1-3.el9.x86_64.rpm 3.5 MB/s | 803 kB 00:00 2024-05-15T15:37:19.905 INFO:teuthology.orchestra.run.smithi104.stdout:(8/158): ceph-common-19.0.0-3709.g43296076.el9. 5.5 MB/s | 20 MB 00:03 2024-05-15T15:37:19.947 INFO:teuthology.orchestra.run.smithi084.stdout:(42/158): ceph-mgr-dashboard-19.0.0-3709.g43296 2.0 MB/s | 3.5 MB 00:01 2024-05-15T15:37:19.966 INFO:teuthology.orchestra.run.smithi104.stdout:(9/158): ceph-selinux-19.0.0-3709.g43296076.el9 420 kB/s | 25 kB 00:00 2024-05-15T15:37:19.972 INFO:teuthology.orchestra.run.smithi084.stdout:(43/158): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.8 MB/s | 253 kB 00:00 2024-05-15T15:37:20.014 INFO:teuthology.orchestra.run.smithi084.stdout:(44/158): python3-cryptography-36.0.1-4.el9.x86 9.7 MB/s | 1.2 MB 00:00 2024-05-15T15:37:20.039 INFO:teuthology.orchestra.run.smithi084.stdout:(45/158): python3-pycparser-2.20-6.el9.noarch.r 2.0 MB/s | 135 kB 00:00 2024-05-15T15:37:20.056 INFO:teuthology.orchestra.run.smithi084.stdout:(46/158): python3-requests-2.25.1-8.el9.noarch. 2.9 MB/s | 125 kB 00:00 2024-05-15T15:37:20.089 INFO:teuthology.orchestra.run.smithi084.stdout:(47/158): python3-urllib3-1.26.5-5.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-05-15T15:37:20.115 INFO:teuthology.orchestra.run.smithi084.stdout:(48/158): python3-ply-3.11-14.el9.noarch.rpm 634 kB/s | 106 kB 00:00 2024-05-15T15:37:20.223 INFO:teuthology.orchestra.run.smithi084.stdout:(49/158): boost-program-options-1.75.0-8.el9.x8 987 kB/s | 107 kB 00:00 2024-05-15T15:37:20.257 INFO:teuthology.orchestra.run.smithi084.stdout:(50/158): automake-1.16.2-8.el9.noarch.rpm 3.4 MB/s | 689 kB 00:00 2024-05-15T15:37:20.282 INFO:teuthology.orchestra.run.smithi084.stdout:(51/158): elfutils-libelf-devel-0.190-2.el9.x86 368 kB/s | 21 kB 00:00 2024-05-15T15:37:20.307 INFO:teuthology.orchestra.run.smithi084.stdout:(52/158): flex-2.6.4-9.el9.x86_64.rpm 6.1 MB/s | 313 kB 00:00 2024-05-15T15:37:20.333 INFO:teuthology.orchestra.run.smithi084.stdout:(53/158): flexiblas-3.0.4-8.el9.x86_64.rpm 651 kB/s | 33 kB 00:00 2024-05-15T15:37:20.366 INFO:teuthology.orchestra.run.smithi084.stdout:(54/158): bison-3.7.4-5.el9.x86_64.rpm 3.3 MB/s | 943 kB 00:00 2024-05-15T15:37:20.392 INFO:teuthology.orchestra.run.smithi084.stdout:(55/158): flexiblas-openblas-openmp-3.0.4-8.el9 311 kB/s | 18 kB 00:00 2024-05-15T15:37:20.417 INFO:teuthology.orchestra.run.smithi084.stdout:(56/158): libaio-devel-0.3.111-13.el9.x86_64.rp 222 kB/s | 11 kB 00:00 2024-05-15T15:37:20.443 INFO:teuthology.orchestra.run.smithi084.stdout:(57/158): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-05-15T15:37:20.468 INFO:teuthology.orchestra.run.smithi084.stdout:(58/158): librabbitmq-0.11.0-7.el9.x86_64.rpm 899 kB/s | 45 kB 00:00 2024-05-15T15:37:20.509 INFO:teuthology.orchestra.run.smithi084.stdout:(59/158): librdkafka-1.6.1-102.el9.x86_64.rpm 9.7 MB/s | 662 kB 00:00 2024-05-15T15:37:20.552 INFO:teuthology.orchestra.run.smithi084.stdout:(60/158): libuuid-devel-2.37.4-18.el9.x86_64.rp 612 kB/s | 25 kB 00:00 2024-05-15T15:37:20.602 INFO:teuthology.orchestra.run.smithi084.stdout:(61/158): flexiblas-netlib-3.0.4-8.el9.x86_64.r 10 MB/s | 3.0 MB 00:00 2024-05-15T15:37:20.627 INFO:teuthology.orchestra.run.smithi084.stdout:(62/158): libtool-2.4.6-45.el9.x86_64.rpm 3.6 MB/s | 582 kB 00:00 2024-05-15T15:37:20.652 INFO:teuthology.orchestra.run.smithi084.stdout:(63/158): libzstd-devel-1.5.1-2.el9.x86_64.rpm 472 kB/s | 47 kB 00:00 2024-05-15T15:37:20.678 INFO:teuthology.orchestra.run.smithi084.stdout:(64/158): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 188 kB 00:00 2024-05-15T15:37:20.694 INFO:teuthology.orchestra.run.smithi084.stdout:(65/158): openblas-0.3.21-2.el9.x86_64.rpm 839 kB/s | 35 kB 00:00 2024-05-15T15:37:20.719 INFO:teuthology.orchestra.run.smithi084.stdout:(66/158): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.4 MB/s | 292 kB 00:00 2024-05-15T15:37:20.787 INFO:teuthology.orchestra.run.smithi084.stdout:(67/158): postgresql-13.14-1.el9.x86_64.rpm 24 MB/s | 1.6 MB 00:00 2024-05-15T15:37:20.845 INFO:teuthology.orchestra.run.smithi084.stdout:(68/158): postgresql-contrib-13.14-1.el9.x86_64 15 MB/s | 911 kB 00:00 2024-05-15T15:37:20.904 INFO:teuthology.orchestra.run.smithi084.stdout:(69/158): openssl-devel-3.2.1-1.el9.x86_64.rpm 21 MB/s | 4.4 MB 00:00 2024-05-15T15:37:20.963 INFO:teuthology.orchestra.run.smithi084.stdout:(70/158): openblas-openmp-0.3.21-2.el9.x86_64.r 17 MB/s | 4.7 MB 00:00 2024-05-15T15:37:20.997 INFO:teuthology.orchestra.run.smithi084.stdout:(71/158): postgresql-private-libs-13.14-1.el9.x 883 kB/s | 133 kB 00:00 2024-05-15T15:37:21.038 INFO:teuthology.orchestra.run.smithi084.stdout:(72/158): protobuf-3.14.0-13.el9.x86_64.rpm 13 MB/s | 1.0 MB 00:00 2024-05-15T15:37:21.064 INFO:teuthology.orchestra.run.smithi084.stdout:(73/158): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 87 kB 00:00 2024-05-15T15:37:21.106 INFO:teuthology.orchestra.run.smithi084.stdout:(74/158): python3-devel-3.9.18-3.el9.x86_64.rpm 5.7 MB/s | 244 kB 00:00 2024-05-15T15:37:21.181 INFO:teuthology.orchestra.run.smithi084.stdout:(75/158): postgresql-server-13.14-1.el9.x86_64. 21 MB/s | 5.8 MB 00:00 2024-05-15T15:37:21.206 INFO:teuthology.orchestra.run.smithi084.stdout:(76/158): python3-jinja2-2.11.3-5.el9.noarch.rp 2.4 MB/s | 248 kB 00:00 2024-05-15T15:37:21.232 INFO:teuthology.orchestra.run.smithi084.stdout:(77/158): python3-jsonpatch-1.21-16.el9.noarch. 512 kB/s | 26 kB 00:00 2024-05-15T15:37:21.257 INFO:teuthology.orchestra.run.smithi084.stdout:(78/158): python3-jsonpointer-2.0-4.el9.noarch. 381 kB/s | 19 kB 00:00 2024-05-15T15:37:21.282 INFO:teuthology.orchestra.run.smithi084.stdout:(79/158): python3-mako-1.1.4-6.el9.noarch.rpm 3.3 MB/s | 172 kB 00:00 2024-05-15T15:37:21.307 INFO:teuthology.orchestra.run.smithi084.stdout:(80/158): python3-markupsafe-1.1.1-12.el9.x86_6 693 kB/s | 35 kB 00:00 2024-05-15T15:37:21.391 INFO:teuthology.orchestra.run.smithi084.stdout:(81/158): python3-babel-2.9.1-2.el9.noarch.rpm 17 MB/s | 6.0 MB 00:00 2024-05-15T15:37:21.416 INFO:teuthology.orchestra.run.smithi084.stdout:(82/158): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.3 MB/s | 250 kB 00:00 2024-05-15T15:37:21.441 INFO:teuthology.orchestra.run.smithi084.stdout:(83/158): python3-oauthlib-3.1.1-5.el9.noarch.r 4.4 MB/s | 222 kB 00:00 2024-05-15T15:37:21.466 INFO:teuthology.orchestra.run.smithi084.stdout:(84/158): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-05-15T15:37:21.484 INFO:teuthology.orchestra.run.smithi084.stdout:(85/158): python3-prettytable-0.7.2-27.el9.noar 1.0 MB/s | 42 kB 00:00 2024-05-15T15:37:21.509 INFO:teuthology.orchestra.run.smithi084.stdout:(86/158): python3-protobuf-3.14.0-13.el9.noarch 6.3 MB/s | 269 kB 00:00 2024-05-15T15:37:21.534 INFO:teuthology.orchestra.run.smithi084.stdout:(87/158): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-05-15T15:37:21.562 INFO:teuthology.orchestra.run.smithi084.stdout:(88/158): python3-pyasn1-modules-0.4.8-6.el9.no 5.4 MB/s | 279 kB 00:00 2024-05-15T15:37:21.585 INFO:teuthology.orchestra.run.smithi084.stdout:(89/158): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-05-15T15:37:21.610 INFO:teuthology.orchestra.run.smithi084.stdout:(90/158): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-05-15T15:37:21.686 INFO:teuthology.orchestra.run.smithi084.stdout:(91/158): python3-numpy-1.20.1-5.el9.x86_64.rpm 13 MB/s | 5.1 MB 00:00 2024-05-15T15:37:21.711 INFO:teuthology.orchestra.run.smithi084.stdout:(92/158): python3-toml-0.10.2-6.el9.noarch.rpm 415 kB/s | 42 kB 00:00 2024-05-15T15:37:21.743 INFO:teuthology.orchestra.run.smithi104.stdout:(10/158): ceph-radosgw-19.0.0-3709.g43296076.el 4.8 MB/s | 10 MB 00:02 2024-05-15T15:37:21.743 INFO:teuthology.orchestra.run.smithi084.stdout:(93/158): python3-wcwidth-0.2.5-8.el9.noarch.rp 885 kB/s | 44 kB 00:00 2024-05-15T15:37:21.770 INFO:teuthology.orchestra.run.smithi084.stdout:(94/158): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-05-15T15:37:21.795 INFO:teuthology.orchestra.run.smithi084.stdout:(95/158): qatlib-service-24.02.0-1.el9.x86_64.r 613 kB/s | 36 kB 00:00 2024-05-15T15:37:21.810 INFO:teuthology.orchestra.run.smithi104.stdout:(11/158): cephfs-mirror-19.0.0-3709.g43296076.e 3.0 MB/s | 224 kB 00:00 2024-05-15T15:37:21.821 INFO:teuthology.orchestra.run.smithi084.stdout:(96/158): qatzip-libs-1.2.0-1.el9.x86_64.rpm 944 kB/s | 47 kB 00:00 2024-05-15T15:37:21.846 INFO:teuthology.orchestra.run.smithi084.stdout:(97/158): socat-1.7.4.1-5.el9.x86_64.rpm 5.9 MB/s | 305 kB 00:00 2024-05-15T15:37:21.871 INFO:teuthology.orchestra.run.smithi084.stdout:(98/158): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-05-15T15:37:21.875 INFO:teuthology.orchestra.run.smithi104.stdout:(12/158): cephfs-shell-19.0.0-3709.g43296076.el 410 kB/s | 27 kB 00:00 2024-05-15T15:37:21.897 INFO:teuthology.orchestra.run.smithi084.stdout:(99/158): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.8 MB/s | 94 kB 00:00 2024-05-15T15:37:21.922 INFO:teuthology.orchestra.run.smithi084.stdout:(100/158): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-05-15T15:37:21.947 INFO:teuthology.orchestra.run.smithi084.stdout:(101/158): zlib-devel-1.2.11-41.el9.x86_64.rpm 892 kB/s | 45 kB 00:00 2024-05-15T15:37:21.951 INFO:teuthology.orchestra.run.smithi104.stdout:(13/158): libcephfs-devel-19.0.0-3709.g43296076 430 kB/s | 32 kB 00:00 2024-05-15T15:37:22.189 INFO:teuthology.orchestra.run.smithi084.stdout:(102/158): python3-scipy-1.6.2-8.el9.x86_64.rpm 27 MB/s | 16 MB 00:00 2024-05-15T15:37:22.214 INFO:teuthology.orchestra.run.smithi084.stdout:(103/158): lua-devel-5.4.4-4.el9.x86_64.rpm 76 kB/s | 22 kB 00:00 2024-05-15T15:37:22.351 INFO:teuthology.orchestra.run.smithi104.stdout:(14/158): ceph-osd-19.0.0-3709.g43296076.el9.x8 4.5 MB/s | 18 MB 00:03 2024-05-15T15:37:22.382 INFO:teuthology.orchestra.run.smithi084.stdout:(104/158): protobuf-compiler-3.14.0-13.el9.x86_ 1.9 MB/s | 863 kB 00:00 2024-05-15T15:37:22.393 INFO:teuthology.orchestra.run.smithi104.stdout:(15/158): libcephfs2-19.0.0-3709.g43296076.el9. 1.7 MB/s | 756 kB 00:00 2024-05-15T15:37:22.426 INFO:teuthology.orchestra.run.smithi104.stdout:(16/158): libcephsqlite-19.0.0-3709.g43296076.e 2.1 MB/s | 157 kB 00:00 2024-05-15T15:37:22.456 INFO:teuthology.orchestra.run.smithi084.stdout:(105/158): abseil-cpp-20211102.0-3.el9.x86_64.r 2.0 MB/s | 548 kB 00:00 2024-05-15T15:37:22.468 INFO:teuthology.orchestra.run.smithi104.stdout:(17/158): librados-devel-19.0.0-3709.g43296076. 1.7 MB/s | 127 kB 00:00 2024-05-15T15:37:22.506 INFO:teuthology.orchestra.run.smithi084.stdout:(106/158): grpc-data-1.46.7-10.el9.noarch.rpm 397 kB/s | 19 kB 00:00 2024-05-15T15:37:22.565 INFO:teuthology.orchestra.run.smithi084.stdout:(107/158): fscrypt-0.3.4-2.el9.x86_64.rpm 5.8 MB/s | 2.0 MB 00:00 2024-05-15T15:37:22.568 INFO:teuthology.orchestra.run.smithi104.stdout:(18/158): libradosstriper1-19.0.0-3709.g4329607 3.4 MB/s | 497 kB 00:00 2024-05-15T15:37:22.616 INFO:teuthology.orchestra.run.smithi084.stdout:(108/158): libarrow-doc-9.0.0-11.el9.noarch.rpm 520 kB/s | 26 kB 00:00 2024-05-15T15:37:22.640 INFO:teuthology.orchestra.run.smithi084.stdout:(109/158): gperftools-libs-2.9.1-2.el9.x86_64.r 1.2 MB/s | 309 kB 00:00 2024-05-15T15:37:22.666 INFO:teuthology.orchestra.run.smithi084.stdout:(110/158): liboath-2.6.7-2.el9.x86_64.rpm 964 kB/s | 49 kB 00:00 2024-05-15T15:37:22.694 INFO:teuthology.orchestra.run.smithi104.stdout:(19/158): python3-ceph-argparse-19.0.0-3709.g43 363 kB/s | 45 kB 00:00 2024-05-15T15:37:22.706 INFO:teuthology.orchestra.run.smithi084.stdout:(111/158): libunwind-1.6.2-1.el9.x86_64.rpm 1.0 MB/s | 67 kB 00:00 2024-05-15T15:37:22.733 INFO:teuthology.orchestra.run.smithi084.stdout:(112/158): luarocks-3.9.2-1.el9.noarch.rpm 2.2 MB/s | 151 kB 00:00 2024-05-15T15:37:22.769 INFO:teuthology.orchestra.run.smithi104.stdout:(20/158): python3-ceph-common-19.0.0-3709.g4329 1.8 MB/s | 136 kB 00:00 2024-05-15T15:37:22.808 INFO:teuthology.orchestra.run.smithi084.stdout:(113/158): libarrow-9.0.0-11.el9.x86_64.rpm 15 MB/s | 4.4 MB 00:00 2024-05-15T15:37:22.850 INFO:teuthology.orchestra.run.smithi084.stdout:(114/158): parquet-libs-9.0.0-11.el9.x86_64.rpm 7.0 MB/s | 839 kB 00:00 2024-05-15T15:37:22.861 INFO:teuthology.orchestra.run.smithi104.stdout:(21/158): python3-cephfs-19.0.0-3709.g43296076. 1.7 MB/s | 162 kB 00:00 2024-05-15T15:37:22.884 INFO:teuthology.orchestra.run.smithi084.stdout:(115/158): python3-asyncssh-2.13.2-5.el9.noarch 7.1 MB/s | 548 kB 00:00 2024-05-15T15:37:22.909 INFO:teuthology.orchestra.run.smithi084.stdout:(116/158): python3-bcrypt-3.2.2-1.el9.x86_64.rp 741 kB/s | 43 kB 00:00 2024-05-15T15:37:22.935 INFO:teuthology.orchestra.run.smithi084.stdout:(117/158): python3-cachetools-4.2.4-1.el9.noarc 642 kB/s | 32 kB 00:00 2024-05-15T15:37:22.960 INFO:teuthology.orchestra.run.smithi084.stdout:(118/158): python3-certifi-2021.10.8-2.el9.noar 298 kB/s | 15 kB 00:00 2024-05-15T15:37:22.977 INFO:teuthology.orchestra.run.smithi084.stdout:(119/158): python3-cheroot-8.6.0-4.el9.noarch.r 4.0 MB/s | 172 kB 00:00 2024-05-15T15:37:23.003 INFO:teuthology.orchestra.run.smithi104.stdout:(22/158): python3-rados-19.0.0-3709.g43296076.e 2.2 MB/s | 320 kB 00:00 2024-05-15T15:37:23.019 INFO:teuthology.orchestra.run.smithi084.stdout:(120/158): pam_fscrypt-0.3.4-2.el9.x86_64.rpm 5.9 MB/s | 1.8 MB 00:00 2024-05-15T15:37:23.044 INFO:teuthology.orchestra.run.smithi084.stdout:(121/158): python3-cherrypy-18.6.1-2.el9.noarch 4.2 MB/s | 358 kB 00:00 2024-05-15T15:37:23.069 INFO:teuthology.orchestra.run.smithi084.stdout:(122/158): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.2 MB/s | 303 kB 00:00 2024-05-15T15:37:23.095 INFO:teuthology.orchestra.run.smithi084.stdout:(123/158): python3-colorama-0.4.4-12.el9.noarch 468 kB/s | 35 kB 00:00 2024-05-15T15:37:23.103 INFO:teuthology.orchestra.run.smithi104.stdout:(23/158): python3-rbd-19.0.0-3709.g43296076.el9 3.0 MB/s | 300 kB 00:00 2024-05-15T15:37:23.120 INFO:teuthology.orchestra.run.smithi084.stdout:(124/158): python3-google-auth-2.29.0-1.el9.noa 2.7 MB/s | 206 kB 00:00 2024-05-15T15:37:23.162 INFO:teuthology.orchestra.run.smithi084.stdout:(125/158): python3-grpcio-tools-1.46.7-10.el9.x 2.1 MB/s | 144 kB 00:00 2024-05-15T15:37:23.179 INFO:teuthology.orchestra.run.smithi084.stdout:(126/158): python3-jaraco-8.2.1-3.el9.noarch.rp 182 kB/s | 11 kB 00:00 2024-05-15T15:37:23.195 INFO:teuthology.orchestra.run.smithi104.stdout:(24/158): python3-rgw-19.0.0-3709.g43296076.el9 1.1 MB/s | 99 kB 00:00 2024-05-15T15:37:23.196 INFO:teuthology.orchestra.run.smithi084.stdout:(127/158): python3-jaraco-classes-3.2.1-5.el9.n 529 kB/s | 18 kB 00:00 2024-05-15T15:37:23.213 INFO:teuthology.orchestra.run.smithi084.stdout:(128/158): python3-jaraco-collections-3.0.0-8.e 694 kB/s | 23 kB 00:00 2024-05-15T15:37:23.238 INFO:teuthology.orchestra.run.smithi084.stdout:(129/158): python3-jaraco-functools-3.5.0-2.el9 462 kB/s | 19 kB 00:00 2024-05-15T15:37:23.263 INFO:teuthology.orchestra.run.smithi084.stdout:(130/158): python3-jaraco-text-3.2.0-6.el9.noar 388 kB/s | 20 kB 00:00 2024-05-15T15:37:23.279 INFO:teuthology.orchestra.run.smithi104.stdout:(25/158): rbd-fuse-19.0.0-3709.g43296076.el9.x8 1.0 MB/s | 86 kB 00:00 2024-05-15T15:37:23.305 INFO:teuthology.orchestra.run.smithi084.stdout:(131/158): python3-grpcio-1.46.7-10.el9.x86_64. 9.7 MB/s | 2.0 MB 00:00 2024-05-15T15:37:23.331 INFO:teuthology.orchestra.run.smithi084.stdout:(132/158): python3-logutils-0.3.5-21.el9.noarch 694 kB/s | 46 kB 00:00 2024-05-15T15:37:23.356 INFO:teuthology.orchestra.run.smithi084.stdout:(133/158): python3-more-itertools-8.12.0-2.el9. 1.5 MB/s | 79 kB 00:00 2024-05-15T15:37:23.381 INFO:teuthology.orchestra.run.smithi084.stdout:(134/158): python3-natsort-7.1.1-5.el9.noarch.r 1.1 MB/s | 58 kB 00:00 2024-05-15T15:37:23.406 INFO:teuthology.orchestra.run.smithi084.stdout:(135/158): python3-pecan-1.4.2-3.el9.noarch.rpm 5.3 MB/s | 272 kB 00:00 2024-05-15T15:37:23.432 INFO:teuthology.orchestra.run.smithi084.stdout:(136/158): python3-portend-3.1.0-2.el9.noarch.r 328 kB/s | 16 kB 00:00 2024-05-15T15:37:23.457 INFO:teuthology.orchestra.run.smithi084.stdout:(137/158): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.7 MB/s | 90 kB 00:00 2024-05-15T15:37:23.482 INFO:teuthology.orchestra.run.smithi084.stdout:(138/158): python3-pyperclip-1.8.2-2.el9.noarch 562 kB/s | 28 kB 00:00 2024-05-15T15:37:23.508 INFO:teuthology.orchestra.run.smithi084.stdout:(139/158): python3-repoze-lru-0.7-16.el9.noarch 613 kB/s | 31 kB 00:00 2024-05-15T15:37:23.541 INFO:teuthology.orchestra.run.smithi084.stdout:(140/158): python3-kubernetes-26.1.0-2.el9.noar 3.4 MB/s | 1.0 MB 00:00 2024-05-15T15:37:23.562 INFO:teuthology.orchestra.run.smithi104.stdout:(26/158): librgw2-19.0.0-3709.g43296076.el9.x86 4.7 MB/s | 5.2 MB 00:01 2024-05-15T15:37:23.566 INFO:teuthology.orchestra.run.smithi084.stdout:(141/158): python3-rsa-4.9-2.el9.noarch.rpm 1.0 MB/s | 59 kB 00:00 2024-05-15T15:37:23.592 INFO:teuthology.orchestra.run.smithi084.stdout:(142/158): python3-routes-2.5.1-5.el9.noarch.rp 1.7 MB/s | 188 kB 00:00 2024-05-15T15:37:23.617 INFO:teuthology.orchestra.run.smithi084.stdout:(143/158): python3-tempora-5.0.0-2.el9.noarch.r 473 kB/s | 36 kB 00:00 2024-05-15T15:37:23.642 INFO:teuthology.orchestra.run.smithi084.stdout:(144/158): python3-typing-extensions-4.4.0-2.el 676 kB/s | 51 kB 00:00 2024-05-15T15:37:23.668 INFO:teuthology.orchestra.run.smithi084.stdout:(145/158): python3-websocket-client-1.2.3-2.el9 1.8 MB/s | 90 kB 00:00 2024-05-15T15:37:23.693 INFO:teuthology.orchestra.run.smithi084.stdout:(146/158): python3-webob-1.8.7-6.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-05-15T15:37:23.718 INFO:teuthology.orchestra.run.smithi084.stdout:(147/158): python3-zc-lockfile-2.0-10.el9.noarc 399 kB/s | 20 kB 00:00 2024-05-15T15:37:23.743 INFO:teuthology.orchestra.run.smithi084.stdout:(148/158): re2-20211101-3.el9.x86_64.rpm 3.7 MB/s | 192 kB 00:00 2024-05-15T15:37:23.769 INFO:teuthology.orchestra.run.smithi084.stdout:(149/158): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-05-15T15:37:23.811 INFO:teuthology.orchestra.run.smithi084.stdout:(150/158): thrift-0.15.0-2.el9.x86_64.rpm 17 MB/s | 1.6 MB 00:00 2024-05-15T15:37:23.971 INFO:teuthology.orchestra.run.smithi104.stdout:(27/158): ceph-test-19.0.0-3709.g43296076.el9.x 11 MB/s | 43 MB 00:04 2024-05-15T15:37:24.005 INFO:teuthology.orchestra.run.smithi104.stdout:(28/158): rbd-nbd-19.0.0-3709.g43296076.el9.x86 383 kB/s | 169 kB 00:00 2024-05-15T15:37:24.030 INFO:teuthology.orchestra.run.smithi104.stdout:(29/158): ceph-grafana-dashboards-19.0.0-3709.g 593 kB/s | 34 kB 00:00 2024-05-15T15:37:24.061 INFO:teuthology.orchestra.run.smithi084.stdout:(151/158): NetworkManager-1.47.90-1.el9.x86_64. 10 MB/s | 2.3 MB 00:00 2024-05-15T15:37:24.097 INFO:teuthology.orchestra.run.smithi104.stdout:(30/158): ceph-mgr-cephadm-19.0.0-3709.g4329607 1.5 MB/s | 143 kB 00:00 2024-05-15T15:37:24.136 INFO:teuthology.orchestra.run.smithi084.stdout:(152/158): NetworkManager-libnm-1.47.90-1.el9.x 24 MB/s | 1.8 MB 00:00 2024-05-15T15:37:24.180 INFO:teuthology.orchestra.run.smithi012.stdout:(10/158): ceph-common-19.0.0-3709.g43296076.el9 1.7 MB/s | 20 MB 00:11 2024-05-15T15:37:24.186 INFO:teuthology.orchestra.run.smithi084.stdout:(153/158): NetworkManager-team-1.47.90-1.el9.x8 830 kB/s | 41 kB 00:00 2024-05-15T15:37:24.197 INFO:teuthology.orchestra.run.smithi104.stdout:(31/158): rbd-mirror-19.0.0-3709.g43296076.el9. 3.3 MB/s | 3.0 MB 00:00 2024-05-15T15:37:24.237 INFO:teuthology.orchestra.run.smithi084.stdout:(154/158): NetworkManager-tui-1.47.90-1.el9.x86 4.9 MB/s | 248 kB 00:00 2024-05-15T15:37:24.304 INFO:teuthology.orchestra.run.smithi084.stdout:(155/158): openssl-3.2.1-1.el9.x86_64.rpm 20 MB/s | 1.3 MB 00:00 2024-05-15T15:37:24.321 INFO:teuthology.orchestra.run.smithi012.stdout:(11/158): cephfs-mirror-19.0.0-3709.g43296076.e 1.6 MB/s | 224 kB 00:00 2024-05-15T15:37:24.381 INFO:teuthology.orchestra.run.smithi104.stdout:(32/158): ceph-mgr-modules-core-19.0.0-3709.g43 1.5 MB/s | 274 kB 00:00 2024-05-15T15:37:24.387 INFO:teuthology.orchestra.run.smithi084.stdout:(156/158): openssl-libs-3.2.1-1.el9.x86_64.rpm 29 MB/s | 2.4 MB 00:00 2024-05-15T15:37:24.456 INFO:teuthology.orchestra.run.smithi012.stdout:(12/158): cephfs-shell-19.0.0-3709.g43296076.el 202 kB/s | 27 kB 00:00 2024-05-15T15:37:24.489 INFO:teuthology.orchestra.run.smithi104.stdout:(33/158): ceph-mgr-dashboard-19.0.0-3709.g43296 7.7 MB/s | 3.5 MB 00:00 2024-05-15T15:37:24.514 INFO:teuthology.orchestra.run.smithi012.stdout:(13/158): libcephfs-devel-19.0.0-3709.g43296076 546 kB/s | 32 kB 00:00 2024-05-15T15:37:24.515 INFO:teuthology.orchestra.run.smithi104.stdout:(34/158): ceph-mgr-rook-19.0.0-3709.g43296076.e 372 kB/s | 49 kB 00:00 2024-05-15T15:37:24.556 INFO:teuthology.orchestra.run.smithi104.stdout:(35/158): ceph-prometheus-alerts-19.0.0-3709.g4 249 kB/s | 16 kB 00:00 2024-05-15T15:37:24.607 INFO:teuthology.orchestra.run.smithi104.stdout:(36/158): ceph-volume-19.0.0-3709.g43296076.el9 2.9 MB/s | 273 kB 00:00 2024-05-15T15:37:24.698 INFO:teuthology.orchestra.run.smithi104.stdout:(37/158): cephadm-19.0.0-3709.g43296076.el9.noa 5.3 MB/s | 763 kB 00:00 2024-05-15T15:37:24.724 INFO:teuthology.orchestra.run.smithi104.stdout:(38/158): cephfs-top-19.0.0-3709.g43296076.el9. 158 kB/s | 18 kB 00:00 2024-05-15T15:37:24.763 INFO:teuthology.orchestra.run.smithi084.stdout:(157/158): librbd1-19.0.0-3709.g43296076.el9.x8 3.1 MB/s | 3.1 MB 00:00 2024-05-15T15:37:24.798 INFO:teuthology.orchestra.run.smithi012.stdout:(14/158): libcephfs2-19.0.0-3709.g43296076.el9. 2.6 MB/s | 756 kB 00:00 2024-05-15T15:37:24.865 INFO:teuthology.orchestra.run.smithi012.stdout:(15/158): libcephsqlite-19.0.0-3709.g43296076.e 2.3 MB/s | 157 kB 00:00 2024-05-15T15:37:24.932 INFO:teuthology.orchestra.run.smithi012.stdout:(16/158): librados-devel-19.0.0-3709.g43296076. 1.9 MB/s | 127 kB 00:00 2024-05-15T15:37:25.038 INFO:teuthology.orchestra.run.smithi084.stdout:(158/158): librados2-19.0.0-3709.g43296076.el9. 2.6 MB/s | 3.3 MB 00:01 2024-05-15T15:37:25.044 INFO:teuthology.orchestra.run.smithi084.stdout:-------------------------------------------------------------------------------- 2024-05-15T15:37:25.044 INFO:teuthology.orchestra.run.smithi084.stdout:Total 15 MB/s | 223 MB 00:15 2024-05-15T15:37:25.124 INFO:teuthology.orchestra.run.smithi012.stdout:(17/158): ceph-osd-19.0.0-3709.g43296076.el9.x8 1.9 MB/s | 18 MB 00:09 2024-05-15T15:37:25.149 INFO:teuthology.orchestra.run.smithi104.stdout:(39/158): fuse-2.9.9-15.el9.x86_64.rpm 178 kB/s | 80 kB 00:00 2024-05-15T15:37:25.190 INFO:teuthology.orchestra.run.smithi012.stdout:(18/158): libradosstriper1-19.0.0-3709.g4329607 1.9 MB/s | 497 kB 00:00 2024-05-15T15:37:25.249 INFO:teuthology.orchestra.run.smithi012.stdout:(19/158): python3-ceph-argparse-19.0.0-3709.g43 775 kB/s | 45 kB 00:00 2024-05-15T15:37:25.325 INFO:teuthology.orchestra.run.smithi012.stdout:(20/158): python3-ceph-common-19.0.0-3709.g4329 1.8 MB/s | 136 kB 00:00 2024-05-15T15:37:25.350 INFO:teuthology.orchestra.run.smithi104.stdout:(40/158): ceph-mgr-diskprediction-local-19.0.0- 5.9 MB/s | 7.4 MB 00:01 2024-05-15T15:37:25.392 INFO:teuthology.orchestra.run.smithi012.stdout:(21/158): python3-cephfs-19.0.0-3709.g43296076. 2.4 MB/s | 162 kB 00:00 2024-05-15T15:37:25.477 INFO:teuthology.orchestra.run.smithi104.stdout:(41/158): libquadmath-11.4.1-3.el9.x86_64.rpm 599 kB/s | 195 kB 00:00 2024-05-15T15:37:25.492 INFO:teuthology.orchestra.run.smithi012.stdout:(22/158): python3-rados-19.0.0-3709.g43296076.e 3.1 MB/s | 320 kB 00:00 2024-05-15T15:37:25.534 INFO:teuthology.orchestra.run.smithi104.stdout:(42/158): libgfortran-11.4.1-3.el9.x86_64.rpm 993 kB/s | 803 kB 00:00 2024-05-15T15:37:25.600 INFO:teuthology.orchestra.run.smithi012.stdout:(23/158): python3-rbd-19.0.0-3709.g43296076.el9 2.7 MB/s | 300 kB 00:00 2024-05-15T15:37:25.661 INFO:teuthology.orchestra.run.smithi104.stdout:(43/158): python3-ply-3.11-14.el9.noarch.rpm 857 kB/s | 106 kB 00:00 2024-05-15T15:37:25.667 INFO:teuthology.orchestra.run.smithi012.stdout:(24/158): python3-rgw-19.0.0-3709.g43296076.el9 1.5 MB/s | 99 kB 00:00 2024-05-15T15:37:25.726 INFO:teuthology.orchestra.run.smithi012.stdout:(25/158): rbd-fuse-19.0.0-3709.g43296076.el9.x8 1.4 MB/s | 86 kB 00:00 2024-05-15T15:37:25.776 INFO:teuthology.orchestra.run.smithi104.stdout:(44/158): python3-pycparser-2.20-6.el9.noarch.r 1.1 MB/s | 135 kB 00:00 2024-05-15T15:37:25.868 INFO:teuthology.orchestra.run.smithi104.stdout:(45/158): python3-cryptography-36.0.1-4.el9.x86 3.1 MB/s | 1.2 MB 00:00 2024-05-15T15:37:25.894 INFO:teuthology.orchestra.run.smithi104.stdout:(46/158): python3-requests-2.25.1-8.el9.noarch. 1.0 MB/s | 125 kB 00:00 2024-05-15T15:37:25.985 INFO:teuthology.orchestra.run.smithi104.stdout:(47/158): python3-urllib3-1.26.5-5.el9.noarch.r 1.8 MB/s | 215 kB 00:00 2024-05-15T15:37:26.027 INFO:teuthology.orchestra.run.smithi104.stdout:(48/158): python3-cffi-1.14.5-5.el9.x86_64.rpm 375 kB/s | 253 kB 00:00 2024-05-15T15:37:26.110 INFO:teuthology.orchestra.run.smithi104.stdout:(49/158): boost-program-options-1.75.0-8.el9.x8 1.3 MB/s | 107 kB 00:00 2024-05-15T15:37:26.169 INFO:teuthology.orchestra.run.smithi104.stdout:(50/158): automake-1.16.2-8.el9.noarch.rpm 2.4 MB/s | 689 kB 00:00 2024-05-15T15:37:26.194 INFO:teuthology.orchestra.run.smithi104.stdout:(51/158): elfutils-libelf-devel-0.190-2.el9.x86 260 kB/s | 21 kB 00:00 2024-05-15T15:37:26.246 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction check 2024-05-15T15:37:26.253 INFO:teuthology.orchestra.run.smithi104.stdout:(52/158): flexiblas-3.0.4-8.el9.x86_64.rpm 570 kB/s | 33 kB 00:00 2024-05-15T15:37:26.328 INFO:teuthology.orchestra.run.smithi104.stdout:(53/158): flex-2.6.4-9.el9.x86_64.rpm 1.9 MB/s | 313 kB 00:00 2024-05-15T15:37:26.400 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction check succeeded. 2024-05-15T15:37:26.400 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction test 2024-05-15T15:37:26.406 INFO:teuthology.orchestra.run.smithi104.stdout:(54/158): bison-3.7.4-5.el9.x86_64.rpm 2.2 MB/s | 943 kB 00:00 2024-05-15T15:37:26.437 INFO:teuthology.orchestra.run.smithi104.stdout:(55/158): flexiblas-openblas-openmp-3.0.4-8.el9 169 kB/s | 18 kB 00:00 2024-05-15T15:37:26.443 INFO:teuthology.orchestra.run.smithi012.stdout:(26/158): librgw2-19.0.0-3709.g43296076.el9.x86 3.9 MB/s | 5.2 MB 00:01 2024-05-15T15:37:26.471 INFO:teuthology.orchestra.run.smithi104.stdout:(56/158): libaio-devel-0.3.111-13.el9.x86_64.rp 177 kB/s | 11 kB 00:00 2024-05-15T15:37:26.502 INFO:teuthology.orchestra.run.smithi012.stdout:(27/158): rbd-mirror-19.0.0-3709.g43296076.el9. 3.9 MB/s | 3.0 MB 00:00 2024-05-15T15:37:26.527 INFO:teuthology.orchestra.run.smithi012.stdout:(28/158): rbd-nbd-19.0.0-3709.g43296076.el9.x86 2.0 MB/s | 169 kB 00:00 2024-05-15T15:37:26.537 INFO:teuthology.orchestra.run.smithi104.stdout:(57/158): librabbitmq-0.11.0-7.el9.x86_64.rpm 689 kB/s | 45 kB 00:00 2024-05-15T15:37:26.561 INFO:teuthology.orchestra.run.smithi012.stdout:(29/158): ceph-grafana-dashboards-19.0.0-3709.g 584 kB/s | 34 kB 00:00 2024-05-15T15:37:26.562 INFO:teuthology.orchestra.run.smithi104.stdout:(58/158): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.3 MB/s | 160 kB 00:00 2024-05-15T15:37:26.594 INFO:teuthology.orchestra.run.smithi012.stdout:(30/158): ceph-mgr-cephadm-19.0.0-3709.g4329607 2.1 MB/s | 143 kB 00:00 2024-05-15T15:37:26.746 INFO:teuthology.orchestra.run.smithi104.stdout:(59/158): librdkafka-1.6.1-102.el9.x86_64.rpm 3.1 MB/s | 662 kB 00:00 2024-05-15T15:37:26.797 INFO:teuthology.orchestra.run.smithi104.stdout:(60/158): libtool-2.4.6-45.el9.x86_64.rpm 2.4 MB/s | 582 kB 00:00 2024-05-15T15:37:26.905 INFO:teuthology.orchestra.run.smithi104.stdout:(61/158): flexiblas-netlib-3.0.4-8.el9.x86_64.r 4.6 MB/s | 3.0 MB 00:00 2024-05-15T15:37:26.931 INFO:teuthology.orchestra.run.smithi104.stdout:(62/158): libuuid-devel-2.37.4-18.el9.x86_64.rp 139 kB/s | 25 kB 00:00 2024-05-15T15:37:26.956 INFO:teuthology.orchestra.run.smithi104.stdout:(63/158): libzstd-devel-1.5.1-2.el9.x86_64.rpm 300 kB/s | 47 kB 00:00 2024-05-15T15:37:27.031 INFO:teuthology.orchestra.run.smithi104.stdout:(64/158): lua-5.4.4-4.el9.x86_64.rpm 1.9 MB/s | 188 kB 00:00 2024-05-15T15:37:27.056 INFO:teuthology.orchestra.run.smithi104.stdout:(65/158): openblas-0.3.21-2.el9.x86_64.rpm 354 kB/s | 35 kB 00:00 2024-05-15T15:37:27.098 INFO:teuthology.orchestra.run.smithi104.stdout:(66/158): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.5 MB/s | 292 kB 00:00 2024-05-15T15:37:27.523 INFO:teuthology.orchestra.run.smithi104.stdout:(67/158): postgresql-13.14-1.el9.x86_64.rpm 3.7 MB/s | 1.6 MB 00:00 2024-05-15T15:37:27.536 INFO:teuthology.orchestra.run.smithi012.stdout:(31/158): ceph-test-19.0.0-3709.g43296076.el9.x 4.4 MB/s | 43 MB 00:09 2024-05-15T15:37:27.595 INFO:teuthology.orchestra.run.smithi012.stdout:(32/158): ceph-mgr-dashboard-19.0.0-3709.g43296 3.4 MB/s | 3.5 MB 00:01 2024-05-15T15:37:27.615 INFO:teuthology.orchestra.run.smithi104.stdout:(68/158): openblas-openmp-0.3.21-2.el9.x86_64.r 8.1 MB/s | 4.7 MB 00:00 2024-05-15T15:37:27.636 INFO:teuthology.orchestra.run.smithi012.stdout:(33/158): ceph-mgr-modules-core-19.0.0-3709.g43 2.7 MB/s | 274 kB 00:00 2024-05-15T15:37:27.662 INFO:teuthology.orchestra.run.smithi012.stdout:(34/158): ceph-mgr-rook-19.0.0-3709.g43296076.e 740 kB/s | 49 kB 00:00 2024-05-15T15:37:27.691 INFO:teuthology.orchestra.run.smithi104.stdout:(69/158): postgresql-private-libs-13.14-1.el9.x 1.8 MB/s | 133 kB 00:00 2024-05-15T15:37:27.695 INFO:teuthology.orchestra.run.smithi012.stdout:(35/158): ceph-prometheus-alerts-19.0.0-3709.g4 281 kB/s | 16 kB 00:00 2024-05-15T15:37:27.762 INFO:teuthology.orchestra.run.smithi012.stdout:(36/158): ceph-volume-19.0.0-3709.g43296076.el9 2.7 MB/s | 273 kB 00:00 2024-05-15T15:37:27.808 INFO:teuthology.orchestra.run.smithi104.stdout:(70/158): openssl-devel-3.2.1-1.el9.x86_64.rpm 5.9 MB/s | 4.4 MB 00:00 2024-05-15T15:37:27.821 INFO:teuthology.orchestra.run.smithi012.stdout:(37/158): cephfs-top-19.0.0-3709.g43296076.el9. 313 kB/s | 18 kB 00:00 2024-05-15T15:37:27.854 INFO:teuthology.orchestra.run.smithi012.stdout:(38/158): cephadm-19.0.0-3709.g43296076.el9.noa 4.7 MB/s | 763 kB 00:00 2024-05-15T15:37:27.917 INFO:teuthology.orchestra.run.smithi104.stdout:(71/158): postgresql-contrib-13.14-1.el9.x86_64 2.3 MB/s | 911 kB 00:00 2024-05-15T15:37:27.947 INFO:teuthology.orchestra.run.smithi012.stdout:(39/158): fuse-2.9.9-15.el9.x86_64.rpm 642 kB/s | 80 kB 00:00 2024-05-15T15:37:28.025 INFO:teuthology.orchestra.run.smithi104.stdout:(72/158): protobuf-3.14.0-13.el9.x86_64.rpm 4.7 MB/s | 1.0 MB 00:00 2024-05-15T15:37:28.050 INFO:teuthology.orchestra.run.smithi104.stdout:(73/158): python3-attrs-20.3.0-7.el9.noarch.rpm 662 kB/s | 87 kB 00:00 2024-05-15T15:37:28.055 INFO:teuthology.orchestra.run.smithi012.stdout:(40/158): libgfortran-11.4.1-3.el9.x86_64.rpm 3.9 MB/s | 803 kB 00:00 2024-05-15T15:37:28.105 INFO:teuthology.orchestra.run.smithi012.stdout:(41/158): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.9 MB/s | 253 kB 00:00 2024-05-15T15:37:28.148 INFO:teuthology.orchestra.run.smithi012.stdout:(42/158): libquadmath-11.4.1-3.el9.x86_64.rpm 974 kB/s | 195 kB 00:00 2024-05-15T15:37:28.150 INFO:teuthology.orchestra.run.smithi104.stdout:(74/158): python3-devel-3.9.18-3.el9.x86_64.rpm 2.4 MB/s | 244 kB 00:00 2024-05-15T15:37:28.183 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction test succeeded. 2024-05-15T15:37:28.184 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction 2024-05-15T15:37:28.206 INFO:teuthology.orchestra.run.smithi012.stdout:(43/158): python3-cryptography-36.0.1-4.el9.x86 12 MB/s | 1.2 MB 00:00 2024-05-15T15:37:28.256 INFO:teuthology.orchestra.run.smithi012.stdout:(44/158): python3-ply-3.11-14.el9.noarch.rpm 981 kB/s | 106 kB 00:00 2024-05-15T15:37:28.267 INFO:teuthology.orchestra.run.smithi104.stdout:(75/158): python3-jinja2-2.11.3-5.el9.noarch.rp 2.1 MB/s | 248 kB 00:00 2024-05-15T15:37:28.290 INFO:teuthology.orchestra.run.smithi012.stdout:(45/158): python3-pycparser-2.20-6.el9.noarch.r 1.6 MB/s | 135 kB 00:00 2024-05-15T15:37:28.340 INFO:teuthology.orchestra.run.smithi012.stdout:(46/158): python3-urllib3-1.26.5-5.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-05-15T15:37:28.343 INFO:teuthology.orchestra.run.smithi104.stdout:(76/158): python3-jsonpatch-1.21-16.el9.noarch. 346 kB/s | 26 kB 00:00 2024-05-15T15:37:28.410 INFO:teuthology.orchestra.run.smithi104.stdout:(77/158): python3-jsonpointer-2.0-4.el9.noarch. 291 kB/s | 19 kB 00:00 2024-05-15T15:37:28.499 INFO:teuthology.orchestra.run.smithi012.stdout:(47/158): ceph-mgr-diskprediction-local-19.0.0- 3.9 MB/s | 7.4 MB 00:01 2024-05-15T15:37:28.544 INFO:teuthology.orchestra.run.smithi104.stdout:(78/158): postgresql-server-13.14-1.el9.x86_64. 6.8 MB/s | 5.8 MB 00:00 2024-05-15T15:37:28.602 INFO:teuthology.orchestra.run.smithi104.stdout:(79/158): python3-markupsafe-1.1.1-12.el9.x86_6 606 kB/s | 35 kB 00:00 2024-05-15T15:37:28.627 INFO:teuthology.orchestra.run.smithi104.stdout:(80/158): python3-mako-1.1.4-6.el9.noarch.rpm 796 kB/s | 172 kB 00:00 2024-05-15T15:37:28.744 INFO:teuthology.orchestra.run.smithi104.stdout:(81/158): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.1 MB/s | 250 kB 00:00 2024-05-15T15:37:28.807 INFO:teuthology.orchestra.run.smithi012.stdout:(48/158): python3-requests-2.25.1-8.el9.noarch. 227 kB/s | 125 kB 00:00 2024-05-15T15:37:28.869 INFO:teuthology.orchestra.run.smithi104.stdout:(82/158): python3-babel-2.9.1-2.el9.noarch.rpm 7.1 MB/s | 6.0 MB 00:00 2024-05-15T15:37:28.945 INFO:teuthology.orchestra.run.smithi104.stdout:(83/158): python3-oauthlib-3.1.1-5.el9.noarch.r 1.1 MB/s | 222 kB 00:00 2024-05-15T15:37:28.995 INFO:teuthology.orchestra.run.smithi104.stdout:(84/158): python3-packaging-20.9-5.el9.noarch.r 621 kB/s | 77 kB 00:00 2024-05-15T15:37:29.020 INFO:teuthology.orchestra.run.smithi104.stdout:(85/158): python3-prettytable-0.7.2-27.el9.noar 570 kB/s | 42 kB 00:00 2024-05-15T15:37:29.129 INFO:teuthology.orchestra.run.smithi104.stdout:(86/158): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.4 MB/s | 159 kB 00:00 2024-05-15T15:37:29.187 INFO:teuthology.orchestra.run.smithi104.stdout:(87/158): python3-protobuf-3.14.0-13.el9.noarch 1.4 MB/s | 269 kB 00:00 2024-05-15T15:37:29.425 INFO:teuthology.orchestra.run.smithi012.stdout:(49/158): automake-1.16.2-8.el9.noarch.rpm 636 kB/s | 689 kB 00:01 2024-05-15T15:37:29.546 INFO:teuthology.orchestra.run.smithi104.stdout:(88/158): python3-numpy-1.20.1-5.el9.x86_64.rpm 5.4 MB/s | 5.1 MB 00:00 2024-05-15T15:37:29.571 INFO:teuthology.orchestra.run.smithi104.stdout:(89/158): python3-pytz-2021.1-5.el9.noarch.rpm 133 kB/s | 51 kB 00:00 2024-05-15T15:37:29.605 INFO:teuthology.orchestra.run.smithi104.stdout:(90/158): python3-pyasn1-modules-0.4.8-6.el9.no 587 kB/s | 279 kB 00:00 2024-05-15T15:37:29.641 INFO:teuthology.orchestra.run.smithi012.stdout:(50/158): bison-3.7.4-5.el9.x86_64.rpm 826 kB/s | 943 kB 00:01 2024-05-15T15:37:29.658 INFO:teuthology.orchestra.run.smithi104.stdout:(91/158): python3-requests-oauthlib-1.3.0-12.el 485 kB/s | 54 kB 00:00 2024-05-15T15:37:29.667 INFO:teuthology.orchestra.run.smithi012.stdout:(51/158): boost-program-options-1.75.0-8.el9.x8 124 kB/s | 107 kB 00:00 2024-05-15T15:37:29.714 INFO:teuthology.orchestra.run.smithi104.stdout:(92/158): python3-toml-0.10.2-6.el9.noarch.rpm 387 kB/s | 42 kB 00:00 2024-05-15T15:37:29.739 INFO:teuthology.orchestra.run.smithi104.stdout:(93/158): python3-wcwidth-0.2.5-8.el9.noarch.rp 552 kB/s | 44 kB 00:00 2024-05-15T15:37:29.823 INFO:teuthology.orchestra.run.smithi104.stdout:(94/158): qatlib-service-24.02.0-1.el9.x86_64.r 436 kB/s | 36 kB 00:00 2024-05-15T15:37:29.865 INFO:teuthology.orchestra.run.smithi104.stdout:(95/158): qatlib-24.02.0-1.el9.x86_64.rpm 1.4 MB/s | 221 kB 00:00 2024-05-15T15:37:29.890 INFO:teuthology.orchestra.run.smithi104.stdout:(96/158): qatzip-libs-1.2.0-1.el9.x86_64.rpm 718 kB/s | 47 kB 00:00 2024-05-15T15:37:29.965 INFO:teuthology.orchestra.run.smithi104.stdout:(97/158): uuid-1.6.2-55.el9.x86_64.rpm 781 kB/s | 58 kB 00:00 2024-05-15T15:37:30.007 INFO:teuthology.orchestra.run.smithi104.stdout:(98/158): socat-1.7.4.1-5.el9.x86_64.rpm 2.1 MB/s | 305 kB 00:00 2024-05-15T15:37:30.066 INFO:teuthology.orchestra.run.smithi104.stdout:(99/158): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 940 kB/s | 94 kB 00:00 2024-05-15T15:37:30.118 INFO:teuthology.orchestra.run.smithi104.stdout:(100/158): xmlstarlet-1.6.1-20.el9.x86_64.rpm 580 kB/s | 64 kB 00:00 2024-05-15T15:37:30.125 INFO:teuthology.orchestra.run.smithi012.stdout:(52/158): elfutils-libelf-devel-0.190-2.el9.x86 31 kB/s | 21 kB 00:00 2024-05-15T15:37:30.183 INFO:teuthology.orchestra.run.smithi104.stdout:(101/158): zlib-devel-1.2.11-41.el9.x86_64.rpm 387 kB/s | 45 kB 00:00 2024-05-15T15:37:30.209 INFO:teuthology.orchestra.run.smithi104.stdout:(102/158): lua-devel-5.4.4-4.el9.x86_64.rpm 251 kB/s | 22 kB 00:00 2024-05-15T15:37:30.301 INFO:teuthology.orchestra.run.smithi012.stdout:(53/158): flexiblas-3.0.4-8.el9.x86_64.rpm 52 kB/s | 33 kB 00:00 2024-05-15T15:37:30.425 INFO:teuthology.orchestra.run.smithi104.stdout:(103/158): protobuf-compiler-3.14.0-13.el9.x86_ 3.5 MB/s | 863 kB 00:00 2024-05-15T15:37:30.526 INFO:teuthology.orchestra.run.smithi012.stdout:(54/158): flex-2.6.4-9.el9.x86_64.rpm 355 kB/s | 313 kB 00:00 2024-05-15T15:37:30.684 INFO:teuthology.orchestra.run.smithi104.stdout:(104/158): python3-scipy-1.6.2-8.el9.x86_64.rpm 15 MB/s | 16 MB 00:01 2024-05-15T15:37:30.726 INFO:teuthology.orchestra.run.smithi104.stdout:(105/158): abseil-cpp-20211102.0-3.el9.x86_64.r 1.0 MB/s | 548 kB 00:00 2024-05-15T15:37:30.826 INFO:teuthology.orchestra.run.smithi012.stdout:(55/158): flexiblas-openblas-openmp-3.0.4-8.el9 35 kB/s | 18 kB 00:00 2024-05-15T15:37:30.843 INFO:teuthology.orchestra.run.smithi104.stdout:(106/158): grpc-data-1.46.7-10.el9.noarch.rpm 405 kB/s | 19 kB 00:00 2024-05-15T15:37:31.010 INFO:teuthology.orchestra.run.smithi104.stdout:(107/158): gperftools-libs-2.9.1-2.el9.x86_64.r 961 kB/s | 309 kB 00:00 2024-05-15T15:37:31.068 INFO:teuthology.orchestra.run.smithi104.stdout:(108/158): libarrow-doc-9.0.0-11.el9.noarch.rpm 453 kB/s | 26 kB 00:00 2024-05-15T15:37:31.093 INFO:teuthology.orchestra.run.smithi012.stdout:(56/158): libaio-devel-0.3.111-13.el9.x86_64.rp 21 kB/s | 11 kB 00:00 2024-05-15T15:37:31.119 INFO:teuthology.orchestra.run.smithi104.stdout:(109/158): liboath-2.6.7-2.el9.x86_64.rpm 988 kB/s | 49 kB 00:00 2024-05-15T15:37:31.177 INFO:teuthology.orchestra.run.smithi104.stdout:(110/158): libunwind-1.6.2-1.el9.x86_64.rpm 1.1 MB/s | 67 kB 00:00 2024-05-15T15:37:31.253 INFO:teuthology.orchestra.run.smithi104.stdout:(111/158): luarocks-3.9.2-1.el9.noarch.rpm 2.0 MB/s | 151 kB 00:00 2024-05-15T15:37:31.293 INFO:teuthology.orchestra.run.smithi012.stdout:(57/158): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.6 MB/s | 3.0 MB 00:01 2024-05-15T15:37:31.461 INFO:teuthology.orchestra.run.smithi104.stdout:(112/158): fscrypt-0.3.4-2.el9.x86_64.rpm 2.0 MB/s | 2.0 MB 00:01 2024-05-15T15:37:31.577 INFO:teuthology.orchestra.run.smithi012.stdout:(58/158): libpmemobj-1.12.1-1.el9.x86_64.rpm 213 kB/s | 160 kB 00:00 2024-05-15T15:37:31.711 INFO:teuthology.orchestra.run.smithi012.stdout:(59/158): librabbitmq-0.11.0-7.el9.x86_64.rpm 73 kB/s | 45 kB 00:00 2024-05-15T15:37:31.728 INFO:teuthology.orchestra.run.smithi104.stdout:(113/158): parquet-libs-9.0.0-11.el9.x86_64.rpm 3.1 MB/s | 839 kB 00:00 2024-05-15T15:37:31.912 INFO:teuthology.orchestra.run.smithi104.stdout:(114/158): python3-asyncssh-2.13.2-5.el9.noarch 2.9 MB/s | 548 kB 00:00 2024-05-15T15:37:31.994 INFO:teuthology.orchestra.run.smithi104.stdout:(115/158): pam_fscrypt-0.3.4-2.el9.x86_64.rpm 2.5 MB/s | 1.8 MB 00:00 2024-05-15T15:37:32.020 INFO:teuthology.orchestra.run.smithi104.stdout:(116/158): python3-bcrypt-3.2.2-1.el9.x86_64.rp 403 kB/s | 43 kB 00:00 2024-05-15T15:37:32.037 INFO:teuthology.orchestra.run.smithi104.stdout:(117/158): python3-cachetools-4.2.4-1.el9.noarc 759 kB/s | 32 kB 00:00 2024-05-15T15:37:32.063 INFO:teuthology.orchestra.run.smithi104.stdout:(118/158): python3-certifi-2021.10.8-2.el9.noar 365 kB/s | 15 kB 00:00 2024-05-15T15:37:32.171 INFO:teuthology.orchestra.run.smithi104.stdout:(119/158): python3-cheroot-8.6.0-4.el9.noarch.r 1.3 MB/s | 172 kB 00:00 2024-05-15T15:37:32.227 INFO:teuthology.orchestra.run.smithi012.stdout:(60/158): librdkafka-1.6.1-102.el9.x86_64.rpm 710 kB/s | 662 kB 00:00 2024-05-15T15:37:32.230 INFO:teuthology.orchestra.run.smithi104.stdout:(120/158): python3-cherrypy-18.6.1-2.el9.noarch 2.1 MB/s | 358 kB 00:00 2024-05-15T15:37:32.275 INFO:teuthology.orchestra.run.smithi104.stdout:(121/158): python3-colorama-0.4.4-12.el9.noarch 866 kB/s | 35 kB 00:00 2024-05-15T15:37:32.311 INFO:teuthology.orchestra.run.smithi012.stdout:(61/158): libuuid-devel-2.37.4-18.el9.x86_64.rp 42 kB/s | 25 kB 00:00 2024-05-15T15:37:32.381 INFO:teuthology.orchestra.run.smithi104.stdout:(122/158): libarrow-9.0.0-11.el9.x86_64.rpm 2.9 MB/s | 4.4 MB 00:01 2024-05-15T15:37:32.432 INFO:teuthology.orchestra.run.smithi104.stdout:(123/158): python3-cmd2-2.4.2-2.el9.noarch.rpm 1.1 MB/s | 303 kB 00:00 2024-05-15T15:37:32.473 INFO:teuthology.orchestra.run.smithi104.stdout:(124/158): python3-google-auth-2.29.0-1.el9.noa 1.0 MB/s | 206 kB 00:00 2024-05-15T15:37:32.511 INFO:teuthology.orchestra.run.smithi012.stdout:(62/158): libtool-2.4.6-45.el9.x86_64.rpm 624 kB/s | 582 kB 00:00 2024-05-15T15:37:32.514 INFO:teuthology.orchestra.run.smithi104.stdout:(125/158): python3-jaraco-8.2.1-3.el9.noarch.rp 265 kB/s | 11 kB 00:00 2024-05-15T15:37:32.557 INFO:teuthology.orchestra.run.smithi104.stdout:(126/158): python3-jaraco-classes-3.2.1-5.el9.n 434 kB/s | 18 kB 00:00 2024-05-15T15:37:32.581 INFO:teuthology.orchestra.run.smithi104.stdout:(127/158): python3-grpcio-tools-1.46.7-10.el9.x 1.3 MB/s | 144 kB 00:00 2024-05-15T15:37:32.607 INFO:teuthology.orchestra.run.smithi104.stdout:(128/158): python3-jaraco-collections-3.0.0-8.e 466 kB/s | 23 kB 00:00 2024-05-15T15:37:32.633 INFO:teuthology.orchestra.run.smithi104.stdout:(129/158): python3-jaraco-functools-3.5.0-2.el9 389 kB/s | 19 kB 00:00 2024-05-15T15:37:32.658 INFO:teuthology.orchestra.run.smithi104.stdout:(130/158): python3-jaraco-text-3.2.0-6.el9.noar 399 kB/s | 20 kB 00:00 2024-05-15T15:37:32.700 INFO:teuthology.orchestra.run.smithi104.stdout:(131/158): python3-logutils-0.3.5-21.el9.noarch 1.1 MB/s | 46 kB 00:00 2024-05-15T15:37:32.750 INFO:teuthology.orchestra.run.smithi104.stdout:(132/158): python3-more-itertools-8.12.0-2.el9. 1.6 MB/s | 79 kB 00:00 2024-05-15T15:37:32.792 INFO:teuthology.orchestra.run.smithi104.stdout:(133/158): python3-natsort-7.1.1-5.el9.noarch.r 1.4 MB/s | 58 kB 00:00 2024-05-15T15:37:32.895 INFO:teuthology.orchestra.run.smithi012.stdout:(63/158): libzstd-devel-1.5.1-2.el9.x86_64.rpm 71 kB/s | 47 kB 00:00 2024-05-15T15:37:32.957 INFO:teuthology.orchestra.run.smithi104.stdout:(134/158): python3-pecan-1.4.2-3.el9.noarch.rpm 1.6 MB/s | 272 kB 00:00 2024-05-15T15:37:33.009 INFO:teuthology.orchestra.run.smithi104.stdout:(135/158): python3-portend-3.1.0-2.el9.noarch.r 325 kB/s | 16 kB 00:00 2024-05-15T15:37:33.069 INFO:teuthology.orchestra.run.smithi104.stdout:(136/158): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.5 MB/s | 90 kB 00:00 2024-05-15T15:37:33.119 INFO:teuthology.orchestra.run.smithi104.stdout:(137/158): python3-pyperclip-1.8.2-2.el9.noarch 575 kB/s | 28 kB 00:00 2024-05-15T15:37:33.178 INFO:teuthology.orchestra.run.smithi012.stdout:(64/158): lttng-ust-2.12.0-6.el9.x86_64.rpm 337 kB/s | 292 kB 00:00 2024-05-15T15:37:33.193 INFO:teuthology.orchestra.run.smithi104.stdout:(138/158): python3-grpcio-1.46.7-10.el9.x86_64. 2.5 MB/s | 2.0 MB 00:00 2024-05-15T15:37:33.218 INFO:teuthology.orchestra.run.smithi104.stdout:(139/158): python3-repoze-lru-0.7-16.el9.noarch 309 kB/s | 31 kB 00:00 2024-05-15T15:37:33.269 INFO:teuthology.orchestra.run.smithi104.stdout:(140/158): python3-kubernetes-26.1.0-2.el9.noar 1.6 MB/s | 1.0 MB 00:00 2024-05-15T15:37:33.294 INFO:teuthology.orchestra.run.smithi104.stdout:(141/158): python3-rsa-4.9-2.el9.noarch.rpm 795 kB/s | 59 kB 00:00 2024-05-15T15:37:33.295 INFO:teuthology.orchestra.run.smithi012.stdout:(65/158): lua-5.4.4-4.el9.x86_64.rpm 240 kB/s | 188 kB 00:00 2024-05-15T15:37:33.327 INFO:teuthology.orchestra.run.smithi104.stdout:(142/158): python3-routes-2.5.1-5.el9.noarch.rp 1.4 MB/s | 188 kB 00:00 2024-05-15T15:37:33.353 INFO:teuthology.orchestra.run.smithi104.stdout:(143/158): python3-tempora-5.0.0-2.el9.noarch.r 432 kB/s | 36 kB 00:00 2024-05-15T15:37:33.378 INFO:teuthology.orchestra.run.smithi104.stdout:(144/158): python3-typing-extensions-4.4.0-2.el 614 kB/s | 51 kB 00:00 2024-05-15T15:37:33.453 INFO:teuthology.orchestra.run.smithi104.stdout:(145/158): python3-websocket-client-1.2.3-2.el9 907 kB/s | 90 kB 00:00 2024-05-15T15:37:33.479 INFO:teuthology.orchestra.run.smithi104.stdout:(146/158): python3-webob-1.8.7-6.el9.noarch.rpm 1.8 MB/s | 230 kB 00:00 2024-05-15T15:37:33.504 INFO:teuthology.orchestra.run.smithi104.stdout:(147/158): python3-zc-lockfile-2.0-10.el9.noarc 404 kB/s | 20 kB 00:00 2024-05-15T15:37:33.512 INFO:teuthology.orchestra.run.smithi012.stdout:(66/158): openblas-0.3.21-2.el9.x86_64.rpm 57 kB/s | 35 kB 00:00 2024-05-15T15:37:33.563 INFO:teuthology.orchestra.run.smithi104.stdout:(148/158): re2-20211101-3.el9.x86_64.rpm 2.3 MB/s | 192 kB 00:00 2024-05-15T15:37:33.754 INFO:teuthology.orchestra.run.smithi104.stdout:(149/158): python3-werkzeug-2.0.3-3.el9.1.noarc 1.1 MB/s | 427 kB 00:00 2024-05-15T15:37:34.196 INFO:teuthology.orchestra.run.smithi104.stdout:(150/158): librados2-19.0.0-3709.g43296076.el9. 5.3 MB/s | 3.3 MB 00:00 2024-05-15T15:37:34.370 INFO:teuthology.orchestra.run.smithi012.stdout:(67/158): openblas-openmp-0.3.21-2.el9.x86_64.r 4.0 MB/s | 4.7 MB 00:01 2024-05-15T15:37:34.388 INFO:teuthology.orchestra.run.smithi104.stdout:(151/158): librbd1-19.0.0-3709.g43296076.el9.x8 4.9 MB/s | 3.1 MB 00:00 2024-05-15T15:37:34.447 INFO:teuthology.orchestra.run.smithi084.stdout: Preparing : 1/1 2024-05-15T15:37:34.488 INFO:teuthology.orchestra.run.smithi012.stdout:(68/158): openssl-devel-3.2.1-1.el9.x86_64.rpm 3.7 MB/s | 4.4 MB 00:01 2024-05-15T15:37:34.550 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/166 2024-05-15T15:37:34.588 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/166 2024-05-15T15:37:34.598 INFO:teuthology.orchestra.run.smithi012.stdout:(69/158): postgresql-13.14-1.el9.x86_64.rpm 1.5 MB/s | 1.6 MB 00:01 2024-05-15T15:37:34.622 INFO:teuthology.orchestra.run.smithi104.stdout:(152/158): thrift-0.15.0-2.el9.x86_64.rpm 1.4 MB/s | 1.6 MB 00:01 2024-05-15T15:37:34.642 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/166 2024-05-15T15:37:34.676 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/166 2024-05-15T15:37:34.702 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/166 2024-05-15T15:37:34.744 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/166 2024-05-15T15:37:34.964 INFO:teuthology.orchestra.run.smithi104.stdout:(153/158): NetworkManager-team-1.47.90-1.el9.x8 122 kB/s | 41 kB 00:00 2024-05-15T15:37:35.070 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/166 2024-05-15T15:37:35.181 INFO:teuthology.orchestra.run.smithi104.stdout:(154/158): NetworkManager-1.47.90-1.el9.x86_64. 2.3 MB/s | 2.3 MB 00:00 2024-05-15T15:37:35.279 INFO:teuthology.orchestra.run.smithi012.stdout:(70/158): postgresql-private-libs-13.14-1.el9.x 168 kB/s | 133 kB 00:00 2024-05-15T15:37:35.285 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : librados2-2:19.0.0-3709.g43296076.el9.x86_64 8/166 2024-05-15T15:37:35.314 INFO:teuthology.orchestra.run.smithi104.stdout:(155/158): NetworkManager-tui-1.47.90-1.el9.x86 709 kB/s | 248 kB 00:00 2024-05-15T15:37:35.415 INFO:teuthology.orchestra.run.smithi104.stdout:(156/158): openssl-3.2.1-1.el9.x86_64.rpm 5.8 MB/s | 1.3 MB 00:00 2024-05-15T15:37:35.421 INFO:teuthology.orchestra.run.smithi012.stdout:(71/158): postgresql-contrib-13.14-1.el9.x86_64 868 kB/s | 911 kB 00:01 2024-05-15T15:37:35.490 INFO:teuthology.orchestra.run.smithi104.stdout:(157/158): NetworkManager-libnm-1.47.90-1.el9.x 1.6 MB/s | 1.8 MB 00:01 2024-05-15T15:37:35.513 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: librados2-2:19.0.0-3709.g43296076.el9.x86_64 8/166 2024-05-15T15:37:35.553 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libcephfs2-2:19.0.0-3709.g43296076.el9.x86_64 9/166 2024-05-15T15:37:35.637 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: libcephfs2-2:19.0.0-3709.g43296076.el9.x86_64 9/166 2024-05-15T15:37:35.666 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-rados-2:19.0.0-3709.g43296076.el9.x86_64 10/166 2024-05-15T15:37:35.806 INFO:teuthology.orchestra.run.smithi104.stdout:(158/158): openssl-libs-3.2.1-1.el9.x86_64.rpm 4.9 MB/s | 2.4 MB 00:00 2024-05-15T15:37:35.817 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/166 2024-05-15T15:37:35.820 INFO:teuthology.orchestra.run.smithi104.stdout:-------------------------------------------------------------------------------- 2024-05-15T15:37:35.821 INFO:teuthology.orchestra.run.smithi104.stdout:Total 11 MB/s | 223 MB 00:20 2024-05-15T15:37:35.863 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/166 2024-05-15T15:37:35.872 INFO:teuthology.orchestra.run.smithi012.stdout:(72/158): postgresql-server-13.14-1.el9.x86_64. 4.5 MB/s | 5.8 MB 00:01 2024-05-15T15:37:35.891 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libcephsqlite-2:19.0.0-3709.g43296076.el9.x86_64 13/166 2024-05-15T15:37:35.996 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3709.g43296076.el9.x86_64 13/166 2024-05-15T15:37:36.026 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libradosstriper1-2:19.0.0-3709.g43296076.el9.x86 14/166 2024-05-15T15:37:36.071 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3709.g43296076.el9.x86 14/166 2024-05-15T15:37:36.093 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/166 2024-05-15T15:37:36.116 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/166 2024-05-15T15:37:36.172 INFO:teuthology.orchestra.run.smithi012.stdout:(73/158): python3-attrs-20.3.0-7.el9.noarch.rpm 117 kB/s | 87 kB 00:00 2024-05-15T15:37:36.288 INFO:teuthology.orchestra.run.smithi012.stdout:(74/158): protobuf-3.14.0-13.el9.x86_64.rpm 1.0 MB/s | 1.0 MB 00:01 2024-05-15T15:37:36.336 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/166 2024-05-15T15:37:36.502 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/166 2024-05-15T15:37:36.649 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : NetworkManager-libnm-1:1.47.90-1.el9.x86_64 17/166 2024-05-15T15:37:36.701 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.90-1.el9.x86_64 17/166 2024-05-15T15:37:36.816 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: NetworkManager-1:1.47.90-1.el9.x86_64 18/166 2024-05-15T15:37:36.894 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : NetworkManager-1:1.47.90-1.el9.x86_64 18/166 2024-05-15T15:37:37.022 INFO:teuthology.orchestra.run.smithi012.stdout:(75/158): python3-devel-3.9.18-3.el9.x86_64.rpm 287 kB/s | 244 kB 00:00 2024-05-15T15:37:37.089 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: NetworkManager-1:1.47.90-1.el9.x86_64 18/166 2024-05-15T15:37:37.114 INFO:teuthology.orchestra.run.smithi012.stdout:(76/158): python3-babel-2.9.1-2.el9.noarch.rpm 4.8 MB/s | 6.0 MB 00:01 2024-05-15T15:37:37.140 INFO:teuthology.orchestra.run.smithi012.stdout:(77/158): python3-jinja2-2.11.3-5.el9.noarch.rp 291 kB/s | 248 kB 00:00 2024-05-15T15:37:37.203 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : re2-1:20211101-3.el9.x86_64 19/166 2024-05-15T15:37:37.234 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/166 2024-05-15T15:37:37.268 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : liboath-2.6.7-2.el9.x86_64 21/166 2024-05-15T15:37:37.333 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 22/166 2024-05-15T15:37:37.368 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 23/166 2024-05-15T15:37:37.412 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 24/166 2024-05-15T15:37:37.445 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 25/166 2024-05-15T15:37:37.473 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : lua-5.4.4-4.el9.x86_64 26/166 2024-05-15T15:37:37.541 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 27/166 2024-05-15T15:37:37.597 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 28/166 2024-05-15T15:37:37.627 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 29/166 2024-05-15T15:37:37.671 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 30/166 2024-05-15T15:37:37.723 INFO:teuthology.orchestra.run.smithi012.stdout:(78/158): python3-jsonpatch-1.21-16.el9.noarch. 37 kB/s | 26 kB 00:00 2024-05-15T15:37:37.747 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 31/166 2024-05-15T15:37:37.765 INFO:teuthology.orchestra.run.smithi012.stdout:(79/158): python3-jsonpointer-2.0-4.el9.noarch. 29 kB/s | 19 kB 00:00 2024-05-15T15:37:37.783 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-ceph-common-2:19.0.0-3709.g43296076.el9. 32/166 2024-05-15T15:37:37.834 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-ceph-argparse-2:19.0.0-3709.g43296076.el 33/166 2024-05-15T15:37:37.863 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-cephfs-2:19.0.0-3709.g43296076.el9.x86_6 34/166 2024-05-15T15:37:37.932 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 35/166 2024-05-15T15:37:37.986 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : luarocks-3.9.2-1.el9.noarch 36/166 2024-05-15T15:37:38.060 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 37/166 2024-05-15T15:37:38.099 INFO:teuthology.orchestra.run.smithi012.stdout:(80/158): python3-mako-1.1.4-6.el9.noarch.rpm 180 kB/s | 172 kB 00:00 2024-05-15T15:37:38.201 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 38/166 2024-05-15T15:37:38.255 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 39/166 2024-05-15T15:37:38.785 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-rsa-4.9-2.el9.noarch 40/166 2024-05-15T15:37:38.863 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction check 2024-05-15T15:37:38.867 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 41/166 2024-05-15T15:37:38.897 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 42/166 2024-05-15T15:37:38.915 INFO:teuthology.orchestra.run.smithi012.stdout:(81/158): python3-numpy-f2py-1.20.1-5.el9.x86_6 307 kB/s | 250 kB 00:00 2024-05-15T15:37:38.939 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 43/166 2024-05-15T15:37:38.977 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : librados-devel-2:19.0.0-3709.g43296076.el9.x86_6 44/166 2024-05-15T15:37:38.991 INFO:teuthology.orchestra.run.smithi012.stdout:(82/158): python3-numpy-1.20.1-5.el9.x86_64.rpm 4.2 MB/s | 5.1 MB 00:01 2024-05-15T15:37:39.018 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 45/166 2024-05-15T15:37:39.105 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction check succeeded. 2024-05-15T15:37:39.105 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction test 2024-05-15T15:37:39.174 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 46/166 2024-05-15T15:37:39.259 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 47/166 2024-05-15T15:37:39.314 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : pam_fscrypt-0.3.4-2.el9.x86_64 48/166 2024-05-15T15:37:39.348 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : fscrypt-0.3.4-2.el9.x86_64 49/166 2024-05-15T15:37:39.382 INFO:teuthology.orchestra.run.smithi012.stdout:(83/158): python3-markupsafe-1.1.1-12.el9.x86_6 21 kB/s | 35 kB 00:01 2024-05-15T15:37:39.438 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/166 2024-05-15T15:37:39.513 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/166 2024-05-15T15:37:39.584 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/166 2024-05-15T15:37:39.616 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 53/166 2024-05-15T15:37:39.677 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 54/166 2024-05-15T15:37:39.725 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/166 2024-05-15T15:37:39.760 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/166 2024-05-15T15:37:39.783 INFO:teuthology.orchestra.run.smithi012.stdout:(84/158): python3-packaging-20.9-5.el9.noarch.r 101 kB/s | 77 kB 00:00 2024-05-15T15:37:39.803 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/166 2024-05-15T15:37:39.845 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/166 2024-05-15T15:37:39.975 INFO:teuthology.orchestra.run.smithi012.stdout:(85/158): python3-oauthlib-3.1.1-5.el9.noarch.r 210 kB/s | 222 kB 00:01 2024-05-15T15:37:39.982 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/166 2024-05-15T15:37:40.192 INFO:teuthology.orchestra.run.smithi012.stdout:(86/158): python3-prettytable-0.7.2-27.el9.noar 52 kB/s | 42 kB 00:00 2024-05-15T15:37:40.251 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/166 2024-05-15T15:37:40.281 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 61/166 2024-05-15T15:37:40.323 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 62/166 2024-05-15T15:37:40.417 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 63/166 2024-05-15T15:37:40.515 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 64/166 2024-05-15T15:37:40.555 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 65/166 2024-05-15T15:37:40.588 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 66/166 2024-05-15T15:37:40.613 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 67/166 2024-05-15T15:37:40.688 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 68/166 2024-05-15T15:37:40.734 INFO:teuthology.orchestra.run.smithi012.stdout:(87/158): python3-protobuf-3.14.0-13.el9.noarch 284 kB/s | 269 kB 00:00 2024-05-15T15:37:40.759 INFO:teuthology.orchestra.run.smithi012.stdout:(88/158): python3-pyasn1-0.4.8-6.el9.noarch.rpm 203 kB/s | 159 kB 00:00 2024-05-15T15:37:40.815 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 69/166 2024-05-15T15:37:40.862 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 70/166 2024-05-15T15:37:40.882 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 71/166 2024-05-15T15:37:40.916 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 72/166 2024-05-15T15:37:40.955 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : uuid-1.6.2-55.el9.x86_64 73/166 2024-05-15T15:37:40.986 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 74/166 2024-05-15T15:37:41.016 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 75/166 2024-05-15T15:37:41.042 INFO:teuthology.orchestra.run.smithi012.stdout:(89/158): python3-pyasn1-modules-0.4.8-6.el9.no 328 kB/s | 279 kB 00:00 2024-05-15T15:37:41.050 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 76/166 2024-05-15T15:37:41.084 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 77/166 2024-05-15T15:37:41.125 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 78/166 2024-05-15T15:37:41.160 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 79/166 2024-05-15T15:37:41.239 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 80/166 2024-05-15T15:37:41.282 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 81/166 2024-05-15T15:37:41.313 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 82/166 2024-05-15T15:37:41.360 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 83/166 2024-05-15T15:37:41.376 INFO:teuthology.orchestra.run.smithi012.stdout:(90/158): python3-pytz-2021.1-5.el9.noarch.rpm 79 kB/s | 51 kB 00:00 2024-05-15T15:37:41.410 INFO:teuthology.orchestra.run.smithi012.stdout:(91/158): python3-requests-oauthlib-1.3.0-12.el 82 kB/s | 54 kB 00:00 2024-05-15T15:37:41.459 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-packaging-20.9-5.el9.noarch 84/166 2024-05-15T15:37:41.506 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 85/166 2024-05-15T15:37:41.675 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction test succeeded. 2024-05-15T15:37:41.676 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction 2024-05-15T15:37:41.993 INFO:teuthology.orchestra.run.smithi012.stdout:(92/158): python3-toml-0.10.2-6.el9.noarch.rpm 68 kB/s | 42 kB 00:00 2024-05-15T15:37:42.026 INFO:teuthology.orchestra.run.smithi012.stdout:(93/158): python3-wcwidth-0.2.5-8.el9.noarch.rp 72 kB/s | 44 kB 00:00 2024-05-15T15:37:42.222 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 86/166 2024-05-15T15:37:42.271 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 87/166 2024-05-15T15:37:42.304 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 88/166 2024-05-15T15:37:42.405 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 89/166 2024-05-15T15:37:42.470 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 90/166 2024-05-15T15:37:42.560 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 91/166 2024-05-15T15:37:42.598 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 92/166 2024-05-15T15:37:42.618 INFO:teuthology.orchestra.run.smithi012.stdout:(94/158): python3-scipy-1.6.2-8.el9.x86_64.rpm 10 MB/s | 16 MB 00:01 2024-05-15T15:37:42.652 INFO:teuthology.orchestra.run.smithi012.stdout:(95/158): qatlib-service-24.02.0-1.el9.x86_64.r 57 kB/s | 36 kB 00:00 2024-05-15T15:37:42.776 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : openblas-0.3.21-2.el9.x86_64 93/166 2024-05-15T15:37:42.813 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 94/166 2024-05-15T15:37:42.890 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 95/166 2024-05-15T15:37:42.927 INFO:teuthology.orchestra.run.smithi012.stdout:(96/158): qatlib-24.02.0-1.el9.x86_64.rpm 236 kB/s | 221 kB 00:00 2024-05-15T15:37:43.319 INFO:teuthology.orchestra.run.smithi012.stdout:(97/158): qatzip-libs-1.2.0-1.el9.x86_64.rpm 68 kB/s | 47 kB 00:00 2024-05-15T15:37:43.536 INFO:teuthology.orchestra.run.smithi012.stdout:(98/158): socat-1.7.4.1-5.el9.x86_64.rpm 345 kB/s | 305 kB 00:00 2024-05-15T15:37:43.536 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 96/166 2024-05-15T15:37:43.652 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 97/166 2024-05-15T15:37:43.653 INFO:teuthology.orchestra.run.smithi012.stdout:(99/158): uuid-1.6.2-55.el9.x86_64.rpm 80 kB/s | 58 kB 00:00 2024-05-15T15:37:44.087 INFO:teuthology.orchestra.run.smithi012.stdout:(100/158): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 122 kB/s | 94 kB 00:00 2024-05-15T15:37:44.290 INFO:teuthology.orchestra.run.smithi012.stdout:(101/158): xmlstarlet-1.6.1-20.el9.x86_64.rpm 85 kB/s | 64 kB 00:00 2024-05-15T15:37:44.337 INFO:teuthology.orchestra.run.smithi012.stdout:(102/158): zlib-devel-1.2.11-41.el9.x86_64.rpm 65 kB/s | 45 kB 00:00 2024-05-15T15:37:44.371 INFO:teuthology.orchestra.run.smithi012.stdout:(103/158): lua-devel-5.4.4-4.el9.x86_64.rpm 79 kB/s | 22 kB 00:00 2024-05-15T15:37:44.621 INFO:teuthology.orchestra.run.smithi012.stdout:(104/158): abseil-cpp-20211102.0-3.el9.x86_64.r 1.9 MB/s | 548 kB 00:00 2024-05-15T15:37:44.696 INFO:teuthology.orchestra.run.smithi012.stdout:(105/158): gperftools-libs-2.9.1-2.el9.x86_64.r 4.0 MB/s | 309 kB 00:00 2024-05-15T15:37:44.772 INFO:teuthology.orchestra.run.smithi012.stdout:(106/158): fscrypt-0.3.4-2.el9.x86_64.rpm 5.1 MB/s | 2.0 MB 00:00 2024-05-15T15:37:44.797 INFO:teuthology.orchestra.run.smithi012.stdout:(107/158): grpc-data-1.46.7-10.el9.noarch.rpm 194 kB/s | 19 kB 00:00 2024-05-15T15:37:44.872 INFO:teuthology.orchestra.run.smithi012.stdout:(108/158): libarrow-doc-9.0.0-11.el9.noarch.rpm 346 kB/s | 26 kB 00:00 2024-05-15T15:37:44.896 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 98/166 2024-05-15T15:37:44.939 INFO:teuthology.orchestra.run.smithi012.stdout:(109/158): liboath-2.6.7-2.el9.x86_64.rpm 731 kB/s | 49 kB 00:00 2024-05-15T15:37:44.983 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 99/166 2024-05-15T15:37:45.006 INFO:teuthology.orchestra.run.smithi012.stdout:(110/158): libarrow-9.0.0-11.el9.x86_64.rpm 19 MB/s | 4.4 MB 00:00 2024-05-15T15:37:45.010 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 100/166 2024-05-15T15:37:45.031 INFO:teuthology.orchestra.run.smithi012.stdout:(111/158): libunwind-1.6.2-1.el9.x86_64.rpm 734 kB/s | 67 kB 00:00 2024-05-15T15:37:45.044 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 101/166 2024-05-15T15:37:45.073 INFO:teuthology.orchestra.run.smithi012.stdout:(112/158): luarocks-3.9.2-1.el9.noarch.rpm 2.2 MB/s | 151 kB 00:00 2024-05-15T15:37:45.132 INFO:teuthology.orchestra.run.smithi012.stdout:(113/158): protobuf-compiler-3.14.0-13.el9.x86_ 1.0 MB/s | 863 kB 00:00 2024-05-15T15:37:45.166 INFO:teuthology.orchestra.run.smithi012.stdout:(114/158): parquet-libs-9.0.0-11.el9.x86_64.rpm 8.9 MB/s | 839 kB 00:00 2024-05-15T15:37:45.241 INFO:teuthology.orchestra.run.smithi012.stdout:(115/158): pam_fscrypt-0.3.4-2.el9.x86_64.rpm 8.8 MB/s | 1.8 MB 00:00 2024-05-15T15:37:45.257 INFO:teuthology.orchestra.run.smithi012.stdout:(116/158): python3-bcrypt-3.2.2-1.el9.x86_64.rp 473 kB/s | 43 kB 00:00 2024-05-15T15:37:45.316 INFO:teuthology.orchestra.run.smithi012.stdout:(117/158): python3-cachetools-4.2.4-1.el9.noarc 428 kB/s | 32 kB 00:00 2024-05-15T15:37:45.342 INFO:teuthology.orchestra.run.smithi012.stdout:(118/158): python3-certifi-2021.10.8-2.el9.noar 179 kB/s | 15 kB 00:00 2024-05-15T15:37:45.364 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 102/166 2024-05-15T15:37:45.400 INFO:teuthology.orchestra.run.smithi012.stdout:(119/158): python3-cheroot-8.6.0-4.el9.noarch.r 2.0 MB/s | 172 kB 00:00 2024-05-15T15:37:45.407 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : librbd1-2:19.0.0-3709.g43296076.el9.x86_64 103/166 2024-05-15T15:37:45.425 INFO:teuthology.orchestra.run.smithi012.stdout:(120/158): python3-cherrypy-18.6.1-2.el9.noarch 4.2 MB/s | 358 kB 00:00 2024-05-15T15:37:45.481 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: librbd1-2:19.0.0-3709.g43296076.el9.x86_64 103/166 2024-05-15T15:37:45.492 INFO:teuthology.orchestra.run.smithi012.stdout:(121/158): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.2 MB/s | 303 kB 00:00 2024-05-15T15:37:45.510 INFO:teuthology.orchestra.run.smithi012.stdout:(122/158): python3-colorama-0.4.4-12.el9.noarch 421 kB/s | 35 kB 00:00 2024-05-15T15:37:45.511 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-rbd-2:19.0.0-3709.g43296076.el9.x86_64 104/166 2024-05-15T15:37:45.548 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 105/166 2024-05-15T15:37:45.551 INFO:teuthology.orchestra.run.smithi012.stdout:(123/158): python3-asyncssh-2.13.2-5.el9.noarch 1.3 MB/s | 548 kB 00:00 2024-05-15T15:37:45.585 INFO:teuthology.orchestra.run.smithi012.stdout:(124/158): python3-google-auth-2.29.0-1.el9.noa 2.2 MB/s | 206 kB 00:00 2024-05-15T15:37:45.652 INFO:teuthology.orchestra.run.smithi012.stdout:(125/158): python3-grpcio-tools-1.46.7-10.el9.x 1.4 MB/s | 144 kB 00:00 2024-05-15T15:37:45.669 INFO:teuthology.orchestra.run.smithi012.stdout:(126/158): python3-jaraco-8.2.1-3.el9.noarch.rp 128 kB/s | 11 kB 00:00 2024-05-15T15:37:45.711 INFO:teuthology.orchestra.run.smithi012.stdout:(127/158): python3-grpcio-1.46.7-10.el9.x86_64. 10 MB/s | 2.0 MB 00:00 2024-05-15T15:37:45.730 INFO:teuthology.orchestra.run.smithi012.stdout:(128/158): python3-jaraco-classes-3.2.1-5.el9.n 234 kB/s | 18 kB 00:00 2024-05-15T15:37:45.745 INFO:teuthology.orchestra.run.smithi012.stdout:(129/158): python3-jaraco-collections-3.0.0-8.e 306 kB/s | 23 kB 00:00 2024-05-15T15:37:45.778 INFO:teuthology.orchestra.run.smithi012.stdout:(130/158): python3-jaraco-functools-3.5.0-2.el9 290 kB/s | 19 kB 00:00 2024-05-15T15:37:45.795 INFO:teuthology.orchestra.run.smithi012.stdout:(131/158): python3-jaraco-text-3.2.0-6.el9.noar 292 kB/s | 20 kB 00:00 2024-05-15T15:37:45.899 INFO:teuthology.orchestra.run.smithi012.stdout:(132/158): python3-logutils-0.3.5-21.el9.noarch 383 kB/s | 46 kB 00:00 2024-05-15T15:37:45.980 INFO:teuthology.orchestra.run.smithi012.stdout:(133/158): python3-kubernetes-26.1.0-2.el9.noar 4.4 MB/s | 1.0 MB 00:00 2024-05-15T15:37:45.996 INFO:teuthology.orchestra.run.smithi012.stdout:(134/158): python3-more-itertools-8.12.0-2.el9. 392 kB/s | 79 kB 00:00 2024-05-15T15:37:46.022 INFO:teuthology.orchestra.run.smithi012.stdout:(135/158): python3-natsort-7.1.1-5.el9.noarch.r 474 kB/s | 58 kB 00:00 2024-05-15T15:37:46.037 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 106/166 2024-05-15T15:37:46.055 INFO:teuthology.orchestra.run.smithi012.stdout:(136/158): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2024-05-15T15:37:46.068 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : librgw2-2:19.0.0-3709.g43296076.el9.x86_64 107/166 2024-05-15T15:37:46.081 INFO:teuthology.orchestra.run.smithi012.stdout:(137/158): python3-portend-3.1.0-2.el9.noarch.r 196 kB/s | 16 kB 00:00 2024-05-15T15:37:46.106 INFO:teuthology.orchestra.run.smithi012.stdout:(138/158): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.0 MB/s | 90 kB 00:00 2024-05-15T15:37:46.131 INFO:teuthology.orchestra.run.smithi012.stdout:(139/158): python3-pyperclip-1.8.2-2.el9.noarch 375 kB/s | 28 kB 00:00 2024-05-15T15:37:46.139 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: librgw2-2:19.0.0-3709.g43296076.el9.x86_64 107/166 2024-05-15T15:37:46.157 INFO:teuthology.orchestra.run.smithi012.stdout:(140/158): python3-repoze-lru-0.7-16.el9.noarch 407 kB/s | 31 kB 00:00 2024-05-15T15:37:46.170 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-rgw-2:19.0.0-3709.g43296076.el9.x86_64 108/166 2024-05-15T15:37:46.181 INFO:teuthology.orchestra.run.smithi012.stdout:(141/158): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-05-15T15:37:46.207 INFO:teuthology.orchestra.run.smithi012.stdout:(142/158): python3-rsa-4.9-2.el9.noarch.rpm 784 kB/s | 59 kB 00:00 2024-05-15T15:37:46.232 INFO:teuthology.orchestra.run.smithi012.stdout:(143/158): python3-tempora-5.0.0-2.el9.noarch.r 474 kB/s | 36 kB 00:00 2024-05-15T15:37:46.257 INFO:teuthology.orchestra.run.smithi012.stdout:(144/158): python3-typing-extensions-4.4.0-2.el 676 kB/s | 51 kB 00:00 2024-05-15T15:37:46.283 INFO:teuthology.orchestra.run.smithi012.stdout:(145/158): python3-webob-1.8.7-6.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-05-15T15:37:46.317 INFO:teuthology.orchestra.run.smithi012.stdout:(146/158): python3-websocket-client-1.2.3-2.el9 1.0 MB/s | 90 kB 00:00 2024-05-15T15:37:46.342 INFO:teuthology.orchestra.run.smithi012.stdout:(147/158): python3-zc-lockfile-2.0-10.el9.noarc 340 kB/s | 20 kB 00:00 2024-05-15T15:37:46.384 INFO:teuthology.orchestra.run.smithi012.stdout:(148/158): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-05-15T15:37:46.409 INFO:teuthology.orchestra.run.smithi012.stdout:(149/158): re2-20211101-3.el9.x86_64.rpm 2.0 MB/s | 192 kB 00:00 2024-05-15T15:37:46.459 INFO:teuthology.orchestra.run.smithi012.stdout:(150/158): thrift-0.15.0-2.el9.x86_64.rpm 14 MB/s | 1.6 MB 00:00 2024-05-15T15:37:46.801 INFO:teuthology.orchestra.run.smithi012.stdout:(151/158): NetworkManager-1.47.90-1.el9.x86_64. 6.8 MB/s | 2.3 MB 00:00 2024-05-15T15:37:47.035 INFO:teuthology.orchestra.run.smithi012.stdout:(152/158): librbd1-19.0.0-3709.g43296076.el9.x8 4.9 MB/s | 3.1 MB 00:00 2024-05-15T15:37:47.077 INFO:teuthology.orchestra.run.smithi012.stdout:(153/158): NetworkManager-libnm-1.47.90-1.el9.x 6.6 MB/s | 1.8 MB 00:00 2024-05-15T15:37:47.127 INFO:teuthology.orchestra.run.smithi012.stdout:(154/158): NetworkManager-team-1.47.90-1.el9.x8 451 kB/s | 41 kB 00:00 2024-05-15T15:37:47.178 INFO:teuthology.orchestra.run.smithi012.stdout:(155/158): librados2-19.0.0-3709.g43296076.el9. 4.2 MB/s | 3.3 MB 00:00 2024-05-15T15:37:47.287 INFO:teuthology.orchestra.run.smithi012.stdout:(156/158): NetworkManager-tui-1.47.90-1.el9.x86 1.2 MB/s | 248 kB 00:00 2024-05-15T15:37:47.321 INFO:teuthology.orchestra.run.smithi012.stdout:(157/158): openssl-3.2.1-1.el9.x86_64.rpm 7.0 MB/s | 1.3 MB 00:00 2024-05-15T15:37:47.514 INFO:teuthology.orchestra.run.smithi012.stdout:(158/158): openssl-libs-3.2.1-1.el9.x86_64.rpm 7.1 MB/s | 2.4 MB 00:00 2024-05-15T15:37:47.516 INFO:teuthology.orchestra.run.smithi012.stdout:-------------------------------------------------------------------------------- 2024-05-15T15:37:47.516 INFO:teuthology.orchestra.run.smithi012.stdout:Total 6.3 MB/s | 223 MB 00:35 2024-05-15T15:37:48.456 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-common-2:19.0.0-3709.g43296076.el9.x86_64 109/166 2024-05-15T15:37:48.499 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-common-2:19.0.0-3709.g43296076.el9.x86_64 109/166 2024-05-15T15:37:48.530 INFO:teuthology.orchestra.run.smithi104.stdout: Preparing : 1/1 2024-05-15T15:37:48.604 INFO:teuthology.orchestra.run.smithi104.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/166 2024-05-15T15:37:48.670 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction check 2024-05-15T15:37:48.679 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/166 2024-05-15T15:37:48.784 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/166 2024-05-15T15:37:48.835 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/166 2024-05-15T15:37:48.837 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction check succeeded. 2024-05-15T15:37:48.837 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction test 2024-05-15T15:37:48.864 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/166 2024-05-15T15:37:48.944 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/166 2024-05-15T15:37:49.057 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-common-2:19.0.0-3709.g43296076.el9.x86_64 109/166 2024-05-15T15:37:49.094 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-base-2:19.0.0-3709.g43296076.el9.x86_64 110/166 2024-05-15T15:37:49.185 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-base-2:19.0.0-3709.g43296076.el9.x86_64 110/166 2024-05-15T15:37:49.185 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-15T15:37:49.185 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-15T15:37:49.185 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-05-15T15:37:49.215 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-selinux-2:19.0.0-3709.g43296076.el9.x86_64 111/166 2024-05-15T15:37:49.379 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/166 2024-05-15T15:37:49.488 INFO:teuthology.orchestra.run.smithi104.stdout: Upgrading : librados2-2:19.0.0-3709.g43296076.el9.x86_64 8/166 2024-05-15T15:37:49.665 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: librados2-2:19.0.0-3709.g43296076.el9.x86_64 8/166 2024-05-15T15:37:49.697 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libcephfs2-2:19.0.0-3709.g43296076.el9.x86_64 9/166 2024-05-15T15:37:49.820 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: libcephfs2-2:19.0.0-3709.g43296076.el9.x86_64 9/166 2024-05-15T15:37:49.854 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-rados-2:19.0.0-3709.g43296076.el9.x86_64 10/166 2024-05-15T15:37:50.130 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/166 2024-05-15T15:37:50.200 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/166 2024-05-15T15:37:50.226 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libcephsqlite-2:19.0.0-3709.g43296076.el9.x86_64 13/166 2024-05-15T15:37:50.373 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3709.g43296076.el9.x86_64 13/166 2024-05-15T15:37:50.402 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libradosstriper1-2:19.0.0-3709.g43296076.el9.x86 14/166 2024-05-15T15:37:50.488 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3709.g43296076.el9.x86 14/166 2024-05-15T15:37:50.520 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/166 2024-05-15T15:37:50.594 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/166 2024-05-15T15:37:50.739 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction test succeeded. 2024-05-15T15:37:50.739 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction 2024-05-15T15:37:50.879 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/166 2024-05-15T15:37:51.211 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/166 2024-05-15T15:37:51.412 INFO:teuthology.orchestra.run.smithi104.stdout: Upgrading : NetworkManager-libnm-1:1.47.90-1.el9.x86_64 17/166 2024-05-15T15:37:51.497 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.90-1.el9.x86_64 17/166 2024-05-15T15:37:51.683 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: NetworkManager-1:1.47.90-1.el9.x86_64 18/166 2024-05-15T15:37:51.779 INFO:teuthology.orchestra.run.smithi104.stdout: Upgrading : NetworkManager-1:1.47.90-1.el9.x86_64 18/166 2024-05-15T15:37:52.115 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: NetworkManager-1:1.47.90-1.el9.x86_64 18/166 2024-05-15T15:37:52.325 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : re2-1:20211101-3.el9.x86_64 19/166 2024-05-15T15:37:52.367 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/166 2024-05-15T15:37:52.424 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : liboath-2.6.7-2.el9.x86_64 21/166 2024-05-15T15:37:52.572 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 22/166 2024-05-15T15:37:52.700 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 23/166 2024-05-15T15:37:52.780 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 24/166 2024-05-15T15:37:52.839 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 25/166 2024-05-15T15:37:52.876 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : lua-5.4.4-4.el9.x86_64 26/166 2024-05-15T15:37:53.028 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 27/166 2024-05-15T15:37:53.113 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 28/166 2024-05-15T15:37:53.143 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 29/166 2024-05-15T15:37:53.181 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 30/166 2024-05-15T15:37:53.284 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 31/166 2024-05-15T15:37:53.322 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-ceph-common-2:19.0.0-3709.g43296076.el9. 32/166 2024-05-15T15:37:53.383 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-ceph-argparse-2:19.0.0-3709.g43296076.el 33/166 2024-05-15T15:37:53.419 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-cephfs-2:19.0.0-3709.g43296076.el9.x86_6 34/166 2024-05-15T15:37:53.537 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 35/166 2024-05-15T15:37:53.597 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : luarocks-3.9.2-1.el9.noarch 36/166 2024-05-15T15:37:53.696 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 37/166 2024-05-15T15:37:53.877 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 38/166 2024-05-15T15:37:53.943 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 39/166 2024-05-15T15:37:54.647 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-rsa-4.9-2.el9.noarch 40/166 2024-05-15T15:37:54.756 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 41/166 2024-05-15T15:37:54.800 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 42/166 2024-05-15T15:37:54.854 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 43/166 2024-05-15T15:37:54.896 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : librados-devel-2:19.0.0-3709.g43296076.el9.x86_6 44/166 2024-05-15T15:37:54.955 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 45/166 2024-05-15T15:37:55.165 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 46/166 2024-05-15T15:37:55.301 INFO:teuthology.orchestra.run.smithi104.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 47/166 2024-05-15T15:37:55.398 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : pam_fscrypt-0.3.4-2.el9.x86_64 48/166 2024-05-15T15:37:55.438 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : fscrypt-0.3.4-2.el9.x86_64 49/166 2024-05-15T15:37:55.569 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/166 2024-05-15T15:37:55.650 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/166 2024-05-15T15:37:55.736 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/166 2024-05-15T15:37:55.779 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 53/166 2024-05-15T15:37:55.817 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 54/166 2024-05-15T15:37:55.883 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/166 2024-05-15T15:37:55.926 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/166 2024-05-15T15:37:55.988 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/166 2024-05-15T15:37:56.046 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/166 2024-05-15T15:37:56.241 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/166 2024-05-15T15:37:56.299 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/166 2024-05-15T15:37:56.336 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 61/166 2024-05-15T15:37:56.393 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 62/166 2024-05-15T15:37:56.525 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 63/166 2024-05-15T15:37:56.569 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 64/166 2024-05-15T15:37:56.675 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 65/166 2024-05-15T15:37:56.712 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 66/166 2024-05-15T15:37:56.744 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 67/166 2024-05-15T15:37:56.945 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 68/166 2024-05-15T15:37:56.965 INFO:teuthology.orchestra.run.smithi012.stdout: Preparing : 1/1 2024-05-15T15:37:57.035 INFO:teuthology.orchestra.run.smithi012.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/166 2024-05-15T15:37:57.074 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/166 2024-05-15T15:37:57.122 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 69/166 2024-05-15T15:37:57.147 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/166 2024-05-15T15:37:57.173 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 70/166 2024-05-15T15:37:57.186 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/166 2024-05-15T15:37:57.211 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/166 2024-05-15T15:37:57.213 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 71/166 2024-05-15T15:37:57.250 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 72/166 2024-05-15T15:37:57.255 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/166 2024-05-15T15:37:57.307 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : uuid-1.6.2-55.el9.x86_64 73/166 2024-05-15T15:37:57.360 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 74/166 2024-05-15T15:37:57.402 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 75/166 2024-05-15T15:37:57.455 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 76/166 2024-05-15T15:37:57.505 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 77/166 2024-05-15T15:37:57.602 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 78/166 2024-05-15T15:37:57.654 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 79/166 2024-05-15T15:37:57.690 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/166 2024-05-15T15:37:57.737 INFO:teuthology.orchestra.run.smithi012.stdout: Upgrading : librados2-2:19.0.0-3709.g43296076.el9.x86_64 8/166 2024-05-15T15:37:57.799 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 80/166 2024-05-15T15:37:57.858 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 81/166 2024-05-15T15:37:57.865 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: librados2-2:19.0.0-3709.g43296076.el9.x86_64 8/166 2024-05-15T15:37:57.888 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libcephfs2-2:19.0.0-3709.g43296076.el9.x86_64 9/166 2024-05-15T15:37:57.911 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 82/166 2024-05-15T15:37:57.980 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: libcephfs2-2:19.0.0-3709.g43296076.el9.x86_64 9/166 2024-05-15T15:37:57.981 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 83/166 2024-05-15T15:37:58.009 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-rados-2:19.0.0-3709.g43296076.el9.x86_64 10/166 2024-05-15T15:37:58.167 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-packaging-20.9-5.el9.noarch 84/166 2024-05-15T15:37:58.171 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/166 2024-05-15T15:37:58.232 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/166 2024-05-15T15:37:58.241 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 85/166 2024-05-15T15:37:58.260 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libcephsqlite-2:19.0.0-3709.g43296076.el9.x86_64 13/166 2024-05-15T15:37:58.366 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3709.g43296076.el9.x86_64 13/166 2024-05-15T15:37:58.394 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libradosstriper1-2:19.0.0-3709.g43296076.el9.x86 14/166 2024-05-15T15:37:58.457 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3709.g43296076.el9.x86 14/166 2024-05-15T15:37:58.479 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/166 2024-05-15T15:37:58.499 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/166 2024-05-15T15:37:58.646 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/166 2024-05-15T15:37:58.799 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/166 2024-05-15T15:37:58.951 INFO:teuthology.orchestra.run.smithi012.stdout: Upgrading : NetworkManager-libnm-1:1.47.90-1.el9.x86_64 17/166 2024-05-15T15:37:59.011 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.90-1.el9.x86_64 17/166 2024-05-15T15:37:59.097 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: NetworkManager-1:1.47.90-1.el9.x86_64 18/166 2024-05-15T15:37:59.171 INFO:teuthology.orchestra.run.smithi012.stdout: Upgrading : NetworkManager-1:1.47.90-1.el9.x86_64 18/166 2024-05-15T15:37:59.204 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 86/166 2024-05-15T15:37:59.267 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 87/166 2024-05-15T15:37:59.300 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 88/166 2024-05-15T15:37:59.373 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: NetworkManager-1:1.47.90-1.el9.x86_64 18/166 2024-05-15T15:37:59.427 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 89/166 2024-05-15T15:37:59.479 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : re2-1:20211101-3.el9.x86_64 19/166 2024-05-15T15:37:59.495 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 90/166 2024-05-15T15:37:59.508 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/166 2024-05-15T15:37:59.544 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : liboath-2.6.7-2.el9.x86_64 21/166 2024-05-15T15:37:59.599 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 91/166 2024-05-15T15:37:59.620 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 22/166 2024-05-15T15:37:59.635 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 92/166 2024-05-15T15:37:59.660 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 23/166 2024-05-15T15:37:59.712 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 24/166 2024-05-15T15:37:59.744 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 25/166 2024-05-15T15:37:59.772 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : lua-5.4.4-4.el9.x86_64 26/166 2024-05-15T15:37:59.844 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 27/166 2024-05-15T15:37:59.864 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : openblas-0.3.21-2.el9.x86_64 93/166 2024-05-15T15:37:59.896 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 28/166 2024-05-15T15:37:59.898 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 94/166 2024-05-15T15:37:59.925 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 29/166 2024-05-15T15:37:59.960 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 30/166 2024-05-15T15:38:00.004 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 95/166 2024-05-15T15:38:00.039 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 31/166 2024-05-15T15:38:00.071 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-ceph-common-2:19.0.0-3709.g43296076.el9. 32/166 2024-05-15T15:38:00.115 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-ceph-argparse-2:19.0.0-3709.g43296076.el 33/166 2024-05-15T15:38:00.143 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-cephfs-2:19.0.0-3709.g43296076.el9.x86_6 34/166 2024-05-15T15:38:00.218 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 35/166 2024-05-15T15:38:00.275 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : luarocks-3.9.2-1.el9.noarch 36/166 2024-05-15T15:38:00.353 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 37/166 2024-05-15T15:38:00.500 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 38/166 2024-05-15T15:38:00.562 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 39/166 2024-05-15T15:38:00.758 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3709.g43296076.el9.x86_64 111/166 2024-05-15T15:38:00.759 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /sys 2024-05-15T15:38:00.759 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /proc 2024-05-15T15:38:00.759 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /mnt 2024-05-15T15:38:00.759 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /var/tmp 2024-05-15T15:38:00.759 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /home 2024-05-15T15:38:00.759 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /root 2024-05-15T15:38:00.759 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /tmp 2024-05-15T15:38:00.759 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-05-15T15:38:00.813 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 96/166 2024-05-15T15:38:00.927 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-volume-2:19.0.0-3709.g43296076.el9.noarch 112/166 2024-05-15T15:38:00.943 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-volume-2:19.0.0-3709.g43296076.el9.noarch 112/166 2024-05-15T15:38:00.943 INFO:teuthology.orchestra.run.smithi084.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-15T15:38:00.943 INFO:teuthology.orchestra.run.smithi084.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-15T15:38:00.943 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-05-15T15:38:00.954 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 97/166 2024-05-15T15:38:01.129 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-rsa-4.9-2.el9.noarch 40/166 2024-05-15T15:38:01.212 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 41/166 2024-05-15T15:38:01.245 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 42/166 2024-05-15T15:38:01.288 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 43/166 2024-05-15T15:38:01.327 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : librados-devel-2:19.0.0-3709.g43296076.el9.x86_6 44/166 2024-05-15T15:38:01.369 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 45/166 2024-05-15T15:38:01.535 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 46/166 2024-05-15T15:38:01.626 INFO:teuthology.orchestra.run.smithi012.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 47/166 2024-05-15T15:38:01.690 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : pam_fscrypt-0.3.4-2.el9.x86_64 48/166 2024-05-15T15:38:01.722 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : fscrypt-0.3.4-2.el9.x86_64 49/166 2024-05-15T15:38:01.819 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/166 2024-05-15T15:38:01.889 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/166 2024-05-15T15:38:01.963 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/166 2024-05-15T15:38:01.999 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 53/166 2024-05-15T15:38:02.036 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 54/166 2024-05-15T15:38:02.092 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/166 2024-05-15T15:38:02.127 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/166 2024-05-15T15:38:02.171 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/166 2024-05-15T15:38:02.213 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/166 2024-05-15T15:38:02.365 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/166 2024-05-15T15:38:02.409 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/166 2024-05-15T15:38:02.439 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 61/166 2024-05-15T15:38:02.481 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 62/166 2024-05-15T15:38:02.527 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-osd-2:19.0.0-3709.g43296076.el9.x86_64 113/166 2024-05-15T15:38:02.553 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-osd-2:19.0.0-3709.g43296076.el9.x86_64 113/166 2024-05-15T15:38:02.553 INFO:teuthology.orchestra.run.smithi084.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-15T15:38:02.553 INFO:teuthology.orchestra.run.smithi084.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-15T15:38:02.554 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-15T15:38:02.554 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-15T15:38:02.554 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-05-15T15:38:02.577 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 98/166 2024-05-15T15:38:02.580 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 63/166 2024-05-15T15:38:02.614 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 64/166 2024-05-15T15:38:02.663 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 65/166 2024-05-15T15:38:02.688 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 66/166 2024-05-15T15:38:02.697 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 99/166 2024-05-15T15:38:02.713 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 67/166 2024-05-15T15:38:02.732 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 100/166 2024-05-15T15:38:02.768 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 101/166 2024-05-15T15:38:02.777 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mds-2:19.0.0-3709.g43296076.el9.x86_64 114/166 2024-05-15T15:38:02.792 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 68/166 2024-05-15T15:38:02.800 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mds-2:19.0.0-3709.g43296076.el9.x86_64 114/166 2024-05-15T15:38:02.800 INFO:teuthology.orchestra.run.smithi084.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-15T15:38:02.800 INFO:teuthology.orchestra.run.smithi084.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-15T15:38:02.801 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-15T15:38:02.801 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-15T15:38:02.801 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-05-15T15:38:02.930 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 69/166 2024-05-15T15:38:02.971 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 70/166 2024-05-15T15:38:02.999 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 71/166 2024-05-15T15:38:03.033 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 72/166 2024-05-15T15:38:03.072 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : uuid-1.6.2-55.el9.x86_64 73/166 2024-05-15T15:38:03.112 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 74/166 2024-05-15T15:38:03.150 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 75/166 2024-05-15T15:38:03.166 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 102/166 2024-05-15T15:38:03.185 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 76/166 2024-05-15T15:38:03.218 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 77/166 2024-05-15T15:38:03.225 INFO:teuthology.orchestra.run.smithi104.stdout: Upgrading : librbd1-2:19.0.0-3709.g43296076.el9.x86_64 103/166 2024-05-15T15:38:03.260 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 78/166 2024-05-15T15:38:03.270 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mon-2:19.0.0-3709.g43296076.el9.x86_64 115/166 2024-05-15T15:38:03.293 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mon-2:19.0.0-3709.g43296076.el9.x86_64 115/166 2024-05-15T15:38:03.293 INFO:teuthology.orchestra.run.smithi084.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-15T15:38:03.293 INFO:teuthology.orchestra.run.smithi084.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-15T15:38:03.293 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-15T15:38:03.293 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-15T15:38:03.294 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-05-15T15:38:03.294 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 79/166 2024-05-15T15:38:03.350 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: librbd1-2:19.0.0-3709.g43296076.el9.x86_64 103/166 2024-05-15T15:38:03.382 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-rbd-2:19.0.0-3709.g43296076.el9.x86_64 104/166 2024-05-15T15:38:03.385 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 80/166 2024-05-15T15:38:03.399 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : automake-1.16.2-8.el9.noarch 116/166 2024-05-15T15:38:03.434 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 81/166 2024-05-15T15:38:03.447 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 105/166 2024-05-15T15:38:03.448 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-ply-3.11-14.el9.noarch 117/166 2024-05-15T15:38:03.464 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 82/166 2024-05-15T15:38:03.513 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 83/166 2024-05-15T15:38:03.520 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 118/166 2024-05-15T15:38:03.625 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-packaging-20.9-5.el9.noarch 84/166 2024-05-15T15:38:03.675 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 85/166 2024-05-15T15:38:03.704 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 119/166 2024-05-15T15:38:03.754 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 120/166 2024-05-15T15:38:03.830 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 121/166 2024-05-15T15:38:03.918 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 122/166 2024-05-15T15:38:04.002 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 106/166 2024-05-15T15:38:04.048 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 123/166 2024-05-15T15:38:04.061 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : librgw2-2:19.0.0-3709.g43296076.el9.x86_64 107/166 2024-05-15T15:38:04.087 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 124/166 2024-05-15T15:38:04.119 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 125/166 2024-05-15T15:38:04.146 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: librgw2-2:19.0.0-3709.g43296076.el9.x86_64 107/166 2024-05-15T15:38:04.147 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : fuse-2.9.9-15.el9.x86_64 126/166 2024-05-15T15:38:04.172 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-rgw-2:19.0.0-3709.g43296076.el9.x86_64 108/166 2024-05-15T15:38:04.459 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 86/166 2024-05-15T15:38:04.505 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 87/166 2024-05-15T15:38:04.539 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 88/166 2024-05-15T15:38:04.596 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: cephadm-2:19.0.0-3709.g43296076.el9.noarch 127/166 2024-05-15T15:38:04.629 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : cephadm-2:19.0.0-3709.g43296076.el9.noarch 127/166 2024-05-15T15:38:04.646 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 89/166 2024-05-15T15:38:04.669 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3709.g43296076.e 128/166 2024-05-15T15:38:04.698 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 90/166 2024-05-15T15:38:04.731 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3709.g43296076. 129/166 2024-05-15T15:38:04.760 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3709.g43296076.el9.noa 130/166 2024-05-15T15:38:04.789 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 91/166 2024-05-15T15:38:04.841 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 92/166 2024-05-15T15:38:05.025 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : openblas-0.3.21-2.el9.x86_64 93/166 2024-05-15T15:38:05.055 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 94/166 2024-05-15T15:38:05.134 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 95/166 2024-05-15T15:38:05.797 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3709.g43296076.el9.noa 130/166 2024-05-15T15:38:05.828 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 96/166 2024-05-15T15:38:05.829 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3709.g43296076.el9.n 131/166 2024-05-15T15:38:05.941 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 97/166 2024-05-15T15:38:06.790 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3709.g43296076.el9.n 131/166 2024-05-15T15:38:06.820 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3709.g432 132/166 2024-05-15T15:38:06.848 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-common-2:19.0.0-3709.g43296076.el9.x86_64 109/166 2024-05-15T15:38:06.893 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-common-2:19.0.0-3709.g43296076.el9.x86_64 109/166 2024-05-15T15:38:06.930 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3709.g432 132/166 2024-05-15T15:38:07.103 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3709.g43296076.el 133/166 2024-05-15T15:38:07.139 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mgr-2:19.0.0-3709.g43296076.el9.x86_64 134/166 2024-05-15T15:38:07.162 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3709.g43296076.el9.x86_64 134/166 2024-05-15T15:38:07.162 INFO:teuthology.orchestra.run.smithi084.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-15T15:38:07.162 INFO:teuthology.orchestra.run.smithi084.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-15T15:38:07.162 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-15T15:38:07.163 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-15T15:38:07.163 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-05-15T15:38:07.207 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mgr-rook-2:19.0.0-3709.g43296076.el9.noarch 135/166 2024-05-15T15:38:07.218 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3709.g43296076.el9.noarch 135/166 2024-05-15T15:38:07.255 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 98/166 2024-05-15T15:38:07.316 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-2:19.0.0-3709.g43296076.el9.x86_64 136/166 2024-05-15T15:38:07.334 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 99/166 2024-05-15T15:38:07.363 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 100/166 2024-05-15T15:38:07.380 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-fuse-2:19.0.0-3709.g43296076.el9.x86_64 137/166 2024-05-15T15:38:07.396 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 101/166 2024-05-15T15:38:07.733 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 102/166 2024-05-15T15:38:07.768 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-common-2:19.0.0-3709.g43296076.el9.x86_64 109/166 2024-05-15T15:38:07.775 INFO:teuthology.orchestra.run.smithi012.stdout: Upgrading : librbd1-2:19.0.0-3709.g43296076.el9.x86_64 103/166 2024-05-15T15:38:07.813 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-base-2:19.0.0-3709.g43296076.el9.x86_64 110/166 2024-05-15T15:38:07.866 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: librbd1-2:19.0.0-3709.g43296076.el9.x86_64 103/166 2024-05-15T15:38:07.896 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-rbd-2:19.0.0-3709.g43296076.el9.x86_64 104/166 2024-05-15T15:38:07.933 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 105/166 2024-05-15T15:38:07.983 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-base-2:19.0.0-3709.g43296076.el9.x86_64 110/166 2024-05-15T15:38:07.983 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-15T15:38:07.984 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-15T15:38:07.984 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-15T15:38:08.030 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-selinux-2:19.0.0-3709.g43296076.el9.x86_64 111/166 2024-05-15T15:38:08.322 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libtool-2.4.6-45.el9.x86_64 138/166 2024-05-15T15:38:08.350 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-radosgw-2:19.0.0-3709.g43296076.el9.x86_64 139/166 2024-05-15T15:38:08.373 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3709.g43296076.el9.x86_64 139/166 2024-05-15T15:38:08.374 INFO:teuthology.orchestra.run.smithi084.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-15T15:38:08.374 INFO:teuthology.orchestra.run.smithi084.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-15T15:38:08.374 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-15T15:38:08.374 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-15T15:38:08.374 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-05-15T15:38:08.418 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3709.g43296 140/166 2024-05-15T15:38:08.440 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3709.g43296 140/166 2024-05-15T15:38:08.440 INFO:teuthology.orchestra.run.smithi084.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-15T15:38:08.440 INFO:teuthology.orchestra.run.smithi084.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-15T15:38:08.440 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-05-15T15:38:08.447 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 106/166 2024-05-15T15:38:08.469 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : librgw2-2:19.0.0-3709.g43296076.el9.x86_64 107/166 2024-05-15T15:38:08.485 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : cephfs-mirror-2:19.0.0-3709.g43296076.el9.x86_64 141/166 2024-05-15T15:38:08.508 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3709.g43296076.el9.x86_64 141/166 2024-05-15T15:38:08.508 INFO:teuthology.orchestra.run.smithi084.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-15T15:38:08.508 INFO:teuthology.orchestra.run.smithi084.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-05-15T15:38:08.508 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-15T15:38:08.508 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-15T15:38:08.508 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-05-15T15:38:08.524 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: librgw2-2:19.0.0-3709.g43296076.el9.x86_64 107/166 2024-05-15T15:38:08.554 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-rgw-2:19.0.0-3709.g43296076.el9.x86_64 108/166 2024-05-15T15:38:08.827 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : rbd-mirror-2:19.0.0-3709.g43296076.el9.x86_64 142/166 2024-05-15T15:38:08.850 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3709.g43296076.el9.x86_64 142/166 2024-05-15T15:38:08.850 INFO:teuthology.orchestra.run.smithi084.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-15T15:38:08.850 INFO:teuthology.orchestra.run.smithi084.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-15T15:38:08.850 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-15T15:38:08.850 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-15T15:38:08.850 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-05-15T15:38:10.907 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-common-2:19.0.0-3709.g43296076.el9.x86_64 109/166 2024-05-15T15:38:10.943 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-common-2:19.0.0-3709.g43296076.el9.x86_64 109/166 2024-05-15T15:38:11.528 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-common-2:19.0.0-3709.g43296076.el9.x86_64 109/166 2024-05-15T15:38:11.571 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-base-2:19.0.0-3709.g43296076.el9.x86_64 110/166 2024-05-15T15:38:11.673 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-base-2:19.0.0-3709.g43296076.el9.x86_64 110/166 2024-05-15T15:38:11.673 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-15T15:38:11.673 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-15T15:38:11.673 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-05-15T15:38:11.706 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-selinux-2:19.0.0-3709.g43296076.el9.x86_64 111/166 2024-05-15T15:38:13.089 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-test-2:19.0.0-3709.g43296076.el9.x86_64 143/166 2024-05-15T15:38:13.130 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : rbd-fuse-2:19.0.0-3709.g43296076.el9.x86_64 144/166 2024-05-15T15:38:13.171 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : rbd-nbd-2:19.0.0-3709.g43296076.el9.x86_64 145/166 2024-05-15T15:38:13.203 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 146/166 2024-05-15T15:38:13.230 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 147/166 2024-05-15T15:38:13.412 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : cephfs-shell-2:19.0.0-3709.g43296076.el9.x86_64 148/166 2024-05-15T15:38:13.476 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 149/166 2024-05-15T15:38:13.506 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libcephfs-devel-2:19.0.0-3709.g43296076.el9.x86_ 150/166 2024-05-15T15:38:13.536 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : NetworkManager-team-1:1.47.90-1.el9.x86_64 151/166 2024-05-15T15:38:13.593 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : NetworkManager-tui-1:1.47.90-1.el9.x86_64 152/166 2024-05-15T15:38:14.237 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 153/166 2024-05-15T15:38:14.280 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 153/166 2024-05-15T15:38:14.300 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 153/166 2024-05-15T15:38:15.127 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : cephfs-top-2:19.0.0-3709.g43296076.el9.noarch 154/166 2024-05-15T15:38:15.209 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 155/166 2024-05-15T15:38:15.250 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 156/166 2024-05-15T15:38:15.332 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : flex-2.6.4-9.el9.x86_64 157/166 2024-05-15T15:38:15.379 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : bison-3.7.4-5.el9.x86_64 158/166 2024-05-15T15:38:15.414 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 159/166 2024-05-15T15:38:15.414 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/166 2024-05-15T15:38:15.489 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/166 2024-05-15T15:38:15.522 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 161/166 2024-05-15T15:38:15.522 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 162/166 2024-05-15T15:38:15.614 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 162/166 2024-05-15T15:38:15.639 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 163/166 2024-05-15T15:38:15.645 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 164/166 2024-05-15T15:38:15.645 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 164/166 2024-05-15T15:38:15.825 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 164/166 2024-05-15T15:38:15.825 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 165/166 2024-05-15T15:38:15.917 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 165/166 2024-05-15T15:38:15.989 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 166/166 2024-05-15T15:38:20.820 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3709.g43296076.el9.x86_64 111/166 2024-05-15T15:38:20.821 INFO:teuthology.orchestra.run.smithi104.stdout:skipping the directory /sys 2024-05-15T15:38:20.821 INFO:teuthology.orchestra.run.smithi104.stdout:skipping the directory /proc 2024-05-15T15:38:20.821 INFO:teuthology.orchestra.run.smithi104.stdout:skipping the directory /mnt 2024-05-15T15:38:20.821 INFO:teuthology.orchestra.run.smithi104.stdout:skipping the directory /var/tmp 2024-05-15T15:38:20.821 INFO:teuthology.orchestra.run.smithi104.stdout:skipping the directory /home 2024-05-15T15:38:20.821 INFO:teuthology.orchestra.run.smithi104.stdout:skipping the directory /root 2024-05-15T15:38:20.821 INFO:teuthology.orchestra.run.smithi104.stdout:skipping the directory /tmp 2024-05-15T15:38:20.821 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-15T15:38:21.087 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-volume-2:19.0.0-3709.g43296076.el9.noarch 112/166 2024-05-15T15:38:21.133 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-volume-2:19.0.0-3709.g43296076.el9.noarch 112/166 2024-05-15T15:38:21.133 INFO:teuthology.orchestra.run.smithi104.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-15T15:38:21.133 INFO:teuthology.orchestra.run.smithi104.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-15T15:38:21.133 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-15T15:38:21.582 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 166/166 2024-05-15T15:38:21.582 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-2:19.0.0-3709.g43296076.el9.x86_64 1/166 2024-05-15T15:38:21.582 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-base-2:19.0.0-3709.g43296076.el9.x86_64 2/166 2024-05-15T15:38:21.582 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-common-2:19.0.0-3709.g43296076.el9.x86_64 3/166 2024-05-15T15:38:21.582 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-fuse-2:19.0.0-3709.g43296076.el9.x86_64 4/166 2024-05-15T15:38:21.583 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3709.g43296 5/166 2024-05-15T15:38:21.583 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mds-2:19.0.0-3709.g43296076.el9.x86_64 6/166 2024-05-15T15:38:21.583 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mgr-2:19.0.0-3709.g43296076.el9.x86_64 7/166 2024-05-15T15:38:21.583 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mon-2:19.0.0-3709.g43296076.el9.x86_64 8/166 2024-05-15T15:38:21.583 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-osd-2:19.0.0-3709.g43296076.el9.x86_64 9/166 2024-05-15T15:38:21.583 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-radosgw-2:19.0.0-3709.g43296076.el9.x86_64 10/166 2024-05-15T15:38:21.583 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-selinux-2:19.0.0-3709.g43296076.el9.x86_64 11/166 2024-05-15T15:38:21.583 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-test-2:19.0.0-3709.g43296076.el9.x86_64 12/166 2024-05-15T15:38:21.583 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : cephfs-mirror-2:19.0.0-3709.g43296076.el9.x86_64 13/166 2024-05-15T15:38:21.584 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : cephfs-shell-2:19.0.0-3709.g43296076.el9.x86_64 14/166 2024-05-15T15:38:21.584 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libcephfs-devel-2:19.0.0-3709.g43296076.el9.x86_ 15/166 2024-05-15T15:38:21.584 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libcephfs2-2:19.0.0-3709.g43296076.el9.x86_64 16/166 2024-05-15T15:38:21.584 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libcephsqlite-2:19.0.0-3709.g43296076.el9.x86_64 17/166 2024-05-15T15:38:21.584 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librados-devel-2:19.0.0-3709.g43296076.el9.x86_6 18/166 2024-05-15T15:38:21.584 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libradosstriper1-2:19.0.0-3709.g43296076.el9.x86 19/166 2024-05-15T15:38:21.584 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librgw2-2:19.0.0-3709.g43296076.el9.x86_64 20/166 2024-05-15T15:38:21.584 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3709.g43296076.el 21/166 2024-05-15T15:38:21.584 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-ceph-common-2:19.0.0-3709.g43296076.el9. 22/166 2024-05-15T15:38:21.584 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-cephfs-2:19.0.0-3709.g43296076.el9.x86_6 23/166 2024-05-15T15:38:21.585 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-rados-2:19.0.0-3709.g43296076.el9.x86_64 24/166 2024-05-15T15:38:21.585 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-rbd-2:19.0.0-3709.g43296076.el9.x86_64 25/166 2024-05-15T15:38:21.585 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-rgw-2:19.0.0-3709.g43296076.el9.x86_64 26/166 2024-05-15T15:38:21.585 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : rbd-fuse-2:19.0.0-3709.g43296076.el9.x86_64 27/166 2024-05-15T15:38:21.585 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : rbd-mirror-2:19.0.0-3709.g43296076.el9.x86_64 28/166 2024-05-15T15:38:21.585 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : rbd-nbd-2:19.0.0-3709.g43296076.el9.x86_64 29/166 2024-05-15T15:38:21.585 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3709.g43296076. 30/166 2024-05-15T15:38:21.585 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3709.g43296076.el9.noa 31/166 2024-05-15T15:38:21.585 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3709.g43296076.el9.n 32/166 2024-05-15T15:38:21.586 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3709.g432 33/166 2024-05-15T15:38:21.586 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3709.g43296076.el 34/166 2024-05-15T15:38:21.586 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3709.g43296076.el9.noarch 35/166 2024-05-15T15:38:21.586 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3709.g43296076.e 36/166 2024-05-15T15:38:21.586 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-volume-2:19.0.0-3709.g43296076.el9.noarch 37/166 2024-05-15T15:38:21.586 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : cephadm-2:19.0.0-3709.g43296076.el9.noarch 38/166 2024-05-15T15:38:21.586 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : cephfs-top-2:19.0.0-3709.g43296076.el9.noarch 39/166 2024-05-15T15:38:21.586 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/166 2024-05-15T15:38:21.586 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/166 2024-05-15T15:38:21.586 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/166 2024-05-15T15:38:21.586 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/166 2024-05-15T15:38:21.586 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/166 2024-05-15T15:38:21.586 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/166 2024-05-15T15:38:21.587 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/166 2024-05-15T15:38:21.587 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/166 2024-05-15T15:38:21.587 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/166 2024-05-15T15:38:21.587 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/166 2024-05-15T15:38:21.587 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/166 2024-05-15T15:38:21.587 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/166 2024-05-15T15:38:21.587 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/166 2024-05-15T15:38:21.587 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/166 2024-05-15T15:38:21.587 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/166 2024-05-15T15:38:21.587 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/166 2024-05-15T15:38:21.588 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/166 2024-05-15T15:38:21.588 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/166 2024-05-15T15:38:21.588 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/166 2024-05-15T15:38:21.588 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/166 2024-05-15T15:38:21.588 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/166 2024-05-15T15:38:21.588 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/166 2024-05-15T15:38:21.588 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/166 2024-05-15T15:38:21.588 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/166 2024-05-15T15:38:21.588 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/166 2024-05-15T15:38:21.588 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/166 2024-05-15T15:38:21.588 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/166 2024-05-15T15:38:21.588 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/166 2024-05-15T15:38:21.588 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/166 2024-05-15T15:38:21.589 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/166 2024-05-15T15:38:21.589 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/166 2024-05-15T15:38:21.589 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/166 2024-05-15T15:38:21.589 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/166 2024-05-15T15:38:21.589 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/166 2024-05-15T15:38:21.589 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/166 2024-05-15T15:38:21.589 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/166 2024-05-15T15:38:21.589 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/166 2024-05-15T15:38:21.589 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/166 2024-05-15T15:38:21.589 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/166 2024-05-15T15:38:21.589 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/166 2024-05-15T15:38:21.589 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/166 2024-05-15T15:38:21.589 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/166 2024-05-15T15:38:21.589 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/166 2024-05-15T15:38:21.590 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/166 2024-05-15T15:38:21.590 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/166 2024-05-15T15:38:21.590 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/166 2024-05-15T15:38:21.590 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/166 2024-05-15T15:38:21.590 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/166 2024-05-15T15:38:21.590 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/166 2024-05-15T15:38:21.590 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/166 2024-05-15T15:38:21.590 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/166 2024-05-15T15:38:21.590 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/166 2024-05-15T15:38:21.590 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/166 2024-05-15T15:38:21.590 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/166 2024-05-15T15:38:21.590 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/166 2024-05-15T15:38:21.590 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/166 2024-05-15T15:38:21.591 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/166 2024-05-15T15:38:21.591 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/166 2024-05-15T15:38:21.591 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/166 2024-05-15T15:38:21.591 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/166 2024-05-15T15:38:21.591 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/166 2024-05-15T15:38:21.591 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/166 2024-05-15T15:38:21.591 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/166 2024-05-15T15:38:21.591 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/166 2024-05-15T15:38:21.591 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/166 2024-05-15T15:38:21.591 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/166 2024-05-15T15:38:21.591 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : fscrypt-0.3.4-2.el9.x86_64 106/166 2024-05-15T15:38:21.591 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/166 2024-05-15T15:38:21.591 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/166 2024-05-15T15:38:21.592 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/166 2024-05-15T15:38:21.592 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/166 2024-05-15T15:38:21.592 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/166 2024-05-15T15:38:21.592 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/166 2024-05-15T15:38:21.592 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 113/166 2024-05-15T15:38:21.592 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : pam_fscrypt-0.3.4-2.el9.x86_64 114/166 2024-05-15T15:38:21.592 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/166 2024-05-15T15:38:21.592 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/166 2024-05-15T15:38:21.592 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/166 2024-05-15T15:38:21.592 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/166 2024-05-15T15:38:21.592 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 119/166 2024-05-15T15:38:21.592 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/166 2024-05-15T15:38:21.592 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/166 2024-05-15T15:38:21.593 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/166 2024-05-15T15:38:21.593 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 123/166 2024-05-15T15:38:21.593 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 124/166 2024-05-15T15:38:21.593 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 125/166 2024-05-15T15:38:21.593 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 126/166 2024-05-15T15:38:21.593 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 127/166 2024-05-15T15:38:21.593 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 128/166 2024-05-15T15:38:21.593 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 129/166 2024-05-15T15:38:21.593 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 130/166 2024-05-15T15:38:21.593 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 131/166 2024-05-15T15:38:21.593 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 132/166 2024-05-15T15:38:21.593 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 133/166 2024-05-15T15:38:21.593 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 134/166 2024-05-15T15:38:21.593 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 135/166 2024-05-15T15:38:21.594 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 136/166 2024-05-15T15:38:21.594 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 137/166 2024-05-15T15:38:21.594 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 138/166 2024-05-15T15:38:21.594 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 139/166 2024-05-15T15:38:21.594 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 140/166 2024-05-15T15:38:21.594 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 141/166 2024-05-15T15:38:21.594 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 142/166 2024-05-15T15:38:21.595 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 143/166 2024-05-15T15:38:21.595 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 144/166 2024-05-15T15:38:21.595 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 145/166 2024-05-15T15:38:21.595 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 146/166 2024-05-15T15:38:21.595 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 147/166 2024-05-15T15:38:21.595 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 148/166 2024-05-15T15:38:21.595 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : re2-1:20211101-3.el9.x86_64 149/166 2024-05-15T15:38:21.595 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 150/166 2024-05-15T15:38:21.595 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librados2-2:19.0.0-3709.g43296076.el9.x86_64 151/166 2024-05-15T15:38:21.595 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 152/166 2024-05-15T15:38:21.595 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librbd1-2:19.0.0-3709.g43296076.el9.x86_64 153/166 2024-05-15T15:38:21.595 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 154/166 2024-05-15T15:38:21.595 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : NetworkManager-1:1.47.90-1.el9.x86_64 155/166 2024-05-15T15:38:21.595 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 156/166 2024-05-15T15:38:21.596 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : NetworkManager-libnm-1:1.47.90-1.el9.x86_64 157/166 2024-05-15T15:38:21.596 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 158/166 2024-05-15T15:38:21.596 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : NetworkManager-team-1:1.47.90-1.el9.x86_64 159/166 2024-05-15T15:38:21.596 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 160/166 2024-05-15T15:38:21.596 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : NetworkManager-tui-1:1.47.90-1.el9.x86_64 161/166 2024-05-15T15:38:21.596 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 162/166 2024-05-15T15:38:21.596 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 163/166 2024-05-15T15:38:21.596 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 164/166 2024-05-15T15:38:21.596 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 165/166 2024-05-15T15:38:22.855 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-osd-2:19.0.0-3709.g43296076.el9.x86_64 113/166 2024-05-15T15:38:22.932 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-osd-2:19.0.0-3709.g43296076.el9.x86_64 113/166 2024-05-15T15:38:22.933 INFO:teuthology.orchestra.run.smithi104.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-15T15:38:22.933 INFO:teuthology.orchestra.run.smithi104.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-15T15:38:22.933 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-15T15:38:22.933 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-15T15:38:22.933 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-15T15:38:23.188 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-mds-2:19.0.0-3709.g43296076.el9.x86_64 114/166 2024-05-15T15:38:23.256 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-mds-2:19.0.0-3709.g43296076.el9.x86_64 114/166 2024-05-15T15:38:23.256 INFO:teuthology.orchestra.run.smithi104.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-15T15:38:23.256 INFO:teuthology.orchestra.run.smithi104.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-15T15:38:23.256 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-15T15:38:23.256 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-15T15:38:23.257 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-15T15:38:23.694 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3709.g43296076.el9.x86_64 111/166 2024-05-15T15:38:23.694 INFO:teuthology.orchestra.run.smithi012.stdout:skipping the directory /sys 2024-05-15T15:38:23.694 INFO:teuthology.orchestra.run.smithi012.stdout:skipping the directory /proc 2024-05-15T15:38:23.694 INFO:teuthology.orchestra.run.smithi012.stdout:skipping the directory /mnt 2024-05-15T15:38:23.694 INFO:teuthology.orchestra.run.smithi012.stdout:skipping the directory /var/tmp 2024-05-15T15:38:23.694 INFO:teuthology.orchestra.run.smithi012.stdout:skipping the directory /home 2024-05-15T15:38:23.694 INFO:teuthology.orchestra.run.smithi012.stdout:skipping the directory /root 2024-05-15T15:38:23.695 INFO:teuthology.orchestra.run.smithi012.stdout:skipping the directory /tmp 2024-05-15T15:38:23.695 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-05-15T15:38:23.773 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-mon-2:19.0.0-3709.g43296076.el9.x86_64 115/166 2024-05-15T15:38:23.842 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-mon-2:19.0.0-3709.g43296076.el9.x86_64 115/166 2024-05-15T15:38:23.842 INFO:teuthology.orchestra.run.smithi104.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-15T15:38:23.843 INFO:teuthology.orchestra.run.smithi104.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-15T15:38:23.843 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-15T15:38:23.843 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-15T15:38:23.843 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-15T15:38:23.871 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-volume-2:19.0.0-3709.g43296076.el9.noarch 112/166 2024-05-15T15:38:23.887 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-volume-2:19.0.0-3709.g43296076.el9.noarch 112/166 2024-05-15T15:38:23.887 INFO:teuthology.orchestra.run.smithi012.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-15T15:38:23.887 INFO:teuthology.orchestra.run.smithi012.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-15T15:38:23.887 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-05-15T15:38:23.973 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : automake-1.16.2-8.el9.noarch 116/166 2024-05-15T15:38:24.034 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-ply-3.11-14.el9.noarch 117/166 2024-05-15T15:38:24.102 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 118/166 2024-05-15T15:38:24.132 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 166/166 2024-05-15T15:38:24.133 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-05-15T15:38:24.133 INFO:teuthology.orchestra.run.smithi084.stdout:Upgraded: 2024-05-15T15:38:24.133 INFO:teuthology.orchestra.run.smithi084.stdout: NetworkManager-1:1.47.90-1.el9.x86_64 2024-05-15T15:38:24.133 INFO:teuthology.orchestra.run.smithi084.stdout: NetworkManager-libnm-1:1.47.90-1.el9.x86_64 2024-05-15T15:38:24.133 INFO:teuthology.orchestra.run.smithi084.stdout: NetworkManager-team-1:1.47.90-1.el9.x86_64 2024-05-15T15:38:24.133 INFO:teuthology.orchestra.run.smithi084.stdout: NetworkManager-tui-1:1.47.90-1.el9.x86_64 2024-05-15T15:38:24.133 INFO:teuthology.orchestra.run.smithi084.stdout: librados2-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-15T15:38:24.133 INFO:teuthology.orchestra.run.smithi084.stdout: librbd1-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-15T15:38:24.133 INFO:teuthology.orchestra.run.smithi084.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-05-15T15:38:24.133 INFO:teuthology.orchestra.run.smithi084.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-05-15T15:38:24.133 INFO:teuthology.orchestra.run.smithi084.stdout:Installed: 2024-05-15T15:38:24.134 INFO:teuthology.orchestra.run.smithi084.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-05-15T15:38:24.134 INFO:teuthology.orchestra.run.smithi084.stdout: automake-1.16.2-8.el9.noarch 2024-05-15T15:38:24.134 INFO:teuthology.orchestra.run.smithi084.stdout: bison-3.7.4-5.el9.x86_64 2024-05-15T15:38:24.134 INFO:teuthology.orchestra.run.smithi084.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-15T15:38:24.134 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-15T15:38:24.134 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-base-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-15T15:38:24.134 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-common-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-15T15:38:24.134 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-fuse-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-15T15:38:24.134 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-grafana-dashboards-2:19.0.0-3709.g43296076.el9.noarch 2024-05-15T15:38:24.134 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-immutable-object-cache-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-15T15:38:24.134 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mds-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-15T15:38:24.135 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-15T15:38:24.135 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-cephadm-2:19.0.0-3709.g43296076.el9.noarch 2024-05-15T15:38:24.135 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-dashboard-2:19.0.0-3709.g43296076.el9.noarch 2024-05-15T15:38:24.135 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3709.g43296076.el9.noarch 2024-05-15T15:38:24.135 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-modules-core-2:19.0.0-3709.g43296076.el9.noarch 2024-05-15T15:38:24.135 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-rook-2:19.0.0-3709.g43296076.el9.noarch 2024-05-15T15:38:24.135 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mon-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-15T15:38:24.135 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-osd-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-15T15:38:24.135 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-prometheus-alerts-2:19.0.0-3709.g43296076.el9.noarch 2024-05-15T15:38:24.135 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-radosgw-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-15T15:38:24.135 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-selinux-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-15T15:38:24.135 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-test-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-15T15:38:24.135 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-volume-2:19.0.0-3709.g43296076.el9.noarch 2024-05-15T15:38:24.135 INFO:teuthology.orchestra.run.smithi084.stdout: cephadm-2:19.0.0-3709.g43296076.el9.noarch 2024-05-15T15:38:24.136 INFO:teuthology.orchestra.run.smithi084.stdout: cephfs-mirror-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-15T15:38:24.136 INFO:teuthology.orchestra.run.smithi084.stdout: cephfs-shell-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-15T15:38:24.136 INFO:teuthology.orchestra.run.smithi084.stdout: cephfs-top-2:19.0.0-3709.g43296076.el9.noarch 2024-05-15T15:38:24.136 INFO:teuthology.orchestra.run.smithi084.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-05-15T15:38:24.136 INFO:teuthology.orchestra.run.smithi084.stdout: flex-2.6.4-9.el9.x86_64 2024-05-15T15:38:24.136 INFO:teuthology.orchestra.run.smithi084.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-15T15:38:24.136 INFO:teuthology.orchestra.run.smithi084.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-15T15:38:24.136 INFO:teuthology.orchestra.run.smithi084.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-15T15:38:24.136 INFO:teuthology.orchestra.run.smithi084.stdout: fscrypt-0.3.4-2.el9.x86_64 2024-05-15T15:38:24.136 INFO:teuthology.orchestra.run.smithi084.stdout: fuse-2.9.9-15.el9.x86_64 2024-05-15T15:38:24.136 INFO:teuthology.orchestra.run.smithi084.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-15T15:38:24.136 INFO:teuthology.orchestra.run.smithi084.stdout: grpc-data-1.46.7-10.el9.noarch 2024-05-15T15:38:24.137 INFO:teuthology.orchestra.run.smithi084.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-05-15T15:38:24.137 INFO:teuthology.orchestra.run.smithi084.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-15T15:38:24.137 INFO:teuthology.orchestra.run.smithi084.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-15T15:38:24.137 INFO:teuthology.orchestra.run.smithi084.stdout: libcephfs-devel-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-15T15:38:24.137 INFO:teuthology.orchestra.run.smithi084.stdout: libcephfs2-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-15T15:38:24.137 INFO:teuthology.orchestra.run.smithi084.stdout: libcephsqlite-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-15T15:38:24.137 INFO:teuthology.orchestra.run.smithi084.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-15T15:38:24.137 INFO:teuthology.orchestra.run.smithi084.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-15T15:38:24.137 INFO:teuthology.orchestra.run.smithi084.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-15T15:38:24.137 INFO:teuthology.orchestra.run.smithi084.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-15T15:38:24.137 INFO:teuthology.orchestra.run.smithi084.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-15T15:38:24.137 INFO:teuthology.orchestra.run.smithi084.stdout: librados-devel-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-15T15:38:24.138 INFO:teuthology.orchestra.run.smithi084.stdout: libradosstriper1-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-15T15:38:24.138 INFO:teuthology.orchestra.run.smithi084.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-15T15:38:24.138 INFO:teuthology.orchestra.run.smithi084.stdout: librgw2-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-15T15:38:24.138 INFO:teuthology.orchestra.run.smithi084.stdout: libtool-2.4.6-45.el9.x86_64 2024-05-15T15:38:24.138 INFO:teuthology.orchestra.run.smithi084.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-15T15:38:24.138 INFO:teuthology.orchestra.run.smithi084.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-05-15T15:38:24.138 INFO:teuthology.orchestra.run.smithi084.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-05-15T15:38:24.138 INFO:teuthology.orchestra.run.smithi084.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-15T15:38:24.138 INFO:teuthology.orchestra.run.smithi084.stdout: lua-5.4.4-4.el9.x86_64 2024-05-15T15:38:24.138 INFO:teuthology.orchestra.run.smithi084.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-05-15T15:38:24.138 INFO:teuthology.orchestra.run.smithi084.stdout: luarocks-3.9.2-1.el9.noarch 2024-05-15T15:38:24.139 INFO:teuthology.orchestra.run.smithi084.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-15T15:38:24.139 INFO:teuthology.orchestra.run.smithi084.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-15T15:38:24.139 INFO:teuthology.orchestra.run.smithi084.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-05-15T15:38:24.139 INFO:teuthology.orchestra.run.smithi084.stdout: pam_fscrypt-0.3.4-2.el9.x86_64 2024-05-15T15:38:24.139 INFO:teuthology.orchestra.run.smithi084.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-15T15:38:24.139 INFO:teuthology.orchestra.run.smithi084.stdout: postgresql-13.14-1.el9.x86_64 2024-05-15T15:38:24.139 INFO:teuthology.orchestra.run.smithi084.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-05-15T15:38:24.139 INFO:teuthology.orchestra.run.smithi084.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-05-15T15:38:24.139 INFO:teuthology.orchestra.run.smithi084.stdout: postgresql-server-13.14-1.el9.x86_64 2024-05-15T15:38:24.139 INFO:teuthology.orchestra.run.smithi084.stdout: protobuf-3.14.0-13.el9.x86_64 2024-05-15T15:38:24.139 INFO:teuthology.orchestra.run.smithi084.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-05-15T15:38:24.139 INFO:teuthology.orchestra.run.smithi084.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-15T15:38:24.139 INFO:teuthology.orchestra.run.smithi084.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-05-15T15:38:24.140 INFO:teuthology.orchestra.run.smithi084.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-15T15:38:24.140 INFO:teuthology.orchestra.run.smithi084.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-15T15:38:24.140 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-15T15:38:24.140 INFO:teuthology.orchestra.run.smithi084.stdout: python3-ceph-argparse-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-15T15:38:24.140 INFO:teuthology.orchestra.run.smithi084.stdout: python3-ceph-common-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-15T15:38:24.140 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cephfs-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-15T15:38:24.140 INFO:teuthology.orchestra.run.smithi084.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-15T15:38:24.140 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-15T15:38:24.140 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-15T15:38:24.140 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-15T15:38:24.140 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-05-15T15:38:24.140 INFO:teuthology.orchestra.run.smithi084.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-05-15T15:38:24.141 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-15T15:38:24.141 INFO:teuthology.orchestra.run.smithi084.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-15T15:38:24.141 INFO:teuthology.orchestra.run.smithi084.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-15T15:38:24.141 INFO:teuthology.orchestra.run.smithi084.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-05-15T15:38:24.141 INFO:teuthology.orchestra.run.smithi084.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-05-15T15:38:24.141 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-15T15:38:24.141 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-15T15:38:24.141 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-15T15:38:24.141 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-15T15:38:24.141 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-15T15:38:24.141 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-05-15T15:38:24.142 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-15T15:38:24.142 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-15T15:38:24.142 INFO:teuthology.orchestra.run.smithi084.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-15T15:38:24.142 INFO:teuthology.orchestra.run.smithi084.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-15T15:38:24.142 INFO:teuthology.orchestra.run.smithi084.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-15T15:38:24.142 INFO:teuthology.orchestra.run.smithi084.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-15T15:38:24.142 INFO:teuthology.orchestra.run.smithi084.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-15T15:38:24.142 INFO:teuthology.orchestra.run.smithi084.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-15T15:38:24.142 INFO:teuthology.orchestra.run.smithi084.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-15T15:38:24.142 INFO:teuthology.orchestra.run.smithi084.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-15T15:38:24.142 INFO:teuthology.orchestra.run.smithi084.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-15T15:38:24.143 INFO:teuthology.orchestra.run.smithi084.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-15T15:38:24.143 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-15T15:38:24.143 INFO:teuthology.orchestra.run.smithi084.stdout: python3-ply-3.11-14.el9.noarch 2024-05-15T15:38:24.143 INFO:teuthology.orchestra.run.smithi084.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-15T15:38:24.143 INFO:teuthology.orchestra.run.smithi084.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-15T15:38:24.143 INFO:teuthology.orchestra.run.smithi084.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-05-15T15:38:24.143 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-15T15:38:24.143 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-15T15:38:24.143 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-15T15:38:24.143 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-15T15:38:24.143 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-05-15T15:38:24.144 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-15T15:38:24.144 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rados-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-15T15:38:24.144 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rbd-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-15T15:38:24.144 INFO:teuthology.orchestra.run.smithi084.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-15T15:38:24.144 INFO:teuthology.orchestra.run.smithi084.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-15T15:38:24.144 INFO:teuthology.orchestra.run.smithi084.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-15T15:38:24.144 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rgw-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-15T15:38:24.144 INFO:teuthology.orchestra.run.smithi084.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-15T15:38:24.144 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-15T15:38:24.144 INFO:teuthology.orchestra.run.smithi084.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-15T15:38:24.144 INFO:teuthology.orchestra.run.smithi084.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-15T15:38:24.144 INFO:teuthology.orchestra.run.smithi084.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-15T15:38:24.144 INFO:teuthology.orchestra.run.smithi084.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-15T15:38:24.144 INFO:teuthology.orchestra.run.smithi084.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-15T15:38:24.145 INFO:teuthology.orchestra.run.smithi084.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-05-15T15:38:24.145 INFO:teuthology.orchestra.run.smithi084.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-15T15:38:24.145 INFO:teuthology.orchestra.run.smithi084.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-15T15:38:24.145 INFO:teuthology.orchestra.run.smithi084.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-15T15:38:24.145 INFO:teuthology.orchestra.run.smithi084.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-15T15:38:24.145 INFO:teuthology.orchestra.run.smithi084.stdout: qatlib-24.02.0-1.el9.x86_64 2024-05-15T15:38:24.145 INFO:teuthology.orchestra.run.smithi084.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-05-15T15:38:24.145 INFO:teuthology.orchestra.run.smithi084.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-05-15T15:38:24.145 INFO:teuthology.orchestra.run.smithi084.stdout: rbd-fuse-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-15T15:38:24.145 INFO:teuthology.orchestra.run.smithi084.stdout: rbd-mirror-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-15T15:38:24.145 INFO:teuthology.orchestra.run.smithi084.stdout: rbd-nbd-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-15T15:38:24.145 INFO:teuthology.orchestra.run.smithi084.stdout: re2-1:20211101-3.el9.x86_64 2024-05-15T15:38:24.145 INFO:teuthology.orchestra.run.smithi084.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-15T15:38:24.146 INFO:teuthology.orchestra.run.smithi084.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-15T15:38:24.146 INFO:teuthology.orchestra.run.smithi084.stdout: uuid-1.6.2-55.el9.x86_64 2024-05-15T15:38:24.146 INFO:teuthology.orchestra.run.smithi084.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-05-15T15:38:24.146 INFO:teuthology.orchestra.run.smithi084.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-15T15:38:24.146 INFO:teuthology.orchestra.run.smithi084.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-05-15T15:38:24.147 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-05-15T15:38:24.147 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2024-05-15T15:38:24.332 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 119/166 2024-05-15T15:38:24.393 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 120/166 2024-05-15T15:38:24.480 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 121/166 2024-05-15T15:38:24.581 DEBUG:teuthology.parallel:result is None 2024-05-15T15:38:24.596 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 122/166 2024-05-15T15:38:24.757 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 123/166 2024-05-15T15:38:24.817 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 124/166 2024-05-15T15:38:24.859 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 125/166 2024-05-15T15:38:24.892 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : fuse-2.9.9-15.el9.x86_64 126/166 2024-05-15T15:38:25.531 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-osd-2:19.0.0-3709.g43296076.el9.x86_64 113/166 2024-05-15T15:38:25.536 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: cephadm-2:19.0.0-3709.g43296076.el9.noarch 127/166 2024-05-15T15:38:25.557 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-osd-2:19.0.0-3709.g43296076.el9.x86_64 113/166 2024-05-15T15:38:25.557 INFO:teuthology.orchestra.run.smithi012.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-15T15:38:25.558 INFO:teuthology.orchestra.run.smithi012.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-15T15:38:25.558 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-15T15:38:25.558 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-15T15:38:25.558 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-05-15T15:38:25.577 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : cephadm-2:19.0.0-3709.g43296076.el9.noarch 127/166 2024-05-15T15:38:25.641 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3709.g43296076.e 128/166 2024-05-15T15:38:25.774 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3709.g43296076. 129/166 2024-05-15T15:38:25.789 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mds-2:19.0.0-3709.g43296076.el9.x86_64 114/166 2024-05-15T15:38:25.805 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3709.g43296076.el9.noa 130/166 2024-05-15T15:38:25.813 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-mds-2:19.0.0-3709.g43296076.el9.x86_64 114/166 2024-05-15T15:38:25.813 INFO:teuthology.orchestra.run.smithi012.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-15T15:38:25.813 INFO:teuthology.orchestra.run.smithi012.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-15T15:38:25.813 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-15T15:38:25.813 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-15T15:38:25.813 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-05-15T15:38:26.299 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mon-2:19.0.0-3709.g43296076.el9.x86_64 115/166 2024-05-15T15:38:26.322 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-mon-2:19.0.0-3709.g43296076.el9.x86_64 115/166 2024-05-15T15:38:26.323 INFO:teuthology.orchestra.run.smithi012.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-15T15:38:26.323 INFO:teuthology.orchestra.run.smithi012.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-15T15:38:26.323 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-15T15:38:26.323 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-15T15:38:26.323 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-05-15T15:38:26.429 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : automake-1.16.2-8.el9.noarch 116/166 2024-05-15T15:38:26.488 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-ply-3.11-14.el9.noarch 117/166 2024-05-15T15:38:26.551 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 118/166 2024-05-15T15:38:26.750 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 119/166 2024-05-15T15:38:26.800 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 120/166 2024-05-15T15:38:26.882 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 121/166 2024-05-15T15:38:26.971 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 122/166 2024-05-15T15:38:27.124 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 123/166 2024-05-15T15:38:27.129 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3709.g43296076.el9.noa 130/166 2024-05-15T15:38:27.175 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 124/166 2024-05-15T15:38:27.181 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3709.g43296076.el9.n 131/166 2024-05-15T15:38:27.207 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 125/166 2024-05-15T15:38:27.234 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : fuse-2.9.9-15.el9.x86_64 126/166 2024-05-15T15:38:27.701 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: cephadm-2:19.0.0-3709.g43296076.el9.noarch 127/166 2024-05-15T15:38:27.733 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : cephadm-2:19.0.0-3709.g43296076.el9.noarch 127/166 2024-05-15T15:38:27.765 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3709.g43296076.e 128/166 2024-05-15T15:38:27.830 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3709.g43296076. 129/166 2024-05-15T15:38:27.872 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3709.g43296076.el9.noa 130/166 2024-05-15T15:38:28.286 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3709.g43296076.el9.n 131/166 2024-05-15T15:38:28.326 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3709.g432 132/166 2024-05-15T15:38:28.480 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3709.g432 132/166 2024-05-15T15:38:28.678 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3709.g43296076.el 133/166 2024-05-15T15:38:28.705 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-mgr-2:19.0.0-3709.g43296076.el9.x86_64 134/166 2024-05-15T15:38:28.791 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3709.g43296076.el9.x86_64 134/166 2024-05-15T15:38:28.791 INFO:teuthology.orchestra.run.smithi104.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-15T15:38:28.791 INFO:teuthology.orchestra.run.smithi104.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-15T15:38:28.792 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-15T15:38:28.792 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-15T15:38:28.792 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-15T15:38:28.848 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-mgr-rook-2:19.0.0-3709.g43296076.el9.noarch 135/166 2024-05-15T15:38:28.886 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3709.g43296076.el9.noarch 135/166 2024-05-15T15:38:28.974 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3709.g43296076.el9.noa 130/166 2024-05-15T15:38:29.005 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-2:19.0.0-3709.g43296076.el9.x86_64 136/166 2024-05-15T15:38:29.007 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3709.g43296076.el9.n 131/166 2024-05-15T15:38:29.087 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-fuse-2:19.0.0-3709.g43296076.el9.x86_64 137/166 2024-05-15T15:38:30.023 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3709.g43296076.el9.n 131/166 2024-05-15T15:38:30.049 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3709.g432 132/166 2024-05-15T15:38:30.130 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libtool-2.4.6-45.el9.x86_64 138/166 2024-05-15T15:38:30.167 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-radosgw-2:19.0.0-3709.g43296076.el9.x86_64 139/166 2024-05-15T15:38:30.169 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3709.g432 132/166 2024-05-15T15:38:30.235 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3709.g43296076.el9.x86_64 139/166 2024-05-15T15:38:30.235 INFO:teuthology.orchestra.run.smithi104.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-15T15:38:30.235 INFO:teuthology.orchestra.run.smithi104.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-15T15:38:30.235 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-15T15:38:30.235 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-15T15:38:30.235 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-15T15:38:30.284 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3709.g43296 140/166 2024-05-15T15:38:30.348 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3709.g43296076.el 133/166 2024-05-15T15:38:30.350 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3709.g43296 140/166 2024-05-15T15:38:30.350 INFO:teuthology.orchestra.run.smithi104.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-15T15:38:30.350 INFO:teuthology.orchestra.run.smithi104.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-15T15:38:30.350 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-15T15:38:30.385 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mgr-2:19.0.0-3709.g43296076.el9.x86_64 134/166 2024-05-15T15:38:30.408 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3709.g43296076.el9.x86_64 134/166 2024-05-15T15:38:30.408 INFO:teuthology.orchestra.run.smithi012.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-15T15:38:30.408 INFO:teuthology.orchestra.run.smithi012.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-15T15:38:30.408 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-15T15:38:30.408 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-15T15:38:30.408 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-05-15T15:38:30.427 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : cephfs-mirror-2:19.0.0-3709.g43296076.el9.x86_64 141/166 2024-05-15T15:38:30.461 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mgr-rook-2:19.0.0-3709.g43296076.el9.noarch 135/166 2024-05-15T15:38:30.472 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3709.g43296076.el9.noarch 135/166 2024-05-15T15:38:30.498 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3709.g43296076.el9.x86_64 141/166 2024-05-15T15:38:30.498 INFO:teuthology.orchestra.run.smithi104.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-15T15:38:30.498 INFO:teuthology.orchestra.run.smithi104.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-05-15T15:38:30.498 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-15T15:38:30.498 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-15T15:38:30.499 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-15T15:38:30.574 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-2:19.0.0-3709.g43296076.el9.x86_64 136/166 2024-05-15T15:38:30.627 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-fuse-2:19.0.0-3709.g43296076.el9.x86_64 137/166 2024-05-15T15:38:30.861 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : rbd-mirror-2:19.0.0-3709.g43296076.el9.x86_64 142/166 2024-05-15T15:38:30.930 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3709.g43296076.el9.x86_64 142/166 2024-05-15T15:38:30.930 INFO:teuthology.orchestra.run.smithi104.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-15T15:38:30.930 INFO:teuthology.orchestra.run.smithi104.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-15T15:38:30.930 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-15T15:38:30.930 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-15T15:38:30.930 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-15T15:38:31.614 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libtool-2.4.6-45.el9.x86_64 138/166 2024-05-15T15:38:31.646 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-radosgw-2:19.0.0-3709.g43296076.el9.x86_64 139/166 2024-05-15T15:38:31.669 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3709.g43296076.el9.x86_64 139/166 2024-05-15T15:38:31.670 INFO:teuthology.orchestra.run.smithi012.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-15T15:38:31.670 INFO:teuthology.orchestra.run.smithi012.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-15T15:38:31.670 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-15T15:38:31.670 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-15T15:38:31.670 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-05-15T15:38:31.714 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3709.g43296 140/166 2024-05-15T15:38:31.737 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3709.g43296 140/166 2024-05-15T15:38:31.737 INFO:teuthology.orchestra.run.smithi012.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-15T15:38:31.737 INFO:teuthology.orchestra.run.smithi012.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-15T15:38:31.737 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-05-15T15:38:31.797 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : cephfs-mirror-2:19.0.0-3709.g43296076.el9.x86_64 141/166 2024-05-15T15:38:31.821 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3709.g43296076.el9.x86_64 141/166 2024-05-15T15:38:31.821 INFO:teuthology.orchestra.run.smithi012.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-15T15:38:31.821 INFO:teuthology.orchestra.run.smithi012.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-05-15T15:38:31.821 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-15T15:38:31.821 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-15T15:38:31.821 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-05-15T15:38:32.148 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : rbd-mirror-2:19.0.0-3709.g43296076.el9.x86_64 142/166 2024-05-15T15:38:32.171 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3709.g43296076.el9.x86_64 142/166 2024-05-15T15:38:32.171 INFO:teuthology.orchestra.run.smithi012.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-15T15:38:32.171 INFO:teuthology.orchestra.run.smithi012.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-15T15:38:32.172 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-15T15:38:32.172 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-15T15:38:32.172 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-05-15T15:38:35.623 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-test-2:19.0.0-3709.g43296076.el9.x86_64 143/166 2024-05-15T15:38:35.677 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : rbd-fuse-2:19.0.0-3709.g43296076.el9.x86_64 144/166 2024-05-15T15:38:35.741 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : rbd-nbd-2:19.0.0-3709.g43296076.el9.x86_64 145/166 2024-05-15T15:38:35.773 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 146/166 2024-05-15T15:38:35.810 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 147/166 2024-05-15T15:38:36.146 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : cephfs-shell-2:19.0.0-3709.g43296076.el9.x86_64 148/166 2024-05-15T15:38:36.194 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 149/166 2024-05-15T15:38:36.224 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libcephfs-devel-2:19.0.0-3709.g43296076.el9.x86_ 150/166 2024-05-15T15:38:36.266 INFO:teuthology.orchestra.run.smithi104.stdout: Upgrading : NetworkManager-team-1:1.47.90-1.el9.x86_64 151/166 2024-05-15T15:38:36.308 INFO:teuthology.orchestra.run.smithi104.stdout: Upgrading : NetworkManager-tui-1:1.47.90-1.el9.x86_64 152/166 2024-05-15T15:38:36.669 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-test-2:19.0.0-3709.g43296076.el9.x86_64 143/166 2024-05-15T15:38:36.711 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : rbd-fuse-2:19.0.0-3709.g43296076.el9.x86_64 144/166 2024-05-15T15:38:36.752 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : rbd-nbd-2:19.0.0-3709.g43296076.el9.x86_64 145/166 2024-05-15T15:38:36.783 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 146/166 2024-05-15T15:38:36.810 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 147/166 2024-05-15T15:38:37.015 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : cephfs-shell-2:19.0.0-3709.g43296076.el9.x86_64 148/166 2024-05-15T15:38:37.083 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 149/166 2024-05-15T15:38:37.119 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libcephfs-devel-2:19.0.0-3709.g43296076.el9.x86_ 150/166 2024-05-15T15:38:37.166 INFO:teuthology.orchestra.run.smithi012.stdout: Upgrading : NetworkManager-team-1:1.47.90-1.el9.x86_64 151/166 2024-05-15T15:38:37.220 INFO:teuthology.orchestra.run.smithi012.stdout: Upgrading : NetworkManager-tui-1:1.47.90-1.el9.x86_64 152/166 2024-05-15T15:38:37.299 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 153/166 2024-05-15T15:38:37.347 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 153/166 2024-05-15T15:38:37.409 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 153/166 2024-05-15T15:38:37.860 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 153/166 2024-05-15T15:38:37.909 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 153/166 2024-05-15T15:38:37.930 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 153/166 2024-05-15T15:38:38.775 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : cephfs-top-2:19.0.0-3709.g43296076.el9.noarch 154/166 2024-05-15T15:38:38.837 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : cephfs-top-2:19.0.0-3709.g43296076.el9.noarch 154/166 2024-05-15T15:38:38.877 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 155/166 2024-05-15T15:38:38.931 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 155/166 2024-05-15T15:38:38.954 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 156/166 2024-05-15T15:38:38.973 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 156/166 2024-05-15T15:38:39.077 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : flex-2.6.4-9.el9.x86_64 157/166 2024-05-15T15:38:39.111 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : flex-2.6.4-9.el9.x86_64 157/166 2024-05-15T15:38:39.117 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : bison-3.7.4-5.el9.x86_64 158/166 2024-05-15T15:38:39.143 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 159/166 2024-05-15T15:38:39.143 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/166 2024-05-15T15:38:39.182 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : bison-3.7.4-5.el9.x86_64 158/166 2024-05-15T15:38:39.217 INFO:teuthology.orchestra.run.smithi104.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 159/166 2024-05-15T15:38:39.218 INFO:teuthology.orchestra.run.smithi104.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/166 2024-05-15T15:38:39.227 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/166 2024-05-15T15:38:39.260 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 161/166 2024-05-15T15:38:39.260 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 162/166 2024-05-15T15:38:39.345 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/166 2024-05-15T15:38:39.353 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 162/166 2024-05-15T15:38:39.378 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 163/166 2024-05-15T15:38:39.387 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 164/166 2024-05-15T15:38:39.387 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 164/166 2024-05-15T15:38:39.391 INFO:teuthology.orchestra.run.smithi104.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 161/166 2024-05-15T15:38:39.392 INFO:teuthology.orchestra.run.smithi104.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 162/166 2024-05-15T15:38:39.537 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 162/166 2024-05-15T15:38:39.572 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 164/166 2024-05-15T15:38:39.572 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 165/166 2024-05-15T15:38:39.584 INFO:teuthology.orchestra.run.smithi104.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 163/166 2024-05-15T15:38:39.618 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 164/166 2024-05-15T15:38:39.618 INFO:teuthology.orchestra.run.smithi104.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 164/166 2024-05-15T15:38:39.656 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 165/166 2024-05-15T15:38:39.722 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 166/166 2024-05-15T15:38:39.939 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 164/166 2024-05-15T15:38:39.939 INFO:teuthology.orchestra.run.smithi104.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 165/166 2024-05-15T15:38:40.108 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 165/166 2024-05-15T15:38:40.240 INFO:teuthology.orchestra.run.smithi104.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 166/166 2024-05-15T15:38:40.511 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 166/166 2024-05-15T15:38:40.511 INFO:teuthology.orchestra.run.smithi104.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-05-15T15:38:40.511 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-15T15:38:45.392 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 166/166 2024-05-15T15:38:45.392 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-2:19.0.0-3709.g43296076.el9.x86_64 1/166 2024-05-15T15:38:45.392 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-base-2:19.0.0-3709.g43296076.el9.x86_64 2/166 2024-05-15T15:38:45.392 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-common-2:19.0.0-3709.g43296076.el9.x86_64 3/166 2024-05-15T15:38:45.392 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-fuse-2:19.0.0-3709.g43296076.el9.x86_64 4/166 2024-05-15T15:38:45.392 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3709.g43296 5/166 2024-05-15T15:38:45.392 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mds-2:19.0.0-3709.g43296076.el9.x86_64 6/166 2024-05-15T15:38:45.392 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mgr-2:19.0.0-3709.g43296076.el9.x86_64 7/166 2024-05-15T15:38:45.392 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mon-2:19.0.0-3709.g43296076.el9.x86_64 8/166 2024-05-15T15:38:45.393 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-osd-2:19.0.0-3709.g43296076.el9.x86_64 9/166 2024-05-15T15:38:45.393 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-radosgw-2:19.0.0-3709.g43296076.el9.x86_64 10/166 2024-05-15T15:38:45.393 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-selinux-2:19.0.0-3709.g43296076.el9.x86_64 11/166 2024-05-15T15:38:45.393 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-test-2:19.0.0-3709.g43296076.el9.x86_64 12/166 2024-05-15T15:38:45.393 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : cephfs-mirror-2:19.0.0-3709.g43296076.el9.x86_64 13/166 2024-05-15T15:38:45.393 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : cephfs-shell-2:19.0.0-3709.g43296076.el9.x86_64 14/166 2024-05-15T15:38:45.393 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libcephfs-devel-2:19.0.0-3709.g43296076.el9.x86_ 15/166 2024-05-15T15:38:45.393 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libcephfs2-2:19.0.0-3709.g43296076.el9.x86_64 16/166 2024-05-15T15:38:45.393 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libcephsqlite-2:19.0.0-3709.g43296076.el9.x86_64 17/166 2024-05-15T15:38:45.393 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librados-devel-2:19.0.0-3709.g43296076.el9.x86_6 18/166 2024-05-15T15:38:45.393 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libradosstriper1-2:19.0.0-3709.g43296076.el9.x86 19/166 2024-05-15T15:38:45.393 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librgw2-2:19.0.0-3709.g43296076.el9.x86_64 20/166 2024-05-15T15:38:45.394 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3709.g43296076.el 21/166 2024-05-15T15:38:45.394 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-ceph-common-2:19.0.0-3709.g43296076.el9. 22/166 2024-05-15T15:38:45.394 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-cephfs-2:19.0.0-3709.g43296076.el9.x86_6 23/166 2024-05-15T15:38:45.394 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-rados-2:19.0.0-3709.g43296076.el9.x86_64 24/166 2024-05-15T15:38:45.394 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-rbd-2:19.0.0-3709.g43296076.el9.x86_64 25/166 2024-05-15T15:38:45.394 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-rgw-2:19.0.0-3709.g43296076.el9.x86_64 26/166 2024-05-15T15:38:45.394 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : rbd-fuse-2:19.0.0-3709.g43296076.el9.x86_64 27/166 2024-05-15T15:38:45.394 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : rbd-mirror-2:19.0.0-3709.g43296076.el9.x86_64 28/166 2024-05-15T15:38:45.394 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : rbd-nbd-2:19.0.0-3709.g43296076.el9.x86_64 29/166 2024-05-15T15:38:45.394 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3709.g43296076. 30/166 2024-05-15T15:38:45.394 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3709.g43296076.el9.noa 31/166 2024-05-15T15:38:45.394 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3709.g43296076.el9.n 32/166 2024-05-15T15:38:45.395 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3709.g432 33/166 2024-05-15T15:38:45.395 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3709.g43296076.el 34/166 2024-05-15T15:38:45.395 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3709.g43296076.el9.noarch 35/166 2024-05-15T15:38:45.395 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3709.g43296076.e 36/166 2024-05-15T15:38:45.395 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-volume-2:19.0.0-3709.g43296076.el9.noarch 37/166 2024-05-15T15:38:45.395 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : cephadm-2:19.0.0-3709.g43296076.el9.noarch 38/166 2024-05-15T15:38:45.395 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : cephfs-top-2:19.0.0-3709.g43296076.el9.noarch 39/166 2024-05-15T15:38:45.395 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/166 2024-05-15T15:38:45.395 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/166 2024-05-15T15:38:45.395 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/166 2024-05-15T15:38:45.395 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/166 2024-05-15T15:38:45.395 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/166 2024-05-15T15:38:45.396 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/166 2024-05-15T15:38:45.396 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/166 2024-05-15T15:38:45.396 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/166 2024-05-15T15:38:45.396 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/166 2024-05-15T15:38:45.396 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/166 2024-05-15T15:38:45.396 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/166 2024-05-15T15:38:45.396 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/166 2024-05-15T15:38:45.396 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/166 2024-05-15T15:38:45.396 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/166 2024-05-15T15:38:45.396 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/166 2024-05-15T15:38:45.396 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/166 2024-05-15T15:38:45.396 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/166 2024-05-15T15:38:45.396 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/166 2024-05-15T15:38:45.397 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/166 2024-05-15T15:38:45.397 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/166 2024-05-15T15:38:45.397 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/166 2024-05-15T15:38:45.397 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/166 2024-05-15T15:38:45.397 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/166 2024-05-15T15:38:45.397 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/166 2024-05-15T15:38:45.397 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/166 2024-05-15T15:38:45.397 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/166 2024-05-15T15:38:45.397 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/166 2024-05-15T15:38:45.397 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/166 2024-05-15T15:38:45.397 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/166 2024-05-15T15:38:45.397 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/166 2024-05-15T15:38:45.397 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/166 2024-05-15T15:38:45.398 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/166 2024-05-15T15:38:45.398 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/166 2024-05-15T15:38:45.398 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/166 2024-05-15T15:38:45.398 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/166 2024-05-15T15:38:45.398 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/166 2024-05-15T15:38:45.398 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/166 2024-05-15T15:38:45.398 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/166 2024-05-15T15:38:45.398 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/166 2024-05-15T15:38:45.398 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/166 2024-05-15T15:38:45.398 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/166 2024-05-15T15:38:45.398 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/166 2024-05-15T15:38:45.398 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/166 2024-05-15T15:38:45.399 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/166 2024-05-15T15:38:45.399 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/166 2024-05-15T15:38:45.399 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/166 2024-05-15T15:38:45.399 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/166 2024-05-15T15:38:45.399 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/166 2024-05-15T15:38:45.399 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/166 2024-05-15T15:38:45.399 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/166 2024-05-15T15:38:45.399 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/166 2024-05-15T15:38:45.399 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/166 2024-05-15T15:38:45.399 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/166 2024-05-15T15:38:45.399 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/166 2024-05-15T15:38:45.399 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/166 2024-05-15T15:38:45.399 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/166 2024-05-15T15:38:45.400 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/166 2024-05-15T15:38:45.400 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/166 2024-05-15T15:38:45.400 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/166 2024-05-15T15:38:45.400 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/166 2024-05-15T15:38:45.400 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/166 2024-05-15T15:38:45.400 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/166 2024-05-15T15:38:45.400 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/166 2024-05-15T15:38:45.400 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/166 2024-05-15T15:38:45.400 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/166 2024-05-15T15:38:45.400 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/166 2024-05-15T15:38:45.400 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : fscrypt-0.3.4-2.el9.x86_64 106/166 2024-05-15T15:38:45.400 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/166 2024-05-15T15:38:45.401 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/166 2024-05-15T15:38:45.401 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/166 2024-05-15T15:38:45.401 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/166 2024-05-15T15:38:45.401 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/166 2024-05-15T15:38:45.401 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/166 2024-05-15T15:38:45.401 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 113/166 2024-05-15T15:38:45.401 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : pam_fscrypt-0.3.4-2.el9.x86_64 114/166 2024-05-15T15:38:45.401 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/166 2024-05-15T15:38:45.401 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/166 2024-05-15T15:38:45.401 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/166 2024-05-15T15:38:45.401 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/166 2024-05-15T15:38:45.401 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 119/166 2024-05-15T15:38:45.401 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/166 2024-05-15T15:38:45.401 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/166 2024-05-15T15:38:45.402 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/166 2024-05-15T15:38:45.402 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 123/166 2024-05-15T15:38:45.402 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 124/166 2024-05-15T15:38:45.402 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 125/166 2024-05-15T15:38:45.402 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 126/166 2024-05-15T15:38:45.402 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 127/166 2024-05-15T15:38:45.402 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 128/166 2024-05-15T15:38:45.402 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 129/166 2024-05-15T15:38:45.402 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 130/166 2024-05-15T15:38:45.402 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 131/166 2024-05-15T15:38:45.402 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 132/166 2024-05-15T15:38:45.402 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 133/166 2024-05-15T15:38:45.402 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 134/166 2024-05-15T15:38:45.403 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 135/166 2024-05-15T15:38:45.403 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 136/166 2024-05-15T15:38:45.403 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 137/166 2024-05-15T15:38:45.403 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 138/166 2024-05-15T15:38:45.403 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 139/166 2024-05-15T15:38:45.403 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 140/166 2024-05-15T15:38:45.403 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 141/166 2024-05-15T15:38:45.403 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 142/166 2024-05-15T15:38:45.403 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 143/166 2024-05-15T15:38:45.403 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 144/166 2024-05-15T15:38:45.403 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 145/166 2024-05-15T15:38:45.403 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 146/166 2024-05-15T15:38:45.403 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 147/166 2024-05-15T15:38:45.404 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 148/166 2024-05-15T15:38:45.404 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : re2-1:20211101-3.el9.x86_64 149/166 2024-05-15T15:38:45.404 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 150/166 2024-05-15T15:38:45.404 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librados2-2:19.0.0-3709.g43296076.el9.x86_64 151/166 2024-05-15T15:38:45.404 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 152/166 2024-05-15T15:38:45.404 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librbd1-2:19.0.0-3709.g43296076.el9.x86_64 153/166 2024-05-15T15:38:45.404 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 154/166 2024-05-15T15:38:45.404 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : NetworkManager-1:1.47.90-1.el9.x86_64 155/166 2024-05-15T15:38:45.404 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 156/166 2024-05-15T15:38:45.404 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : NetworkManager-libnm-1:1.47.90-1.el9.x86_64 157/166 2024-05-15T15:38:45.404 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 158/166 2024-05-15T15:38:45.404 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : NetworkManager-team-1:1.47.90-1.el9.x86_64 159/166 2024-05-15T15:38:45.404 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 160/166 2024-05-15T15:38:45.404 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : NetworkManager-tui-1:1.47.90-1.el9.x86_64 161/166 2024-05-15T15:38:45.405 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 162/166 2024-05-15T15:38:45.405 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 163/166 2024-05-15T15:38:45.405 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 164/166 2024-05-15T15:38:45.405 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 165/166 2024-05-15T15:38:46.208 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-2:19.0.0-3709.g43296076.el9.x86_64 1/166 2024-05-15T15:38:46.209 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-base-2:19.0.0-3709.g43296076.el9.x86_64 2/166 2024-05-15T15:38:46.209 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-common-2:19.0.0-3709.g43296076.el9.x86_64 3/166 2024-05-15T15:38:46.209 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-fuse-2:19.0.0-3709.g43296076.el9.x86_64 4/166 2024-05-15T15:38:46.209 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3709.g43296 5/166 2024-05-15T15:38:46.209 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-mds-2:19.0.0-3709.g43296076.el9.x86_64 6/166 2024-05-15T15:38:46.209 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-mgr-2:19.0.0-3709.g43296076.el9.x86_64 7/166 2024-05-15T15:38:46.209 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-mon-2:19.0.0-3709.g43296076.el9.x86_64 8/166 2024-05-15T15:38:46.209 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-osd-2:19.0.0-3709.g43296076.el9.x86_64 9/166 2024-05-15T15:38:46.209 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-radosgw-2:19.0.0-3709.g43296076.el9.x86_64 10/166 2024-05-15T15:38:46.209 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-selinux-2:19.0.0-3709.g43296076.el9.x86_64 11/166 2024-05-15T15:38:46.210 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-test-2:19.0.0-3709.g43296076.el9.x86_64 12/166 2024-05-15T15:38:46.210 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : cephfs-mirror-2:19.0.0-3709.g43296076.el9.x86_64 13/166 2024-05-15T15:38:46.210 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : cephfs-shell-2:19.0.0-3709.g43296076.el9.x86_64 14/166 2024-05-15T15:38:46.210 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libcephfs-devel-2:19.0.0-3709.g43296076.el9.x86_ 15/166 2024-05-15T15:38:46.210 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libcephfs2-2:19.0.0-3709.g43296076.el9.x86_64 16/166 2024-05-15T15:38:46.210 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libcephsqlite-2:19.0.0-3709.g43296076.el9.x86_64 17/166 2024-05-15T15:38:46.210 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : librados-devel-2:19.0.0-3709.g43296076.el9.x86_6 18/166 2024-05-15T15:38:46.210 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libradosstriper1-2:19.0.0-3709.g43296076.el9.x86 19/166 2024-05-15T15:38:46.210 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : librgw2-2:19.0.0-3709.g43296076.el9.x86_64 20/166 2024-05-15T15:38:46.210 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3709.g43296076.el 21/166 2024-05-15T15:38:46.210 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-ceph-common-2:19.0.0-3709.g43296076.el9. 22/166 2024-05-15T15:38:46.210 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-cephfs-2:19.0.0-3709.g43296076.el9.x86_6 23/166 2024-05-15T15:38:46.211 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-rados-2:19.0.0-3709.g43296076.el9.x86_64 24/166 2024-05-15T15:38:46.211 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-rbd-2:19.0.0-3709.g43296076.el9.x86_64 25/166 2024-05-15T15:38:46.211 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-rgw-2:19.0.0-3709.g43296076.el9.x86_64 26/166 2024-05-15T15:38:46.211 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : rbd-fuse-2:19.0.0-3709.g43296076.el9.x86_64 27/166 2024-05-15T15:38:46.211 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : rbd-mirror-2:19.0.0-3709.g43296076.el9.x86_64 28/166 2024-05-15T15:38:46.211 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : rbd-nbd-2:19.0.0-3709.g43296076.el9.x86_64 29/166 2024-05-15T15:38:46.211 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3709.g43296076. 30/166 2024-05-15T15:38:46.224 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3709.g43296076.el9.noa 31/166 2024-05-15T15:38:46.224 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3709.g43296076.el9.n 32/166 2024-05-15T15:38:46.224 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3709.g432 33/166 2024-05-15T15:38:46.224 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3709.g43296076.el 34/166 2024-05-15T15:38:46.224 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3709.g43296076.el9.noarch 35/166 2024-05-15T15:38:46.225 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3709.g43296076.e 36/166 2024-05-15T15:38:46.225 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-volume-2:19.0.0-3709.g43296076.el9.noarch 37/166 2024-05-15T15:38:46.225 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : cephadm-2:19.0.0-3709.g43296076.el9.noarch 38/166 2024-05-15T15:38:46.225 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : cephfs-top-2:19.0.0-3709.g43296076.el9.noarch 39/166 2024-05-15T15:38:46.225 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/166 2024-05-15T15:38:46.225 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/166 2024-05-15T15:38:46.225 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/166 2024-05-15T15:38:46.225 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/166 2024-05-15T15:38:46.225 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/166 2024-05-15T15:38:46.225 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/166 2024-05-15T15:38:46.226 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/166 2024-05-15T15:38:46.226 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/166 2024-05-15T15:38:46.226 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/166 2024-05-15T15:38:46.226 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/166 2024-05-15T15:38:46.226 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/166 2024-05-15T15:38:46.226 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/166 2024-05-15T15:38:46.226 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/166 2024-05-15T15:38:46.226 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/166 2024-05-15T15:38:46.226 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/166 2024-05-15T15:38:46.226 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/166 2024-05-15T15:38:46.226 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/166 2024-05-15T15:38:46.226 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/166 2024-05-15T15:38:46.227 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/166 2024-05-15T15:38:46.227 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/166 2024-05-15T15:38:46.227 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/166 2024-05-15T15:38:46.227 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/166 2024-05-15T15:38:46.227 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/166 2024-05-15T15:38:46.227 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/166 2024-05-15T15:38:46.227 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/166 2024-05-15T15:38:46.227 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/166 2024-05-15T15:38:46.227 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/166 2024-05-15T15:38:46.227 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/166 2024-05-15T15:38:46.227 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/166 2024-05-15T15:38:46.227 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/166 2024-05-15T15:38:46.227 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/166 2024-05-15T15:38:46.228 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/166 2024-05-15T15:38:46.228 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/166 2024-05-15T15:38:46.228 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/166 2024-05-15T15:38:46.228 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/166 2024-05-15T15:38:46.228 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/166 2024-05-15T15:38:46.228 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/166 2024-05-15T15:38:46.228 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/166 2024-05-15T15:38:46.228 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/166 2024-05-15T15:38:46.228 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/166 2024-05-15T15:38:46.228 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/166 2024-05-15T15:38:46.228 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/166 2024-05-15T15:38:46.228 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/166 2024-05-15T15:38:46.228 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/166 2024-05-15T15:38:46.229 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/166 2024-05-15T15:38:46.229 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/166 2024-05-15T15:38:46.229 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/166 2024-05-15T15:38:46.229 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/166 2024-05-15T15:38:46.229 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/166 2024-05-15T15:38:46.229 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/166 2024-05-15T15:38:46.229 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/166 2024-05-15T15:38:46.229 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/166 2024-05-15T15:38:46.229 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/166 2024-05-15T15:38:46.229 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/166 2024-05-15T15:38:46.229 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/166 2024-05-15T15:38:46.229 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/166 2024-05-15T15:38:46.229 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/166 2024-05-15T15:38:46.230 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/166 2024-05-15T15:38:46.230 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/166 2024-05-15T15:38:46.230 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/166 2024-05-15T15:38:46.230 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/166 2024-05-15T15:38:46.230 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/166 2024-05-15T15:38:46.230 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/166 2024-05-15T15:38:46.230 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/166 2024-05-15T15:38:46.230 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/166 2024-05-15T15:38:46.230 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/166 2024-05-15T15:38:46.230 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : fscrypt-0.3.4-2.el9.x86_64 106/166 2024-05-15T15:38:46.230 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/166 2024-05-15T15:38:46.230 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/166 2024-05-15T15:38:46.231 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/166 2024-05-15T15:38:46.231 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/166 2024-05-15T15:38:46.231 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/166 2024-05-15T15:38:46.231 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/166 2024-05-15T15:38:46.231 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 113/166 2024-05-15T15:38:46.231 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : pam_fscrypt-0.3.4-2.el9.x86_64 114/166 2024-05-15T15:38:46.231 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/166 2024-05-15T15:38:46.231 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/166 2024-05-15T15:38:46.231 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/166 2024-05-15T15:38:46.231 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/166 2024-05-15T15:38:46.231 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 119/166 2024-05-15T15:38:46.231 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/166 2024-05-15T15:38:46.231 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/166 2024-05-15T15:38:46.231 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/166 2024-05-15T15:38:46.232 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 123/166 2024-05-15T15:38:46.232 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 124/166 2024-05-15T15:38:46.232 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 125/166 2024-05-15T15:38:46.232 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 126/166 2024-05-15T15:38:46.232 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 127/166 2024-05-15T15:38:46.232 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 128/166 2024-05-15T15:38:46.232 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 129/166 2024-05-15T15:38:46.232 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 130/166 2024-05-15T15:38:46.232 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 131/166 2024-05-15T15:38:46.232 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 132/166 2024-05-15T15:38:46.232 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 133/166 2024-05-15T15:38:46.232 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 134/166 2024-05-15T15:38:46.232 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 135/166 2024-05-15T15:38:46.233 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 136/166 2024-05-15T15:38:46.233 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 137/166 2024-05-15T15:38:46.233 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 138/166 2024-05-15T15:38:46.233 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 139/166 2024-05-15T15:38:46.233 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 140/166 2024-05-15T15:38:46.233 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 141/166 2024-05-15T15:38:46.233 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 142/166 2024-05-15T15:38:46.233 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 143/166 2024-05-15T15:38:46.233 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 144/166 2024-05-15T15:38:46.233 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 145/166 2024-05-15T15:38:46.233 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 146/166 2024-05-15T15:38:46.233 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 147/166 2024-05-15T15:38:46.233 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 148/166 2024-05-15T15:38:46.233 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : re2-1:20211101-3.el9.x86_64 149/166 2024-05-15T15:38:46.234 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 150/166 2024-05-15T15:38:46.234 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : librados2-2:19.0.0-3709.g43296076.el9.x86_64 151/166 2024-05-15T15:38:46.234 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 152/166 2024-05-15T15:38:46.234 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : librbd1-2:19.0.0-3709.g43296076.el9.x86_64 153/166 2024-05-15T15:38:46.234 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 154/166 2024-05-15T15:38:46.234 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : NetworkManager-1:1.47.90-1.el9.x86_64 155/166 2024-05-15T15:38:46.234 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 156/166 2024-05-15T15:38:46.234 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : NetworkManager-libnm-1:1.47.90-1.el9.x86_64 157/166 2024-05-15T15:38:46.234 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 158/166 2024-05-15T15:38:46.234 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : NetworkManager-team-1:1.47.90-1.el9.x86_64 159/166 2024-05-15T15:38:46.234 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 160/166 2024-05-15T15:38:46.234 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : NetworkManager-tui-1:1.47.90-1.el9.x86_64 161/166 2024-05-15T15:38:46.234 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 162/166 2024-05-15T15:38:46.235 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 163/166 2024-05-15T15:38:46.235 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 164/166 2024-05-15T15:38:46.235 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 165/166 2024-05-15T15:38:48.220 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 166/166 2024-05-15T15:38:48.220 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-05-15T15:38:48.220 INFO:teuthology.orchestra.run.smithi012.stdout:Upgraded: 2024-05-15T15:38:48.220 INFO:teuthology.orchestra.run.smithi012.stdout: NetworkManager-1:1.47.90-1.el9.x86_64 2024-05-15T15:38:48.220 INFO:teuthology.orchestra.run.smithi012.stdout: NetworkManager-libnm-1:1.47.90-1.el9.x86_64 2024-05-15T15:38:48.220 INFO:teuthology.orchestra.run.smithi012.stdout: NetworkManager-team-1:1.47.90-1.el9.x86_64 2024-05-15T15:38:48.220 INFO:teuthology.orchestra.run.smithi012.stdout: NetworkManager-tui-1:1.47.90-1.el9.x86_64 2024-05-15T15:38:48.221 INFO:teuthology.orchestra.run.smithi012.stdout: librados2-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-15T15:38:48.221 INFO:teuthology.orchestra.run.smithi012.stdout: librbd1-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-15T15:38:48.221 INFO:teuthology.orchestra.run.smithi012.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-05-15T15:38:48.221 INFO:teuthology.orchestra.run.smithi012.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-05-15T15:38:48.221 INFO:teuthology.orchestra.run.smithi012.stdout:Installed: 2024-05-15T15:38:48.221 INFO:teuthology.orchestra.run.smithi012.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-05-15T15:38:48.221 INFO:teuthology.orchestra.run.smithi012.stdout: automake-1.16.2-8.el9.noarch 2024-05-15T15:38:48.221 INFO:teuthology.orchestra.run.smithi012.stdout: bison-3.7.4-5.el9.x86_64 2024-05-15T15:38:48.221 INFO:teuthology.orchestra.run.smithi012.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-15T15:38:48.221 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-15T15:38:48.221 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-base-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-15T15:38:48.221 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-common-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-15T15:38:48.221 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-fuse-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-15T15:38:48.222 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-grafana-dashboards-2:19.0.0-3709.g43296076.el9.noarch 2024-05-15T15:38:48.222 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-immutable-object-cache-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-15T15:38:48.222 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mds-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-15T15:38:48.222 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-15T15:38:48.222 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-cephadm-2:19.0.0-3709.g43296076.el9.noarch 2024-05-15T15:38:48.222 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-dashboard-2:19.0.0-3709.g43296076.el9.noarch 2024-05-15T15:38:48.222 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3709.g43296076.el9.noarch 2024-05-15T15:38:48.222 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-modules-core-2:19.0.0-3709.g43296076.el9.noarch 2024-05-15T15:38:48.222 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-rook-2:19.0.0-3709.g43296076.el9.noarch 2024-05-15T15:38:48.222 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mon-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-15T15:38:48.222 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-osd-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-15T15:38:48.222 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-prometheus-alerts-2:19.0.0-3709.g43296076.el9.noarch 2024-05-15T15:38:48.222 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-radosgw-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-15T15:38:48.223 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-selinux-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-15T15:38:48.223 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-test-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-15T15:38:48.223 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-volume-2:19.0.0-3709.g43296076.el9.noarch 2024-05-15T15:38:48.223 INFO:teuthology.orchestra.run.smithi012.stdout: cephadm-2:19.0.0-3709.g43296076.el9.noarch 2024-05-15T15:38:48.223 INFO:teuthology.orchestra.run.smithi012.stdout: cephfs-mirror-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-15T15:38:48.223 INFO:teuthology.orchestra.run.smithi012.stdout: cephfs-shell-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-15T15:38:48.223 INFO:teuthology.orchestra.run.smithi012.stdout: cephfs-top-2:19.0.0-3709.g43296076.el9.noarch 2024-05-15T15:38:48.223 INFO:teuthology.orchestra.run.smithi012.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-05-15T15:38:48.223 INFO:teuthology.orchestra.run.smithi012.stdout: flex-2.6.4-9.el9.x86_64 2024-05-15T15:38:48.223 INFO:teuthology.orchestra.run.smithi012.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-15T15:38:48.223 INFO:teuthology.orchestra.run.smithi012.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-15T15:38:48.223 INFO:teuthology.orchestra.run.smithi012.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-15T15:38:48.224 INFO:teuthology.orchestra.run.smithi012.stdout: fscrypt-0.3.4-2.el9.x86_64 2024-05-15T15:38:48.224 INFO:teuthology.orchestra.run.smithi012.stdout: fuse-2.9.9-15.el9.x86_64 2024-05-15T15:38:48.224 INFO:teuthology.orchestra.run.smithi012.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-15T15:38:48.224 INFO:teuthology.orchestra.run.smithi012.stdout: grpc-data-1.46.7-10.el9.noarch 2024-05-15T15:38:48.224 INFO:teuthology.orchestra.run.smithi012.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-05-15T15:38:48.224 INFO:teuthology.orchestra.run.smithi012.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-15T15:38:48.224 INFO:teuthology.orchestra.run.smithi012.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-15T15:38:48.224 INFO:teuthology.orchestra.run.smithi012.stdout: libcephfs-devel-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-15T15:38:48.224 INFO:teuthology.orchestra.run.smithi012.stdout: libcephfs2-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-15T15:38:48.224 INFO:teuthology.orchestra.run.smithi012.stdout: libcephsqlite-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-15T15:38:48.224 INFO:teuthology.orchestra.run.smithi012.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-15T15:38:48.224 INFO:teuthology.orchestra.run.smithi012.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-15T15:38:48.224 INFO:teuthology.orchestra.run.smithi012.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-15T15:38:48.225 INFO:teuthology.orchestra.run.smithi012.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-15T15:38:48.225 INFO:teuthology.orchestra.run.smithi012.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-15T15:38:48.225 INFO:teuthology.orchestra.run.smithi012.stdout: librados-devel-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-15T15:38:48.225 INFO:teuthology.orchestra.run.smithi012.stdout: libradosstriper1-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-15T15:38:48.225 INFO:teuthology.orchestra.run.smithi012.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-15T15:38:48.225 INFO:teuthology.orchestra.run.smithi012.stdout: librgw2-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-15T15:38:48.225 INFO:teuthology.orchestra.run.smithi012.stdout: libtool-2.4.6-45.el9.x86_64 2024-05-15T15:38:48.225 INFO:teuthology.orchestra.run.smithi012.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-15T15:38:48.225 INFO:teuthology.orchestra.run.smithi012.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-05-15T15:38:48.225 INFO:teuthology.orchestra.run.smithi012.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-05-15T15:38:48.225 INFO:teuthology.orchestra.run.smithi012.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-15T15:38:48.225 INFO:teuthology.orchestra.run.smithi012.stdout: lua-5.4.4-4.el9.x86_64 2024-05-15T15:38:48.225 INFO:teuthology.orchestra.run.smithi012.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-05-15T15:38:48.226 INFO:teuthology.orchestra.run.smithi012.stdout: luarocks-3.9.2-1.el9.noarch 2024-05-15T15:38:48.226 INFO:teuthology.orchestra.run.smithi012.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-15T15:38:48.226 INFO:teuthology.orchestra.run.smithi012.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-15T15:38:48.226 INFO:teuthology.orchestra.run.smithi012.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-05-15T15:38:48.226 INFO:teuthology.orchestra.run.smithi012.stdout: pam_fscrypt-0.3.4-2.el9.x86_64 2024-05-15T15:38:48.226 INFO:teuthology.orchestra.run.smithi012.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-15T15:38:48.226 INFO:teuthology.orchestra.run.smithi012.stdout: postgresql-13.14-1.el9.x86_64 2024-05-15T15:38:48.226 INFO:teuthology.orchestra.run.smithi012.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-05-15T15:38:48.226 INFO:teuthology.orchestra.run.smithi012.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-05-15T15:38:48.226 INFO:teuthology.orchestra.run.smithi012.stdout: postgresql-server-13.14-1.el9.x86_64 2024-05-15T15:38:48.226 INFO:teuthology.orchestra.run.smithi012.stdout: protobuf-3.14.0-13.el9.x86_64 2024-05-15T15:38:48.226 INFO:teuthology.orchestra.run.smithi012.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-05-15T15:38:48.227 INFO:teuthology.orchestra.run.smithi012.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-15T15:38:48.227 INFO:teuthology.orchestra.run.smithi012.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-05-15T15:38:48.227 INFO:teuthology.orchestra.run.smithi012.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-15T15:38:48.227 INFO:teuthology.orchestra.run.smithi012.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-15T15:38:48.227 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-15T15:38:48.227 INFO:teuthology.orchestra.run.smithi012.stdout: python3-ceph-argparse-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-15T15:38:48.227 INFO:teuthology.orchestra.run.smithi012.stdout: python3-ceph-common-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-15T15:38:48.227 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cephfs-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-15T15:38:48.227 INFO:teuthology.orchestra.run.smithi012.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-15T15:38:48.227 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-15T15:38:48.227 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-15T15:38:48.227 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-15T15:38:48.227 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-05-15T15:38:48.227 INFO:teuthology.orchestra.run.smithi012.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-05-15T15:38:48.228 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-15T15:38:48.228 INFO:teuthology.orchestra.run.smithi012.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-15T15:38:48.228 INFO:teuthology.orchestra.run.smithi012.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-15T15:38:48.228 INFO:teuthology.orchestra.run.smithi012.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-05-15T15:38:48.228 INFO:teuthology.orchestra.run.smithi012.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-05-15T15:38:48.228 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-15T15:38:48.228 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-15T15:38:48.228 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-15T15:38:48.228 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-15T15:38:48.228 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-15T15:38:48.228 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-05-15T15:38:48.228 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-15T15:38:48.229 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-15T15:38:48.229 INFO:teuthology.orchestra.run.smithi012.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-15T15:38:48.229 INFO:teuthology.orchestra.run.smithi012.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-15T15:38:48.229 INFO:teuthology.orchestra.run.smithi012.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-15T15:38:48.229 INFO:teuthology.orchestra.run.smithi012.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-15T15:38:48.229 INFO:teuthology.orchestra.run.smithi012.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-15T15:38:48.229 INFO:teuthology.orchestra.run.smithi012.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-15T15:38:48.229 INFO:teuthology.orchestra.run.smithi012.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-15T15:38:48.229 INFO:teuthology.orchestra.run.smithi012.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-15T15:38:48.229 INFO:teuthology.orchestra.run.smithi012.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-15T15:38:48.229 INFO:teuthology.orchestra.run.smithi012.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-15T15:38:48.229 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-15T15:38:48.229 INFO:teuthology.orchestra.run.smithi012.stdout: python3-ply-3.11-14.el9.noarch 2024-05-15T15:38:48.229 INFO:teuthology.orchestra.run.smithi012.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-15T15:38:48.230 INFO:teuthology.orchestra.run.smithi012.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-15T15:38:48.230 INFO:teuthology.orchestra.run.smithi012.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-05-15T15:38:48.230 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-15T15:38:48.230 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-15T15:38:48.230 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-15T15:38:48.230 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-15T15:38:48.230 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-05-15T15:38:48.230 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-15T15:38:48.230 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rados-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-15T15:38:48.230 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rbd-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-15T15:38:48.230 INFO:teuthology.orchestra.run.smithi012.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-15T15:38:48.230 INFO:teuthology.orchestra.run.smithi012.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-15T15:38:48.230 INFO:teuthology.orchestra.run.smithi012.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-15T15:38:48.231 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rgw-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-15T15:38:48.231 INFO:teuthology.orchestra.run.smithi012.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-15T15:38:48.231 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-15T15:38:48.231 INFO:teuthology.orchestra.run.smithi012.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-15T15:38:48.231 INFO:teuthology.orchestra.run.smithi012.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-15T15:38:48.231 INFO:teuthology.orchestra.run.smithi012.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-15T15:38:48.231 INFO:teuthology.orchestra.run.smithi012.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-15T15:38:48.231 INFO:teuthology.orchestra.run.smithi012.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-15T15:38:48.231 INFO:teuthology.orchestra.run.smithi012.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-05-15T15:38:48.231 INFO:teuthology.orchestra.run.smithi012.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-15T15:38:48.231 INFO:teuthology.orchestra.run.smithi012.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-15T15:38:48.231 INFO:teuthology.orchestra.run.smithi012.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-15T15:38:48.231 INFO:teuthology.orchestra.run.smithi012.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-15T15:38:48.231 INFO:teuthology.orchestra.run.smithi012.stdout: qatlib-24.02.0-1.el9.x86_64 2024-05-15T15:38:48.232 INFO:teuthology.orchestra.run.smithi012.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-05-15T15:38:48.232 INFO:teuthology.orchestra.run.smithi012.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-05-15T15:38:48.232 INFO:teuthology.orchestra.run.smithi012.stdout: rbd-fuse-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-15T15:38:48.232 INFO:teuthology.orchestra.run.smithi012.stdout: rbd-mirror-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-15T15:38:48.232 INFO:teuthology.orchestra.run.smithi012.stdout: rbd-nbd-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-15T15:38:48.232 INFO:teuthology.orchestra.run.smithi012.stdout: re2-1:20211101-3.el9.x86_64 2024-05-15T15:38:48.232 INFO:teuthology.orchestra.run.smithi012.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-15T15:38:48.232 INFO:teuthology.orchestra.run.smithi012.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-15T15:38:48.232 INFO:teuthology.orchestra.run.smithi012.stdout: uuid-1.6.2-55.el9.x86_64 2024-05-15T15:38:48.232 INFO:teuthology.orchestra.run.smithi012.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-05-15T15:38:48.232 INFO:teuthology.orchestra.run.smithi012.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-15T15:38:48.233 INFO:teuthology.orchestra.run.smithi012.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-05-15T15:38:48.233 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-05-15T15:38:48.233 INFO:teuthology.orchestra.run.smithi012.stdout:Complete! 2024-05-15T15:38:48.387 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 166/166 2024-05-15T15:38:48.388 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-15T15:38:48.388 INFO:teuthology.orchestra.run.smithi104.stdout:Upgraded: 2024-05-15T15:38:48.388 INFO:teuthology.orchestra.run.smithi104.stdout: NetworkManager-1:1.47.90-1.el9.x86_64 2024-05-15T15:38:48.388 INFO:teuthology.orchestra.run.smithi104.stdout: NetworkManager-libnm-1:1.47.90-1.el9.x86_64 2024-05-15T15:38:48.388 INFO:teuthology.orchestra.run.smithi104.stdout: NetworkManager-team-1:1.47.90-1.el9.x86_64 2024-05-15T15:38:48.388 INFO:teuthology.orchestra.run.smithi104.stdout: NetworkManager-tui-1:1.47.90-1.el9.x86_64 2024-05-15T15:38:48.388 INFO:teuthology.orchestra.run.smithi104.stdout: librados2-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-15T15:38:48.388 INFO:teuthology.orchestra.run.smithi104.stdout: librbd1-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-15T15:38:48.388 INFO:teuthology.orchestra.run.smithi104.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-05-15T15:38:48.388 INFO:teuthology.orchestra.run.smithi104.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-05-15T15:38:48.389 INFO:teuthology.orchestra.run.smithi104.stdout:Installed: 2024-05-15T15:38:48.389 INFO:teuthology.orchestra.run.smithi104.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-05-15T15:38:48.389 INFO:teuthology.orchestra.run.smithi104.stdout: automake-1.16.2-8.el9.noarch 2024-05-15T15:38:48.389 INFO:teuthology.orchestra.run.smithi104.stdout: bison-3.7.4-5.el9.x86_64 2024-05-15T15:38:48.389 INFO:teuthology.orchestra.run.smithi104.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-15T15:38:48.389 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-15T15:38:48.389 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-base-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-15T15:38:48.389 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-common-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-15T15:38:48.389 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-fuse-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-15T15:38:48.389 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-grafana-dashboards-2:19.0.0-3709.g43296076.el9.noarch 2024-05-15T15:38:48.389 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-immutable-object-cache-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-15T15:38:48.389 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mds-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-15T15:38:48.389 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-15T15:38:48.389 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-cephadm-2:19.0.0-3709.g43296076.el9.noarch 2024-05-15T15:38:48.390 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-dashboard-2:19.0.0-3709.g43296076.el9.noarch 2024-05-15T15:38:48.390 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3709.g43296076.el9.noarch 2024-05-15T15:38:48.390 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-modules-core-2:19.0.0-3709.g43296076.el9.noarch 2024-05-15T15:38:48.390 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-rook-2:19.0.0-3709.g43296076.el9.noarch 2024-05-15T15:38:48.390 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mon-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-15T15:38:48.390 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-osd-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-15T15:38:48.390 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-prometheus-alerts-2:19.0.0-3709.g43296076.el9.noarch 2024-05-15T15:38:48.390 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-radosgw-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-15T15:38:48.390 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-selinux-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-15T15:38:48.390 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-test-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-15T15:38:48.390 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-volume-2:19.0.0-3709.g43296076.el9.noarch 2024-05-15T15:38:48.390 INFO:teuthology.orchestra.run.smithi104.stdout: cephadm-2:19.0.0-3709.g43296076.el9.noarch 2024-05-15T15:38:48.391 INFO:teuthology.orchestra.run.smithi104.stdout: cephfs-mirror-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-15T15:38:48.391 INFO:teuthology.orchestra.run.smithi104.stdout: cephfs-shell-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-15T15:38:48.391 INFO:teuthology.orchestra.run.smithi104.stdout: cephfs-top-2:19.0.0-3709.g43296076.el9.noarch 2024-05-15T15:38:48.391 INFO:teuthology.orchestra.run.smithi104.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-05-15T15:38:48.391 INFO:teuthology.orchestra.run.smithi104.stdout: flex-2.6.4-9.el9.x86_64 2024-05-15T15:38:48.391 INFO:teuthology.orchestra.run.smithi104.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-15T15:38:48.391 INFO:teuthology.orchestra.run.smithi104.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-15T15:38:48.391 INFO:teuthology.orchestra.run.smithi104.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-15T15:38:48.391 INFO:teuthology.orchestra.run.smithi104.stdout: fscrypt-0.3.4-2.el9.x86_64 2024-05-15T15:38:48.391 INFO:teuthology.orchestra.run.smithi104.stdout: fuse-2.9.9-15.el9.x86_64 2024-05-15T15:38:48.391 INFO:teuthology.orchestra.run.smithi104.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-15T15:38:48.391 INFO:teuthology.orchestra.run.smithi104.stdout: grpc-data-1.46.7-10.el9.noarch 2024-05-15T15:38:48.391 INFO:teuthology.orchestra.run.smithi104.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-05-15T15:38:48.392 INFO:teuthology.orchestra.run.smithi104.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-15T15:38:48.392 INFO:teuthology.orchestra.run.smithi104.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-15T15:38:48.392 INFO:teuthology.orchestra.run.smithi104.stdout: libcephfs-devel-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-15T15:38:48.392 INFO:teuthology.orchestra.run.smithi104.stdout: libcephfs2-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-15T15:38:48.392 INFO:teuthology.orchestra.run.smithi104.stdout: libcephsqlite-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-15T15:38:48.392 INFO:teuthology.orchestra.run.smithi104.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-15T15:38:48.392 INFO:teuthology.orchestra.run.smithi104.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-15T15:38:48.392 INFO:teuthology.orchestra.run.smithi104.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-15T15:38:48.392 INFO:teuthology.orchestra.run.smithi104.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-15T15:38:48.392 INFO:teuthology.orchestra.run.smithi104.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-15T15:38:48.392 INFO:teuthology.orchestra.run.smithi104.stdout: librados-devel-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-15T15:38:48.392 INFO:teuthology.orchestra.run.smithi104.stdout: libradosstriper1-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-15T15:38:48.392 INFO:teuthology.orchestra.run.smithi104.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-15T15:38:48.393 INFO:teuthology.orchestra.run.smithi104.stdout: librgw2-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-15T15:38:48.393 INFO:teuthology.orchestra.run.smithi104.stdout: libtool-2.4.6-45.el9.x86_64 2024-05-15T15:38:48.393 INFO:teuthology.orchestra.run.smithi104.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-15T15:38:48.393 INFO:teuthology.orchestra.run.smithi104.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-05-15T15:38:48.393 INFO:teuthology.orchestra.run.smithi104.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-05-15T15:38:48.393 INFO:teuthology.orchestra.run.smithi104.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-15T15:38:48.393 INFO:teuthology.orchestra.run.smithi104.stdout: lua-5.4.4-4.el9.x86_64 2024-05-15T15:38:48.393 INFO:teuthology.orchestra.run.smithi104.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-05-15T15:38:48.393 INFO:teuthology.orchestra.run.smithi104.stdout: luarocks-3.9.2-1.el9.noarch 2024-05-15T15:38:48.393 INFO:teuthology.orchestra.run.smithi104.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-15T15:38:48.393 INFO:teuthology.orchestra.run.smithi104.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-15T15:38:48.393 INFO:teuthology.orchestra.run.smithi104.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-05-15T15:38:48.393 INFO:teuthology.orchestra.run.smithi104.stdout: pam_fscrypt-0.3.4-2.el9.x86_64 2024-05-15T15:38:48.394 INFO:teuthology.orchestra.run.smithi104.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-15T15:38:48.394 INFO:teuthology.orchestra.run.smithi104.stdout: postgresql-13.14-1.el9.x86_64 2024-05-15T15:38:48.394 INFO:teuthology.orchestra.run.smithi104.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-05-15T15:38:48.394 INFO:teuthology.orchestra.run.smithi104.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-05-15T15:38:48.394 INFO:teuthology.orchestra.run.smithi104.stdout: postgresql-server-13.14-1.el9.x86_64 2024-05-15T15:38:48.394 INFO:teuthology.orchestra.run.smithi104.stdout: protobuf-3.14.0-13.el9.x86_64 2024-05-15T15:38:48.394 INFO:teuthology.orchestra.run.smithi104.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-05-15T15:38:48.394 INFO:teuthology.orchestra.run.smithi104.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-15T15:38:48.394 INFO:teuthology.orchestra.run.smithi104.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-05-15T15:38:48.394 INFO:teuthology.orchestra.run.smithi104.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-15T15:38:48.394 INFO:teuthology.orchestra.run.smithi104.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-15T15:38:48.395 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-15T15:38:48.395 INFO:teuthology.orchestra.run.smithi104.stdout: python3-ceph-argparse-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-15T15:38:48.395 INFO:teuthology.orchestra.run.smithi104.stdout: python3-ceph-common-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-15T15:38:48.395 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cephfs-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-15T15:38:48.395 INFO:teuthology.orchestra.run.smithi104.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-15T15:38:48.395 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-15T15:38:48.395 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-15T15:38:48.395 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-15T15:38:48.395 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-05-15T15:38:48.395 INFO:teuthology.orchestra.run.smithi104.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-05-15T15:38:48.395 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-15T15:38:48.395 INFO:teuthology.orchestra.run.smithi104.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-15T15:38:48.395 INFO:teuthology.orchestra.run.smithi104.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-15T15:38:48.395 INFO:teuthology.orchestra.run.smithi104.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-05-15T15:38:48.395 INFO:teuthology.orchestra.run.smithi104.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-05-15T15:38:48.396 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-15T15:38:48.396 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-15T15:38:48.396 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-15T15:38:48.396 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-15T15:38:48.396 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-15T15:38:48.396 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-05-15T15:38:48.396 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-15T15:38:48.396 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-15T15:38:48.396 INFO:teuthology.orchestra.run.smithi104.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-15T15:38:48.396 INFO:teuthology.orchestra.run.smithi104.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-15T15:38:48.396 INFO:teuthology.orchestra.run.smithi104.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-15T15:38:48.396 INFO:teuthology.orchestra.run.smithi104.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-15T15:38:48.397 INFO:teuthology.orchestra.run.smithi104.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-15T15:38:48.397 INFO:teuthology.orchestra.run.smithi104.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-15T15:38:48.397 INFO:teuthology.orchestra.run.smithi104.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-15T15:38:48.397 INFO:teuthology.orchestra.run.smithi104.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-15T15:38:48.397 INFO:teuthology.orchestra.run.smithi104.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-15T15:38:48.397 INFO:teuthology.orchestra.run.smithi104.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-15T15:38:48.397 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-15T15:38:48.397 INFO:teuthology.orchestra.run.smithi104.stdout: python3-ply-3.11-14.el9.noarch 2024-05-15T15:38:48.397 INFO:teuthology.orchestra.run.smithi104.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-15T15:38:48.397 INFO:teuthology.orchestra.run.smithi104.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-15T15:38:48.397 INFO:teuthology.orchestra.run.smithi104.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-05-15T15:38:48.397 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-15T15:38:48.397 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-15T15:38:48.397 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-15T15:38:48.398 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-15T15:38:48.398 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-05-15T15:38:48.398 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-15T15:38:48.398 INFO:teuthology.orchestra.run.smithi104.stdout: python3-rados-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-15T15:38:48.398 INFO:teuthology.orchestra.run.smithi104.stdout: python3-rbd-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-15T15:38:48.398 INFO:teuthology.orchestra.run.smithi104.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-15T15:38:48.398 INFO:teuthology.orchestra.run.smithi104.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-15T15:38:48.398 INFO:teuthology.orchestra.run.smithi104.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-15T15:38:48.398 INFO:teuthology.orchestra.run.smithi104.stdout: python3-rgw-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-15T15:38:48.398 INFO:teuthology.orchestra.run.smithi104.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-15T15:38:48.399 INFO:teuthology.orchestra.run.smithi104.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-15T15:38:48.399 INFO:teuthology.orchestra.run.smithi104.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-15T15:38:48.399 INFO:teuthology.orchestra.run.smithi104.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-15T15:38:48.399 INFO:teuthology.orchestra.run.smithi104.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-15T15:38:48.399 INFO:teuthology.orchestra.run.smithi104.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-15T15:38:48.399 INFO:teuthology.orchestra.run.smithi104.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-15T15:38:48.399 INFO:teuthology.orchestra.run.smithi104.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-05-15T15:38:48.399 INFO:teuthology.orchestra.run.smithi104.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-15T15:38:48.399 INFO:teuthology.orchestra.run.smithi104.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-15T15:38:48.399 INFO:teuthology.orchestra.run.smithi104.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-15T15:38:48.399 INFO:teuthology.orchestra.run.smithi104.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-15T15:38:48.399 INFO:teuthology.orchestra.run.smithi104.stdout: qatlib-24.02.0-1.el9.x86_64 2024-05-15T15:38:48.399 INFO:teuthology.orchestra.run.smithi104.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-05-15T15:38:48.399 INFO:teuthology.orchestra.run.smithi104.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-05-15T15:38:48.400 INFO:teuthology.orchestra.run.smithi104.stdout: rbd-fuse-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-15T15:38:48.400 INFO:teuthology.orchestra.run.smithi104.stdout: rbd-mirror-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-15T15:38:48.400 INFO:teuthology.orchestra.run.smithi104.stdout: rbd-nbd-2:19.0.0-3709.g43296076.el9.x86_64 2024-05-15T15:38:48.400 INFO:teuthology.orchestra.run.smithi104.stdout: re2-1:20211101-3.el9.x86_64 2024-05-15T15:38:48.400 INFO:teuthology.orchestra.run.smithi104.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-15T15:38:48.400 INFO:teuthology.orchestra.run.smithi104.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-15T15:38:48.400 INFO:teuthology.orchestra.run.smithi104.stdout: uuid-1.6.2-55.el9.x86_64 2024-05-15T15:38:48.400 INFO:teuthology.orchestra.run.smithi104.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-05-15T15:38:48.400 INFO:teuthology.orchestra.run.smithi104.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-15T15:38:48.401 INFO:teuthology.orchestra.run.smithi104.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-05-15T15:38:48.401 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-15T15:38:48.401 INFO:teuthology.orchestra.run.smithi104.stdout:Complete! 2024-05-15T15:38:48.771 DEBUG:teuthology.parallel:result is None 2024-05-15T15:38:49.045 DEBUG:teuthology.parallel:result is None 2024-05-15T15:38:49.046 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=43296076bed1da2423ef68e9230eab60284d4c31 2024-05-15T15:38:49.189 DEBUG:teuthology.orchestra.run.smithi012:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-15T15:38:49.214 INFO:teuthology.orchestra.run.smithi012.stdout:19.0.0-3709.g43296076.el9 2024-05-15T15:38:49.214 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3709.g43296076.el9 2024-05-15T15:38:49.215 INFO:teuthology.task.install:The correct ceph version 19.0.0-3709.g43296076 is installed. 2024-05-15T15:38:49.217 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=43296076bed1da2423ef68e9230eab60284d4c31 2024-05-15T15:38:49.434 DEBUG:teuthology.orchestra.run.smithi084:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-15T15:38:49.461 INFO:teuthology.orchestra.run.smithi084.stdout:19.0.0-3709.g43296076.el9 2024-05-15T15:38:49.461 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3709.g43296076.el9 2024-05-15T15:38:49.461 INFO:teuthology.task.install:The correct ceph version 19.0.0-3709.g43296076 is installed. 2024-05-15T15:38:49.463 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=43296076bed1da2423ef68e9230eab60284d4c31 2024-05-15T15:38:49.598 DEBUG:teuthology.orchestra.run.smithi104:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-15T15:38:49.653 INFO:teuthology.orchestra.run.smithi104.stdout:19.0.0-3709.g43296076.el9 2024-05-15T15:38:49.654 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3709.g43296076.el9 2024-05-15T15:38:49.654 INFO:teuthology.task.install:The correct ceph version 19.0.0-3709.g43296076 is installed. 2024-05-15T15:38:49.656 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-05-15T15:38:49.656 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-05-15T15:38:49.657 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-15T15:38:49.689 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-05-15T15:38:49.690 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-15T15:38:49.720 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-05-15T15:38:49.720 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-15T15:38:49.785 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-05-15T15:38:49.786 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-05-15T15:38:49.786 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/usr/bin/daemon-helper 2024-05-15T15:38:49.853 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-15T15:38:49.923 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-05-15T15:38:49.923 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/usr/bin/daemon-helper 2024-05-15T15:38:49.951 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-15T15:38:50.019 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-05-15T15:38:50.019 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd of=/usr/bin/daemon-helper 2024-05-15T15:38:50.087 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-15T15:38:50.190 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-05-15T15:38:50.191 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-05-15T15:38:50.191 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-15T15:38:50.253 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-15T15:38:50.323 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-05-15T15:38:50.323 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-15T15:38:50.347 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-15T15:38:50.411 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-05-15T15:38:50.411 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-15T15:38:50.474 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-15T15:38:50.578 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-05-15T15:38:50.578 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-05-15T15:38:50.579 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/usr/bin/stdin-killer 2024-05-15T15:38:50.608 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-15T15:38:50.678 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-05-15T15:38:50.678 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/usr/bin/stdin-killer 2024-05-15T15:38:50.703 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-15T15:38:50.766 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-05-15T15:38:50.766 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd of=/usr/bin/stdin-killer 2024-05-15T15:38:50.831 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-15T15:38:50.940 INFO:teuthology.run_tasks:Running task ceph... 2024-05-15T15:38:51.274 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-05-15T15:38:51.275 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 777 /var/log/ceph 2024-05-15T15:38:51.277 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 777 /var/log/ceph 2024-05-15T15:38:51.280 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod 777 /var/log/ceph 2024-05-15T15:38:51.343 INFO:tasks.ceph:Disabling ceph logrotate... 2024-05-15T15:38:51.344 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-15T15:38:51.347 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-15T15:38:51.349 DEBUG:teuthology.orchestra.run.smithi104:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-15T15:38:51.416 INFO:tasks.ceph:Creating extra log directories... 2024-05-15T15:38:51.417 DEBUG:teuthology.orchestra.run.smithi012:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-15T15:38:51.420 DEBUG:teuthology.orchestra.run.smithi084:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-15T15:38:51.422 DEBUG:teuthology.orchestra.run.smithi104:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-15T15:38:51.496 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-05-15T15:38:51.497 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-05-15T15:38:51.522 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-05-15T15:38:51.522 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-05-15T15:38:51.522 DEBUG:teuthology.orchestra.run.smithi012:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-05-15T15:38:51.540 DEBUG:teuthology.orchestra.run.smithi012:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-05-15T15:38:51.657 DEBUG:teuthology.orchestra.run.smithi012:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-05-15T15:38:51.685 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-05-15T15:38:51.685 DEBUG:teuthology.orchestra.run.smithi084:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-05-15T15:38:51.700 DEBUG:teuthology.orchestra.run.smithi084:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-05-15T15:38:51.808 DEBUG:teuthology.orchestra.run.smithi084:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-05-15T15:38:51.847 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-05-15T15:38:51.847 DEBUG:teuthology.orchestra.run.smithi104:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-05-15T15:38:51.887 DEBUG:teuthology.orchestra.run.smithi104:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-05-15T15:38:52.082 DEBUG:teuthology.orchestra.run.smithi104:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-05-15T15:38:52.151 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-05-15T15:38:52.151 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0, 'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-05-15T15:38:52.152 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/pdonnell-2024-05-15_15:16:14-fs:fscrypt-wip-pdonnell-testing-20240515.023933-debug-distro-default-smithi/7707268', 'branch': 'wip-pdonnell-testing-20240515.023933-debug', 'description': 'fs:fscrypt/{begin/{0-install 1-ceph 2-logrotate 3-modules} bluestore-bitmap clusters/1-mds-1-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} overrides/{ignorelist_health ignorelist_health_more ignorelist_wrongly_marked_down osd pg-warn pg_health} tasks/{0-client 1-tests/fscrypt-common}}', 'email': 'pdonnell@redhat.com', 'first_in_suite': False, 'job_id': '7707268', 'kernel': {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'pdonnell-2024-05-15_15:16:14-fs:fscrypt-wip-pdonnell-testing-20240515.023933-debug-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-pdonnell-testing-20240515.023933-debug'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0, 'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': '43296076bed1da2423ef68e9230eab60284d4c31'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '43296076bed1da2423ef68e9230eab60284d4c31'}, 'extra_system_packages': {'deb': ['fscrypt'], 'rpm': ['fscrypt']}}, 'kclient': {'syntax': 'v1'}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'i64602', 'sha1': 'b8bd437e67ddf964c5c673086ea1e4c237db86fa'}}, 'owner': 'scheduled_pdonnell@teuthology', 'priority': 65, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'], ['client.0']], 'seed': 2176, 'sha1': '43296076bed1da2423ef68e9230eab60284d4c31', 'sleep_before_teardown': 0, 'suite': 'fs:fscrypt', 'suite_branch': 'i64602', 'suite_path': '/home/teuthworker/src/github.com_batrick_ceph_b8bd437e67ddf964c5c673086ea1e4c237db86fa/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/batrick/ceph.git', 'suite_sha1': 'b8bd437e67ddf964c5c673086ea1e4c237db86fa', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi012.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBG2i70EpL77oPbG/6MA++NCF0uVUZz0Qn3hgynP6Ra4eXFERNjfmD4+oGS3/ks6eG9cLo+CrJySNJ851dnkVdTE=', 'smithi084.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKg91V/Kmfd0ek4z720g3qcttaon7aGfKZ+BIb1+EKkDr9Gi4zWlwDedklEjb0y5tvPJuIr5sWgiZgBWyW7yCbU=', 'smithi104.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBA4rmZ4S3yNGHZiN5a6YvUTX8tOaCaaM2ddSiIfEAwKC/OMYTIuvWJ8ySpMZHCU+ukEuoQ7sP/V69xi1K/P4tvk='}, 'task': None, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib', 'fscrypt'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib', 'fscrypt']}, 'flavor': 'default', 'sha1': '43296076bed1da2423ef68e9230eab60284d4c31'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0, 'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': '43296076bed1da2423ef68e9230eab60284d4c31', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'kclient': None}, {'full_sequential_finally': [{'sleep': {'duration': 3600}}]}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_fscrypt']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end', 'if not is_kupstream() then reject() end']}, 'teuthology_branch': 'install-override-extra_system_packages', 'teuthology_sha1': '08ca1187b5d019c0ae6c90488c6c9faaace42185', 'timestamp': '2024-05-15_15:16:14', 'tube': 'smithi', 'user': 'pdonnell', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-05-15T15:38:52.152 DEBUG:teuthology.orchestra.run.smithi012:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-15T15:38:52.156 DEBUG:teuthology.orchestra.run.smithi084:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-15T15:38:52.158 DEBUG:teuthology.orchestra.run.smithi104:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-15T15:38:52.197 DEBUG:teuthology.orchestra.run.smithi012:> sudo install -d -m0777 -- /var/run/ceph 2024-05-15T15:38:52.214 DEBUG:teuthology.orchestra.run.smithi084:> sudo install -d -m0777 -- /var/run/ceph 2024-05-15T15:38:52.216 DEBUG:teuthology.orchestra.run.smithi104:> sudo install -d -m0777 -- /var/run/ceph 2024-05-15T15:38:52.317 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-05-15T15:38:52.317 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/scratch_devs of=/dev/stdout 2024-05-15T15:38:52.336 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-15T15:38:52.336 DEBUG:teuthology.orchestra.run.smithi012:> stat /dev/vg_nvme/lv_1 2024-05-15T15:38:52.394 INFO:teuthology.orchestra.run.smithi012.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-15T15:38:52.394 INFO:teuthology.orchestra.run.smithi012.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-15T15:38:52.394 INFO:teuthology.orchestra.run.smithi012.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-05-15T15:38:52.394 INFO:teuthology.orchestra.run.smithi012.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-15T15:38:52.394 INFO:teuthology.orchestra.run.smithi012.stdout:Context: system_u:object_r:device_t:s0 2024-05-15T15:38:52.394 INFO:teuthology.orchestra.run.smithi012.stdout:Access: 2024-05-15 15:38:40.072301786 +0000 2024-05-15T15:38:52.394 INFO:teuthology.orchestra.run.smithi012.stdout:Modify: 2024-05-15 15:34:56.024577718 +0000 2024-05-15T15:38:52.395 INFO:teuthology.orchestra.run.smithi012.stdout:Change: 2024-05-15 15:34:56.024577718 +0000 2024-05-15T15:38:52.395 INFO:teuthology.orchestra.run.smithi012.stdout: Birth: 2024-05-15 15:34:56.024577718 +0000 2024-05-15T15:38:52.395 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-15T15:38:52.462 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records in 2024-05-15T15:38:52.462 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records out 2024-05-15T15:38:52.462 INFO:teuthology.orchestra.run.smithi012.stderr:512 bytes copied, 0.000289748 s, 1.8 MB/s 2024-05-15T15:38:52.463 DEBUG:teuthology.orchestra.run.smithi012:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-15T15:38:52.523 DEBUG:teuthology.orchestra.run.smithi012:> stat /dev/vg_nvme/lv_2 2024-05-15T15:38:52.580 INFO:teuthology.orchestra.run.smithi012.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-15T15:38:52.580 INFO:teuthology.orchestra.run.smithi012.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-15T15:38:52.580 INFO:teuthology.orchestra.run.smithi012.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-05-15T15:38:52.581 INFO:teuthology.orchestra.run.smithi012.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-15T15:38:52.581 INFO:teuthology.orchestra.run.smithi012.stdout:Context: system_u:object_r:device_t:s0 2024-05-15T15:38:52.581 INFO:teuthology.orchestra.run.smithi012.stdout:Access: 2024-05-15 15:38:40.072301786 +0000 2024-05-15T15:38:52.581 INFO:teuthology.orchestra.run.smithi012.stdout:Modify: 2024-05-15 15:34:56.371574664 +0000 2024-05-15T15:38:52.581 INFO:teuthology.orchestra.run.smithi012.stdout:Change: 2024-05-15 15:34:56.371574664 +0000 2024-05-15T15:38:52.581 INFO:teuthology.orchestra.run.smithi012.stdout: Birth: 2024-05-15 15:34:56.371574664 +0000 2024-05-15T15:38:52.581 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-15T15:38:52.647 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records in 2024-05-15T15:38:52.648 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records out 2024-05-15T15:38:52.648 INFO:teuthology.orchestra.run.smithi012.stderr:512 bytes copied, 0.000206399 s, 2.5 MB/s 2024-05-15T15:38:52.649 DEBUG:teuthology.orchestra.run.smithi012:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-15T15:38:52.707 DEBUG:teuthology.orchestra.run.smithi012:> stat /dev/vg_nvme/lv_3 2024-05-15T15:38:52.764 INFO:teuthology.orchestra.run.smithi012.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-15T15:38:52.765 INFO:teuthology.orchestra.run.smithi012.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-15T15:38:52.765 INFO:teuthology.orchestra.run.smithi012.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-05-15T15:38:52.765 INFO:teuthology.orchestra.run.smithi012.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-15T15:38:52.765 INFO:teuthology.orchestra.run.smithi012.stdout:Context: system_u:object_r:device_t:s0 2024-05-15T15:38:52.765 INFO:teuthology.orchestra.run.smithi012.stdout:Access: 2024-05-15 15:38:40.073301777 +0000 2024-05-15T15:38:52.765 INFO:teuthology.orchestra.run.smithi012.stdout:Modify: 2024-05-15 15:34:56.741571408 +0000 2024-05-15T15:38:52.765 INFO:teuthology.orchestra.run.smithi012.stdout:Change: 2024-05-15 15:34:56.741571408 +0000 2024-05-15T15:38:52.765 INFO:teuthology.orchestra.run.smithi012.stdout: Birth: 2024-05-15 15:34:56.741571408 +0000 2024-05-15T15:38:52.766 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-15T15:38:52.831 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records in 2024-05-15T15:38:52.833 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records out 2024-05-15T15:38:52.833 INFO:teuthology.orchestra.run.smithi012.stderr:512 bytes copied, 0.00023415 s, 2.2 MB/s 2024-05-15T15:38:52.834 DEBUG:teuthology.orchestra.run.smithi012:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-15T15:38:52.894 DEBUG:teuthology.orchestra.run.smithi012:> stat /dev/vg_nvme/lv_4 2024-05-15T15:38:52.953 INFO:teuthology.orchestra.run.smithi012.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-15T15:38:52.953 INFO:teuthology.orchestra.run.smithi012.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-15T15:38:52.953 INFO:teuthology.orchestra.run.smithi012.stdout:Device: 5h/5d Inode: 720 Links: 1 2024-05-15T15:38:52.953 INFO:teuthology.orchestra.run.smithi012.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-15T15:38:52.953 INFO:teuthology.orchestra.run.smithi012.stdout:Context: system_u:object_r:device_t:s0 2024-05-15T15:38:52.954 INFO:teuthology.orchestra.run.smithi012.stdout:Access: 2024-05-15 15:38:40.073301777 +0000 2024-05-15T15:38:52.954 INFO:teuthology.orchestra.run.smithi012.stdout:Modify: 2024-05-15 15:34:57.075568469 +0000 2024-05-15T15:38:52.954 INFO:teuthology.orchestra.run.smithi012.stdout:Change: 2024-05-15 15:34:57.075568469 +0000 2024-05-15T15:38:52.954 INFO:teuthology.orchestra.run.smithi012.stdout: Birth: 2024-05-15 15:34:57.075568469 +0000 2024-05-15T15:38:52.954 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-15T15:38:53.021 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records in 2024-05-15T15:38:53.021 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records out 2024-05-15T15:38:53.021 INFO:teuthology.orchestra.run.smithi012.stderr:512 bytes copied, 0.000192816 s, 2.7 MB/s 2024-05-15T15:38:53.022 DEBUG:teuthology.orchestra.run.smithi012:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-15T15:38:53.081 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-15T15:38:53.081 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-05-15T15:38:53.081 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/scratch_devs of=/dev/stdout 2024-05-15T15:38:53.100 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-15T15:38:53.100 DEBUG:teuthology.orchestra.run.smithi084:> stat /dev/vg_nvme/lv_1 2024-05-15T15:38:53.159 INFO:teuthology.orchestra.run.smithi084.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-15T15:38:53.159 INFO:teuthology.orchestra.run.smithi084.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-15T15:38:53.159 INFO:teuthology.orchestra.run.smithi084.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-05-15T15:38:53.159 INFO:teuthology.orchestra.run.smithi084.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-15T15:38:53.159 INFO:teuthology.orchestra.run.smithi084.stdout:Context: system_u:object_r:device_t:s0 2024-05-15T15:38:53.159 INFO:teuthology.orchestra.run.smithi084.stdout:Access: 2024-05-15 15:38:16.341015691 +0000 2024-05-15T15:38:53.160 INFO:teuthology.orchestra.run.smithi084.stdout:Modify: 2024-05-15 15:34:51.414835759 +0000 2024-05-15T15:38:53.160 INFO:teuthology.orchestra.run.smithi084.stdout:Change: 2024-05-15 15:34:51.414835759 +0000 2024-05-15T15:38:53.160 INFO:teuthology.orchestra.run.smithi084.stdout: Birth: 2024-05-15 15:34:51.414835759 +0000 2024-05-15T15:38:53.160 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-15T15:38:53.225 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records in 2024-05-15T15:38:53.225 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records out 2024-05-15T15:38:53.225 INFO:teuthology.orchestra.run.smithi084.stderr:512 bytes copied, 0.000219661 s, 2.3 MB/s 2024-05-15T15:38:53.226 DEBUG:teuthology.orchestra.run.smithi084:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-15T15:38:53.284 DEBUG:teuthology.orchestra.run.smithi084:> stat /dev/vg_nvme/lv_2 2024-05-15T15:38:53.341 INFO:teuthology.orchestra.run.smithi084.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-15T15:38:53.341 INFO:teuthology.orchestra.run.smithi084.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-15T15:38:53.341 INFO:teuthology.orchestra.run.smithi084.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-05-15T15:38:53.341 INFO:teuthology.orchestra.run.smithi084.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-15T15:38:53.341 INFO:teuthology.orchestra.run.smithi084.stdout:Context: system_u:object_r:device_t:s0 2024-05-15T15:38:53.341 INFO:teuthology.orchestra.run.smithi084.stdout:Access: 2024-05-15 15:38:16.342015674 +0000 2024-05-15T15:38:53.341 INFO:teuthology.orchestra.run.smithi084.stdout:Modify: 2024-05-15 15:34:51.751829924 +0000 2024-05-15T15:38:53.341 INFO:teuthology.orchestra.run.smithi084.stdout:Change: 2024-05-15 15:34:51.751829924 +0000 2024-05-15T15:38:53.341 INFO:teuthology.orchestra.run.smithi084.stdout: Birth: 2024-05-15 15:34:51.751829924 +0000 2024-05-15T15:38:53.342 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-15T15:38:53.406 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records in 2024-05-15T15:38:53.406 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records out 2024-05-15T15:38:53.406 INFO:teuthology.orchestra.run.smithi084.stderr:512 bytes copied, 0.000262255 s, 2.0 MB/s 2024-05-15T15:38:53.407 DEBUG:teuthology.orchestra.run.smithi084:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-15T15:38:53.464 DEBUG:teuthology.orchestra.run.smithi084:> stat /dev/vg_nvme/lv_3 2024-05-15T15:38:53.521 INFO:teuthology.orchestra.run.smithi084.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-15T15:38:53.521 INFO:teuthology.orchestra.run.smithi084.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-15T15:38:53.522 INFO:teuthology.orchestra.run.smithi084.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-05-15T15:38:53.522 INFO:teuthology.orchestra.run.smithi084.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-15T15:38:53.522 INFO:teuthology.orchestra.run.smithi084.stdout:Context: system_u:object_r:device_t:s0 2024-05-15T15:38:53.522 INFO:teuthology.orchestra.run.smithi084.stdout:Access: 2024-05-15 15:38:16.342015674 +0000 2024-05-15T15:38:53.522 INFO:teuthology.orchestra.run.smithi084.stdout:Modify: 2024-05-15 15:34:52.076824296 +0000 2024-05-15T15:38:53.522 INFO:teuthology.orchestra.run.smithi084.stdout:Change: 2024-05-15 15:34:52.076824296 +0000 2024-05-15T15:38:53.522 INFO:teuthology.orchestra.run.smithi084.stdout: Birth: 2024-05-15 15:34:52.076824296 +0000 2024-05-15T15:38:53.522 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-15T15:38:53.584 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records in 2024-05-15T15:38:53.585 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records out 2024-05-15T15:38:53.585 INFO:teuthology.orchestra.run.smithi084.stderr:512 bytes copied, 0.000185398 s, 2.8 MB/s 2024-05-15T15:38:53.586 DEBUG:teuthology.orchestra.run.smithi084:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-15T15:38:53.643 DEBUG:teuthology.orchestra.run.smithi084:> stat /dev/vg_nvme/lv_4 2024-05-15T15:38:53.698 INFO:teuthology.orchestra.run.smithi084.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-15T15:38:53.698 INFO:teuthology.orchestra.run.smithi084.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-15T15:38:53.699 INFO:teuthology.orchestra.run.smithi084.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-05-15T15:38:53.699 INFO:teuthology.orchestra.run.smithi084.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-15T15:38:53.699 INFO:teuthology.orchestra.run.smithi084.stdout:Context: system_u:object_r:device_t:s0 2024-05-15T15:38:53.699 INFO:teuthology.orchestra.run.smithi084.stdout:Access: 2024-05-15 15:38:16.343015657 +0000 2024-05-15T15:38:53.699 INFO:teuthology.orchestra.run.smithi084.stdout:Modify: 2024-05-15 15:34:52.401818669 +0000 2024-05-15T15:38:53.699 INFO:teuthology.orchestra.run.smithi084.stdout:Change: 2024-05-15 15:34:52.401818669 +0000 2024-05-15T15:38:53.699 INFO:teuthology.orchestra.run.smithi084.stdout: Birth: 2024-05-15 15:34:52.401818669 +0000 2024-05-15T15:38:53.699 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-15T15:38:53.760 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records in 2024-05-15T15:38:53.761 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records out 2024-05-15T15:38:53.761 INFO:teuthology.orchestra.run.smithi084.stderr:512 bytes copied, 0.00018655 s, 2.7 MB/s 2024-05-15T15:38:53.762 DEBUG:teuthology.orchestra.run.smithi084:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-15T15:38:53.817 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-15T15:38:53.817 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi012.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi084.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-05-15T15:38:53.818 INFO:tasks.ceph:Generating config... 2024-05-15T15:38:53.839 INFO:tasks.ceph:[client] client mount timeout = 600 2024-05-15T15:38:53.839 INFO:tasks.ceph:[client] debug client = 20 2024-05-15T15:38:53.839 INFO:tasks.ceph:[client] debug ms = 1 2024-05-15T15:38:53.839 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-05-15T15:38:53.839 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-05-15T15:38:53.839 INFO:tasks.ceph:[global] mon pg warn min per osd = 0 2024-05-15T15:38:53.839 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-05-15T15:38:53.839 INFO:tasks.ceph:[mds] debug mds = 20 2024-05-15T15:38:53.839 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-05-15T15:38:53.840 INFO:tasks.ceph:[mds] debug ms = 1 2024-05-15T15:38:53.840 INFO:tasks.ceph:[mds] mds debug frag = True 2024-05-15T15:38:53.840 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-05-15T15:38:53.840 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-05-15T15:38:53.840 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-05-15T15:38:53.840 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-05-15T15:38:53.840 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-05-15T15:38:53.840 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-05-15T15:38:53.840 INFO:tasks.ceph:[mgr] debug client = 20 2024-05-15T15:38:53.841 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-05-15T15:38:53.841 INFO:tasks.ceph:[mgr] debug ms = 1 2024-05-15T15:38:53.841 INFO:tasks.ceph:[mon] debug mon = 20 2024-05-15T15:38:53.841 INFO:tasks.ceph:[mon] debug ms = 1 2024-05-15T15:38:53.841 INFO:tasks.ceph:[mon] debug paxos = 20 2024-05-15T15:38:53.841 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-05-15T15:38:53.841 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-05-15T15:38:53.841 INFO:tasks.ceph:[osd] bdev async discard = True 2024-05-15T15:38:53.842 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-05-15T15:38:53.842 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-05-15T15:38:53.842 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-05-15T15:38:53.842 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-05-15T15:38:53.842 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-05-15T15:38:53.842 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-05-15T15:38:53.842 INFO:tasks.ceph:[osd] debug ms = 1 2024-05-15T15:38:53.842 INFO:tasks.ceph:[osd] debug osd = 20 2024-05-15T15:38:53.843 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-05-15T15:38:53.843 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-05-15T15:38:53.843 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-05-15T15:38:53.843 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-05-15T15:38:53.843 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-05-15T15:38:53.843 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-05-15T15:38:53.843 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-05-15T15:38:53.844 INFO:tasks.ceph:Setting up mon.a... 2024-05-15T15:38:53.844 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-05-15T15:38:53.903 INFO:teuthology.orchestra.run.smithi012.stdout:creating /etc/ceph/ceph.keyring 2024-05-15T15:38:53.906 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-05-15T15:38:53.971 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-15T15:38:53.997 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.12'), ('mon.b', '172.21.15.84'), ('mon.c', '[v2:172.21.15.84:3301,v1:172.21.15.84:6790]')] 2024-05-15T15:38:53.997 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.12,172.21.15.84,[v2:172.21.15.84:3301,v1:172.21.15.84:6790]', 'mon pg warn min per osd': 0, 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-05-15T15:38:53.998 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-05-15T15:38:53.999 DEBUG:teuthology.orchestra.run.smithi012:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-05-15T15:38:54.054 DEBUG:teuthology.orchestra.run.smithi012:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.12 --add b 172.21.15.84 --addv c '[v2:172.21.15.84:3301,v1:172.21.15.84:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-05-15T15:38:54.153 INFO:teuthology.orchestra.run.smithi012.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-05-15T15:38:54.153 INFO:teuthology.orchestra.run.smithi012.stdout:monmaptool: generated fsid 3b7fc4b2-b85c-49b5-a5de-38444eeed40d 2024-05-15T15:38:54.153 INFO:teuthology.orchestra.run.smithi012.stdout:setting min_mon_release = quincy 2024-05-15T15:38:54.153 INFO:teuthology.orchestra.run.smithi012.stdout:epoch 0 2024-05-15T15:38:54.153 INFO:teuthology.orchestra.run.smithi012.stdout:fsid 3b7fc4b2-b85c-49b5-a5de-38444eeed40d 2024-05-15T15:38:54.153 INFO:teuthology.orchestra.run.smithi012.stdout:last_changed 2024-05-15T15:38:54.152015+0000 2024-05-15T15:38:54.153 INFO:teuthology.orchestra.run.smithi012.stdout:created 2024-05-15T15:38:54.152015+0000 2024-05-15T15:38:54.153 INFO:teuthology.orchestra.run.smithi012.stdout:min_mon_release 17 (quincy) 2024-05-15T15:38:54.153 INFO:teuthology.orchestra.run.smithi012.stdout:election_strategy: 1 2024-05-15T15:38:54.154 INFO:teuthology.orchestra.run.smithi012.stdout:0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.a 2024-05-15T15:38:54.154 INFO:teuthology.orchestra.run.smithi012.stdout:1: [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] mon.b 2024-05-15T15:38:54.154 INFO:teuthology.orchestra.run.smithi012.stdout:2: [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] mon.c 2024-05-15T15:38:54.154 INFO:teuthology.orchestra.run.smithi012.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-05-15T15:38:54.155 DEBUG:teuthology.orchestra.run.smithi012:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-05-15T15:38:54.171 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 3b7fc4b2-b85c-49b5-a5de-38444eeed40d... 2024-05-15T15:38:54.171 DEBUG:teuthology.orchestra.run.smithi012:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-15T15:38:54.213 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-15T15:38:54.216 DEBUG:teuthology.orchestra.run.smithi104:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-15T15:38:54.253 INFO:teuthology.orchestra.run.smithi012.stdout:[global] 2024-05-15T15:38:54.253 INFO:teuthology.orchestra.run.smithi012.stdout: chdir = "" 2024-05-15T15:38:54.253 INFO:teuthology.orchestra.run.smithi012.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-15T15:38:54.253 INFO:teuthology.orchestra.run.smithi012.stdout: auth supported = cephx 2024-05-15T15:38:54.253 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-05-15T15:38:54.253 INFO:teuthology.orchestra.run.smithi012.stdout: filestore xattr use omap = true 2024-05-15T15:38:54.253 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-05-15T15:38:54.254 INFO:teuthology.orchestra.run.smithi012.stdout: mon clock drift allowed = 1.000 2024-05-15T15:38:54.254 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-05-15T15:38:54.254 INFO:teuthology.orchestra.run.smithi012.stdout: osd crush chooseleaf type = 0 2024-05-15T15:38:54.254 INFO:teuthology.orchestra.run.smithi012.stdout: auth debug = true 2024-05-15T15:38:54.254 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-05-15T15:38:54.254 INFO:teuthology.orchestra.run.smithi012.stdout: ms die on old message = true 2024-05-15T15:38:54.254 INFO:teuthology.orchestra.run.smithi012.stdout: ms die on bug = true 2024-05-15T15:38:54.254 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-05-15T15:38:54.254 INFO:teuthology.orchestra.run.smithi012.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-15T15:38:54.254 INFO:teuthology.orchestra.run.smithi012.stdout: mon pg warn max object skew = 0 2024-05-15T15:38:54.254 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-05-15T15:38:54.254 INFO:teuthology.orchestra.run.smithi012.stdout: # disable pg_autoscaler by default for new pools 2024-05-15T15:38:54.254 INFO:teuthology.orchestra.run.smithi012.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-15T15:38:54.255 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-05-15T15:38:54.255 INFO:teuthology.orchestra.run.smithi012.stdout: osd pool default size = 2 2024-05-15T15:38:54.255 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-05-15T15:38:54.255 INFO:teuthology.orchestra.run.smithi012.stdout: mon osd allow primary affinity = true 2024-05-15T15:38:54.255 INFO:teuthology.orchestra.run.smithi012.stdout: mon osd allow pg remap = true 2024-05-15T15:38:54.255 INFO:teuthology.orchestra.run.smithi012.stdout: mon warn on legacy crush tunables = false 2024-05-15T15:38:54.255 INFO:teuthology.orchestra.run.smithi012.stdout: mon warn on crush straw calc version zero = false 2024-05-15T15:38:54.255 INFO:teuthology.orchestra.run.smithi012.stdout: mon warn on no sortbitwise = false 2024-05-15T15:38:54.255 INFO:teuthology.orchestra.run.smithi012.stdout: mon warn on osd down out interval zero = false 2024-05-15T15:38:54.255 INFO:teuthology.orchestra.run.smithi012.stdout: mon warn on too few osds = false 2024-05-15T15:38:54.255 INFO:teuthology.orchestra.run.smithi012.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-15T15:38:54.255 INFO:teuthology.orchestra.run.smithi012.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-15T15:38:54.255 INFO:teuthology.orchestra.run.smithi012.stdout: mon_allow_pool_size_one = true 2024-05-15T15:38:54.255 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-05-15T15:38:54.256 INFO:teuthology.orchestra.run.smithi012.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-15T15:38:54.256 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-05-15T15:38:54.256 INFO:teuthology.orchestra.run.smithi012.stdout: osd default data pool replay window = 5 2024-05-15T15:38:54.256 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-05-15T15:38:54.256 INFO:teuthology.orchestra.run.smithi012.stdout: mon allow pool delete = true 2024-05-15T15:38:54.256 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-05-15T15:38:54.256 INFO:teuthology.orchestra.run.smithi012.stdout: mon cluster log file level = debug 2024-05-15T15:38:54.256 INFO:teuthology.orchestra.run.smithi012.stdout: debug asserts on shutdown = true 2024-05-15T15:38:54.256 INFO:teuthology.orchestra.run.smithi012.stdout: mon health detail to clog = false 2024-05-15T15:38:54.256 INFO:teuthology.orchestra.run.smithi012.stdout: mon host = "172.21.15.12,172.21.15.84,[v2:172.21.15.84:3301,v1:172.21.15.84:6790]" 2024-05-15T15:38:54.256 INFO:teuthology.orchestra.run.smithi012.stdout: mon pg warn min per osd = 0 2024-05-15T15:38:54.256 INFO:teuthology.orchestra.run.smithi012.stdout: ms die on skipped message = False 2024-05-15T15:38:54.256 INFO:teuthology.orchestra.run.smithi012.stdout: fsid = 3b7fc4b2-b85c-49b5-a5de-38444eeed40d 2024-05-15T15:38:54.256 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-05-15T15:38:54.257 INFO:teuthology.orchestra.run.smithi012.stdout:[osd] 2024-05-15T15:38:54.257 INFO:teuthology.orchestra.run.smithi012.stdout: osd journal size = 100 2024-05-15T15:38:54.257 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-05-15T15:38:54.257 INFO:teuthology.orchestra.run.smithi012.stdout: osd scrub load threshold = 5.0 2024-05-15T15:38:54.257 INFO:teuthology.orchestra.run.smithi012.stdout: osd scrub max interval = 600 2024-05-15T15:38:54.257 INFO:teuthology.orchestra.run.smithi012.stdout: osd mclock profile = high_recovery_ops 2024-05-15T15:38:54.257 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-05-15T15:38:54.257 INFO:teuthology.orchestra.run.smithi012.stdout: osd recover clone overlap = true 2024-05-15T15:38:54.257 INFO:teuthology.orchestra.run.smithi012.stdout: osd recovery max chunk = 1048576 2024-05-15T15:38:54.257 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-05-15T15:38:54.257 INFO:teuthology.orchestra.run.smithi012.stdout: osd debug shutdown = true 2024-05-15T15:38:54.257 INFO:teuthology.orchestra.run.smithi012.stdout: osd debug op order = true 2024-05-15T15:38:54.257 INFO:teuthology.orchestra.run.smithi012.stdout: osd debug verify stray on activate = true 2024-05-15T15:38:54.257 INFO:teuthology.orchestra.run.smithi012.stdout: osd debug trim objects = true 2024-05-15T15:38:54.257 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-05-15T15:38:54.258 INFO:teuthology.orchestra.run.smithi012.stdout: osd open classes on start = true 2024-05-15T15:38:54.258 INFO:teuthology.orchestra.run.smithi012.stdout: osd debug pg log writeout = true 2024-05-15T15:38:54.258 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-05-15T15:38:54.258 INFO:teuthology.orchestra.run.smithi012.stdout: osd deep scrub update digest min age = 30 2024-05-15T15:38:54.258 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-05-15T15:38:54.258 INFO:teuthology.orchestra.run.smithi012.stdout: osd map max advance = 10 2024-05-15T15:38:54.258 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-05-15T15:38:54.258 INFO:teuthology.orchestra.run.smithi012.stdout: journal zero on create = true 2024-05-15T15:38:54.258 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-05-15T15:38:54.258 INFO:teuthology.orchestra.run.smithi012.stdout: filestore ondisk finisher threads = 3 2024-05-15T15:38:54.258 INFO:teuthology.orchestra.run.smithi012.stdout: filestore apply finisher threads = 3 2024-05-15T15:38:54.258 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-05-15T15:38:54.258 INFO:teuthology.orchestra.run.smithi012.stdout: bdev debug aio = true 2024-05-15T15:38:54.258 INFO:teuthology.orchestra.run.smithi012.stdout: osd debug misdirected ops = true 2024-05-15T15:38:54.259 INFO:teuthology.orchestra.run.smithi012.stdout: bdev async discard = True 2024-05-15T15:38:54.259 INFO:teuthology.orchestra.run.smithi012.stdout: bdev enable discard = True 2024-05-15T15:38:54.259 INFO:teuthology.orchestra.run.smithi012.stdout: bluestore allocator = bitmap 2024-05-15T15:38:54.259 INFO:teuthology.orchestra.run.smithi012.stdout: bluestore block size = 96636764160 2024-05-15T15:38:54.259 INFO:teuthology.orchestra.run.smithi012.stdout: bluestore fsck on mount = True 2024-05-15T15:38:54.259 INFO:teuthology.orchestra.run.smithi012.stdout: debug bluefs = 1/20 2024-05-15T15:38:54.259 INFO:teuthology.orchestra.run.smithi012.stdout: debug bluestore = 20 2024-05-15T15:38:54.259 INFO:teuthology.orchestra.run.smithi012.stdout: debug ms = 1 2024-05-15T15:38:54.259 INFO:teuthology.orchestra.run.smithi012.stdout: debug osd = 20 2024-05-15T15:38:54.259 INFO:teuthology.orchestra.run.smithi012.stdout: debug rocksdb = 4/10 2024-05-15T15:38:54.259 INFO:teuthology.orchestra.run.smithi012.stdout: mon osd backfillfull_ratio = 0.85 2024-05-15T15:38:54.259 INFO:teuthology.orchestra.run.smithi012.stdout: mon osd full ratio = 0.9 2024-05-15T15:38:54.259 INFO:teuthology.orchestra.run.smithi012.stdout: mon osd nearfull ratio = 0.8 2024-05-15T15:38:54.259 INFO:teuthology.orchestra.run.smithi012.stdout: osd failsafe full ratio = 0.95 2024-05-15T15:38:54.260 INFO:teuthology.orchestra.run.smithi012.stdout: osd objectstore = bluestore 2024-05-15T15:38:54.260 INFO:teuthology.orchestra.run.smithi012.stdout: osd op complaint time = 180 2024-05-15T15:38:54.260 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-05-15T15:38:54.260 INFO:teuthology.orchestra.run.smithi012.stdout:[mgr] 2024-05-15T15:38:54.260 INFO:teuthology.orchestra.run.smithi012.stdout: debug ms = 1 2024-05-15T15:38:54.260 INFO:teuthology.orchestra.run.smithi012.stdout: debug mgr = 20 2024-05-15T15:38:54.260 INFO:teuthology.orchestra.run.smithi012.stdout: debug mon = 20 2024-05-15T15:38:54.260 INFO:teuthology.orchestra.run.smithi012.stdout: debug auth = 20 2024-05-15T15:38:54.260 INFO:teuthology.orchestra.run.smithi012.stdout: mon reweight min pgs per osd = 4 2024-05-15T15:38:54.260 INFO:teuthology.orchestra.run.smithi012.stdout: mon reweight min bytes per osd = 10 2024-05-15T15:38:54.260 INFO:teuthology.orchestra.run.smithi012.stdout: mgr/telemetry/nag = false 2024-05-15T15:38:54.260 INFO:teuthology.orchestra.run.smithi012.stdout: debug client = 20 2024-05-15T15:38:54.260 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-05-15T15:38:54.260 INFO:teuthology.orchestra.run.smithi012.stdout:[mon] 2024-05-15T15:38:54.261 INFO:teuthology.orchestra.run.smithi012.stdout: debug ms = 1 2024-05-15T15:38:54.261 INFO:teuthology.orchestra.run.smithi012.stdout: debug mon = 20 2024-05-15T15:38:54.261 INFO:teuthology.orchestra.run.smithi012.stdout: debug paxos = 20 2024-05-15T15:38:54.261 INFO:teuthology.orchestra.run.smithi012.stdout: debug auth = 20 2024-05-15T15:38:54.261 INFO:teuthology.orchestra.run.smithi012.stdout: mon data avail warn = 5 2024-05-15T15:38:54.261 INFO:teuthology.orchestra.run.smithi012.stdout: mon mgr mkfs grace = 240 2024-05-15T15:38:54.261 INFO:teuthology.orchestra.run.smithi012.stdout: mon reweight min pgs per osd = 4 2024-05-15T15:38:54.261 INFO:teuthology.orchestra.run.smithi012.stdout: mon osd reporter subtree level = osd 2024-05-15T15:38:54.261 INFO:teuthology.orchestra.run.smithi012.stdout: mon osd prime pg temp = true 2024-05-15T15:38:54.261 INFO:teuthology.orchestra.run.smithi012.stdout: mon reweight min bytes per osd = 10 2024-05-15T15:38:54.261 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-05-15T15:38:54.261 INFO:teuthology.orchestra.run.smithi012.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-15T15:38:54.261 INFO:teuthology.orchestra.run.smithi012.stdout: auth mon ticket ttl = 660 # 11m 2024-05-15T15:38:54.261 INFO:teuthology.orchestra.run.smithi012.stdout: auth service ticket ttl = 240 # 4m 2024-05-15T15:38:54.262 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-05-15T15:38:54.262 INFO:teuthology.orchestra.run.smithi012.stdout: # don't complain about insecure global_id in the test suite 2024-05-15T15:38:54.262 INFO:teuthology.orchestra.run.smithi012.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-15T15:38:54.262 INFO:teuthology.orchestra.run.smithi012.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-15T15:38:54.262 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-05-15T15:38:54.262 INFO:teuthology.orchestra.run.smithi012.stdout: # 1m isn't quite enough 2024-05-15T15:38:54.262 INFO:teuthology.orchestra.run.smithi012.stdout: mon_down_mkfs_grace = 2m 2024-05-15T15:38:54.262 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-05-15T15:38:54.262 INFO:teuthology.orchestra.run.smithi012.stdout: mon_warn_on_filestore_osds = false 2024-05-15T15:38:54.262 INFO:teuthology.orchestra.run.smithi012.stdout: mon down mkfs grace = 300 2024-05-15T15:38:54.262 INFO:teuthology.orchestra.run.smithi012.stdout: mon op complaint time = 120 2024-05-15T15:38:54.262 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-05-15T15:38:54.262 INFO:teuthology.orchestra.run.smithi012.stdout:[client] 2024-05-15T15:38:54.262 INFO:teuthology.orchestra.run.smithi012.stdout: rgw cache enabled = true 2024-05-15T15:38:54.263 INFO:teuthology.orchestra.run.smithi012.stdout: rgw enable ops log = true 2024-05-15T15:38:54.263 INFO:teuthology.orchestra.run.smithi012.stdout: rgw enable usage log = true 2024-05-15T15:38:54.263 INFO:teuthology.orchestra.run.smithi012.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-15T15:38:54.263 INFO:teuthology.orchestra.run.smithi012.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-15T15:38:54.263 INFO:teuthology.orchestra.run.smithi012.stdout: client mount timeout = 600 2024-05-15T15:38:54.263 INFO:teuthology.orchestra.run.smithi012.stdout: debug client = 20 2024-05-15T15:38:54.263 INFO:teuthology.orchestra.run.smithi012.stdout: debug ms = 1 2024-05-15T15:38:54.263 INFO:teuthology.orchestra.run.smithi012.stdout: rados mon op timeout = 900 2024-05-15T15:38:54.263 INFO:teuthology.orchestra.run.smithi012.stdout: rados osd op timeout = 900 2024-05-15T15:38:54.263 INFO:teuthology.orchestra.run.smithi012.stdout:[mon.a] 2024-05-15T15:38:54.264 INFO:teuthology.orchestra.run.smithi012.stdout:[mon.b] 2024-05-15T15:38:54.264 INFO:teuthology.orchestra.run.smithi012.stdout:[mon.c] 2024-05-15T15:38:54.264 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.a] 2024-05-15T15:38:54.264 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.c] 2024-05-15T15:38:54.264 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.b] 2024-05-15T15:38:54.264 INFO:teuthology.orchestra.run.smithi012.stdout:[mds] 2024-05-15T15:38:54.264 INFO:teuthology.orchestra.run.smithi012.stdout: debug mds = 20 2024-05-15T15:38:54.264 INFO:teuthology.orchestra.run.smithi012.stdout: debug mds balancer = 20 2024-05-15T15:38:54.264 INFO:teuthology.orchestra.run.smithi012.stdout: debug ms = 1 2024-05-15T15:38:54.264 INFO:teuthology.orchestra.run.smithi012.stdout: mds debug frag = True 2024-05-15T15:38:54.264 INFO:teuthology.orchestra.run.smithi012.stdout: mds debug scatterstat = True 2024-05-15T15:38:54.264 INFO:teuthology.orchestra.run.smithi012.stdout: mds op complaint time = 180 2024-05-15T15:38:54.264 INFO:teuthology.orchestra.run.smithi012.stdout: mds verify scatter = True 2024-05-15T15:38:54.265 INFO:teuthology.orchestra.run.smithi012.stdout: osd op complaint time = 180 2024-05-15T15:38:54.265 INFO:teuthology.orchestra.run.smithi012.stdout: rados mon op timeout = 900 2024-05-15T15:38:54.265 INFO:teuthology.orchestra.run.smithi012.stdout: rados osd op timeout = 900 2024-05-15T15:38:54.267 INFO:teuthology.orchestra.run.smithi084.stdout:[global] 2024-05-15T15:38:54.267 INFO:teuthology.orchestra.run.smithi084.stdout: chdir = "" 2024-05-15T15:38:54.267 INFO:teuthology.orchestra.run.smithi084.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-15T15:38:54.267 INFO:teuthology.orchestra.run.smithi084.stdout: auth supported = cephx 2024-05-15T15:38:54.267 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-05-15T15:38:54.267 INFO:teuthology.orchestra.run.smithi084.stdout: filestore xattr use omap = true 2024-05-15T15:38:54.267 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-05-15T15:38:54.267 INFO:teuthology.orchestra.run.smithi084.stdout: mon clock drift allowed = 1.000 2024-05-15T15:38:54.268 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-05-15T15:38:54.268 INFO:teuthology.orchestra.run.smithi084.stdout: osd crush chooseleaf type = 0 2024-05-15T15:38:54.268 INFO:teuthology.orchestra.run.smithi084.stdout: auth debug = true 2024-05-15T15:38:54.268 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-05-15T15:38:54.268 INFO:teuthology.orchestra.run.smithi084.stdout: ms die on old message = true 2024-05-15T15:38:54.268 INFO:teuthology.orchestra.run.smithi084.stdout: ms die on bug = true 2024-05-15T15:38:54.268 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-05-15T15:38:54.268 INFO:teuthology.orchestra.run.smithi084.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-15T15:38:54.268 INFO:teuthology.orchestra.run.smithi084.stdout: mon pg warn max object skew = 0 2024-05-15T15:38:54.268 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-05-15T15:38:54.268 INFO:teuthology.orchestra.run.smithi084.stdout: # disable pg_autoscaler by default for new pools 2024-05-15T15:38:54.268 INFO:teuthology.orchestra.run.smithi084.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-15T15:38:54.268 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-05-15T15:38:54.268 INFO:teuthology.orchestra.run.smithi084.stdout: osd pool default size = 2 2024-05-15T15:38:54.269 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-05-15T15:38:54.269 INFO:teuthology.orchestra.run.smithi084.stdout: mon osd allow primary affinity = true 2024-05-15T15:38:54.269 INFO:teuthology.orchestra.run.smithi084.stdout: mon osd allow pg remap = true 2024-05-15T15:38:54.269 INFO:teuthology.orchestra.run.smithi084.stdout: mon warn on legacy crush tunables = false 2024-05-15T15:38:54.269 INFO:teuthology.orchestra.run.smithi084.stdout: mon warn on crush straw calc version zero = false 2024-05-15T15:38:54.269 INFO:teuthology.orchestra.run.smithi084.stdout: mon warn on no sortbitwise = false 2024-05-15T15:38:54.269 INFO:teuthology.orchestra.run.smithi084.stdout: mon warn on osd down out interval zero = false 2024-05-15T15:38:54.269 INFO:teuthology.orchestra.run.smithi084.stdout: mon warn on too few osds = false 2024-05-15T15:38:54.269 INFO:teuthology.orchestra.run.smithi084.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-15T15:38:54.269 INFO:teuthology.orchestra.run.smithi084.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-15T15:38:54.269 INFO:teuthology.orchestra.run.smithi084.stdout: mon_allow_pool_size_one = true 2024-05-15T15:38:54.269 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-05-15T15:38:54.269 INFO:teuthology.orchestra.run.smithi084.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-15T15:38:54.269 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-05-15T15:38:54.270 INFO:teuthology.orchestra.run.smithi084.stdout: osd default data pool replay window = 5 2024-05-15T15:38:54.270 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-05-15T15:38:54.270 INFO:teuthology.orchestra.run.smithi084.stdout: mon allow pool delete = true 2024-05-15T15:38:54.270 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-05-15T15:38:54.270 INFO:teuthology.orchestra.run.smithi084.stdout: mon cluster log file level = debug 2024-05-15T15:38:54.270 INFO:teuthology.orchestra.run.smithi084.stdout: debug asserts on shutdown = true 2024-05-15T15:38:54.270 INFO:teuthology.orchestra.run.smithi084.stdout: mon health detail to clog = false 2024-05-15T15:38:54.270 INFO:teuthology.orchestra.run.smithi084.stdout: mon host = "172.21.15.12,172.21.15.84,[v2:172.21.15.84:3301,v1:172.21.15.84:6790]" 2024-05-15T15:38:54.270 INFO:teuthology.orchestra.run.smithi084.stdout: mon pg warn min per osd = 0 2024-05-15T15:38:54.270 INFO:teuthology.orchestra.run.smithi084.stdout: ms die on skipped message = False 2024-05-15T15:38:54.270 INFO:teuthology.orchestra.run.smithi084.stdout: fsid = 3b7fc4b2-b85c-49b5-a5de-38444eeed40d 2024-05-15T15:38:54.270 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-05-15T15:38:54.270 INFO:teuthology.orchestra.run.smithi084.stdout:[osd] 2024-05-15T15:38:54.271 INFO:teuthology.orchestra.run.smithi084.stdout: osd journal size = 100 2024-05-15T15:38:54.271 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-05-15T15:38:54.271 INFO:teuthology.orchestra.run.smithi084.stdout: osd scrub load threshold = 5.0 2024-05-15T15:38:54.271 INFO:teuthology.orchestra.run.smithi084.stdout: osd scrub max interval = 600 2024-05-15T15:38:54.271 INFO:teuthology.orchestra.run.smithi084.stdout: osd mclock profile = high_recovery_ops 2024-05-15T15:38:54.271 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-05-15T15:38:54.271 INFO:teuthology.orchestra.run.smithi084.stdout: osd recover clone overlap = true 2024-05-15T15:38:54.271 INFO:teuthology.orchestra.run.smithi084.stdout: osd recovery max chunk = 1048576 2024-05-15T15:38:54.271 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-05-15T15:38:54.271 INFO:teuthology.orchestra.run.smithi084.stdout: osd debug shutdown = true 2024-05-15T15:38:54.271 INFO:teuthology.orchestra.run.smithi084.stdout: osd debug op order = true 2024-05-15T15:38:54.271 INFO:teuthology.orchestra.run.smithi084.stdout: osd debug verify stray on activate = true 2024-05-15T15:38:54.271 INFO:teuthology.orchestra.run.smithi084.stdout: osd debug trim objects = true 2024-05-15T15:38:54.271 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-05-15T15:38:54.272 INFO:teuthology.orchestra.run.smithi084.stdout: osd open classes on start = true 2024-05-15T15:38:54.272 INFO:teuthology.orchestra.run.smithi084.stdout: osd debug pg log writeout = true 2024-05-15T15:38:54.272 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-05-15T15:38:54.272 INFO:teuthology.orchestra.run.smithi084.stdout: osd deep scrub update digest min age = 30 2024-05-15T15:38:54.272 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-05-15T15:38:54.272 INFO:teuthology.orchestra.run.smithi084.stdout: osd map max advance = 10 2024-05-15T15:38:54.272 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-05-15T15:38:54.272 INFO:teuthology.orchestra.run.smithi084.stdout: journal zero on create = true 2024-05-15T15:38:54.272 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-05-15T15:38:54.272 INFO:teuthology.orchestra.run.smithi084.stdout: filestore ondisk finisher threads = 3 2024-05-15T15:38:54.272 INFO:teuthology.orchestra.run.smithi084.stdout: filestore apply finisher threads = 3 2024-05-15T15:38:54.272 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-05-15T15:38:54.272 INFO:teuthology.orchestra.run.smithi084.stdout: bdev debug aio = true 2024-05-15T15:38:54.272 INFO:teuthology.orchestra.run.smithi084.stdout: osd debug misdirected ops = true 2024-05-15T15:38:54.273 INFO:teuthology.orchestra.run.smithi084.stdout: bdev async discard = True 2024-05-15T15:38:54.273 INFO:teuthology.orchestra.run.smithi084.stdout: bdev enable discard = True 2024-05-15T15:38:54.273 INFO:teuthology.orchestra.run.smithi084.stdout: bluestore allocator = bitmap 2024-05-15T15:38:54.273 INFO:teuthology.orchestra.run.smithi084.stdout: bluestore block size = 96636764160 2024-05-15T15:38:54.273 INFO:teuthology.orchestra.run.smithi084.stdout: bluestore fsck on mount = True 2024-05-15T15:38:54.273 INFO:teuthology.orchestra.run.smithi084.stdout: debug bluefs = 1/20 2024-05-15T15:38:54.273 INFO:teuthology.orchestra.run.smithi084.stdout: debug bluestore = 20 2024-05-15T15:38:54.273 INFO:teuthology.orchestra.run.smithi084.stdout: debug ms = 1 2024-05-15T15:38:54.273 INFO:teuthology.orchestra.run.smithi084.stdout: debug osd = 20 2024-05-15T15:38:54.273 INFO:teuthology.orchestra.run.smithi084.stdout: debug rocksdb = 4/10 2024-05-15T15:38:54.273 INFO:teuthology.orchestra.run.smithi084.stdout: mon osd backfillfull_ratio = 0.85 2024-05-15T15:38:54.273 INFO:teuthology.orchestra.run.smithi084.stdout: mon osd full ratio = 0.9 2024-05-15T15:38:54.273 INFO:teuthology.orchestra.run.smithi084.stdout: mon osd nearfull ratio = 0.8 2024-05-15T15:38:54.274 INFO:teuthology.orchestra.run.smithi084.stdout: osd failsafe full ratio = 0.95 2024-05-15T15:38:54.274 INFO:teuthology.orchestra.run.smithi084.stdout: osd objectstore = bluestore 2024-05-15T15:38:54.274 INFO:teuthology.orchestra.run.smithi084.stdout: osd op complaint time = 180 2024-05-15T15:38:54.274 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-05-15T15:38:54.274 INFO:teuthology.orchestra.run.smithi084.stdout:[mgr] 2024-05-15T15:38:54.274 INFO:teuthology.orchestra.run.smithi084.stdout: debug ms = 1 2024-05-15T15:38:54.274 INFO:teuthology.orchestra.run.smithi084.stdout: debug mgr = 20 2024-05-15T15:38:54.274 INFO:teuthology.orchestra.run.smithi084.stdout: debug mon = 20 2024-05-15T15:38:54.274 INFO:teuthology.orchestra.run.smithi084.stdout: debug auth = 20 2024-05-15T15:38:54.274 INFO:teuthology.orchestra.run.smithi084.stdout: mon reweight min pgs per osd = 4 2024-05-15T15:38:54.274 INFO:teuthology.orchestra.run.smithi084.stdout: mon reweight min bytes per osd = 10 2024-05-15T15:38:54.274 INFO:teuthology.orchestra.run.smithi084.stdout: mgr/telemetry/nag = false 2024-05-15T15:38:54.274 INFO:teuthology.orchestra.run.smithi084.stdout: debug client = 20 2024-05-15T15:38:54.274 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-05-15T15:38:54.275 INFO:teuthology.orchestra.run.smithi084.stdout:[mon] 2024-05-15T15:38:54.275 INFO:teuthology.orchestra.run.smithi084.stdout: debug ms = 1 2024-05-15T15:38:54.275 INFO:teuthology.orchestra.run.smithi084.stdout: debug mon = 20 2024-05-15T15:38:54.275 INFO:teuthology.orchestra.run.smithi084.stdout: debug paxos = 20 2024-05-15T15:38:54.275 INFO:teuthology.orchestra.run.smithi084.stdout: debug auth = 20 2024-05-15T15:38:54.275 INFO:teuthology.orchestra.run.smithi084.stdout: mon data avail warn = 5 2024-05-15T15:38:54.275 INFO:teuthology.orchestra.run.smithi084.stdout: mon mgr mkfs grace = 240 2024-05-15T15:38:54.275 INFO:teuthology.orchestra.run.smithi084.stdout: mon reweight min pgs per osd = 4 2024-05-15T15:38:54.275 INFO:teuthology.orchestra.run.smithi084.stdout: mon osd reporter subtree level = osd 2024-05-15T15:38:54.275 INFO:teuthology.orchestra.run.smithi084.stdout: mon osd prime pg temp = true 2024-05-15T15:38:54.275 INFO:teuthology.orchestra.run.smithi084.stdout: mon reweight min bytes per osd = 10 2024-05-15T15:38:54.275 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-05-15T15:38:54.275 INFO:teuthology.orchestra.run.smithi084.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-15T15:38:54.275 INFO:teuthology.orchestra.run.smithi084.stdout: auth mon ticket ttl = 660 # 11m 2024-05-15T15:38:54.276 INFO:teuthology.orchestra.run.smithi084.stdout: auth service ticket ttl = 240 # 4m 2024-05-15T15:38:54.276 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-05-15T15:38:54.276 INFO:teuthology.orchestra.run.smithi084.stdout: # don't complain about insecure global_id in the test suite 2024-05-15T15:38:54.276 INFO:teuthology.orchestra.run.smithi084.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-15T15:38:54.276 INFO:teuthology.orchestra.run.smithi084.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-15T15:38:54.276 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-05-15T15:38:54.276 INFO:teuthology.orchestra.run.smithi084.stdout: # 1m isn't quite enough 2024-05-15T15:38:54.276 INFO:teuthology.orchestra.run.smithi084.stdout: mon_down_mkfs_grace = 2m 2024-05-15T15:38:54.276 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-05-15T15:38:54.276 INFO:teuthology.orchestra.run.smithi084.stdout: mon_warn_on_filestore_osds = false 2024-05-15T15:38:54.276 INFO:teuthology.orchestra.run.smithi084.stdout: mon down mkfs grace = 300 2024-05-15T15:38:54.276 INFO:teuthology.orchestra.run.smithi084.stdout: mon op complaint time = 120 2024-05-15T15:38:54.276 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-05-15T15:38:54.276 INFO:teuthology.orchestra.run.smithi084.stdout:[client] 2024-05-15T15:38:54.277 INFO:teuthology.orchestra.run.smithi084.stdout: rgw cache enabled = true 2024-05-15T15:38:54.277 INFO:teuthology.orchestra.run.smithi084.stdout: rgw enable ops log = true 2024-05-15T15:38:54.277 INFO:teuthology.orchestra.run.smithi084.stdout: rgw enable usage log = true 2024-05-15T15:38:54.277 INFO:teuthology.orchestra.run.smithi084.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-15T15:38:54.277 INFO:teuthology.orchestra.run.smithi084.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-15T15:38:54.277 INFO:teuthology.orchestra.run.smithi084.stdout: client mount timeout = 600 2024-05-15T15:38:54.277 INFO:teuthology.orchestra.run.smithi084.stdout: debug client = 20 2024-05-15T15:38:54.277 INFO:teuthology.orchestra.run.smithi084.stdout: debug ms = 1 2024-05-15T15:38:54.277 INFO:teuthology.orchestra.run.smithi084.stdout: rados mon op timeout = 900 2024-05-15T15:38:54.277 INFO:teuthology.orchestra.run.smithi084.stdout: rados osd op timeout = 900 2024-05-15T15:38:54.277 INFO:teuthology.orchestra.run.smithi084.stdout:[mon.a] 2024-05-15T15:38:54.277 INFO:teuthology.orchestra.run.smithi084.stdout:[mon.b] 2024-05-15T15:38:54.277 INFO:teuthology.orchestra.run.smithi084.stdout:[mon.c] 2024-05-15T15:38:54.277 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.a] 2024-05-15T15:38:54.277 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.c] 2024-05-15T15:38:54.278 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.b] 2024-05-15T15:38:54.278 INFO:teuthology.orchestra.run.smithi084.stdout:[mds] 2024-05-15T15:38:54.278 INFO:teuthology.orchestra.run.smithi084.stdout: debug mds = 20 2024-05-15T15:38:54.278 INFO:teuthology.orchestra.run.smithi084.stdout: debug mds balancer = 20 2024-05-15T15:38:54.278 INFO:teuthology.orchestra.run.smithi084.stdout: debug ms = 1 2024-05-15T15:38:54.278 INFO:teuthology.orchestra.run.smithi084.stdout: mds debug frag = True 2024-05-15T15:38:54.278 INFO:teuthology.orchestra.run.smithi084.stdout: mds debug scatterstat = True 2024-05-15T15:38:54.278 INFO:teuthology.orchestra.run.smithi084.stdout: mds op complaint time = 180 2024-05-15T15:38:54.278 INFO:teuthology.orchestra.run.smithi084.stdout: mds verify scatter = True 2024-05-15T15:38:54.278 INFO:teuthology.orchestra.run.smithi084.stdout: osd op complaint time = 180 2024-05-15T15:38:54.278 INFO:teuthology.orchestra.run.smithi084.stdout: rados mon op timeout = 900 2024-05-15T15:38:54.278 INFO:teuthology.orchestra.run.smithi084.stdout: rados osd op timeout = 900 2024-05-15T15:38:54.362 INFO:teuthology.orchestra.run.smithi104.stdout:[global] 2024-05-15T15:38:54.362 INFO:teuthology.orchestra.run.smithi104.stdout: chdir = "" 2024-05-15T15:38:54.362 INFO:teuthology.orchestra.run.smithi104.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-15T15:38:54.362 INFO:teuthology.orchestra.run.smithi104.stdout: auth supported = cephx 2024-05-15T15:38:54.362 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-15T15:38:54.362 INFO:teuthology.orchestra.run.smithi104.stdout: filestore xattr use omap = true 2024-05-15T15:38:54.362 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-15T15:38:54.362 INFO:teuthology.orchestra.run.smithi104.stdout: mon clock drift allowed = 1.000 2024-05-15T15:38:54.362 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-15T15:38:54.363 INFO:teuthology.orchestra.run.smithi104.stdout: osd crush chooseleaf type = 0 2024-05-15T15:38:54.363 INFO:teuthology.orchestra.run.smithi104.stdout: auth debug = true 2024-05-15T15:38:54.363 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-15T15:38:54.363 INFO:teuthology.orchestra.run.smithi104.stdout: ms die on old message = true 2024-05-15T15:38:54.363 INFO:teuthology.orchestra.run.smithi104.stdout: ms die on bug = true 2024-05-15T15:38:54.363 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-15T15:38:54.363 INFO:teuthology.orchestra.run.smithi104.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-15T15:38:54.363 INFO:teuthology.orchestra.run.smithi104.stdout: mon pg warn max object skew = 0 2024-05-15T15:38:54.363 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-15T15:38:54.363 INFO:teuthology.orchestra.run.smithi104.stdout: # disable pg_autoscaler by default for new pools 2024-05-15T15:38:54.363 INFO:teuthology.orchestra.run.smithi104.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-15T15:38:54.363 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-15T15:38:54.363 INFO:teuthology.orchestra.run.smithi104.stdout: osd pool default size = 2 2024-05-15T15:38:54.364 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-15T15:38:54.364 INFO:teuthology.orchestra.run.smithi104.stdout: mon osd allow primary affinity = true 2024-05-15T15:38:54.364 INFO:teuthology.orchestra.run.smithi104.stdout: mon osd allow pg remap = true 2024-05-15T15:38:54.364 INFO:teuthology.orchestra.run.smithi104.stdout: mon warn on legacy crush tunables = false 2024-05-15T15:38:54.364 INFO:teuthology.orchestra.run.smithi104.stdout: mon warn on crush straw calc version zero = false 2024-05-15T15:38:54.364 INFO:teuthology.orchestra.run.smithi104.stdout: mon warn on no sortbitwise = false 2024-05-15T15:38:54.364 INFO:teuthology.orchestra.run.smithi104.stdout: mon warn on osd down out interval zero = false 2024-05-15T15:38:54.364 INFO:teuthology.orchestra.run.smithi104.stdout: mon warn on too few osds = false 2024-05-15T15:38:54.364 INFO:teuthology.orchestra.run.smithi104.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-15T15:38:54.364 INFO:teuthology.orchestra.run.smithi104.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-15T15:38:54.364 INFO:teuthology.orchestra.run.smithi104.stdout: mon_allow_pool_size_one = true 2024-05-15T15:38:54.364 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-15T15:38:54.364 INFO:teuthology.orchestra.run.smithi104.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-15T15:38:54.365 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-15T15:38:54.365 INFO:teuthology.orchestra.run.smithi104.stdout: osd default data pool replay window = 5 2024-05-15T15:38:54.365 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-15T15:38:54.365 INFO:teuthology.orchestra.run.smithi104.stdout: mon allow pool delete = true 2024-05-15T15:38:54.365 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-15T15:38:54.365 INFO:teuthology.orchestra.run.smithi104.stdout: mon cluster log file level = debug 2024-05-15T15:38:54.365 INFO:teuthology.orchestra.run.smithi104.stdout: debug asserts on shutdown = true 2024-05-15T15:38:54.365 INFO:teuthology.orchestra.run.smithi104.stdout: mon health detail to clog = false 2024-05-15T15:38:54.365 INFO:teuthology.orchestra.run.smithi104.stdout: mon host = "172.21.15.12,172.21.15.84,[v2:172.21.15.84:3301,v1:172.21.15.84:6790]" 2024-05-15T15:38:54.365 INFO:teuthology.orchestra.run.smithi104.stdout: mon pg warn min per osd = 0 2024-05-15T15:38:54.365 INFO:teuthology.orchestra.run.smithi104.stdout: ms die on skipped message = False 2024-05-15T15:38:54.365 INFO:teuthology.orchestra.run.smithi104.stdout: fsid = 3b7fc4b2-b85c-49b5-a5de-38444eeed40d 2024-05-15T15:38:54.365 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-15T15:38:54.365 INFO:teuthology.orchestra.run.smithi104.stdout:[osd] 2024-05-15T15:38:54.366 INFO:teuthology.orchestra.run.smithi104.stdout: osd journal size = 100 2024-05-15T15:38:54.366 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-15T15:38:54.366 INFO:teuthology.orchestra.run.smithi104.stdout: osd scrub load threshold = 5.0 2024-05-15T15:38:54.366 INFO:teuthology.orchestra.run.smithi104.stdout: osd scrub max interval = 600 2024-05-15T15:38:54.366 INFO:teuthology.orchestra.run.smithi104.stdout: osd mclock profile = high_recovery_ops 2024-05-15T15:38:54.366 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-15T15:38:54.366 INFO:teuthology.orchestra.run.smithi104.stdout: osd recover clone overlap = true 2024-05-15T15:38:54.366 INFO:teuthology.orchestra.run.smithi104.stdout: osd recovery max chunk = 1048576 2024-05-15T15:38:54.366 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-15T15:38:54.366 INFO:teuthology.orchestra.run.smithi104.stdout: osd debug shutdown = true 2024-05-15T15:38:54.366 INFO:teuthology.orchestra.run.smithi104.stdout: osd debug op order = true 2024-05-15T15:38:54.366 INFO:teuthology.orchestra.run.smithi104.stdout: osd debug verify stray on activate = true 2024-05-15T15:38:54.366 INFO:teuthology.orchestra.run.smithi104.stdout: osd debug trim objects = true 2024-05-15T15:38:54.367 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-15T15:38:54.367 INFO:teuthology.orchestra.run.smithi104.stdout: osd open classes on start = true 2024-05-15T15:38:54.367 INFO:teuthology.orchestra.run.smithi104.stdout: osd debug pg log writeout = true 2024-05-15T15:38:54.367 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-15T15:38:54.367 INFO:teuthology.orchestra.run.smithi104.stdout: osd deep scrub update digest min age = 30 2024-05-15T15:38:54.367 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-15T15:38:54.367 INFO:teuthology.orchestra.run.smithi104.stdout: osd map max advance = 10 2024-05-15T15:38:54.367 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-15T15:38:54.367 INFO:teuthology.orchestra.run.smithi104.stdout: journal zero on create = true 2024-05-15T15:38:54.367 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-15T15:38:54.367 INFO:teuthology.orchestra.run.smithi104.stdout: filestore ondisk finisher threads = 3 2024-05-15T15:38:54.367 INFO:teuthology.orchestra.run.smithi104.stdout: filestore apply finisher threads = 3 2024-05-15T15:38:54.367 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-15T15:38:54.367 INFO:teuthology.orchestra.run.smithi104.stdout: bdev debug aio = true 2024-05-15T15:38:54.368 INFO:teuthology.orchestra.run.smithi104.stdout: osd debug misdirected ops = true 2024-05-15T15:38:54.368 INFO:teuthology.orchestra.run.smithi104.stdout: bdev async discard = True 2024-05-15T15:38:54.368 INFO:teuthology.orchestra.run.smithi104.stdout: bdev enable discard = True 2024-05-15T15:38:54.368 INFO:teuthology.orchestra.run.smithi104.stdout: bluestore allocator = bitmap 2024-05-15T15:38:54.368 INFO:teuthology.orchestra.run.smithi104.stdout: bluestore block size = 96636764160 2024-05-15T15:38:54.368 INFO:teuthology.orchestra.run.smithi104.stdout: bluestore fsck on mount = True 2024-05-15T15:38:54.368 INFO:teuthology.orchestra.run.smithi104.stdout: debug bluefs = 1/20 2024-05-15T15:38:54.368 INFO:teuthology.orchestra.run.smithi104.stdout: debug bluestore = 20 2024-05-15T15:38:54.368 INFO:teuthology.orchestra.run.smithi104.stdout: debug ms = 1 2024-05-15T15:38:54.368 INFO:teuthology.orchestra.run.smithi104.stdout: debug osd = 20 2024-05-15T15:38:54.368 INFO:teuthology.orchestra.run.smithi104.stdout: debug rocksdb = 4/10 2024-05-15T15:38:54.368 INFO:teuthology.orchestra.run.smithi104.stdout: mon osd backfillfull_ratio = 0.85 2024-05-15T15:38:54.368 INFO:teuthology.orchestra.run.smithi104.stdout: mon osd full ratio = 0.9 2024-05-15T15:38:54.368 INFO:teuthology.orchestra.run.smithi104.stdout: mon osd nearfull ratio = 0.8 2024-05-15T15:38:54.369 INFO:teuthology.orchestra.run.smithi104.stdout: osd failsafe full ratio = 0.95 2024-05-15T15:38:54.369 INFO:teuthology.orchestra.run.smithi104.stdout: osd objectstore = bluestore 2024-05-15T15:38:54.369 INFO:teuthology.orchestra.run.smithi104.stdout: osd op complaint time = 180 2024-05-15T15:38:54.369 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-15T15:38:54.369 INFO:teuthology.orchestra.run.smithi104.stdout:[mgr] 2024-05-15T15:38:54.369 INFO:teuthology.orchestra.run.smithi104.stdout: debug ms = 1 2024-05-15T15:38:54.369 INFO:teuthology.orchestra.run.smithi104.stdout: debug mgr = 20 2024-05-15T15:38:54.369 INFO:teuthology.orchestra.run.smithi104.stdout: debug mon = 20 2024-05-15T15:38:54.369 INFO:teuthology.orchestra.run.smithi104.stdout: debug auth = 20 2024-05-15T15:38:54.369 INFO:teuthology.orchestra.run.smithi104.stdout: mon reweight min pgs per osd = 4 2024-05-15T15:38:54.369 INFO:teuthology.orchestra.run.smithi104.stdout: mon reweight min bytes per osd = 10 2024-05-15T15:38:54.369 INFO:teuthology.orchestra.run.smithi104.stdout: mgr/telemetry/nag = false 2024-05-15T15:38:54.369 INFO:teuthology.orchestra.run.smithi104.stdout: debug client = 20 2024-05-15T15:38:54.369 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-15T15:38:54.370 INFO:teuthology.orchestra.run.smithi104.stdout:[mon] 2024-05-15T15:38:54.370 INFO:teuthology.orchestra.run.smithi104.stdout: debug ms = 1 2024-05-15T15:38:54.370 INFO:teuthology.orchestra.run.smithi104.stdout: debug mon = 20 2024-05-15T15:38:54.370 INFO:teuthology.orchestra.run.smithi104.stdout: debug paxos = 20 2024-05-15T15:38:54.370 INFO:teuthology.orchestra.run.smithi104.stdout: debug auth = 20 2024-05-15T15:38:54.370 INFO:teuthology.orchestra.run.smithi104.stdout: mon data avail warn = 5 2024-05-15T15:38:54.370 INFO:teuthology.orchestra.run.smithi104.stdout: mon mgr mkfs grace = 240 2024-05-15T15:38:54.370 INFO:teuthology.orchestra.run.smithi104.stdout: mon reweight min pgs per osd = 4 2024-05-15T15:38:54.370 INFO:teuthology.orchestra.run.smithi104.stdout: mon osd reporter subtree level = osd 2024-05-15T15:38:54.370 INFO:teuthology.orchestra.run.smithi104.stdout: mon osd prime pg temp = true 2024-05-15T15:38:54.370 INFO:teuthology.orchestra.run.smithi104.stdout: mon reweight min bytes per osd = 10 2024-05-15T15:38:54.371 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-15T15:38:54.371 INFO:teuthology.orchestra.run.smithi104.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-15T15:38:54.371 INFO:teuthology.orchestra.run.smithi104.stdout: auth mon ticket ttl = 660 # 11m 2024-05-15T15:38:54.371 INFO:teuthology.orchestra.run.smithi104.stdout: auth service ticket ttl = 240 # 4m 2024-05-15T15:38:54.371 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-15T15:38:54.371 INFO:teuthology.orchestra.run.smithi104.stdout: # don't complain about insecure global_id in the test suite 2024-05-15T15:38:54.371 INFO:teuthology.orchestra.run.smithi104.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-15T15:38:54.371 INFO:teuthology.orchestra.run.smithi104.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-15T15:38:54.371 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-15T15:38:54.371 INFO:teuthology.orchestra.run.smithi104.stdout: # 1m isn't quite enough 2024-05-15T15:38:54.371 INFO:teuthology.orchestra.run.smithi104.stdout: mon_down_mkfs_grace = 2m 2024-05-15T15:38:54.371 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-15T15:38:54.371 INFO:teuthology.orchestra.run.smithi104.stdout: mon_warn_on_filestore_osds = false 2024-05-15T15:38:54.372 INFO:teuthology.orchestra.run.smithi104.stdout: mon down mkfs grace = 300 2024-05-15T15:38:54.372 INFO:teuthology.orchestra.run.smithi104.stdout: mon op complaint time = 120 2024-05-15T15:38:54.372 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-15T15:38:54.372 INFO:teuthology.orchestra.run.smithi104.stdout:[client] 2024-05-15T15:38:54.372 INFO:teuthology.orchestra.run.smithi104.stdout: rgw cache enabled = true 2024-05-15T15:38:54.372 INFO:teuthology.orchestra.run.smithi104.stdout: rgw enable ops log = true 2024-05-15T15:38:54.372 INFO:teuthology.orchestra.run.smithi104.stdout: rgw enable usage log = true 2024-05-15T15:38:54.372 INFO:teuthology.orchestra.run.smithi104.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-15T15:38:54.372 INFO:teuthology.orchestra.run.smithi104.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-15T15:38:54.372 INFO:teuthology.orchestra.run.smithi104.stdout: client mount timeout = 600 2024-05-15T15:38:54.372 INFO:teuthology.orchestra.run.smithi104.stdout: debug client = 20 2024-05-15T15:38:54.372 INFO:teuthology.orchestra.run.smithi104.stdout: debug ms = 1 2024-05-15T15:38:54.372 INFO:teuthology.orchestra.run.smithi104.stdout: rados mon op timeout = 900 2024-05-15T15:38:54.373 INFO:teuthology.orchestra.run.smithi104.stdout: rados osd op timeout = 900 2024-05-15T15:38:54.373 INFO:teuthology.orchestra.run.smithi104.stdout:[mon.a] 2024-05-15T15:38:54.373 INFO:teuthology.orchestra.run.smithi104.stdout:[mon.b] 2024-05-15T15:38:54.373 INFO:teuthology.orchestra.run.smithi104.stdout:[mon.c] 2024-05-15T15:38:54.373 INFO:teuthology.orchestra.run.smithi104.stdout:[mds.a] 2024-05-15T15:38:54.373 INFO:teuthology.orchestra.run.smithi104.stdout:[mds.c] 2024-05-15T15:38:54.373 INFO:teuthology.orchestra.run.smithi104.stdout:[mds.b] 2024-05-15T15:38:54.373 INFO:teuthology.orchestra.run.smithi104.stdout:[mds] 2024-05-15T15:38:54.373 INFO:teuthology.orchestra.run.smithi104.stdout: debug mds = 20 2024-05-15T15:38:54.373 INFO:teuthology.orchestra.run.smithi104.stdout: debug mds balancer = 20 2024-05-15T15:38:54.373 INFO:teuthology.orchestra.run.smithi104.stdout: debug ms = 1 2024-05-15T15:38:54.373 INFO:teuthology.orchestra.run.smithi104.stdout: mds debug frag = True 2024-05-15T15:38:54.373 INFO:teuthology.orchestra.run.smithi104.stdout: mds debug scatterstat = True 2024-05-15T15:38:54.373 INFO:teuthology.orchestra.run.smithi104.stdout: mds op complaint time = 180 2024-05-15T15:38:54.374 INFO:teuthology.orchestra.run.smithi104.stdout: mds verify scatter = True 2024-05-15T15:38:54.374 INFO:teuthology.orchestra.run.smithi104.stdout: osd op complaint time = 180 2024-05-15T15:38:54.374 INFO:teuthology.orchestra.run.smithi104.stdout: rados mon op timeout = 900 2024-05-15T15:38:54.374 INFO:teuthology.orchestra.run.smithi104.stdout: rados osd op timeout = 900 2024-05-15T15:38:54.396 INFO:tasks.ceph:Creating admin key on mon.a... 2024-05-15T15:38:54.397 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-05-15T15:38:54.461 INFO:tasks.ceph:Copying monmap to all nodes... 2024-05-15T15:38:54.461 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-05-15T15:38:54.461 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-05-15T15:38:54.477 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-05-15T15:38:54.477 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-05-15T15:38:54.532 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi012.front.sepia.ceph.com 2024-05-15T15:38:54.533 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-05-15T15:38:54.533 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-15T15:38:54.533 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-15T15:38:54.606 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-05-15T15:38:54.606 DEBUG:teuthology.orchestra.run.smithi012:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-15T15:38:54.662 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi084.front.sepia.ceph.com 2024-05-15T15:38:54.662 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-05-15T15:38:54.662 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-15T15:38:54.663 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-15T15:38:54.696 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-05-15T15:38:54.697 DEBUG:teuthology.orchestra.run.smithi084:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-15T15:38:54.751 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi104.front.sepia.ceph.com 2024-05-15T15:38:54.751 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-05-15T15:38:54.752 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-15T15:38:54.752 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-15T15:38:54.872 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-05-15T15:38:54.872 DEBUG:teuthology.orchestra.run.smithi104:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-15T15:38:54.969 INFO:tasks.ceph:Setting up mon nodes... 2024-05-15T15:38:54.969 INFO:tasks.ceph:Setting up mgr nodes... 2024-05-15T15:38:54.969 DEBUG:teuthology.orchestra.run.smithi012:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-05-15T15:38:55.031 INFO:teuthology.orchestra.run.smithi012.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-05-15T15:38:55.034 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-05-15T15:38:55.100 INFO:teuthology.orchestra.run.smithi084.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-05-15T15:38:55.103 INFO:tasks.ceph:Setting up mds nodes... 2024-05-15T15:38:55.103 DEBUG:teuthology.orchestra.run.smithi012:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-05-15T15:38:55.163 INFO:teuthology.orchestra.run.smithi012.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-05-15T15:38:55.166 DEBUG:teuthology.orchestra.run.smithi012:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-05-15T15:38:55.190 DEBUG:teuthology.orchestra.run.smithi012:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-05-15T15:38:55.289 INFO:teuthology.orchestra.run.smithi012.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-05-15T15:38:55.292 DEBUG:teuthology.orchestra.run.smithi012:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-05-15T15:38:55.317 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-05-15T15:38:55.375 INFO:teuthology.orchestra.run.smithi084.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-05-15T15:38:55.378 DEBUG:teuthology.orchestra.run.smithi084:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-05-15T15:38:55.402 INFO:tasks.ceph_client:Setting up client nodes... 2024-05-15T15:38:55.402 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-05-15T15:38:55.615 INFO:teuthology.orchestra.run.smithi104.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-05-15T15:38:55.661 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-05-15T15:38:55.662 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi012.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi084.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-05-15T15:38:55.662 DEBUG:teuthology.orchestra.run.smithi012:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-05-15T15:38:55.688 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-15T15:38:55.688 INFO:tasks.ceph:role: osd.0 2024-05-15T15:38:55.688 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi012.front.sepia.ceph.com 2024-05-15T15:38:55.688 DEBUG:teuthology.orchestra.run.smithi012:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-15T15:38:55.760 INFO:teuthology.orchestra.run.smithi012.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-15T15:38:55.760 INFO:teuthology.orchestra.run.smithi012.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-15T15:38:55.760 INFO:teuthology.orchestra.run.smithi012.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-15T15:38:55.760 INFO:teuthology.orchestra.run.smithi012.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-15T15:38:55.760 INFO:teuthology.orchestra.run.smithi012.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-15T15:38:55.760 INFO:teuthology.orchestra.run.smithi012.stdout: = sunit=0 swidth=0 blks 2024-05-15T15:38:55.761 INFO:teuthology.orchestra.run.smithi012.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-15T15:38:55.761 INFO:teuthology.orchestra.run.smithi012.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-15T15:38:55.761 INFO:teuthology.orchestra.run.smithi012.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-15T15:38:55.761 INFO:teuthology.orchestra.run.smithi012.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-15T15:38:56.260 INFO:teuthology.orchestra.run.smithi012.stdout:Discarding blocks...Done. 2024-05-15T15:38:56.263 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi012.front.sepia.ceph.com -o noatime 2024-05-15T15:38:56.263 DEBUG:teuthology.orchestra.run.smithi012:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-05-15T15:38:56.375 DEBUG:teuthology.orchestra.run.smithi012:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-05-15T15:38:56.412 DEBUG:teuthology.orchestra.run.smithi012:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-05-15T15:38:56.479 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-15T15:38:56.479 INFO:tasks.ceph:role: osd.1 2024-05-15T15:38:56.479 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi012.front.sepia.ceph.com 2024-05-15T15:38:56.479 DEBUG:teuthology.orchestra.run.smithi012:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-05-15T15:38:56.554 INFO:teuthology.orchestra.run.smithi012.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-05-15T15:38:56.554 INFO:teuthology.orchestra.run.smithi012.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-15T15:38:56.554 INFO:teuthology.orchestra.run.smithi012.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-15T15:38:56.554 INFO:teuthology.orchestra.run.smithi012.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-15T15:38:56.554 INFO:teuthology.orchestra.run.smithi012.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-15T15:38:56.554 INFO:teuthology.orchestra.run.smithi012.stdout: = sunit=0 swidth=0 blks 2024-05-15T15:38:56.554 INFO:teuthology.orchestra.run.smithi012.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-15T15:38:56.554 INFO:teuthology.orchestra.run.smithi012.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-15T15:38:56.555 INFO:teuthology.orchestra.run.smithi012.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-15T15:38:56.555 INFO:teuthology.orchestra.run.smithi012.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-15T15:38:57.015 INFO:teuthology.orchestra.run.smithi012.stdout:Discarding blocks...Done. 2024-05-15T15:38:57.017 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi012.front.sepia.ceph.com -o noatime 2024-05-15T15:38:57.017 DEBUG:teuthology.orchestra.run.smithi012:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-05-15T15:38:57.111 DEBUG:teuthology.orchestra.run.smithi012:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-05-15T15:38:57.143 DEBUG:teuthology.orchestra.run.smithi012:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-05-15T15:38:57.210 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-15T15:38:57.210 INFO:tasks.ceph:role: osd.2 2024-05-15T15:38:57.210 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi012.front.sepia.ceph.com 2024-05-15T15:38:57.211 DEBUG:teuthology.orchestra.run.smithi012:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-05-15T15:38:57.284 INFO:teuthology.orchestra.run.smithi012.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-05-15T15:38:57.285 INFO:teuthology.orchestra.run.smithi012.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-15T15:38:57.285 INFO:teuthology.orchestra.run.smithi012.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-15T15:38:57.285 INFO:teuthology.orchestra.run.smithi012.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-15T15:38:57.285 INFO:teuthology.orchestra.run.smithi012.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-15T15:38:57.285 INFO:teuthology.orchestra.run.smithi012.stdout: = sunit=0 swidth=0 blks 2024-05-15T15:38:57.285 INFO:teuthology.orchestra.run.smithi012.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-15T15:38:57.285 INFO:teuthology.orchestra.run.smithi012.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-15T15:38:57.285 INFO:teuthology.orchestra.run.smithi012.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-15T15:38:57.285 INFO:teuthology.orchestra.run.smithi012.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-15T15:38:57.779 INFO:teuthology.orchestra.run.smithi012.stdout:Discarding blocks...Done. 2024-05-15T15:38:57.781 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi012.front.sepia.ceph.com -o noatime 2024-05-15T15:38:57.781 DEBUG:teuthology.orchestra.run.smithi012:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-05-15T15:38:57.906 DEBUG:teuthology.orchestra.run.smithi012:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-05-15T15:38:57.938 DEBUG:teuthology.orchestra.run.smithi012:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-05-15T15:38:58.006 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-15T15:38:58.006 INFO:tasks.ceph:role: osd.3 2024-05-15T15:38:58.006 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi012.front.sepia.ceph.com 2024-05-15T15:38:58.006 DEBUG:teuthology.orchestra.run.smithi012:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-05-15T15:38:58.079 INFO:teuthology.orchestra.run.smithi012.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-05-15T15:38:58.079 INFO:teuthology.orchestra.run.smithi012.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-15T15:38:58.080 INFO:teuthology.orchestra.run.smithi012.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-15T15:38:58.080 INFO:teuthology.orchestra.run.smithi012.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-15T15:38:58.080 INFO:teuthology.orchestra.run.smithi012.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-15T15:38:58.080 INFO:teuthology.orchestra.run.smithi012.stdout: = sunit=0 swidth=0 blks 2024-05-15T15:38:58.080 INFO:teuthology.orchestra.run.smithi012.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-15T15:38:58.080 INFO:teuthology.orchestra.run.smithi012.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-15T15:38:58.080 INFO:teuthology.orchestra.run.smithi012.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-15T15:38:58.080 INFO:teuthology.orchestra.run.smithi012.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-15T15:38:58.602 INFO:teuthology.orchestra.run.smithi012.stdout:Discarding blocks...Done. 2024-05-15T15:38:58.604 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi012.front.sepia.ceph.com -o noatime 2024-05-15T15:38:58.605 DEBUG:teuthology.orchestra.run.smithi012:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-05-15T15:38:58.732 DEBUG:teuthology.orchestra.run.smithi012:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-05-15T15:38:58.764 DEBUG:teuthology.orchestra.run.smithi012:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-15T15:38:58.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:38:58.880+0000 7f67cfc1b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-05-15T15:38:58.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:38:58.880+0000 7f67cfc1b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-05-15T15:38:58.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:38:58.880+0000 7f67cfc1b640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-15T15:38:58.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:38:58.881+0000 7f67cfc1b640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-15T15:38:58.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:38:58.881+0000 7f67cfc1b640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-15T15:38:58.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:38:58.881+0000 7f67cfc1b640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-05-15T15:39:01.733 DEBUG:teuthology.orchestra.run.smithi012:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-05-15T15:39:01.763 DEBUG:teuthology.orchestra.run.smithi012:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-15T15:39:01.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:01.863+0000 7fc17bbd6640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-05-15T15:39:01.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:01.863+0000 7fc17bbd6640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-05-15T15:39:01.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:01.863+0000 7fc17bbd6640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-15T15:39:01.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:01.863+0000 7fc17bbd6640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-15T15:39:01.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:01.863+0000 7fc17bbd6640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-15T15:39:01.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:01.864+0000 7fc17bbd6640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-05-15T15:39:04.720 DEBUG:teuthology.orchestra.run.smithi012:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-05-15T15:39:04.745 DEBUG:teuthology.orchestra.run.smithi012:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-15T15:39:04.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:04.841+0000 7f00ed419640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-05-15T15:39:04.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:04.842+0000 7f00ed419640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-05-15T15:39:04.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:04.842+0000 7f00ed419640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-15T15:39:04.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:04.842+0000 7f00ed419640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-15T15:39:04.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:04.842+0000 7f00ed419640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-15T15:39:04.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:04.842+0000 7f00ed419640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-05-15T15:39:07.692 DEBUG:teuthology.orchestra.run.smithi012:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-05-15T15:39:07.720 DEBUG:teuthology.orchestra.run.smithi012:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-15T15:39:07.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:07.819+0000 7fbe31dcb640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-05-15T15:39:07.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:07.820+0000 7fbe31dcb640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-05-15T15:39:07.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:07.820+0000 7fbe31dcb640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-15T15:39:07.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:07.820+0000 7fbe31dcb640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-15T15:39:07.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:07.820+0000 7fbe31dcb640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-15T15:39:07.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:07.820+0000 7fbe31dcb640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-05-15T15:39:10.680 DEBUG:teuthology.orchestra.run.smithi012:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-05-15T15:39:10.709 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-05-15T15:39:10.739 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-15T15:39:10.739 INFO:tasks.ceph:role: osd.4 2024-05-15T15:39:10.739 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi084.front.sepia.ceph.com 2024-05-15T15:39:10.740 DEBUG:teuthology.orchestra.run.smithi084:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-15T15:39:10.813 INFO:teuthology.orchestra.run.smithi084.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-15T15:39:10.813 INFO:teuthology.orchestra.run.smithi084.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-15T15:39:10.813 INFO:teuthology.orchestra.run.smithi084.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-15T15:39:10.813 INFO:teuthology.orchestra.run.smithi084.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-15T15:39:10.813 INFO:teuthology.orchestra.run.smithi084.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-15T15:39:10.813 INFO:teuthology.orchestra.run.smithi084.stdout: = sunit=0 swidth=0 blks 2024-05-15T15:39:10.813 INFO:teuthology.orchestra.run.smithi084.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-15T15:39:10.814 INFO:teuthology.orchestra.run.smithi084.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-15T15:39:10.814 INFO:teuthology.orchestra.run.smithi084.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-15T15:39:10.814 INFO:teuthology.orchestra.run.smithi084.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-15T15:39:11.301 INFO:teuthology.orchestra.run.smithi084.stdout:Discarding blocks...Done. 2024-05-15T15:39:11.304 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi084.front.sepia.ceph.com -o noatime 2024-05-15T15:39:11.304 DEBUG:teuthology.orchestra.run.smithi084:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-05-15T15:39:11.406 DEBUG:teuthology.orchestra.run.smithi084:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-05-15T15:39:11.439 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-05-15T15:39:11.504 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-15T15:39:11.504 INFO:tasks.ceph:role: osd.5 2024-05-15T15:39:11.505 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi084.front.sepia.ceph.com 2024-05-15T15:39:11.505 DEBUG:teuthology.orchestra.run.smithi084:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-05-15T15:39:11.576 INFO:teuthology.orchestra.run.smithi084.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-05-15T15:39:11.576 INFO:teuthology.orchestra.run.smithi084.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-15T15:39:11.576 INFO:teuthology.orchestra.run.smithi084.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-15T15:39:11.576 INFO:teuthology.orchestra.run.smithi084.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-15T15:39:11.577 INFO:teuthology.orchestra.run.smithi084.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-15T15:39:11.577 INFO:teuthology.orchestra.run.smithi084.stdout: = sunit=0 swidth=0 blks 2024-05-15T15:39:11.577 INFO:teuthology.orchestra.run.smithi084.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-15T15:39:11.577 INFO:teuthology.orchestra.run.smithi084.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-15T15:39:11.577 INFO:teuthology.orchestra.run.smithi084.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-15T15:39:11.577 INFO:teuthology.orchestra.run.smithi084.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-15T15:39:12.026 INFO:teuthology.orchestra.run.smithi084.stdout:Discarding blocks...Done. 2024-05-15T15:39:12.028 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi084.front.sepia.ceph.com -o noatime 2024-05-15T15:39:12.029 DEBUG:teuthology.orchestra.run.smithi084:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-05-15T15:39:12.106 DEBUG:teuthology.orchestra.run.smithi084:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-05-15T15:39:12.176 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-05-15T15:39:12.243 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-15T15:39:12.243 INFO:tasks.ceph:role: osd.6 2024-05-15T15:39:12.244 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi084.front.sepia.ceph.com 2024-05-15T15:39:12.244 DEBUG:teuthology.orchestra.run.smithi084:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-05-15T15:39:12.315 INFO:teuthology.orchestra.run.smithi084.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-05-15T15:39:12.316 INFO:teuthology.orchestra.run.smithi084.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-15T15:39:12.316 INFO:teuthology.orchestra.run.smithi084.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-15T15:39:12.316 INFO:teuthology.orchestra.run.smithi084.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-15T15:39:12.316 INFO:teuthology.orchestra.run.smithi084.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-15T15:39:12.316 INFO:teuthology.orchestra.run.smithi084.stdout: = sunit=0 swidth=0 blks 2024-05-15T15:39:12.316 INFO:teuthology.orchestra.run.smithi084.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-15T15:39:12.316 INFO:teuthology.orchestra.run.smithi084.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-15T15:39:12.316 INFO:teuthology.orchestra.run.smithi084.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-15T15:39:12.316 INFO:teuthology.orchestra.run.smithi084.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-15T15:39:12.800 INFO:teuthology.orchestra.run.smithi084.stdout:Discarding blocks...Done. 2024-05-15T15:39:12.802 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi084.front.sepia.ceph.com -o noatime 2024-05-15T15:39:12.803 DEBUG:teuthology.orchestra.run.smithi084:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-05-15T15:39:12.896 DEBUG:teuthology.orchestra.run.smithi084:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-05-15T15:39:12.927 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-05-15T15:39:12.994 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-15T15:39:12.994 INFO:tasks.ceph:role: osd.7 2024-05-15T15:39:12.995 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi084.front.sepia.ceph.com 2024-05-15T15:39:12.995 DEBUG:teuthology.orchestra.run.smithi084:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-05-15T15:39:13.067 INFO:teuthology.orchestra.run.smithi084.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-05-15T15:39:13.067 INFO:teuthology.orchestra.run.smithi084.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-15T15:39:13.067 INFO:teuthology.orchestra.run.smithi084.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-15T15:39:13.067 INFO:teuthology.orchestra.run.smithi084.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-15T15:39:13.067 INFO:teuthology.orchestra.run.smithi084.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-15T15:39:13.067 INFO:teuthology.orchestra.run.smithi084.stdout: = sunit=0 swidth=0 blks 2024-05-15T15:39:13.067 INFO:teuthology.orchestra.run.smithi084.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-15T15:39:13.067 INFO:teuthology.orchestra.run.smithi084.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-15T15:39:13.067 INFO:teuthology.orchestra.run.smithi084.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-15T15:39:13.067 INFO:teuthology.orchestra.run.smithi084.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-15T15:39:13.553 INFO:teuthology.orchestra.run.smithi084.stdout:Discarding blocks...Done. 2024-05-15T15:39:13.556 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi084.front.sepia.ceph.com -o noatime 2024-05-15T15:39:13.556 DEBUG:teuthology.orchestra.run.smithi084:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-05-15T15:39:13.707 DEBUG:teuthology.orchestra.run.smithi084:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-05-15T15:39:13.742 DEBUG:teuthology.orchestra.run.smithi084:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-15T15:39:13.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:13.857+0000 7f04c9e20640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-05-15T15:39:13.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:13.859+0000 7f04c9e20640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-05-15T15:39:13.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:13.859+0000 7f04c9e20640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-15T15:39:13.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:13.859+0000 7f04c9e20640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-15T15:39:13.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:13.859+0000 7f04c9e20640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-15T15:39:13.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:13.867+0000 7f04c9e20640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-05-15T15:39:16.735 DEBUG:teuthology.orchestra.run.smithi084:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-05-15T15:39:16.763 DEBUG:teuthology.orchestra.run.smithi084:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-15T15:39:16.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:16.859+0000 7f9bc980f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-05-15T15:39:16.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:16.860+0000 7f9bc980f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-05-15T15:39:16.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:16.860+0000 7f9bc980f640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-15T15:39:16.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:16.860+0000 7f9bc980f640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-15T15:39:16.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:16.860+0000 7f9bc980f640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-15T15:39:16.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:16.860+0000 7f9bc980f640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-05-15T15:39:19.708 DEBUG:teuthology.orchestra.run.smithi084:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-05-15T15:39:19.736 DEBUG:teuthology.orchestra.run.smithi084:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-15T15:39:19.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:19.835+0000 7f8008663640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-05-15T15:39:19.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:19.835+0000 7f8008663640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-05-15T15:39:19.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:19.835+0000 7f8008663640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-15T15:39:19.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:19.835+0000 7f8008663640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-15T15:39:19.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:19.835+0000 7f8008663640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-15T15:39:19.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:19.836+0000 7f8008663640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-05-15T15:39:22.154 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:39:22.157 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:39:22.160 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:39:22.687 DEBUG:teuthology.orchestra.run.smithi084:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-05-15T15:39:22.714 DEBUG:teuthology.orchestra.run.smithi084:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-15T15:39:22.815 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:22.812+0000 7ffaf0814640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-05-15T15:39:22.816 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:22.813+0000 7ffaf0814640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-05-15T15:39:22.816 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:22.813+0000 7ffaf0814640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-15T15:39:22.816 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:22.813+0000 7ffaf0814640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-15T15:39:22.816 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:22.813+0000 7ffaf0814640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-15T15:39:22.816 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:22.813+0000 7ffaf0814640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-05-15T15:39:25.672 DEBUG:teuthology.orchestra.run.smithi084:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-05-15T15:39:25.705 INFO:tasks.ceph:Reading keys from all nodes... 2024-05-15T15:39:25.705 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-05-15T15:39:25.705 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-05-15T15:39:25.739 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-05-15T15:39:25.739 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-05-15T15:39:25.808 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-05-15T15:39:25.808 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-05-15T15:39:25.879 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-05-15T15:39:25.879 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-05-15T15:39:25.948 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-05-15T15:39:25.948 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-05-15T15:39:26.015 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-05-15T15:39:26.015 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-05-15T15:39:26.082 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-05-15T15:39:26.082 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-05-15T15:39:26.150 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-05-15T15:39:26.151 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-05-15T15:39:26.179 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-05-15T15:39:26.179 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-05-15T15:39:26.247 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-05-15T15:39:26.247 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-05-15T15:39:26.314 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-05-15T15:39:26.315 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-05-15T15:39:26.382 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-05-15T15:39:26.382 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-05-15T15:39:26.448 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-05-15T15:39:26.448 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-05-15T15:39:26.514 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-05-15T15:39:26.514 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-05-15T15:39:26.572 INFO:tasks.ceph:Adding keys to all mons... 2024-05-15T15:39:26.572 DEBUG:teuthology.orchestra.run.smithi012:> sudo tee -a /etc/ceph/ceph.keyring 2024-05-15T15:39:26.575 DEBUG:teuthology.orchestra.run.smithi084:> sudo tee -a /etc/ceph/ceph.keyring 2024-05-15T15:39:26.599 INFO:teuthology.orchestra.run.smithi084.stdout:[mgr.y] 2024-05-15T15:39:26.599 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQAP10RmRRvYARAA5dteLyaQOKK4MGV47G2K4A== 2024-05-15T15:39:26.599 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.a] 2024-05-15T15:39:26.600 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQAP10RmmQ2uCRAAFB9bs/ym4nRSFKX584a6mQ== 2024-05-15T15:39:26.600 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.c] 2024-05-15T15:39:26.600 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQAP10RmuB07ERAACvsGo526hg1gaXZQtBgs+g== 2024-05-15T15:39:26.600 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.0] 2024-05-15T15:39:26.600 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQAS10RmxP6MNBAAFAUbMsN4KpAu7dQEGQ9o7Q== 2024-05-15T15:39:26.600 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.1] 2024-05-15T15:39:26.600 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQAV10RmWySDMxAATzW1HykcApFzQgrMKKU1Bw== 2024-05-15T15:39:26.600 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.2] 2024-05-15T15:39:26.600 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQAY10RmK9w8MhAAtv6kgdHrx0T0qPIGZ9P8/Q== 2024-05-15T15:39:26.601 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.3] 2024-05-15T15:39:26.601 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQAb10RmKnXtMBAAP4HVGQshldH+e5d9bgJIZA== 2024-05-15T15:39:26.601 INFO:teuthology.orchestra.run.smithi084.stdout:[mgr.x] 2024-05-15T15:39:26.601 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQAP10RmMFHvBRAAT8pfcXRRCuyK73tJkbHtHQ== 2024-05-15T15:39:26.601 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.b] 2024-05-15T15:39:26.601 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQAP10RmDQ5ZFhAA78W/atUW8ScGMPhq8VKE6w== 2024-05-15T15:39:26.601 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.4] 2024-05-15T15:39:26.601 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQAh10RmeCUoMxAAGFSV0KY4ncBkIU4msHmNiQ== 2024-05-15T15:39:26.601 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.5] 2024-05-15T15:39:26.601 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQAk10RmraNVMxAAHLlxhGUYQGlFsVGOvKtXsQ== 2024-05-15T15:39:26.601 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.6] 2024-05-15T15:39:26.601 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQAn10Rm/ObgMRAAkTAoPV6wKKNDgqsp0H4WBA== 2024-05-15T15:39:26.601 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.7] 2024-05-15T15:39:26.601 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQAq10Rm50mLMBAAcltsG3nIohFBu6fmG79LYQ== 2024-05-15T15:39:26.601 INFO:teuthology.orchestra.run.smithi084.stdout:[client.0] 2024-05-15T15:39:26.602 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQAP10RmgcqhJBAAq/xIvSfZmvkmH8pu4FHIBw== 2024-05-15T15:39:26.603 INFO:teuthology.orchestra.run.smithi012.stdout:[mgr.y] 2024-05-15T15:39:26.603 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQAP10RmRRvYARAA5dteLyaQOKK4MGV47G2K4A== 2024-05-15T15:39:26.603 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.a] 2024-05-15T15:39:26.603 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQAP10RmmQ2uCRAAFB9bs/ym4nRSFKX584a6mQ== 2024-05-15T15:39:26.603 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.c] 2024-05-15T15:39:26.603 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQAP10RmuB07ERAACvsGo526hg1gaXZQtBgs+g== 2024-05-15T15:39:26.603 INFO:teuthology.orchestra.run.smithi012.stdout:[osd.0] 2024-05-15T15:39:26.603 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQAS10RmxP6MNBAAFAUbMsN4KpAu7dQEGQ9o7Q== 2024-05-15T15:39:26.604 INFO:teuthology.orchestra.run.smithi012.stdout:[osd.1] 2024-05-15T15:39:26.604 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQAV10RmWySDMxAATzW1HykcApFzQgrMKKU1Bw== 2024-05-15T15:39:26.604 INFO:teuthology.orchestra.run.smithi012.stdout:[osd.2] 2024-05-15T15:39:26.604 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQAY10RmK9w8MhAAtv6kgdHrx0T0qPIGZ9P8/Q== 2024-05-15T15:39:26.604 INFO:teuthology.orchestra.run.smithi012.stdout:[osd.3] 2024-05-15T15:39:26.604 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQAb10RmKnXtMBAAP4HVGQshldH+e5d9bgJIZA== 2024-05-15T15:39:26.604 INFO:teuthology.orchestra.run.smithi012.stdout:[mgr.x] 2024-05-15T15:39:26.604 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQAP10RmMFHvBRAAT8pfcXRRCuyK73tJkbHtHQ== 2024-05-15T15:39:26.604 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.b] 2024-05-15T15:39:26.604 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQAP10RmDQ5ZFhAA78W/atUW8ScGMPhq8VKE6w== 2024-05-15T15:39:26.604 INFO:teuthology.orchestra.run.smithi012.stdout:[osd.4] 2024-05-15T15:39:26.604 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQAh10RmeCUoMxAAGFSV0KY4ncBkIU4msHmNiQ== 2024-05-15T15:39:26.605 INFO:teuthology.orchestra.run.smithi012.stdout:[osd.5] 2024-05-15T15:39:26.605 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQAk10RmraNVMxAAHLlxhGUYQGlFsVGOvKtXsQ== 2024-05-15T15:39:26.605 INFO:teuthology.orchestra.run.smithi012.stdout:[osd.6] 2024-05-15T15:39:26.605 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQAn10Rm/ObgMRAAkTAoPV6wKKNDgqsp0H4WBA== 2024-05-15T15:39:26.605 INFO:teuthology.orchestra.run.smithi012.stdout:[osd.7] 2024-05-15T15:39:26.605 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQAq10Rm50mLMBAAcltsG3nIohFBu6fmG79LYQ== 2024-05-15T15:39:26.606 INFO:teuthology.orchestra.run.smithi012.stdout:[client.0] 2024-05-15T15:39:26.606 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQAP10RmgcqhJBAAq/xIvSfZmvkmH8pu4FHIBw== 2024-05-15T15:39:26.606 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-15T15:39:26.646 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-15T15:39:26.714 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-15T15:39:26.716 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-15T15:39:26.780 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-15T15:39:26.783 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-15T15:39:26.845 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-15T15:39:26.847 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-15T15:39:26.906 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-15T15:39:26.909 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-15T15:39:26.967 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-15T15:39:26.970 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-15T15:39:27.028 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-15T15:39:27.031 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-15T15:39:27.090 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-15T15:39:27.092 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-15T15:39:27.150 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-15T15:39:27.152 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-15T15:39:27.214 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-15T15:39:27.216 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-15T15:39:27.275 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-15T15:39:27.277 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-15T15:39:27.337 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-15T15:39:27.339 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-15T15:39:27.398 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-15T15:39:27.400 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-15T15:39:27.458 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-15T15:39:27.461 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-15T15:39:27.523 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-05-15T15:39:27.523 DEBUG:teuthology.orchestra.run.smithi012:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-05-15T15:39:27.547 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-15T15:39:27.654 DEBUG:teuthology.orchestra.run.smithi012:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-05-15T15:39:27.678 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-05-15T15:39:27.703 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-15T15:39:27.808 DEBUG:teuthology.orchestra.run.smithi084:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-05-15T15:39:27.831 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-05-15T15:39:27.896 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-15T15:39:28.000 DEBUG:teuthology.orchestra.run.smithi084:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-05-15T15:39:28.024 DEBUG:teuthology.orchestra.run.smithi012:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-05-15T15:39:28.027 DEBUG:teuthology.orchestra.run.smithi084:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-05-15T15:39:28.079 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-05-15T15:39:28.079 INFO:tasks.ceph.mon.a:Restarting daemon 2024-05-15T15:39:28.080 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-05-15T15:39:28.083 INFO:tasks.ceph.mon.a:Started 2024-05-15T15:39:28.083 INFO:tasks.ceph.mon.b:Restarting daemon 2024-05-15T15:39:28.084 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-05-15T15:39:28.122 INFO:tasks.ceph.mon.b:Started 2024-05-15T15:39:28.122 INFO:tasks.ceph.mon.c:Restarting daemon 2024-05-15T15:39:28.122 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-05-15T15:39:28.124 INFO:tasks.ceph.mon.c:Started 2024-05-15T15:39:28.124 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-05-15T15:39:28.124 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-05-15T15:39:28.124 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-05-15T15:39:28.126 INFO:tasks.ceph.mgr.y:Started 2024-05-15T15:39:28.127 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-05-15T15:39:28.127 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-05-15T15:39:28.128 INFO:tasks.ceph.mgr.x:Started 2024-05-15T15:39:28.131 INFO:tasks.ceph:Setting crush tunables to default 2024-05-15T15:39:28.131 DEBUG:teuthology.orchestra.run.smithi012:> sudo ceph --cluster ceph osd crush tunables default 2024-05-15T15:39:28.246 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:28.244+0000 7fbebd772640 1 Processor -- start 2024-05-15T15:39:28.246 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:28.244+0000 7fbebd772640 1 -- start start 2024-05-15T15:39:28.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:28.245+0000 7fbebd772640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fbeb80a9060 0x7fbeb8148910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:28.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:28.245+0000 7fbebd772640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fbeb814ed70 0x7fbeb8158db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:28.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:28.245+0000 7fbebd772640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbeb80b8a30 con 0x7fbeb80ba0f0 2024-05-15T15:39:28.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:28.245+0000 7fbebd772640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7fbeb80b8d10 con 0x7fbeb814ed70 2024-05-15T15:39:28.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:28.245+0000 7fbebd772640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fbeb80b8ff0 con 0x7fbeb80a9060 2024-05-15T15:39:28.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:28.245+0000 7fbeb77fe640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fbeb814ed70 0x7fbeb8158db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:28.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:28.245+0000 7fbeb6ffd640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fbeb80a9060 0x7fbeb8148910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:28.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:28.245+0000 7fbeb77fe640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fbeb814ed70 0x7fbeb8158db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.12:36694/0 (socket says 172.21.15.12:36694) 2024-05-15T15:39:28.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:28.245+0000 7fbeb77fe640 1 -- 172.21.15.12:0/3387287109 learned_addr learned my addr 172.21.15.12:0/3387287109 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:39:28.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:28.245+0000 7fbeb6ffd640 1 -- 172.21.15.12:0/3387287109 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fbeb80a9060 msgr2=0x7fbeb8148910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-15T15:39:28.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:28.245+0000 7fbeb6ffd640 1 -- 172.21.15.12:0/3387287109 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fbeb80a9060 msgr2=0x7fbeb8148910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-15T15:39:28.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:28.245+0000 7fbeb77fe640 1 -- 172.21.15.12:0/3387287109 >> v2:172.21.15.84:3300/0 conn(0x7fbeb814ed70 msgr2=0x7fbeb8158db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-05-15T15:39:28.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:28.245+0000 7fbeb6ffd640 1 --2- 172.21.15.12:0/3387287109 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fbeb80a9060 0x7fbeb8148910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-15T15:39:28.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:28.245+0000 7fbeb77fe640 1 -- 172.21.15.12:0/3387287109 >> v2:172.21.15.84:3300/0 conn(0x7fbeb814ed70 msgr2=0x7fbeb8158db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-15T15:39:28.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:28.245+0000 7fbeb77fe640 1 --2- 172.21.15.12:0/3387287109 >> v2:172.21.15.84:3300/0 conn(0x7fbeb814ed70 0x7fbeb8158db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-15T15:39:28.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:28.245+0000 7fbeb6ffd640 1 --2- 172.21.15.12:0/3387287109 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fbeb80a9060 0x7fbeb8148910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-15T15:39:28.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:28.245+0000 7fbeb77fe640 1 --2- 172.21.15.12:0/3387287109 >> v2:172.21.15.84:3300/0 conn(0x7fbeb814ed70 0x7fbeb8158db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-15T15:39:28.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:28.403+0000 7fbeb5ffb640 1 -- 172.21.15.12:0/3387287109 <== mon.1 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2985399851 0 0) 0x7fbeb80b8a30 con 0x7fbeb80ba0f0 2024-05-15T15:39:28.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:28.403+0000 7fbeb5ffb640 1 -- 172.21.15.12:0/3387287109 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbea0003520 con 0x7fbeb80ba0f0 2024-05-15T15:39:28.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:28.403+0000 7fbeb5ffb640 1 -- 172.21.15.12:0/3387287109 <== mon.1 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3504597267 0 0) 0x7fbea0003520 con 0x7fbeb80ba0f0 2024-05-15T15:39:28.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:28.403+0000 7fbeb5ffb640 1 -- 172.21.15.12:0/3387287109 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fbeb80a9060 msgr2=0x7fbeb8148910 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-15T15:39:28.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:28.403+0000 7fbeb5ffb640 1 --2- 172.21.15.12:0/3387287109 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fbeb80a9060 0x7fbeb8148910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:28.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:28.403+0000 7fbeb5ffb640 1 -- 172.21.15.12:0/3387287109 >> v2:172.21.15.84:3300/0 conn(0x7fbeb814ed70 msgr2=0x7fbeb8158db0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-15T15:39:28.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:28.403+0000 7fbeb5ffb640 1 --2- 172.21.15.12:0/3387287109 >> v2:172.21.15.84:3300/0 conn(0x7fbeb814ed70 0x7fbeb8158db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:28.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:28.403+0000 7fbeb5ffb640 1 -- 172.21.15.12:0/3387287109 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbeb80b92d0 con 0x7fbeb80ba0f0 2024-05-15T15:39:28.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:28.403+0000 7fbeb5ffb640 1 -- 172.21.15.12:0/3387287109 <== mon.1 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 38171736 0 0) 0x7fbeac0016f0 con 0x7fbeb80ba0f0 2024-05-15T15:39:28.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:28.403+0000 7fbeb5ffb640 1 -- 172.21.15.12:0/3387287109 >> v1:172.21.15.84:6789/0 conn(0x7fbeb80ba0f0 legacy=0x7fbeb814e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:28.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:28.403+0000 7fbeb5ffb640 1 --2- 172.21.15.12:0/3387287109 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbea0003a50 0x7fbea0003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:28.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:28.403+0000 7fbeb5ffb640 1 --2- 172.21.15.12:0/3387287109 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbea0004800 0x7fbea0004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:28.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:28.403+0000 7fbeb5ffb640 1 --2- 172.21.15.12:0/3387287109 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fbeb80a9060 0x7fbea0005280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:28.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:28.403+0000 7fbeb5ffb640 1 -- 172.21.15.12:0/3387287109 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fbeb80b8d10 con 0x7fbea0003a50 2024-05-15T15:39:28.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:28.403+0000 7fbeb5ffb640 1 -- 172.21.15.12:0/3387287109 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fbeb80b8ff0 con 0x7fbea0004800 2024-05-15T15:39:28.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:28.403+0000 7fbeb5ffb640 1 -- 172.21.15.12:0/3387287109 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fbea000bc90 con 0x7fbeb80a9060 2024-05-15T15:39:28.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:28.403+0000 7fbeb6ffd640 1 --2- 172.21.15.12:0/3387287109 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbea0003a50 0x7fbea0003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:28.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:28.403+0000 7fbeb67fc640 1 --2- 172.21.15.12:0/3387287109 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbea0004800 0x7fbea0004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:28.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:28.403+0000 7fbeb77fe640 1 --2- 172.21.15.12:0/3387287109 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fbeb80a9060 0x7fbea0005280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:28.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:28.403+0000 7fbeb6ffd640 1 -- 172.21.15.12:0/3387287109 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fbeb80a9060 msgr2=0x7fbea0005280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:39:28.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:28.404+0000 7fbeb6ffd640 1 --2- 172.21.15.12:0/3387287109 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fbeb80a9060 0x7fbea0005280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:28.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:28.404+0000 7fbeb6ffd640 1 -- 172.21.15.12:0/3387287109 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbea0004800 msgr2=0x7fbea0004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:39:28.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:28.404+0000 7fbeb6ffd640 1 --2- 172.21.15.12:0/3387287109 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbea0004800 0x7fbea0004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:28.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:28.404+0000 7fbeb6ffd640 1 -- 172.21.15.12:0/3387287109 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbea0003520 con 0x7fbea0003a50 2024-05-15T15:39:28.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:28.404+0000 7fbeb6ffd640 1 --2- 172.21.15.12:0/3387287109 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbea0003a50 0x7fbea0003ec0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fbea8006fd0 tx=0x7fbea0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b06f7c348ccb86d8 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:39:28.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:28.405+0000 7fbeb5ffb640 1 -- 172.21.15.12:0/3387287109 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbea8030070 con 0x7fbea0003a50 2024-05-15T15:39:28.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:28.405+0000 7fbeb5ffb640 1 -- 172.21.15.12:0/3387287109 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbea802ad50 con 0x7fbea0003a50 2024-05-15T15:39:28.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:28.405+0000 7fbeb5ffb640 1 -- 172.21.15.12:0/3387287109 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbea800b5e0 con 0x7fbea0003a50 2024-05-15T15:39:28.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:28.407+0000 7fbebd772640 1 -- 172.21.15.12:0/3387287109 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbea0003a50 msgr2=0x7fbea0003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:28.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:28.407+0000 7fbebd772640 1 --2- 172.21.15.12:0/3387287109 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbea0003a50 0x7fbea0003ec0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fbea8006fd0 tx=0x7fbea0005830 comp rx=0 tx=0).stop 2024-05-15T15:39:28.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:28.407+0000 7fbeb77fe640 1 -- 172.21.15.12:0/3387287109 reap_dead start 2024-05-15T15:39:28.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:28.407+0000 7fbebd772640 1 -- 172.21.15.12:0/3387287109 shutdown_connections 2024-05-15T15:39:28.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:28.407+0000 7fbebd772640 1 -- 172.21.15.12:0/3387287109 >> 172.21.15.12:0/3387287109 conn(0x7fbeb80c07c0 msgr2=0x7fbeb80c0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:39:28.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:28.407+0000 7fbebd772640 1 -- 172.21.15.12:0/3387287109 shutdown_connections 2024-05-15T15:39:28.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:28.407+0000 7fbebd772640 1 -- 172.21.15.12:0/3387287109 wait complete. 2024-05-15T15:39:28.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:28.409+0000 7fbebd772640 1 Processor -- start 2024-05-15T15:39:28.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:28.409+0000 7fbebd772640 1 -- start start 2024-05-15T15:39:28.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:28.410+0000 7fbebd772640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbea0003a50 0x7fbeb81427c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:28.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:28.410+0000 7fbebd772640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbeb81455a0 0x7fbeb813d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:28.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:28.410+0000 7fbebd772640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fbeb813d650 0x7fbeb81e74b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:28.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:28.410+0000 7fbebd772640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fbeb808dbb0 con 0x7fbea0003a50 2024-05-15T15:39:28.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:28.410+0000 7fbebd772640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fbeb808da30 con 0x7fbeb81455a0 2024-05-15T15:39:28.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:28.410+0000 7fbebd772640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fbeb80ba500 con 0x7fbeb813d650 2024-05-15T15:39:28.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:28.410+0000 7fbeb6ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbea0003a50 0x7fbeb81427c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:28.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:28.410+0000 7fbeb6ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbea0003a50 0x7fbeb81427c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43996/0 (socket says 172.21.15.12:43996) 2024-05-15T15:39:28.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:28.410+0000 7fbeb6ffd640 1 -- 172.21.15.12:0/2257797942 learned_addr learned my addr 172.21.15.12:0/2257797942 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:39:28.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:28.410+0000 7fbeb67fc640 1 --2- 172.21.15.12:0/2257797942 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbeb81455a0 0x7fbeb813d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:28.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:28.410+0000 7fbeb77fe640 1 --2- 172.21.15.12:0/2257797942 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fbeb813d650 0x7fbeb81e74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:28.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:28.410+0000 7fbeb6ffd640 1 -- 172.21.15.12:0/2257797942 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fbeb813d650 msgr2=0x7fbeb81e74b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:28.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:28.410+0000 7fbeb6ffd640 1 --2- 172.21.15.12:0/2257797942 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fbeb813d650 0x7fbeb81e74b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:28.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:28.410+0000 7fbeb6ffd640 1 -- 172.21.15.12:0/2257797942 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbeb81455a0 msgr2=0x7fbeb813d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:28.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:28.410+0000 7fbeb6ffd640 1 --2- 172.21.15.12:0/2257797942 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbeb81455a0 0x7fbeb813d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:28.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:28.410+0000 7fbeb6ffd640 1 -- 172.21.15.12:0/2257797942 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbeb8142d00 con 0x7fbea0003a50 2024-05-15T15:39:28.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:28.410+0000 7fbeb77fe640 1 --2- 172.21.15.12:0/2257797942 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fbeb813d650 0x7fbeb81e74b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-15T15:39:28.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:28.410+0000 7fbeb6ffd640 1 --2- 172.21.15.12:0/2257797942 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbea0003a50 0x7fbeb81427c0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fbea802a840 tx=0x7fbea8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:39:28.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:28.410+0000 7fbe9f7fe640 1 -- 172.21.15.12:0/2257797942 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbea8043020 con 0x7fbea0003a50 2024-05-15T15:39:28.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:28.410+0000 7fbe9f7fe640 1 -- 172.21.15.12:0/2257797942 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbea803f680 con 0x7fbea0003a50 2024-05-15T15:39:28.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:28.410+0000 7fbebd772640 1 -- 172.21.15.12:0/2257797942 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbeb8152710 con 0x7fbea0003a50 2024-05-15T15:39:28.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:28.410+0000 7fbe9f7fe640 1 -- 172.21.15.12:0/2257797942 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbea800b5e0 con 0x7fbea0003a50 2024-05-15T15:39:28.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:28.411+0000 7fbebd772640 1 -- 172.21.15.12:0/2257797942 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbeb8143c60 con 0x7fbea0003a50 2024-05-15T15:39:28.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:28.411+0000 7fbe9f7fe640 1 -- 172.21.15.12:0/2257797942 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fbea8046020 con 0x7fbea0003a50 2024-05-15T15:39:28.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:28.411+0000 7fbe9f7fe640 1 -- 172.21.15.12:0/2257797942 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fbea803dd50 con 0x7fbea0003a50 2024-05-15T15:39:28.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:28.412+0000 7fbebd772640 1 -- 172.21.15.12:0/2257797942 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbeb8144140 con 0x7fbea0003a50 2024-05-15T15:39:28.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:28.414+0000 7fbe9f7fe640 1 -- 172.21.15.12:0/2257797942 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fbea804d020 con 0x7fbea0003a50 2024-05-15T15:39:28.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:28.481+0000 7fbebd772640 1 -- 172.21.15.12:0/2257797942 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7fbeb8050940 con 0x7fbea0003a50 2024-05-15T15:39:28.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:28.483+0000 7fbe9f7fe640 1 -- 172.21.15.12:0/2257797942 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7fbea803d440 con 0x7fbea0003a50 2024-05-15T15:39:28.485 INFO:teuthology.orchestra.run.smithi012.stderr:adjusted tunables profile to default 2024-05-15T15:39:28.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:28.484+0000 7fbebd772640 1 -- 172.21.15.12:0/2257797942 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbea0003a50 msgr2=0x7fbeb81427c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:28.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:28.484+0000 7fbebd772640 1 --2- 172.21.15.12:0/2257797942 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbea0003a50 0x7fbeb81427c0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fbea802a840 tx=0x7fbea8004730 comp rx=0 tx=0).stop 2024-05-15T15:39:28.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:28.484+0000 7fbebd772640 1 -- 172.21.15.12:0/2257797942 shutdown_connections 2024-05-15T15:39:28.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:28.484+0000 7fbebd772640 1 --2- 172.21.15.12:0/2257797942 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fbeb813d650 0x7fbeb81e74b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:28.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:28.484+0000 7fbebd772640 1 --2- 172.21.15.12:0/2257797942 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbeb81455a0 0x7fbeb813d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:28.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:28.484+0000 7fbebd772640 1 --2- 172.21.15.12:0/2257797942 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbea0003a50 0x7fbeb81427c0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:28.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:28.484+0000 7fbebd772640 1 -- 172.21.15.12:0/2257797942 >> 172.21.15.12:0/2257797942 conn(0x7fbeb80c07c0 msgr2=0x7fbeb8074560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:39:28.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:28.484+0000 7fbebd772640 1 -- 172.21.15.12:0/2257797942 shutdown_connections 2024-05-15T15:39:28.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:28.484+0000 7fbebd772640 1 -- 172.21.15.12:0/2257797942 wait complete. 2024-05-15T15:39:28.497 INFO:tasks.ceph:check_enable_crimson: False 2024-05-15T15:39:28.498 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-05-15T15:39:28.498 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-05-15T15:39:28.498 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-05-15T15:39:28.522 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-05-15T15:39:28.522 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-05-15T15:39:28.524 INFO:tasks.ceph.mgr.x.smithi084.stderr:2024-05-15T15:39:28.521+0000 7f1aa1e37040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-15T15:39:28.530 INFO:tasks.ceph.mgr.y.smithi012.stderr:2024-05-15T15:39:28.528+0000 7f40e3a62040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-15T15:39:28.553 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-05-15T15:39:28.553 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-05-15T15:39:28.618 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-05-15T15:39:28.618 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-05-15T15:39:28.668 INFO:tasks.ceph.mgr.x.smithi084.stderr:2024-05-15T15:39:28.666+0000 7f1aa1e37040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-15T15:39:28.682 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-05-15T15:39:28.682 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-05-15T15:39:28.688 INFO:tasks.ceph.mgr.y.smithi012.stderr:2024-05-15T15:39:28.686+0000 7f40e3a62040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-15T15:39:28.706 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-05-15T15:39:28.706 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-05-15T15:39:28.723 INFO:tasks.ceph.mgr.x.smithi084.stderr:2024-05-15T15:39:28.721+0000 7f1aa1e37040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-15T15:39:28.744 INFO:tasks.ceph.mgr.y.smithi012.stderr:2024-05-15T15:39:28.742+0000 7f40e3a62040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-15T15:39:28.745 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-05-15T15:39:28.745 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-05-15T15:39:28.809 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-05-15T15:39:28.809 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-05-15T15:39:28.872 DEBUG:teuthology.orchestra.run.smithi084:> sudo ceph --cluster ceph osd new 0d06a12a-866a-418e-9776-704d74354579 0 2024-05-15T15:39:28.972 INFO:tasks.ceph.mgr.x.smithi084.stderr:2024-05-15T15:39:28.969+0000 7f1aa1e37040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-15T15:39:28.997 INFO:tasks.ceph.mgr.y.smithi012.stderr:2024-05-15T15:39:28.995+0000 7f40e3a62040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-15T15:39:29.019 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.016+0000 7f4f9e013640 1 Processor -- start 2024-05-15T15:39:29.019 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.016+0000 7f4f9e013640 1 -- start start 2024-05-15T15:39:29.020 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.017+0000 7f4f9e013640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4f980bc360 0x7f4f98148680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:29.020 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.017+0000 7f4f9e013640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4f9806d6f0 0x7f4f98151f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:29.020 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.017+0000 7f4f9e013640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f98073600 con 0x7f4f9806db00 2024-05-15T15:39:29.020 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.017+0000 7f4f9e013640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f4f98151a70 con 0x7f4f9806d6f0 2024-05-15T15:39:29.020 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.017+0000 7f4f9e013640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f4f980738e0 con 0x7f4f980bc360 2024-05-15T15:39:29.020 INFO:tasks.ceph.mgr.x.smithi084.stderr:2024-05-15T15:39:29.018+0000 7f1aa1e37040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-15T15:39:29.021 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.018+0000 7f4f977fe640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4f980bc360 0x7f4f98148680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:29.021 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.018+0000 7f4f977fe640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4f980bc360 0x7f4f98148680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41712/0 (socket says 172.21.15.84:41712) 2024-05-15T15:39:29.022 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.018+0000 7f4f977fe640 1 -- 172.21.15.84:0/4245328214 learned_addr learned my addr 172.21.15.84:0/4245328214 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-05-15T15:39:29.022 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.018+0000 7f4f97fff640 1 --1- 172.21.15.84:0/4245328214 >> v1:172.21.15.84:6789/0 conn(0x7f4f9806db00 0x7f4f9814e320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:34910/0 (socket says 172.21.15.84:34910) 2024-05-15T15:39:29.022 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.018+0000 7f4f96ffd640 1 --2- 172.21.15.84:0/4245328214 >> v2:172.21.15.12:3300/0 conn(0x7f4f9806d6f0 0x7f4f98151f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:29.022 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.018+0000 7f4f977fe640 1 -- 172.21.15.84:0/4245328214 >> v2:172.21.15.12:3300/0 conn(0x7f4f9806d6f0 msgr2=0x7f4f98151f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:39:29.022 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.018+0000 7f4f977fe640 1 --2- 172.21.15.84:0/4245328214 >> v2:172.21.15.12:3300/0 conn(0x7f4f9806d6f0 0x7f4f98151f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:29.022 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.018+0000 7f4f977fe640 1 -- 172.21.15.84:0/4245328214 >> v1:172.21.15.84:6789/0 conn(0x7f4f9806db00 legacy=0x7f4f9814e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:29.022 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.018+0000 7f4f977fe640 1 -- 172.21.15.84:0/4245328214 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f98073bc0 con 0x7f4f980bc360 2024-05-15T15:39:29.022 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.019+0000 7f4f977fe640 1 --2- 172.21.15.84:0/4245328214 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f980bc360 0x7f4f98148680 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f4f9806e0c0 tx=0x7f4f8c02a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=144859e362e9bcb8 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:39:29.022 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.019+0000 7f4f967fc640 1 -- 172.21.15.84:0/4245328214 <== mon.1 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f8c037070 con 0x7f4f980bc360 2024-05-15T15:39:29.022 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.019+0000 7f4f967fc640 1 -- 172.21.15.84:0/4245328214 <== mon.1 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f8c032440 con 0x7f4f980bc360 2024-05-15T15:39:29.022 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.019+0000 7f4f967fc640 1 -- 172.21.15.84:0/4245328214 <== mon.1 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f8c032810 con 0x7f4f980bc360 2024-05-15T15:39:29.023 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.020+0000 7f4f9e013640 1 -- 172.21.15.84:0/4245328214 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f980bc360 msgr2=0x7f4f98148680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:29.023 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.020+0000 7f4f9e013640 1 --2- 172.21.15.84:0/4245328214 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f980bc360 0x7f4f98148680 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f4f9806e0c0 tx=0x7f4f8c02a270 comp rx=0 tx=0).stop 2024-05-15T15:39:29.024 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.020+0000 7f4f9e013640 1 -- 172.21.15.84:0/4245328214 shutdown_connections 2024-05-15T15:39:29.024 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.020+0000 7f4f9e013640 1 --2- 172.21.15.84:0/4245328214 >> v2:172.21.15.12:3300/0 conn(0x7f4f9806d6f0 0x7f4f98151f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:29.024 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.020+0000 7f4f9e013640 1 --2- 172.21.15.84:0/4245328214 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f980bc360 0x7f4f98148680 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:29.024 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.020+0000 7f4f9e013640 1 -- 172.21.15.84:0/4245328214 >> 172.21.15.84:0/4245328214 conn(0x7f4f9806f390 msgr2=0x7f4f9806f7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:39:29.024 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.020+0000 7f4f9e013640 1 -- 172.21.15.84:0/4245328214 shutdown_connections 2024-05-15T15:39:29.024 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.020+0000 7f4f9e013640 1 -- 172.21.15.84:0/4245328214 wait complete. 2024-05-15T15:39:29.024 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.021+0000 7f4f9e013640 1 Processor -- start 2024-05-15T15:39:29.024 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.021+0000 7f4f9e013640 1 -- start start 2024-05-15T15:39:29.026 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.022+0000 7f4f9e013640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f4f9806d6f0 0x7f4f980b9620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:29.026 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.022+0000 7f4f9e013640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4f9806db00 0x7f4f981e7d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:29.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.022+0000 7f4f9e013640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f980bc360 0x7f4f9813f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:29.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.022+0000 7f4f9e013640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f4f980742d0 con 0x7f4f9806db00 2024-05-15T15:39:29.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.022+0000 7f4f9e013640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f4f98073ea0 con 0x7f4f980bc360 2024-05-15T15:39:29.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.022+0000 7f4f9e013640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f4f98140fb0 con 0x7f4f9806d6f0 2024-05-15T15:39:29.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.022+0000 7f4f97fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f980bc360 0x7f4f9813f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:29.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.023+0000 7f4f977fe640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f4f9806d6f0 0x7f4f980b9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:29.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.023+0000 7f4f97fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f980bc360 0x7f4f9813f220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41714/0 (socket says 172.21.15.84:41714) 2024-05-15T15:39:29.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.023+0000 7f4f97fff640 1 -- 172.21.15.84:0/1447184332 learned_addr learned my addr 172.21.15.84:0/1447184332 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-05-15T15:39:29.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.023+0000 7f4f96ffd640 1 --2- 172.21.15.84:0/1447184332 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4f9806db00 0x7f4f981e7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:29.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.023+0000 7f4f97fff640 1 -- 172.21.15.84:0/1447184332 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f4f9806d6f0 msgr2=0x7f4f980b9620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:29.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.023+0000 7f4f97fff640 1 --2- 172.21.15.84:0/1447184332 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f4f9806d6f0 0x7f4f980b9620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:29.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.023+0000 7f4f97fff640 1 -- 172.21.15.84:0/1447184332 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4f9806db00 msgr2=0x7f4f981e7d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:29.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.023+0000 7f4f97fff640 1 --2- 172.21.15.84:0/1447184332 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4f9806db00 0x7f4f981e7d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:29.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.023+0000 7f4f97fff640 1 -- 172.21.15.84:0/1447184332 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f981e82d0 con 0x7f4f980bc360 2024-05-15T15:39:29.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.023+0000 7f4f977fe640 1 --2- 172.21.15.84:0/1447184332 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f4f9806d6f0 0x7f4f980b9620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-15T15:39:29.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.023+0000 7f4f96ffd640 1 --2- 172.21.15.84:0/1447184332 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4f9806db00 0x7f4f981e7d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-15T15:39:29.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.023+0000 7f4f97fff640 1 --2- 172.21.15.84:0/1447184332 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f980bc360 0x7f4f9813f220 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4f9000c790 tx=0x7f4f9000cc50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:39:29.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.023+0000 7f4f7ffff640 1 -- 172.21.15.84:0/1447184332 <== mon.1 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f90017070 con 0x7f4f980bc360 2024-05-15T15:39:29.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.023+0000 7f4f7ffff640 1 -- 172.21.15.84:0/1447184332 <== mon.1 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f9000a640 con 0x7f4f980bc360 2024-05-15T15:39:29.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.023+0000 7f4f7ffff640 1 -- 172.21.15.84:0/1447184332 <== mon.1 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f9000a9f0 con 0x7f4f980bc360 2024-05-15T15:39:29.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.023+0000 7f4f9e013640 1 -- 172.21.15.84:0/1447184332 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f980b8580 con 0x7f4f980bc360 2024-05-15T15:39:29.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.023+0000 7f4f9e013640 1 -- 172.21.15.84:0/1447184332 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f980b8b40 con 0x7f4f980bc360 2024-05-15T15:39:29.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.023+0000 7f4f7ffff640 1 -- 172.21.15.84:0/1447184332 <== mon.1 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f4f9001a070 con 0x7f4f980bc360 2024-05-15T15:39:29.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.024+0000 7f4f7ffff640 1 -- 172.21.15.84:0/1447184332 <== mon.1 v2:172.21.15.84:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f4f9001c780 con 0x7f4f980bc360 2024-05-15T15:39:29.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.024+0000 7f4f9e013640 1 -- 172.21.15.84:0/1447184332 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f98069b50 con 0x7f4f980bc360 2024-05-15T15:39:29.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.028+0000 7f4f7ffff640 1 -- 172.21.15.84:0/1447184332 <== mon.1 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f4f900078c0 con 0x7f4f980bc360 2024-05-15T15:39:29.045 INFO:tasks.ceph.mgr.y.smithi012.stderr:2024-05-15T15:39:29.043+0000 7f40e3a62040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-15T15:39:29.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.099+0000 7f4f9e013640 1 -- 172.21.15.84:0/1447184332 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd new", "uuid": "0d06a12a-866a-418e-9776-704d74354579", "id": 0} v 0) -- 0x7f4f98050940 con 0x7f4f980bc360 2024-05-15T15:39:29.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.103+0000 7f4f7ffff640 1 -- 172.21.15.84:0/1447184332 <== mon.1 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0d06a12a-866a-418e-9776-704d74354579", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f4f9000ab90 con 0x7f4f980bc360 2024-05-15T15:39:29.106 INFO:teuthology.orchestra.run.smithi084.stdout:0 2024-05-15T15:39:29.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.104+0000 7f4f9e013640 1 -- 172.21.15.84:0/1447184332 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f980bc360 msgr2=0x7f4f9813f220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:29.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.104+0000 7f4f9e013640 1 --2- 172.21.15.84:0/1447184332 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f980bc360 0x7f4f9813f220 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4f9000c790 tx=0x7f4f9000cc50 comp rx=0 tx=0).stop 2024-05-15T15:39:29.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.104+0000 7f4f9e013640 1 -- 172.21.15.84:0/1447184332 shutdown_connections 2024-05-15T15:39:29.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.104+0000 7f4f9e013640 1 --2- 172.21.15.84:0/1447184332 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f980bc360 0x7f4f9813f220 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:29.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.104+0000 7f4f9e013640 1 --2- 172.21.15.84:0/1447184332 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4f9806db00 0x7f4f981e7d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:29.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.104+0000 7f4f9e013640 1 --2- 172.21.15.84:0/1447184332 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f4f9806d6f0 0x7f4f980b9620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:29.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.104+0000 7f4f9e013640 1 -- 172.21.15.84:0/1447184332 >> 172.21.15.84:0/1447184332 conn(0x7f4f9806f390 msgr2=0x7f4f980bb440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:39:29.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.104+0000 7f4f9e013640 1 -- 172.21.15.84:0/1447184332 shutdown_connections 2024-05-15T15:39:29.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.105+0000 7f4f9e013640 1 -- 172.21.15.84:0/1447184332 wait complete. 2024-05-15T15:39:29.118 DEBUG:teuthology.orchestra.run.smithi084:> sudo ceph --cluster ceph osd new 09d0fa19-9ef8-4f35-bf99-6e86658c6f10 1 2024-05-15T15:39:29.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.222+0000 7f5cfb661640 1 Processor -- start 2024-05-15T15:39:29.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.222+0000 7f5cfb661640 1 -- start start 2024-05-15T15:39:29.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.223+0000 7f5cfb661640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5cf40bec10 0x7f5cf40bf020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:29.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.223+0000 7f5cfb661640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f5cf414ba60 0x7f5cf414be70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:29.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.223+0000 7f5cfb661640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5cf414c3b0 con 0x7f5cf40be460 2024-05-15T15:39:29.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.223+0000 7f5cfb661640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f5cf40bb220 con 0x7f5cf40bec10 2024-05-15T15:39:29.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.223+0000 7f5cfb661640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f5cf409ff70 con 0x7f5cf414ba60 2024-05-15T15:39:29.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.223+0000 7f5cf9bfe640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f5cf414ba60 0x7f5cf414be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:29.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.223+0000 7f5cf8bfc640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5cf40bec10 0x7f5cf40bf020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:29.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.223+0000 7f5cf9bfe640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f5cf414ba60 0x7f5cf414be70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3301/0 says I am v2:172.21.15.84:44594/0 (socket says 172.21.15.84:44594) 2024-05-15T15:39:29.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.223+0000 7f5cf9bfe640 1 -- 172.21.15.84:0/234067378 learned_addr learned my addr 172.21.15.84:0/234067378 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-05-15T15:39:29.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.223+0000 7f5cf9bfe640 1 -- 172.21.15.84:0/234067378 >> v2:172.21.15.84:3300/0 conn(0x7f5cf40bec10 msgr2=0x7f5cf40bf020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:39:29.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.223+0000 7f5cf9bfe640 1 --2- 172.21.15.84:0/234067378 >> v2:172.21.15.84:3300/0 conn(0x7f5cf40bec10 0x7f5cf40bf020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:29.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.223+0000 7f5cf9bfe640 1 -- 172.21.15.84:0/234067378 >> v1:172.21.15.84:6789/0 conn(0x7f5cf40be460 legacy=0x7f5cf406fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:29.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.223+0000 7f5cf9bfe640 1 -- 172.21.15.84:0/234067378 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cf40bb970 con 0x7f5cf414ba60 2024-05-15T15:39:29.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.223+0000 7f5cf8bfc640 1 --2- 172.21.15.84:0/234067378 >> v2:172.21.15.84:3300/0 conn(0x7f5cf40bec10 0x7f5cf40bf020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-15T15:39:29.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.224+0000 7f5cf9bfe640 1 --2- 172.21.15.84:0/234067378 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f5cf414ba60 0x7f5cf414be70 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5cec009e50 tx=0x7f5cec02a730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3cb22c4a382bae98 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:39:29.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.224+0000 7f5cebfff640 1 -- 172.21.15.84:0/234067378 <== mon.2 v2:172.21.15.84:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cec036070 con 0x7f5cf414ba60 2024-05-15T15:39:29.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.224+0000 7f5cebfff640 1 -- 172.21.15.84:0/234067378 <== mon.2 v2:172.21.15.84:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cec031600 con 0x7f5cf414ba60 2024-05-15T15:39:29.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.224+0000 7f5cebfff640 1 -- 172.21.15.84:0/234067378 <== mon.2 v2:172.21.15.84:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cec0319d0 con 0x7f5cf414ba60 2024-05-15T15:39:29.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.225+0000 7f5cfb661640 1 -- 172.21.15.84:0/234067378 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f5cf414ba60 msgr2=0x7f5cf414be70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:29.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.225+0000 7f5cfb661640 1 --2- 172.21.15.84:0/234067378 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f5cf414ba60 0x7f5cf414be70 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5cec009e50 tx=0x7f5cec02a730 comp rx=0 tx=0).stop 2024-05-15T15:39:29.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.225+0000 7f5cfb661640 1 -- 172.21.15.84:0/234067378 shutdown_connections 2024-05-15T15:39:29.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.225+0000 7f5cfb661640 1 --2- 172.21.15.84:0/234067378 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f5cf414ba60 0x7f5cf414be70 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:29.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.225+0000 7f5cfb661640 1 --2- 172.21.15.84:0/234067378 >> v2:172.21.15.84:3300/0 conn(0x7f5cf40bec10 0x7f5cf40bf020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:29.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.225+0000 7f5cfb661640 1 -- 172.21.15.84:0/234067378 >> 172.21.15.84:0/234067378 conn(0x7f5cf406d7f0 msgr2=0x7f5cf406dc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:39:29.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.225+0000 7f5cfb661640 1 -- 172.21.15.84:0/234067378 shutdown_connections 2024-05-15T15:39:29.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.225+0000 7f5cfb661640 1 -- 172.21.15.84:0/234067378 wait complete. 2024-05-15T15:39:29.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.228+0000 7f5cfb661640 1 Processor -- start 2024-05-15T15:39:29.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.228+0000 7f5cfb661640 1 -- start start 2024-05-15T15:39:29.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.229+0000 7f5cfb661640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f5cf40be460 0x7f5cf406c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:29.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.229+0000 7f5cfb661640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5cf40bec10 0x7f5cf40a4860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:29.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.230+0000 7f5cfb661640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5cf414ba60 0x7f5cf40a4da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:29.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.230+0000 7f5cfb661640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f5cf40bb730 con 0x7f5cf414ba60 2024-05-15T15:39:29.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.230+0000 7f5cfb661640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f5cf40bb5b0 con 0x7f5cf40bec10 2024-05-15T15:39:29.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.230+0000 7f5cfb661640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f5cf40c0320 con 0x7f5cf40be460 2024-05-15T15:39:29.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.230+0000 7f5cf93fd640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f5cf40be460 0x7f5cf406c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:29.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.230+0000 7f5cf8bfc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5cf40bec10 0x7f5cf40a4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:29.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.230+0000 7f5cf93fd640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f5cf40be460 0x7f5cf406c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3301/0 says I am v2:172.21.15.84:44610/0 (socket says 172.21.15.84:44610) 2024-05-15T15:39:29.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.230+0000 7f5cf93fd640 1 -- 172.21.15.84:0/2175365310 learned_addr learned my addr 172.21.15.84:0/2175365310 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-05-15T15:39:29.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.230+0000 7f5cf9bfe640 1 --2- 172.21.15.84:0/2175365310 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5cf414ba60 0x7f5cf40a4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:29.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.230+0000 7f5cf93fd640 1 -- 172.21.15.84:0/2175365310 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5cf40bec10 msgr2=0x7f5cf40a4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:29.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.230+0000 7f5cf93fd640 1 --2- 172.21.15.84:0/2175365310 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5cf40bec10 0x7f5cf40a4860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:29.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.230+0000 7f5cf93fd640 1 -- 172.21.15.84:0/2175365310 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5cf414ba60 msgr2=0x7f5cf40a4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:29.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.230+0000 7f5cf93fd640 1 --2- 172.21.15.84:0/2175365310 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5cf414ba60 0x7f5cf40a4da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:29.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.230+0000 7f5cf93fd640 1 -- 172.21.15.84:0/2175365310 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cf406ce00 con 0x7f5cf40be460 2024-05-15T15:39:29.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.230+0000 7f5cf8bfc640 1 --2- 172.21.15.84:0/2175365310 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5cf40bec10 0x7f5cf40a4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-15T15:39:29.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.230+0000 7f5cf93fd640 1 --2- 172.21.15.84:0/2175365310 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f5cf40be460 0x7f5cf406c8c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5ce400c3a0 tx=0x7f5ce400c860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:39:29.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.230+0000 7f5ce9ffb640 1 -- 172.21.15.84:0/2175365310 <== mon.2 v2:172.21.15.84:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ce4017070 con 0x7f5cf40be460 2024-05-15T15:39:29.237 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.230+0000 7f5ce9ffb640 1 -- 172.21.15.84:0/2175365310 <== mon.2 v2:172.21.15.84:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ce40052d0 con 0x7f5cf40be460 2024-05-15T15:39:29.237 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.230+0000 7f5ce9ffb640 1 -- 172.21.15.84:0/2175365310 <== mon.2 v2:172.21.15.84:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ce4003830 con 0x7f5cf40be460 2024-05-15T15:39:29.237 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.230+0000 7f5cfb661640 1 -- 172.21.15.84:0/2175365310 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5cf41d5400 con 0x7f5cf40be460 2024-05-15T15:39:29.237 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.231+0000 7f5ce9ffb640 1 -- 172.21.15.84:0/2175365310 <== mon.2 v2:172.21.15.84:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f5ce401a070 con 0x7f5cf40be460 2024-05-15T15:39:29.237 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.231+0000 7f5cfb661640 1 -- 172.21.15.84:0/2175365310 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f5cf40a5d70 con 0x7f5cf40be460 2024-05-15T15:39:29.237 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.231+0000 7f5ce9ffb640 1 -- 172.21.15.84:0/2175365310 <== mon.2 v2:172.21.15.84:3301/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f5ce4011590 con 0x7f5cf40be460 2024-05-15T15:39:29.237 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.232+0000 7f5cfb661640 1 -- 172.21.15.84:0/2175365310 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5cf4050940 con 0x7f5cf40be460 2024-05-15T15:39:29.237 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.234+0000 7f5ce9ffb640 1 -- 172.21.15.84:0/2175365310 <== mon.2 v2:172.21.15.84:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f5ce4022070 con 0x7f5cf40be460 2024-05-15T15:39:29.307 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.304+0000 7f5cfb661640 1 -- 172.21.15.84:0/2175365310 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_command({"prefix": "osd new", "uuid": "09d0fa19-9ef8-4f35-bf99-6e86658c6f10", "id": 1} v 0) -- 0x7f5cf4070b80 con 0x7f5cf40be460 2024-05-15T15:39:29.310 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.308+0000 7f5ce9ffb640 1 -- 172.21.15.84:0/2175365310 <== mon.2 v2:172.21.15.84:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "09d0fa19-9ef8-4f35-bf99-6e86658c6f10", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f5ce4011b30 con 0x7f5cf40be460 2024-05-15T15:39:29.311 INFO:teuthology.orchestra.run.smithi084.stdout:1 2024-05-15T15:39:29.312 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.309+0000 7f5cfb661640 1 -- 172.21.15.84:0/2175365310 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f5cf40be460 msgr2=0x7f5cf406c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:29.312 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.309+0000 7f5cfb661640 1 --2- 172.21.15.84:0/2175365310 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f5cf40be460 0x7f5cf406c8c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5ce400c3a0 tx=0x7f5ce400c860 comp rx=0 tx=0).stop 2024-05-15T15:39:29.313 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.309+0000 7f5cfb661640 1 -- 172.21.15.84:0/2175365310 shutdown_connections 2024-05-15T15:39:29.313 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.309+0000 7f5cfb661640 1 --2- 172.21.15.84:0/2175365310 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5cf414ba60 0x7f5cf40a4da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:29.313 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.309+0000 7f5cfb661640 1 --2- 172.21.15.84:0/2175365310 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5cf40bec10 0x7f5cf40a4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:29.313 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.309+0000 7f5cfb661640 1 --2- 172.21.15.84:0/2175365310 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f5cf40be460 0x7f5cf406c8c0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:29.313 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.309+0000 7f5cfb661640 1 -- 172.21.15.84:0/2175365310 >> 172.21.15.84:0/2175365310 conn(0x7f5cf406d7f0 msgr2=0x7f5cf40730d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:39:29.313 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.309+0000 7f5cfb661640 1 -- 172.21.15.84:0/2175365310 shutdown_connections 2024-05-15T15:39:29.313 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.309+0000 7f5cfb661640 1 -- 172.21.15.84:0/2175365310 wait complete. 2024-05-15T15:39:29.323 DEBUG:teuthology.orchestra.run.smithi084:> sudo ceph --cluster ceph osd new b204c6ad-f431-40a5-ba27-9844294f0ece 2 2024-05-15T15:39:29.432 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.429+0000 7faae7186640 1 Processor -- start 2024-05-15T15:39:29.432 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.429+0000 7faae7186640 1 -- start start 2024-05-15T15:39:29.441 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.430+0000 7faae7186640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7faae00bfe70 0x7faae006c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:29.442 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.430+0000 7faae7186640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7faae00bb520 0x7faae0152120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:29.442 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.430+0000 7faae7186640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faae00bbc20 con 0x7faae0152660 2024-05-15T15:39:29.442 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.430+0000 7faae7186640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7faae00bbf00 con 0x7faae00bfe70 2024-05-15T15:39:29.442 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.430+0000 7faae7186640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7faae0151c20 con 0x7faae00bb520 2024-05-15T15:39:29.442 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.430+0000 7faadffff640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7faae00bb520 0x7faae0152120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:29.442 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.430+0000 7faae4f22640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7faae00bfe70 0x7faae006c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:29.442 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.430+0000 7faadffff640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7faae00bb520 0x7faae0152120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3301/0 says I am v2:172.21.15.84:44624/0 (socket says 172.21.15.84:44624) 2024-05-15T15:39:29.442 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.430+0000 7faadffff640 1 -- 172.21.15.84:0/1041336890 learned_addr learned my addr 172.21.15.84:0/1041336890 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-05-15T15:39:29.442 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.430+0000 7faae4f22640 1 -- 172.21.15.84:0/1041336890 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7faae00bb520 msgr2=0x7faae0152120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:39:29.442 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.430+0000 7faae4f22640 1 --2- 172.21.15.84:0/1041336890 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7faae00bb520 0x7faae0152120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:29.442 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.430+0000 7faae4f22640 1 -- 172.21.15.84:0/1041336890 >> v1:172.21.15.12:6789/0 conn(0x7faae0152660 legacy=0x7faae014ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:29.443 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.430+0000 7faae4f22640 1 -- 172.21.15.84:0/1041336890 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faae00bb930 con 0x7faae00bfe70 2024-05-15T15:39:29.443 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.430+0000 7faadffff640 1 --2- 172.21.15.84:0/1041336890 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7faae00bb520 0x7faae0152120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-15T15:39:29.443 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.431+0000 7faae4f22640 1 --2- 172.21.15.84:0/1041336890 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faae00bfe70 0x7faae006c980 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7faad40097a0 tx=0x7faad402a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f963b49c1c421cb0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:39:29.443 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.431+0000 7faadf7fe640 1 -- 172.21.15.84:0/1041336890 <== mon.1 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faad4037070 con 0x7faae00bfe70 2024-05-15T15:39:29.443 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.431+0000 7faadf7fe640 1 -- 172.21.15.84:0/1041336890 <== mon.1 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faad4032440 con 0x7faae00bfe70 2024-05-15T15:39:29.443 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.431+0000 7faadf7fe640 1 -- 172.21.15.84:0/1041336890 <== mon.1 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faad4032810 con 0x7faae00bfe70 2024-05-15T15:39:29.443 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.432+0000 7faae7186640 1 -- 172.21.15.84:0/1041336890 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faae00bfe70 msgr2=0x7faae006c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:29.443 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.432+0000 7faae7186640 1 --2- 172.21.15.84:0/1041336890 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faae00bfe70 0x7faae006c980 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7faad40097a0 tx=0x7faad402a180 comp rx=0 tx=0).stop 2024-05-15T15:39:29.443 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.432+0000 7faae7186640 1 -- 172.21.15.84:0/1041336890 shutdown_connections 2024-05-15T15:39:29.443 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.432+0000 7faae7186640 1 --2- 172.21.15.84:0/1041336890 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7faae00bb520 0x7faae0152120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:29.443 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.432+0000 7faae7186640 1 --2- 172.21.15.84:0/1041336890 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faae00bfe70 0x7faae006c980 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:29.443 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.432+0000 7faae7186640 1 -- 172.21.15.84:0/1041336890 >> 172.21.15.84:0/1041336890 conn(0x7faae00bd160 msgr2=0x7faae00bd570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:39:29.443 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.432+0000 7faae7186640 1 -- 172.21.15.84:0/1041336890 shutdown_connections 2024-05-15T15:39:29.443 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.432+0000 7faae7186640 1 -- 172.21.15.84:0/1041336890 wait complete. 2024-05-15T15:39:29.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.434+0000 7faae7186640 1 Processor -- start 2024-05-15T15:39:29.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.434+0000 7faae7186640 1 -- start start 2024-05-15T15:39:29.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.435+0000 7faae7186640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faae00bb520 0x7faae0071030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:29.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.435+0000 7faae7186640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faae00bfe70 0x7faae014ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:29.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.435+0000 7faae7186640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7faae0152660 0x7faae01e7c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:29.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.435+0000 7faae7186640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7faae014f290 con 0x7faae00bfe70 2024-05-15T15:39:29.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.435+0000 7faae7186640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7faae014f110 con 0x7faae00bb520 2024-05-15T15:39:29.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.435+0000 7faae7186640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7faae014f410 con 0x7faae0152660 2024-05-15T15:39:29.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.435+0000 7faae4f22640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faae00bb520 0x7faae0071030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:29.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.435+0000 7faae4f22640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faae00bb520 0x7faae0071030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41752/0 (socket says 172.21.15.84:41752) 2024-05-15T15:39:29.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.435+0000 7faae4f22640 1 -- 172.21.15.84:0/2170513795 learned_addr learned my addr 172.21.15.84:0/2170513795 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-05-15T15:39:29.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.435+0000 7faae5723640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7faae0152660 0x7faae01e7c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:29.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.435+0000 7faadffff640 1 --2- 172.21.15.84:0/2170513795 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faae00bfe70 0x7faae014ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:29.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.435+0000 7faae4f22640 1 -- 172.21.15.84:0/2170513795 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7faae0152660 msgr2=0x7faae01e7c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:29.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.435+0000 7faae4f22640 1 --2- 172.21.15.84:0/2170513795 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7faae0152660 0x7faae01e7c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:29.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.435+0000 7faae4f22640 1 -- 172.21.15.84:0/2170513795 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faae00bfe70 msgr2=0x7faae014ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:29.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.435+0000 7faae4f22640 1 --2- 172.21.15.84:0/2170513795 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faae00bfe70 0x7faae014ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:29.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.435+0000 7faae4f22640 1 -- 172.21.15.84:0/2170513795 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faae014d410 con 0x7faae00bb520 2024-05-15T15:39:29.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.435+0000 7faae5723640 1 --2- 172.21.15.84:0/2170513795 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7faae0152660 0x7faae01e7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-15T15:39:29.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.436+0000 7faae4f22640 1 --2- 172.21.15.84:0/2170513795 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faae00bb520 0x7faae0071030 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7faad4000c00 tx=0x7faad40046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:39:29.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.436+0000 7faadd7fa640 1 -- 172.21.15.84:0/2170513795 <== mon.1 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faad4037040 con 0x7faae00bb520 2024-05-15T15:39:29.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.436+0000 7faadd7fa640 1 -- 172.21.15.84:0/2170513795 <== mon.1 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faad4042070 con 0x7faae00bb520 2024-05-15T15:39:29.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.436+0000 7faadd7fa640 1 -- 172.21.15.84:0/2170513795 <== mon.1 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faad4030940 con 0x7faae00bb520 2024-05-15T15:39:29.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.436+0000 7faae7186640 1 -- 172.21.15.84:0/2170513795 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faae01e8170 con 0x7faae00bb520 2024-05-15T15:39:29.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.436+0000 7faae7186640 1 -- 172.21.15.84:0/2170513795 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faae01e4a10 con 0x7faae00bb520 2024-05-15T15:39:29.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.436+0000 7faadd7fa640 1 -- 172.21.15.84:0/2170513795 <== mon.1 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7faad4030ae0 con 0x7faae00bb520 2024-05-15T15:39:29.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.436+0000 7faadd7fa640 1 -- 172.21.15.84:0/2170513795 <== mon.1 v2:172.21.15.84:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7faad4047d00 con 0x7faae00bb520 2024-05-15T15:39:29.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.437+0000 7faae7186640 1 -- 172.21.15.84:0/2170513795 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faae00bc650 con 0x7faae00bb520 2024-05-15T15:39:29.446 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.439+0000 7faadd7fa640 1 -- 172.21.15.84:0/2170513795 <== mon.1 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7faae00bc650 con 0x7faae00bb520 2024-05-15T15:39:29.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.511+0000 7faae7186640 1 -- 172.21.15.84:0/2170513795 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd new", "uuid": "b204c6ad-f431-40a5-ba27-9844294f0ece", "id": 2} v 0) -- 0x7faae0069b50 con 0x7faae00bb520 2024-05-15T15:39:29.519 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.516+0000 7faadd7fa640 1 -- 172.21.15.84:0/2170513795 <== mon.1 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b204c6ad-f431-40a5-ba27-9844294f0ece", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7faad4047460 con 0x7faae00bb520 2024-05-15T15:39:29.519 INFO:teuthology.orchestra.run.smithi084.stdout:2 2024-05-15T15:39:29.520 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.517+0000 7faae7186640 1 -- 172.21.15.84:0/2170513795 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faae00bb520 msgr2=0x7faae0071030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:29.520 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.517+0000 7faae7186640 1 --2- 172.21.15.84:0/2170513795 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faae00bb520 0x7faae0071030 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7faad4000c00 tx=0x7faad40046c0 comp rx=0 tx=0).stop 2024-05-15T15:39:29.520 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.517+0000 7faae7186640 1 -- 172.21.15.84:0/2170513795 shutdown_connections 2024-05-15T15:39:29.520 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.517+0000 7faae7186640 1 --2- 172.21.15.84:0/2170513795 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7faae0152660 0x7faae01e7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:29.520 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.517+0000 7faae7186640 1 --2- 172.21.15.84:0/2170513795 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faae00bfe70 0x7faae014ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:29.520 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.517+0000 7faae7186640 1 --2- 172.21.15.84:0/2170513795 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faae00bb520 0x7faae0071030 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:29.521 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.517+0000 7faae7186640 1 -- 172.21.15.84:0/2170513795 >> 172.21.15.84:0/2170513795 conn(0x7faae00bd160 msgr2=0x7faae0073b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:39:29.521 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.517+0000 7faae7186640 1 -- 172.21.15.84:0/2170513795 shutdown_connections 2024-05-15T15:39:29.521 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.517+0000 7faae7186640 1 -- 172.21.15.84:0/2170513795 wait complete. 2024-05-15T15:39:29.531 DEBUG:teuthology.orchestra.run.smithi084:> sudo ceph --cluster ceph osd new 660a9ccb-2ee5-42d8-8481-0835047a8260 3 2024-05-15T15:39:29.640 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.637+0000 7f6530cf9640 1 Processor -- start 2024-05-15T15:39:29.640 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.637+0000 7f6530cf9640 1 -- start start 2024-05-15T15:39:29.641 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.638+0000 7f6530cf9640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f652c1486c0 0x7f652c073ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:29.641 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.638+0000 7f6530cf9640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f652c06de00 con 0x7f652c14e7a0 2024-05-15T15:39:29.641 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.638+0000 7f6530cf9640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f652c14e2c0 con 0x7f652c072940 2024-05-15T15:39:29.642 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.638+0000 7f6530cf9640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f652c0bbe10 con 0x7f652c1486c0 2024-05-15T15:39:29.642 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.638+0000 7f652a59c640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f652c072940 0x7f652c06d6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:34924/0 (socket says 172.21.15.84:34924) 2024-05-15T15:39:29.642 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.638+0000 7f652a59c640 1 -- 172.21.15.84:0/1090951112 learned_addr learned my addr 172.21.15.84:0/1090951112 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-05-15T15:39:29.642 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.638+0000 7f6523fff640 1 --2- 172.21.15.84:0/1090951112 >> v2:172.21.15.12:3300/0 conn(0x7f652c1486c0 0x7f652c073ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:29.642 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.639+0000 7f6529d9b640 1 -- 172.21.15.84:0/1090951112 <== mon.1 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3619719517 0 0) 0x7f652c14e2c0 con 0x7f652c072940 2024-05-15T15:39:29.642 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.639+0000 7f6529d9b640 1 -- 172.21.15.84:0/1090951112 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6518003520 con 0x7f652c072940 2024-05-15T15:39:29.642 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.639+0000 7f6523fff640 1 -- 172.21.15.84:0/1090951112 >> v1:172.21.15.84:6789/0 conn(0x7f652c072940 legacy=0x7f652c06d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:29.642 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.639+0000 7f6523fff640 1 -- 172.21.15.84:0/1090951112 >> v1:172.21.15.12:6789/0 conn(0x7f652c14e7a0 legacy=0x7f652c14ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:29.642 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.639+0000 7f6523fff640 1 -- 172.21.15.84:0/1090951112 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f652c0bc0f0 con 0x7f652c1486c0 2024-05-15T15:39:29.643 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.640+0000 7f6523fff640 1 --2- 172.21.15.84:0/1090951112 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f652c1486c0 0x7f652c073ad0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f65140097a0 tx=0x7f651402a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a62a77bdc3aa3a0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:39:29.644 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.640+0000 7f6529d9b640 1 -- 172.21.15.84:0/1090951112 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6514037070 con 0x7f652c1486c0 2024-05-15T15:39:29.644 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.640+0000 7f6529d9b640 1 -- 172.21.15.84:0/1090951112 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6514032640 con 0x7f652c1486c0 2024-05-15T15:39:29.644 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.640+0000 7f6529d9b640 1 -- 172.21.15.84:0/1090951112 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6514032a10 con 0x7f652c1486c0 2024-05-15T15:39:29.644 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.641+0000 7f6530cf9640 1 -- 172.21.15.84:0/1090951112 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f652c1486c0 msgr2=0x7f652c073ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:29.644 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.641+0000 7f6530cf9640 1 --2- 172.21.15.84:0/1090951112 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f652c1486c0 0x7f652c073ad0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f65140097a0 tx=0x7f651402a2c0 comp rx=0 tx=0).stop 2024-05-15T15:39:29.644 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.641+0000 7f6530cf9640 1 -- 172.21.15.84:0/1090951112 shutdown_connections 2024-05-15T15:39:29.644 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.641+0000 7f6530cf9640 1 --2- 172.21.15.84:0/1090951112 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f652c1486c0 0x7f652c073ad0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:29.644 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.641+0000 7f6530cf9640 1 -- 172.21.15.84:0/1090951112 >> 172.21.15.84:0/1090951112 conn(0x7f652c06f390 msgr2=0x7f652c06f7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:39:29.644 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.641+0000 7f6530cf9640 1 -- 172.21.15.84:0/1090951112 shutdown_connections 2024-05-15T15:39:29.644 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.641+0000 7f6530cf9640 1 -- 172.21.15.84:0/1090951112 wait complete. 2024-05-15T15:39:29.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.642+0000 7f6530cf9640 1 Processor -- start 2024-05-15T15:39:29.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.642+0000 7f6530cf9640 1 -- start start 2024-05-15T15:39:29.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.643+0000 7f6530cf9640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f652c072940 0x7f652c0a2610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:29.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.643+0000 7f6530cf9640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f652c1486c0 0x7f652c1e7db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:29.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.643+0000 7f6530cf9640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f652c14e7a0 0x7f652c137e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:29.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.643+0000 7f6530cf9640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f652c159c30 con 0x7f652c14e7a0 2024-05-15T15:39:29.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.643+0000 7f6530cf9640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f652c0bc6b0 con 0x7f652c1486c0 2024-05-15T15:39:29.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.643+0000 7f6530cf9640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f652c159db0 con 0x7f652c072940 2024-05-15T15:39:29.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.643+0000 7f6523fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f652c1486c0 0x7f652c1e7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:29.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.643+0000 7f652a59c640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f652c072940 0x7f652c0a2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:29.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.643+0000 7f652a59c640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f652c072940 0x7f652c0a2610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3301/0 says I am v2:172.21.15.84:44644/0 (socket says 172.21.15.84:44644) 2024-05-15T15:39:29.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.643+0000 7f652a59c640 1 -- 172.21.15.84:0/317204710 learned_addr learned my addr 172.21.15.84:0/317204710 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-05-15T15:39:29.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.643+0000 7f652ad9d640 1 --2- 172.21.15.84:0/317204710 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f652c14e7a0 0x7f652c137e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:29.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.644+0000 7f652a59c640 1 -- 172.21.15.84:0/317204710 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f652c1486c0 msgr2=0x7f652c1e7db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:29.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.644+0000 7f652a59c640 1 --2- 172.21.15.84:0/317204710 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f652c1486c0 0x7f652c1e7db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:29.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.644+0000 7f652a59c640 1 -- 172.21.15.84:0/317204710 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f652c14e7a0 msgr2=0x7f652c137e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:29.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.644+0000 7f652a59c640 1 --2- 172.21.15.84:0/317204710 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f652c14e7a0 0x7f652c137e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:29.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.644+0000 7f652a59c640 1 -- 172.21.15.84:0/317204710 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f652c139f10 con 0x7f652c072940 2024-05-15T15:39:29.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.644+0000 7f6523fff640 1 --2- 172.21.15.84:0/317204710 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f652c1486c0 0x7f652c1e7db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-15T15:39:29.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.644+0000 7f652a59c640 1 --2- 172.21.15.84:0/317204710 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f652c072940 0x7f652c0a2610 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f651c00c430 tx=0x7f651c00c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:39:29.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.644+0000 7f6522ffd640 1 -- 172.21.15.84:0/317204710 <== mon.2 v2:172.21.15.84:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f651c017070 con 0x7f652c072940 2024-05-15T15:39:29.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.644+0000 7f6522ffd640 1 -- 172.21.15.84:0/317204710 <== mon.2 v2:172.21.15.84:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f651c005d00 con 0x7f652c072940 2024-05-15T15:39:29.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.644+0000 7f6530cf9640 1 -- 172.21.15.84:0/317204710 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f652c0a2b50 con 0x7f652c072940 2024-05-15T15:39:29.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.644+0000 7f6522ffd640 1 -- 172.21.15.84:0/317204710 <== mon.2 v2:172.21.15.84:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f651c007310 con 0x7f652c072940 2024-05-15T15:39:29.649 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.644+0000 7f6530cf9640 1 -- 172.21.15.84:0/317204710 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f652c13a180 con 0x7f652c072940 2024-05-15T15:39:29.649 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.644+0000 7f6522ffd640 1 -- 172.21.15.84:0/317204710 <== mon.2 v2:172.21.15.84:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f651c01a070 con 0x7f652c072940 2024-05-15T15:39:29.649 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.644+0000 7f6522ffd640 1 -- 172.21.15.84:0/317204710 <== mon.2 v2:172.21.15.84:3301/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f651c012890 con 0x7f652c072940 2024-05-15T15:39:29.649 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.645+0000 7f6530cf9640 1 -- 172.21.15.84:0/317204710 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f652c069b50 con 0x7f652c072940 2024-05-15T15:39:29.649 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.647+0000 7f6522ffd640 1 -- 172.21.15.84:0/317204710 <== mon.2 v2:172.21.15.84:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f651c021070 con 0x7f652c072940 2024-05-15T15:39:29.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.720+0000 7f6530cf9640 1 -- 172.21.15.84:0/317204710 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_command({"prefix": "osd new", "uuid": "660a9ccb-2ee5-42d8-8481-0835047a8260", "id": 3} v 0) -- 0x7f652c13dd30 con 0x7f652c072940 2024-05-15T15:39:29.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.726+0000 7f6522ffd640 1 -- 172.21.15.84:0/317204710 <== mon.2 v2:172.21.15.84:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "660a9ccb-2ee5-42d8-8481-0835047a8260", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f651c012400 con 0x7f652c072940 2024-05-15T15:39:29.729 INFO:teuthology.orchestra.run.smithi084.stdout:3 2024-05-15T15:39:29.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.727+0000 7f6530cf9640 1 -- 172.21.15.84:0/317204710 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f652c072940 msgr2=0x7f652c0a2610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:29.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.727+0000 7f6530cf9640 1 --2- 172.21.15.84:0/317204710 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f652c072940 0x7f652c0a2610 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f651c00c430 tx=0x7f651c00c8f0 comp rx=0 tx=0).stop 2024-05-15T15:39:29.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.727+0000 7f6530cf9640 1 -- 172.21.15.84:0/317204710 shutdown_connections 2024-05-15T15:39:29.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.727+0000 7f6530cf9640 1 --2- 172.21.15.84:0/317204710 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f652c14e7a0 0x7f652c137e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:29.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.727+0000 7f6530cf9640 1 --2- 172.21.15.84:0/317204710 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f652c1486c0 0x7f652c1e7db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:29.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.727+0000 7f6530cf9640 1 --2- 172.21.15.84:0/317204710 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f652c072940 0x7f652c0a2610 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:29.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.727+0000 7f6530cf9640 1 -- 172.21.15.84:0/317204710 >> 172.21.15.84:0/317204710 conn(0x7f652c06f390 msgr2=0x7f652c0bafd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:39:29.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.727+0000 7f6530cf9640 1 -- 172.21.15.84:0/317204710 shutdown_connections 2024-05-15T15:39:29.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.727+0000 7f6530cf9640 1 -- 172.21.15.84:0/317204710 wait complete. 2024-05-15T15:39:29.740 DEBUG:teuthology.orchestra.run.smithi084:> sudo ceph --cluster ceph osd new 9eef1461-a961-457c-9a78-43b5098a46a0 4 2024-05-15T15:39:29.771 INFO:tasks.ceph.mgr.x.smithi084.stderr:2024-05-15T15:39:29.769+0000 7f1aa1e37040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-15T15:39:29.783 INFO:tasks.ceph.mgr.y.smithi012.stderr:2024-05-15T15:39:29.782+0000 7f40e3a62040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-15T15:39:29.846 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.843+0000 7ff233372640 1 Processor -- start 2024-05-15T15:39:29.846 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.843+0000 7ff233372640 1 -- start start 2024-05-15T15:39:29.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.845+0000 7ff233372640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff22c0c10a0 0x7ff22c14f770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:29.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.845+0000 7ff233372640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff22c146070 0x7ff22c146480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:29.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.845+0000 7ff233372640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff22c14c7e0 0x7ff22c14cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:29.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.845+0000 7ff233372640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7ff22c0a1200 con 0x7ff22c146070 2024-05-15T15:39:29.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.845+0000 7ff233372640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7ff22c14c350 con 0x7ff22c0c10a0 2024-05-15T15:39:29.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.845+0000 7ff233372640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7ff22c1469c0 con 0x7ff22c14c7e0 2024-05-15T15:39:29.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.845+0000 7ff23190f640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff22c14c7e0 0x7ff22c14cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:29.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.845+0000 7ff23110e640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff22c0c10a0 0x7ff22c14f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:29.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.845+0000 7ff23190f640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff22c14c7e0 0x7ff22c14cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3301/0 says I am v2:172.21.15.84:44654/0 (socket says 172.21.15.84:44654) 2024-05-15T15:39:29.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.845+0000 7ff23190f640 1 -- 172.21.15.84:0/3246944220 learned_addr learned my addr 172.21.15.84:0/3246944220 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-05-15T15:39:29.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.845+0000 7ff23090d640 1 --2- 172.21.15.84:0/3246944220 >> v2:172.21.15.12:3300/0 conn(0x7ff22c146070 0x7ff22c146480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:29.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.845+0000 7ff23190f640 1 -- 172.21.15.84:0/3246944220 >> v2:172.21.15.84:3300/0 conn(0x7ff22c0c10a0 msgr2=0x7ff22c14f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:39:29.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.845+0000 7ff23190f640 1 --2- 172.21.15.84:0/3246944220 >> v2:172.21.15.84:3300/0 conn(0x7ff22c0c10a0 0x7ff22c14f770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:29.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.845+0000 7ff23190f640 1 -- 172.21.15.84:0/3246944220 >> v2:172.21.15.12:3300/0 conn(0x7ff22c146070 msgr2=0x7ff22c146480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:39:29.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.845+0000 7ff23190f640 1 --2- 172.21.15.84:0/3246944220 >> v2:172.21.15.12:3300/0 conn(0x7ff22c146070 0x7ff22c146480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:29.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.845+0000 7ff23190f640 1 -- 172.21.15.84:0/3246944220 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff22c14ffe0 con 0x7ff22c14c7e0 2024-05-15T15:39:29.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.845+0000 7ff23110e640 1 --2- 172.21.15.84:0/3246944220 >> v2:172.21.15.84:3300/0 conn(0x7ff22c0c10a0 0x7ff22c14f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-15T15:39:29.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.846+0000 7ff23190f640 1 --2- 172.21.15.84:0/3246944220 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff22c14c7e0 0x7ff22c14cbf0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ff22c0a4670 tx=0x7ff22402a730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6c811d40ef4c6f55 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:39:29.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.846+0000 7ff21ffff640 1 -- 172.21.15.84:0/3246944220 <== mon.2 v2:172.21.15.84:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff224036070 con 0x7ff22c14c7e0 2024-05-15T15:39:29.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.846+0000 7ff21ffff640 1 -- 172.21.15.84:0/3246944220 <== mon.2 v2:172.21.15.84:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff224031600 con 0x7ff22c14c7e0 2024-05-15T15:39:29.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.846+0000 7ff21ffff640 1 -- 172.21.15.84:0/3246944220 <== mon.2 v2:172.21.15.84:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2240319d0 con 0x7ff22c14c7e0 2024-05-15T15:39:29.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.847+0000 7ff233372640 1 -- 172.21.15.84:0/3246944220 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff22c14c7e0 msgr2=0x7ff22c14cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:29.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.847+0000 7ff233372640 1 --2- 172.21.15.84:0/3246944220 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff22c14c7e0 0x7ff22c14cbf0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ff22c0a4670 tx=0x7ff22402a730 comp rx=0 tx=0).stop 2024-05-15T15:39:29.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.847+0000 7ff233372640 1 -- 172.21.15.84:0/3246944220 shutdown_connections 2024-05-15T15:39:29.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.847+0000 7ff233372640 1 --2- 172.21.15.84:0/3246944220 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff22c14c7e0 0x7ff22c14cbf0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:29.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.847+0000 7ff233372640 1 --2- 172.21.15.84:0/3246944220 >> v2:172.21.15.12:3300/0 conn(0x7ff22c146070 0x7ff22c146480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:29.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.847+0000 7ff233372640 1 --2- 172.21.15.84:0/3246944220 >> v2:172.21.15.84:3300/0 conn(0x7ff22c0c10a0 0x7ff22c14f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:29.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.847+0000 7ff233372640 1 -- 172.21.15.84:0/3246944220 >> 172.21.15.84:0/3246944220 conn(0x7ff22c0c1830 msgr2=0x7ff22c0c1c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:39:29.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.847+0000 7ff233372640 1 -- 172.21.15.84:0/3246944220 shutdown_connections 2024-05-15T15:39:29.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.847+0000 7ff233372640 1 -- 172.21.15.84:0/3246944220 wait complete. 2024-05-15T15:39:29.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.848+0000 7ff233372640 1 Processor -- start 2024-05-15T15:39:29.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.848+0000 7ff233372640 1 -- start start 2024-05-15T15:39:29.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.849+0000 7ff233372640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff22c0c10a0 0x7ff22c0bae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:29.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.849+0000 7ff233372640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff22c146070 0x7ff22c1e8130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:29.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.849+0000 7ff233372640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff22c14c7e0 0x7ff22c142af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:29.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.849+0000 7ff233372640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7ff22c0c14b0 con 0x7ff22c14c7e0 2024-05-15T15:39:29.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.849+0000 7ff233372640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ff22c1505a0 con 0x7ff22c0c10a0 2024-05-15T15:39:29.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.849+0000 7ff233372640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7ff22c14d130 con 0x7ff22c146070 2024-05-15T15:39:29.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.849+0000 7ff23090d640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff22c146070 0x7ff22c1e8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:29.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.849+0000 7ff23110e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff22c0c10a0 0x7ff22c0bae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:29.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.850+0000 7ff23090d640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff22c146070 0x7ff22c1e8130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3301/0 says I am v2:172.21.15.84:44658/0 (socket says 172.21.15.84:44658) 2024-05-15T15:39:29.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.850+0000 7ff23090d640 1 -- 172.21.15.84:0/3081933206 learned_addr learned my addr 172.21.15.84:0/3081933206 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-05-15T15:39:29.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.850+0000 7ff23190f640 1 --2- 172.21.15.84:0/3081933206 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff22c14c7e0 0x7ff22c142af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:29.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.850+0000 7ff23090d640 1 -- 172.21.15.84:0/3081933206 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff22c0c10a0 msgr2=0x7ff22c0bae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:29.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.850+0000 7ff23090d640 1 --2- 172.21.15.84:0/3081933206 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff22c0c10a0 0x7ff22c0bae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:29.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.850+0000 7ff23090d640 1 -- 172.21.15.84:0/3081933206 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff22c14c7e0 msgr2=0x7ff22c142af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:29.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.850+0000 7ff23090d640 1 --2- 172.21.15.84:0/3081933206 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff22c14c7e0 0x7ff22c142af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:29.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.850+0000 7ff23090d640 1 -- 172.21.15.84:0/3081933206 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff22c0bb380 con 0x7ff22c146070 2024-05-15T15:39:29.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.850+0000 7ff23090d640 1 --2- 172.21.15.84:0/3081933206 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff22c146070 0x7ff22c1e8130 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ff22800e870 tx=0x7ff22800ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:39:29.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.850+0000 7ff21dffb640 1 -- 172.21.15.84:0/3081933206 <== mon.2 v2:172.21.15.84:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff228017070 con 0x7ff22c146070 2024-05-15T15:39:29.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.850+0000 7ff21dffb640 1 -- 172.21.15.84:0/3081933206 <== mon.2 v2:172.21.15.84:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff22800c940 con 0x7ff22c146070 2024-05-15T15:39:29.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.850+0000 7ff233372640 1 -- 172.21.15.84:0/3081933206 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff22c148930 con 0x7ff22c146070 2024-05-15T15:39:29.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.850+0000 7ff21dffb640 1 -- 172.21.15.84:0/3081933206 <== mon.2 v2:172.21.15.84:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff22800cd10 con 0x7ff22c146070 2024-05-15T15:39:29.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.850+0000 7ff233372640 1 -- 172.21.15.84:0/3081933206 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff22c06f6b0 con 0x7ff22c146070 2024-05-15T15:39:29.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.851+0000 7ff21dffb640 1 -- 172.21.15.84:0/3081933206 <== mon.2 v2:172.21.15.84:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff22801a070 con 0x7ff22c146070 2024-05-15T15:39:29.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.851+0000 7ff21dffb640 1 -- 172.21.15.84:0/3081933206 <== mon.2 v2:172.21.15.84:3301/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7ff22801c960 con 0x7ff22c146070 2024-05-15T15:39:29.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.852+0000 7ff233372640 1 -- 172.21.15.84:0/3081933206 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff22c144210 con 0x7ff22c146070 2024-05-15T15:39:29.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.854+0000 7ff21dffb640 1 -- 172.21.15.84:0/3081933206 <== mon.2 v2:172.21.15.84:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7ff22c144210 con 0x7ff22c146070 2024-05-15T15:39:29.864 INFO:tasks.ceph.mgr.x.smithi084.stderr:2024-05-15T15:39:29.862+0000 7f1aa1e37040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-15T15:39:29.875 INFO:tasks.ceph.mgr.y.smithi012.stderr:2024-05-15T15:39:29.873+0000 7f40e3a62040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-15T15:39:29.908 INFO:tasks.ceph.mgr.x.smithi084.stderr:2024-05-15T15:39:29.905+0000 7f1aa1e37040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-15T15:39:29.919 INFO:tasks.ceph.mgr.y.smithi012.stderr:2024-05-15T15:39:29.917+0000 7f40e3a62040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-15T15:39:29.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.924+0000 7ff233372640 1 -- 172.21.15.84:0/3081933206 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_command({"prefix": "osd new", "uuid": "9eef1461-a961-457c-9a78-43b5098a46a0", "id": 4} v 0) -- 0x7ff22c149bf0 con 0x7ff22c146070 2024-05-15T15:39:29.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.930+0000 7ff21dffb640 1 -- 172.21.15.84:0/3081933206 <== mon.2 v2:172.21.15.84:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9eef1461-a961-457c-9a78-43b5098a46a0", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7ff22c148930 con 0x7ff22c146070 2024-05-15T15:39:29.933 INFO:teuthology.orchestra.run.smithi084.stdout:4 2024-05-15T15:39:29.934 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.931+0000 7ff233372640 1 -- 172.21.15.84:0/3081933206 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff22c146070 msgr2=0x7ff22c1e8130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:29.934 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.931+0000 7ff233372640 1 --2- 172.21.15.84:0/3081933206 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff22c146070 0x7ff22c1e8130 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ff22800e870 tx=0x7ff22800ed30 comp rx=0 tx=0).stop 2024-05-15T15:39:29.934 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.931+0000 7ff233372640 1 -- 172.21.15.84:0/3081933206 shutdown_connections 2024-05-15T15:39:29.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.931+0000 7ff233372640 1 --2- 172.21.15.84:0/3081933206 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff22c14c7e0 0x7ff22c142af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:29.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.931+0000 7ff233372640 1 --2- 172.21.15.84:0/3081933206 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff22c146070 0x7ff22c1e8130 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:29.936 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.931+0000 7ff233372640 1 --2- 172.21.15.84:0/3081933206 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff22c0c10a0 0x7ff22c0bae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:29.936 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.931+0000 7ff233372640 1 -- 172.21.15.84:0/3081933206 >> 172.21.15.84:0/3081933206 conn(0x7ff22c0c1830 msgr2=0x7ff22c143b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:39:29.936 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.931+0000 7ff233372640 1 -- 172.21.15.84:0/3081933206 shutdown_connections 2024-05-15T15:39:29.936 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:29.931+0000 7ff233372640 1 -- 172.21.15.84:0/3081933206 wait complete. 2024-05-15T15:39:29.944 DEBUG:teuthology.orchestra.run.smithi084:> sudo ceph --cluster ceph osd new 5f924e2f-6c71-4741-a727-d3710c438431 5 2024-05-15T15:39:30.080 INFO:tasks.ceph.mgr.x.smithi084.stderr:2024-05-15T15:39:30.078+0000 7f1aa1e37040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-15T15:39:30.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.088+0000 7f80468af640 1 Processor -- start 2024-05-15T15:39:30.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.088+0000 7f80468af640 1 -- start start 2024-05-15T15:39:30.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.089+0000 7f80468af640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f80400bf330 0x7f804006c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:30.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.089+0000 7f80468af640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8040073100 0x7f8040148200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:30.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.089+0000 7f80468af640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f804006ce00 con 0x7f8040073510 2024-05-15T15:39:30.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.089+0000 7f80468af640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f8040151860 con 0x7f8040073100 2024-05-15T15:39:30.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.089+0000 7f80468af640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f80400bf8a0 con 0x7f80400bf330 2024-05-15T15:39:30.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.089+0000 7f803ffff640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f80400bf330 0x7f804006c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:30.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.090+0000 7f803ffff640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f80400bf330 0x7f804006c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41790/0 (socket says 172.21.15.84:41790) 2024-05-15T15:39:30.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.090+0000 7f803ffff640 1 -- 172.21.15.84:0/101663201 learned_addr learned my addr 172.21.15.84:0/101663201 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-05-15T15:39:30.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.090+0000 7f803f7fe640 1 --2- 172.21.15.84:0/101663201 >> v2:172.21.15.12:3300/0 conn(0x7f8040073100 0x7f8040148200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:30.096 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.090+0000 7f803ffff640 1 -- 172.21.15.84:0/101663201 >> v2:172.21.15.12:3300/0 conn(0x7f8040073100 msgr2=0x7f8040148200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:39:30.096 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.090+0000 7f803ffff640 1 --2- 172.21.15.84:0/101663201 >> v2:172.21.15.12:3300/0 conn(0x7f8040073100 0x7f8040148200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:30.096 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.090+0000 7f803ffff640 1 -- 172.21.15.84:0/101663201 >> v1:172.21.15.84:6789/0 conn(0x7f8040073510 legacy=0x7f8040151cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:30.096 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.090+0000 7f803ffff640 1 -- 172.21.15.84:0/101663201 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80400bfb80 con 0x7f80400bf330 2024-05-15T15:39:30.096 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.090+0000 7f803ffff640 1 --2- 172.21.15.84:0/101663201 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80400bf330 0x7f804006c8c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f80400c0630 tx=0x7f803402a300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f2438ace1791542f server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:39:30.096 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.091+0000 7f803effd640 1 -- 172.21.15.84:0/101663201 <== mon.1 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8034037070 con 0x7f80400bf330 2024-05-15T15:39:30.097 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.091+0000 7f803effd640 1 -- 172.21.15.84:0/101663201 <== mon.1 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f803402ae50 con 0x7f80400bf330 2024-05-15T15:39:30.097 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.091+0000 7f803effd640 1 -- 172.21.15.84:0/101663201 <== mon.1 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8034032860 con 0x7f80400bf330 2024-05-15T15:39:30.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.091+0000 7f80468af640 1 -- 172.21.15.84:0/101663201 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80400bf330 msgr2=0x7f804006c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:30.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.091+0000 7f80468af640 1 --2- 172.21.15.84:0/101663201 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80400bf330 0x7f804006c8c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f80400c0630 tx=0x7f803402a300 comp rx=0 tx=0).stop 2024-05-15T15:39:30.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.091+0000 7f80468af640 1 -- 172.21.15.84:0/101663201 shutdown_connections 2024-05-15T15:39:30.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.091+0000 7f80468af640 1 --2- 172.21.15.84:0/101663201 >> v2:172.21.15.12:3300/0 conn(0x7f8040073100 0x7f8040148200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:30.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.091+0000 7f80468af640 1 --2- 172.21.15.84:0/101663201 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80400bf330 0x7f804006c8c0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:30.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.091+0000 7f80468af640 1 -- 172.21.15.84:0/101663201 >> 172.21.15.84:0/101663201 conn(0x7f80400bd1d0 msgr2=0x7f80400bd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:39:30.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.092+0000 7f80468af640 1 -- 172.21.15.84:0/101663201 shutdown_connections 2024-05-15T15:39:30.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.092+0000 7f80468af640 1 -- 172.21.15.84:0/101663201 wait complete. 2024-05-15T15:39:30.099 INFO:tasks.ceph.mgr.y.smithi012.stderr:2024-05-15T15:39:30.091+0000 7f40e3a62040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-15T15:39:30.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.093+0000 7f80468af640 1 Processor -- start 2024-05-15T15:39:30.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.093+0000 7f80468af640 1 -- start start 2024-05-15T15:39:30.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.094+0000 7f80468af640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8040073100 0x7f80401508c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:30.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.094+0000 7f80468af640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f80400bf330 0x7f804014d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:30.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.094+0000 7f80468af640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f80401e75a0 0x7f80401e79b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:30.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.094+0000 7f80468af640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f8040152580 con 0x7f80401e75a0 2024-05-15T15:39:30.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.094+0000 7f80468af640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f8040152400 con 0x7f8040073100 2024-05-15T15:39:30.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.094+0000 7f80468af640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f80401e4130 con 0x7f80400bf330 2024-05-15T15:39:30.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.094+0000 7f803ffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8040073100 0x7f80401508c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:30.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.094+0000 7f803ffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8040073100 0x7f80401508c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41796/0 (socket says 172.21.15.84:41796) 2024-05-15T15:39:30.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.094+0000 7f803f7fe640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f80400bf330 0x7f804014d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:30.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.094+0000 7f803ffff640 1 -- 172.21.15.84:0/2128968273 learned_addr learned my addr 172.21.15.84:0/2128968273 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-05-15T15:39:30.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.094+0000 7f8044e4c640 1 --2- 172.21.15.84:0/2128968273 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f80401e75a0 0x7f80401e79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:30.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.095+0000 7f803ffff640 1 -- 172.21.15.84:0/2128968273 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f80400bf330 msgr2=0x7f804014d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:30.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.095+0000 7f803ffff640 1 --2- 172.21.15.84:0/2128968273 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f80400bf330 0x7f804014d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:30.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.095+0000 7f803ffff640 1 -- 172.21.15.84:0/2128968273 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f80401e75a0 msgr2=0x7f80401e79b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:30.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.095+0000 7f803ffff640 1 --2- 172.21.15.84:0/2128968273 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f80401e75a0 0x7f80401e79b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:30.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.095+0000 7f803ffff640 1 -- 172.21.15.84:0/2128968273 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f804014eaf0 con 0x7f8040073100 2024-05-15T15:39:30.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.095+0000 7f8044e4c640 1 --2- 172.21.15.84:0/2128968273 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f80401e75a0 0x7f80401e79b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-15T15:39:30.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.095+0000 7f803f7fe640 1 --2- 172.21.15.84:0/2128968273 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f80400bf330 0x7f804014d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-15T15:39:30.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.095+0000 7f803ffff640 1 --2- 172.21.15.84:0/2128968273 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8040073100 0x7f80401508c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f803402a340 tx=0x7f80340046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:39:30.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.095+0000 7f803cff9640 1 -- 172.21.15.84:0/2128968273 <== mon.1 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8034041020 con 0x7f8040073100 2024-05-15T15:39:30.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.095+0000 7f803cff9640 1 -- 172.21.15.84:0/2128968273 <== mon.1 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f803403c890 con 0x7f8040073100 2024-05-15T15:39:30.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.095+0000 7f80468af640 1 -- 172.21.15.84:0/2128968273 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8040150e00 con 0x7f8040073100 2024-05-15T15:39:30.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.095+0000 7f803cff9640 1 -- 172.21.15.84:0/2128968273 <== mon.1 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8034037040 con 0x7f8040073100 2024-05-15T15:39:30.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.095+0000 7f80468af640 1 -- 172.21.15.84:0/2128968273 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80400bc8c0 con 0x7f8040073100 2024-05-15T15:39:30.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.095+0000 7f803cff9640 1 -- 172.21.15.84:0/2128968273 <== mon.1 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8034044020 con 0x7f8040073100 2024-05-15T15:39:30.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.095+0000 7f803cff9640 1 -- 172.21.15.84:0/2128968273 <== mon.1 v2:172.21.15.84:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f803403dc30 con 0x7f8040073100 2024-05-15T15:39:30.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.096+0000 7f80468af640 1 -- 172.21.15.84:0/2128968273 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8040069b50 con 0x7f8040073100 2024-05-15T15:39:30.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.100+0000 7f803cff9640 1 -- 172.21.15.84:0/2128968273 <== mon.1 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f803404b030 con 0x7f8040073100 2024-05-15T15:39:30.134 INFO:tasks.ceph.mgr.x.smithi084.stderr:2024-05-15T15:39:30.132+0000 7f1aa1e37040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-15T15:39:30.150 INFO:tasks.ceph.mgr.y.smithi012.stderr:2024-05-15T15:39:30.148+0000 7f40e3a62040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-15T15:39:30.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.171+0000 7f80468af640 1 -- 172.21.15.84:0/2128968273 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd new", "uuid": "5f924e2f-6c71-4741-a727-d3710c438431", "id": 5} v 0) -- 0x7f804006d060 con 0x7f8040073100 2024-05-15T15:39:30.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.176+0000 7f803cff9640 1 -- 172.21.15.84:0/2128968273 <== mon.1 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5f924e2f-6c71-4741-a727-d3710c438431", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f803403cc80 con 0x7f8040073100 2024-05-15T15:39:30.179 INFO:teuthology.orchestra.run.smithi084.stdout:5 2024-05-15T15:39:30.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.177+0000 7f80468af640 1 -- 172.21.15.84:0/2128968273 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8040073100 msgr2=0x7f80401508c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:30.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.177+0000 7f80468af640 1 --2- 172.21.15.84:0/2128968273 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8040073100 0x7f80401508c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f803402a340 tx=0x7f80340046c0 comp rx=0 tx=0).stop 2024-05-15T15:39:30.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.177+0000 7f80468af640 1 -- 172.21.15.84:0/2128968273 shutdown_connections 2024-05-15T15:39:30.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.177+0000 7f80468af640 1 --2- 172.21.15.84:0/2128968273 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f80401e75a0 0x7f80401e79b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:30.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.177+0000 7f80468af640 1 --2- 172.21.15.84:0/2128968273 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f80400bf330 0x7f804014d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:30.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.177+0000 7f80468af640 1 --2- 172.21.15.84:0/2128968273 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8040073100 0x7f80401508c0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:30.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.177+0000 7f80468af640 1 -- 172.21.15.84:0/2128968273 >> 172.21.15.84:0/2128968273 conn(0x7f80400bd1d0 msgr2=0x7f80400bd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:39:30.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.177+0000 7f80468af640 1 -- 172.21.15.84:0/2128968273 shutdown_connections 2024-05-15T15:39:30.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.177+0000 7f80468af640 1 -- 172.21.15.84:0/2128968273 wait complete. 2024-05-15T15:39:30.187 INFO:tasks.ceph.mgr.x.smithi084.stderr:2024-05-15T15:39:30.185+0000 7f1aa1e37040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-15T15:39:30.191 DEBUG:teuthology.orchestra.run.smithi084:> sudo ceph --cluster ceph osd new efae9975-8c16-4ad3-892f-71f3c59718d0 6 2024-05-15T15:39:30.206 INFO:tasks.ceph.mgr.y.smithi012.stderr:2024-05-15T15:39:30.204+0000 7f40e3a62040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-15T15:39:30.298 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.295+0000 7f5739015640 1 Processor -- start 2024-05-15T15:39:30.298 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.295+0000 7f5739015640 1 -- start start 2024-05-15T15:39:30.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.296+0000 7f5739015640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f57340bb060 0x7f573414e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:30.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.296+0000 7f5739015640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f57340bb470 0x7f573414ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:30.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.296+0000 7f5739015640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57340bc710 con 0x7f57341455f0 2024-05-15T15:39:30.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.296+0000 7f5739015640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f573414b590 con 0x7f57340bb470 2024-05-15T15:39:30.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.296+0000 7f5739015640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f573414f1c0 con 0x7f57340bb060 2024-05-15T15:39:30.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.296+0000 7f573259c640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f57340bb060 0x7f573414e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:30.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.296+0000 7f573359e640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f57340bb470 0x7f573414ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:30.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.296+0000 7f573259c640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f57340bb060 0x7f573414e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3301/0 says I am v2:172.21.15.84:44684/0 (socket says 172.21.15.84:44684) 2024-05-15T15:39:30.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.296+0000 7f573259c640 1 -- 172.21.15.84:0/3341586757 learned_addr learned my addr 172.21.15.84:0/3341586757 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-05-15T15:39:30.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.296+0000 7f573359e640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f57340bb470 0x7f573414ebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41800/0 (socket says 172.21.15.84:41800) 2024-05-15T15:39:30.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.296+0000 7f573259c640 1 -- 172.21.15.84:0/3341586757 >> v2:172.21.15.84:3300/0 conn(0x7f57340bb470 msgr2=0x7f573414ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:39:30.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.296+0000 7f573259c640 1 --2- 172.21.15.84:0/3341586757 >> v2:172.21.15.84:3300/0 conn(0x7f57340bb470 0x7f573414ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:30.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.296+0000 7f573259c640 1 -- 172.21.15.84:0/3341586757 >> v1:172.21.15.12:6789/0 conn(0x7f57341455f0 legacy=0x7f573414ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:30.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.296+0000 7f5731d9b640 1 -- 172.21.15.84:0/3341586757 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2472129751 0 0) 0x7f57340bc710 con 0x7f57341455f0 2024-05-15T15:39:30.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.297+0000 7f573259c640 1 -- 172.21.15.84:0/3341586757 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f573414b220 con 0x7f57340bb060 2024-05-15T15:39:30.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.297+0000 7f573359e640 1 --2- 172.21.15.84:0/3341586757 >> v2:172.21.15.84:3300/0 conn(0x7f57340bb470 0x7f573414ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-15T15:39:30.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.297+0000 7f573259c640 1 --2- 172.21.15.84:0/3341586757 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f57340bb060 0x7f573414e680 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5728009870 tx=0x7f572802c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b223f6a5659ec042 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:39:30.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.297+0000 7f5731d9b640 1 -- 172.21.15.84:0/3341586757 <== mon.2 v2:172.21.15.84:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5728038070 con 0x7f57340bb060 2024-05-15T15:39:30.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.297+0000 7f5731d9b640 1 -- 172.21.15.84:0/3341586757 <== mon.2 v2:172.21.15.84:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5728031710 con 0x7f57340bb060 2024-05-15T15:39:30.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.297+0000 7f5731d9b640 1 -- 172.21.15.84:0/3341586757 <== mon.2 v2:172.21.15.84:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5728031ae0 con 0x7f57340bb060 2024-05-15T15:39:30.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.298+0000 7f5739015640 1 -- 172.21.15.84:0/3341586757 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f57340bb060 msgr2=0x7f573414e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:30.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.298+0000 7f5739015640 1 --2- 172.21.15.84:0/3341586757 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f57340bb060 0x7f573414e680 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5728009870 tx=0x7f572802c510 comp rx=0 tx=0).stop 2024-05-15T15:39:30.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.298+0000 7f5739015640 1 -- 172.21.15.84:0/3341586757 shutdown_connections 2024-05-15T15:39:30.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.298+0000 7f5739015640 1 --2- 172.21.15.84:0/3341586757 >> v2:172.21.15.84:3300/0 conn(0x7f57340bb470 0x7f573414ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:30.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.298+0000 7f5739015640 1 --2- 172.21.15.84:0/3341586757 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f57340bb060 0x7f573414e680 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:30.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.298+0000 7f5739015640 1 -- 172.21.15.84:0/3341586757 >> 172.21.15.84:0/3341586757 conn(0x7f57340bd160 msgr2=0x7f57340bd570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:39:30.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.298+0000 7f5739015640 1 -- 172.21.15.84:0/3341586757 shutdown_connections 2024-05-15T15:39:30.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.298+0000 7f5739015640 1 -- 172.21.15.84:0/3341586757 wait complete. 2024-05-15T15:39:30.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.300+0000 7f5739015640 1 Processor -- start 2024-05-15T15:39:30.307 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.300+0000 7f5739015640 1 -- start start 2024-05-15T15:39:30.307 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.301+0000 7f5739015640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f57340bb060 0x7f5734149210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:30.307 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.301+0000 7f5739015640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f57340bb470 0x7f57341e3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:30.307 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.301+0000 7f5739015640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f57341455f0 0x7f5734148310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:30.307 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.301+0000 7f5739015640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f5734073120 con 0x7f57340bb470 2024-05-15T15:39:30.307 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.301+0000 7f5739015640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f573406c6e0 con 0x7f57340bb060 2024-05-15T15:39:30.307 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.301+0000 7f5739015640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f57341e4420 con 0x7f57341455f0 2024-05-15T15:39:30.307 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.301+0000 7f5732d9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f57340bb060 0x7f5734149210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:30.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.301+0000 7f573359e640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f57341455f0 0x7f5734148310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:30.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.301+0000 7f5732d9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f57340bb060 0x7f5734149210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41808/0 (socket says 172.21.15.84:41808) 2024-05-15T15:39:30.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.301+0000 7f5732d9d640 1 -- 172.21.15.84:0/1833913802 learned_addr learned my addr 172.21.15.84:0/1833913802 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-05-15T15:39:30.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.301+0000 7f573259c640 1 --2- 172.21.15.84:0/1833913802 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f57340bb470 0x7f57341e3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:30.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.301+0000 7f5732d9d640 1 -- 172.21.15.84:0/1833913802 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f57341455f0 msgr2=0x7f5734148310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:30.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.301+0000 7f5732d9d640 1 --2- 172.21.15.84:0/1833913802 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f57341455f0 0x7f5734148310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:30.309 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.301+0000 7f5732d9d640 1 -- 172.21.15.84:0/1833913802 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f57340bb470 msgr2=0x7f57341e3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:30.309 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.301+0000 7f5732d9d640 1 --2- 172.21.15.84:0/1833913802 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f57340bb470 0x7f57341e3ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:30.309 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.301+0000 7f5732d9d640 1 -- 172.21.15.84:0/1833913802 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f573414a050 con 0x7f57340bb060 2024-05-15T15:39:30.309 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.301+0000 7f573359e640 1 --2- 172.21.15.84:0/1833913802 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f57341455f0 0x7f5734148310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-15T15:39:30.309 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.302+0000 7f5732d9d640 1 --2- 172.21.15.84:0/1833913802 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f57340bb060 0x7f5734149210 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f572400c3a0 tx=0x7f572400c7a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:39:30.309 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.302+0000 7f571b7fe640 1 -- 172.21.15.84:0/1833913802 <== mon.1 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5724017070 con 0x7f57340bb060 2024-05-15T15:39:30.310 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.302+0000 7f571b7fe640 1 -- 172.21.15.84:0/1833913802 <== mon.1 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57240035f0 con 0x7f57340bb060 2024-05-15T15:39:30.310 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.302+0000 7f5739015640 1 -- 172.21.15.84:0/1833913802 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5734149a50 con 0x7f57340bb060 2024-05-15T15:39:30.310 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.302+0000 7f571b7fe640 1 -- 172.21.15.84:0/1833913802 <== mon.1 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57240039e0 con 0x7f57340bb060 2024-05-15T15:39:30.310 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.302+0000 7f5739015640 1 -- 172.21.15.84:0/1833913802 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5734146a20 con 0x7f57340bb060 2024-05-15T15:39:30.310 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.302+0000 7f571b7fe640 1 -- 172.21.15.84:0/1833913802 <== mon.1 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f572401a070 con 0x7f57340bb060 2024-05-15T15:39:30.310 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.302+0000 7f571b7fe640 1 -- 172.21.15.84:0/1833913802 <== mon.1 v2:172.21.15.84:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f5724003b80 con 0x7f57340bb060 2024-05-15T15:39:30.310 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.303+0000 7f5739015640 1 -- 172.21.15.84:0/1833913802 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5734074290 con 0x7f57340bb060 2024-05-15T15:39:30.311 INFO:tasks.ceph.mgr.x.smithi084.stderr:2024-05-15T15:39:30.307+0000 7f1aa1e37040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-15T15:39:30.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.307+0000 7f571b7fe640 1 -- 172.21.15.84:0/1833913802 <== mon.1 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f5734074290 con 0x7f57340bb060 2024-05-15T15:39:30.324 INFO:tasks.ceph.mgr.y.smithi012.stderr:2024-05-15T15:39:30.322+0000 7f40e3a62040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-15T15:39:30.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.377+0000 7f5739015640 1 -- 172.21.15.84:0/1833913802 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd new", "uuid": "efae9975-8c16-4ad3-892f-71f3c59718d0", "id": 6} v 0) -- 0x7f5734069b50 con 0x7f57340bb060 2024-05-15T15:39:30.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.384+0000 7f571b7fe640 1 -- 172.21.15.84:0/1833913802 <== mon.1 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "efae9975-8c16-4ad3-892f-71f3c59718d0", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f5724021020 con 0x7f57340bb060 2024-05-15T15:39:30.386 INFO:teuthology.orchestra.run.smithi084.stdout:6 2024-05-15T15:39:30.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.385+0000 7f5739015640 1 -- 172.21.15.84:0/1833913802 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f57340bb060 msgr2=0x7f5734149210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:30.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.385+0000 7f5739015640 1 --2- 172.21.15.84:0/1833913802 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f57340bb060 0x7f5734149210 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f572400c3a0 tx=0x7f572400c7a0 comp rx=0 tx=0).stop 2024-05-15T15:39:30.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.385+0000 7f5739015640 1 -- 172.21.15.84:0/1833913802 shutdown_connections 2024-05-15T15:39:30.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.385+0000 7f5739015640 1 --2- 172.21.15.84:0/1833913802 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f57341455f0 0x7f5734148310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:30.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.385+0000 7f5739015640 1 --2- 172.21.15.84:0/1833913802 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f57340bb470 0x7f57341e3ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:30.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.385+0000 7f5739015640 1 --2- 172.21.15.84:0/1833913802 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f57340bb060 0x7f5734149210 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:30.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.385+0000 7f5739015640 1 -- 172.21.15.84:0/1833913802 >> 172.21.15.84:0/1833913802 conn(0x7f57340bd160 msgr2=0x7f5734073b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:39:30.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.385+0000 7f5739015640 1 -- 172.21.15.84:0/1833913802 shutdown_connections 2024-05-15T15:39:30.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.385+0000 7f5739015640 1 -- 172.21.15.84:0/1833913802 wait complete. 2024-05-15T15:39:30.398 DEBUG:teuthology.orchestra.run.smithi084:> sudo ceph --cluster ceph osd new 6426efba-ee4d-4e44-83d1-c76c75aec30c 7 2024-05-15T15:39:30.506 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.503+0000 7ff68b03b640 1 Processor -- start 2024-05-15T15:39:30.506 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.503+0000 7ff68b03b640 1 -- start start 2024-05-15T15:39:30.507 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.504+0000 7ff68b03b640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff684145660 0x7ff68409fb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:30.507 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.504+0000 7ff68b03b640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff68414bd30 0x7ff684155a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:30.507 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.504+0000 7ff68b03b640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6840bf8d0 con 0x7ff68406f970 2024-05-15T15:39:30.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.504+0000 7ff68b03b640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7ff6840befa0 con 0x7ff684145660 2024-05-15T15:39:30.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.504+0000 7ff68b03b640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7ff6840bf280 con 0x7ff68414bd30 2024-05-15T15:39:30.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.504+0000 7ff688dd7640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff684145660 0x7ff68409fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:30.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.504+0000 7ff6895d8640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff68414bd30 0x7ff684155a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:30.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.504+0000 7ff688dd7640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff684145660 0x7ff68409fb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41812/0 (socket says 172.21.15.84:41812) 2024-05-15T15:39:30.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.504+0000 7ff6895d8640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff68414bd30 0x7ff684155a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3301/0 says I am v2:172.21.15.84:44706/0 (socket says 172.21.15.84:44706) 2024-05-15T15:39:30.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.504+0000 7ff688dd7640 1 -- 172.21.15.84:0/2033302408 learned_addr learned my addr 172.21.15.84:0/2033302408 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-05-15T15:39:30.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.505+0000 7ff688dd7640 1 -- 172.21.15.84:0/2033302408 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff68414bd30 msgr2=0x7ff684155a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:39:30.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.505+0000 7ff688dd7640 1 --2- 172.21.15.84:0/2033302408 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff68414bd30 0x7ff684155a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:30.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.505+0000 7ff688dd7640 1 -- 172.21.15.84:0/2033302408 >> v1:172.21.15.84:6789/0 conn(0x7ff68406f970 legacy=0x7ff68414b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:30.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.505+0000 7ff688dd7640 1 -- 172.21.15.84:0/2033302408 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6840bf560 con 0x7ff684145660 2024-05-15T15:39:30.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.505+0000 7ff6895d8640 1 --2- 172.21.15.84:0/2033302408 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff68414bd30 0x7ff684155a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-15T15:39:30.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.505+0000 7ff688dd7640 1 --2- 172.21.15.84:0/2033302408 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff684145660 0x7ff68409fb90 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ff67800bb10 tx=0x7ff67802c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1d2db50052d5f33a server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:39:30.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.506+0000 7ff6837fe640 1 -- 172.21.15.84:0/2033302408 <== mon.1 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff678036020 con 0x7ff684145660 2024-05-15T15:39:30.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.506+0000 7ff6837fe640 1 -- 172.21.15.84:0/2033302408 <== mon.1 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff678032820 con 0x7ff684145660 2024-05-15T15:39:30.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.506+0000 7ff6837fe640 1 -- 172.21.15.84:0/2033302408 <== mon.1 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff678032bf0 con 0x7ff684145660 2024-05-15T15:39:30.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.506+0000 7ff68b03b640 1 -- 172.21.15.84:0/2033302408 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff684145660 msgr2=0x7ff68409fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:30.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.506+0000 7ff68b03b640 1 --2- 172.21.15.84:0/2033302408 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff684145660 0x7ff68409fb90 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ff67800bb10 tx=0x7ff67802c920 comp rx=0 tx=0).stop 2024-05-15T15:39:30.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.507+0000 7ff68b03b640 1 -- 172.21.15.84:0/2033302408 shutdown_connections 2024-05-15T15:39:30.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.507+0000 7ff68b03b640 1 --2- 172.21.15.84:0/2033302408 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff68414bd30 0x7ff684155a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:30.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.507+0000 7ff68b03b640 1 --2- 172.21.15.84:0/2033302408 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff684145660 0x7ff68409fb90 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:30.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.507+0000 7ff68b03b640 1 -- 172.21.15.84:0/2033302408 >> 172.21.15.84:0/2033302408 conn(0x7ff6840bd1d0 msgr2=0x7ff6840bd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:39:30.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.507+0000 7ff68b03b640 1 -- 172.21.15.84:0/2033302408 shutdown_connections 2024-05-15T15:39:30.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.507+0000 7ff68b03b640 1 -- 172.21.15.84:0/2033302408 wait complete. 2024-05-15T15:39:30.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.508+0000 7ff68b03b640 1 Processor -- start 2024-05-15T15:39:30.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.508+0000 7ff68b03b640 1 -- start start 2024-05-15T15:39:30.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.509+0000 7ff68b03b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff68406f970 0x7ff684141f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:30.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.509+0000 7ff68b03b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff684145660 0x7ff684146840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:30.514 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.509+0000 7ff68b03b640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff68414bd30 0x7ff68413f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:30.514 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.509+0000 7ff68b03b640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7ff6840bed40 con 0x7ff684145660 2024-05-15T15:39:30.514 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.509+0000 7ff68b03b640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ff6840bebc0 con 0x7ff68406f970 2024-05-15T15:39:30.514 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.509+0000 7ff68b03b640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7ff68406fd80 con 0x7ff68414bd30 2024-05-15T15:39:30.514 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.510+0000 7ff688dd7640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff68406f970 0x7ff684141f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:30.514 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.510+0000 7ff688dd7640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff68406f970 0x7ff684141f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41816/0 (socket says 172.21.15.84:41816) 2024-05-15T15:39:30.514 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.510+0000 7ff688dd7640 1 -- 172.21.15.84:0/9235694 learned_addr learned my addr 172.21.15.84:0/9235694 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-05-15T15:39:30.514 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.510+0000 7ff6895d8640 1 --2- 172.21.15.84:0/9235694 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff68414bd30 0x7ff68413f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:30.514 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.510+0000 7ff683fff640 1 --2- 172.21.15.84:0/9235694 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff684145660 0x7ff684146840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:30.514 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.510+0000 7ff688dd7640 1 -- 172.21.15.84:0/9235694 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff68414bd30 msgr2=0x7ff68413f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:30.514 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.510+0000 7ff688dd7640 1 --2- 172.21.15.84:0/9235694 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff68414bd30 0x7ff68413f7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:30.514 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.510+0000 7ff688dd7640 1 -- 172.21.15.84:0/9235694 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff684145660 msgr2=0x7ff684146840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:30.515 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.510+0000 7ff688dd7640 1 --2- 172.21.15.84:0/9235694 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff684145660 0x7ff684146840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:30.515 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.510+0000 7ff688dd7640 1 -- 172.21.15.84:0/9235694 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff684147950 con 0x7ff68406f970 2024-05-15T15:39:30.515 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.510+0000 7ff6895d8640 1 --2- 172.21.15.84:0/9235694 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff68414bd30 0x7ff68413f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-15T15:39:30.515 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.510+0000 7ff688dd7640 1 --2- 172.21.15.84:0/9235694 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff68406f970 0x7ff684141f30 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7ff67800b2c0 tx=0x7ff6780046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:39:30.515 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.510+0000 7ff6817fa640 1 -- 172.21.15.84:0/9235694 <== mon.1 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff678036040 con 0x7ff68406f970 2024-05-15T15:39:30.515 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.510+0000 7ff6817fa640 1 -- 172.21.15.84:0/9235694 <== mon.1 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff67803bd60 con 0x7ff68406f970 2024-05-15T15:39:30.515 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.510+0000 7ff68b03b640 1 -- 172.21.15.84:0/9235694 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff684142470 con 0x7ff68406f970 2024-05-15T15:39:30.515 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.510+0000 7ff6817fa640 1 -- 172.21.15.84:0/9235694 <== mon.1 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff678045610 con 0x7ff68406f970 2024-05-15T15:39:30.515 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.510+0000 7ff68b03b640 1 -- 172.21.15.84:0/9235694 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff684146d80 con 0x7ff68406f970 2024-05-15T15:39:30.515 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.510+0000 7ff6817fa640 1 -- 172.21.15.84:0/9235694 <== mon.1 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff67804c060 con 0x7ff68406f970 2024-05-15T15:39:30.515 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.511+0000 7ff6817fa640 1 -- 172.21.15.84:0/9235694 <== mon.1 v2:172.21.15.84:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7ff678044a00 con 0x7ff68406f970 2024-05-15T15:39:30.515 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.511+0000 7ff68b03b640 1 -- 172.21.15.84:0/9235694 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff684069b50 con 0x7ff68406f970 2024-05-15T15:39:30.517 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.515+0000 7ff6817fa640 1 -- 172.21.15.84:0/9235694 <== mon.1 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7ff678040070 con 0x7ff68406f970 2024-05-15T15:39:30.591 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.588+0000 7ff68b03b640 1 -- 172.21.15.84:0/9235694 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd new", "uuid": "6426efba-ee4d-4e44-83d1-c76c75aec30c", "id": 7} v 0) -- 0x7ff6840be4d0 con 0x7ff68406f970 2024-05-15T15:39:30.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.595+0000 7ff6817fa640 1 -- 172.21.15.84:0/9235694 <== mon.1 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6426efba-ee4d-4e44-83d1-c76c75aec30c", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7ff67802f070 con 0x7ff68406f970 2024-05-15T15:39:30.597 INFO:teuthology.orchestra.run.smithi084.stdout:7 2024-05-15T15:39:30.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.596+0000 7ff68b03b640 1 -- 172.21.15.84:0/9235694 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff68406f970 msgr2=0x7ff684141f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:30.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.596+0000 7ff68b03b640 1 --2- 172.21.15.84:0/9235694 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff68406f970 0x7ff684141f30 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7ff67800b2c0 tx=0x7ff6780046c0 comp rx=0 tx=0).stop 2024-05-15T15:39:30.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.596+0000 7ff68b03b640 1 -- 172.21.15.84:0/9235694 shutdown_connections 2024-05-15T15:39:30.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.596+0000 7ff68b03b640 1 --2- 172.21.15.84:0/9235694 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff68414bd30 0x7ff68413f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:30.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.596+0000 7ff68b03b640 1 --2- 172.21.15.84:0/9235694 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff684145660 0x7ff684146840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:30.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.596+0000 7ff68b03b640 1 --2- 172.21.15.84:0/9235694 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff68406f970 0x7ff684141f30 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:30.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.596+0000 7ff68b03b640 1 -- 172.21.15.84:0/9235694 >> 172.21.15.84:0/9235694 conn(0x7ff6840bd1d0 msgr2=0x7ff684073f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:39:30.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.596+0000 7ff68b03b640 1 -- 172.21.15.84:0/9235694 shutdown_connections 2024-05-15T15:39:30.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-05-15T15:39:30.596+0000 7ff68b03b640 1 -- 172.21.15.84:0/9235694 wait complete. 2024-05-15T15:39:30.609 INFO:tasks.ceph.osd.0:Restarting daemon 2024-05-15T15:39:30.609 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-05-15T15:39:30.611 INFO:tasks.ceph.osd.0:Started 2024-05-15T15:39:30.612 INFO:tasks.ceph.osd.1:Restarting daemon 2024-05-15T15:39:30.612 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-05-15T15:39:30.614 INFO:tasks.ceph.osd.1:Started 2024-05-15T15:39:30.614 INFO:tasks.ceph.osd.2:Restarting daemon 2024-05-15T15:39:30.614 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-05-15T15:39:30.616 INFO:tasks.ceph.osd.2:Started 2024-05-15T15:39:30.616 INFO:tasks.ceph.osd.3:Restarting daemon 2024-05-15T15:39:30.616 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-05-15T15:39:30.618 INFO:tasks.ceph.osd.3:Started 2024-05-15T15:39:30.618 INFO:tasks.ceph.osd.4:Restarting daemon 2024-05-15T15:39:30.619 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-05-15T15:39:30.620 INFO:tasks.ceph.osd.4:Started 2024-05-15T15:39:30.621 INFO:tasks.ceph.osd.5:Restarting daemon 2024-05-15T15:39:30.621 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-05-15T15:39:30.623 INFO:tasks.ceph.osd.5:Started 2024-05-15T15:39:30.623 INFO:tasks.ceph.osd.6:Restarting daemon 2024-05-15T15:39:30.626 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-05-15T15:39:30.628 INFO:tasks.ceph.osd.6:Started 2024-05-15T15:39:30.628 INFO:tasks.ceph.osd.7:Restarting daemon 2024-05-15T15:39:30.628 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-05-15T15:39:30.630 INFO:tasks.ceph.osd.7:Started 2024-05-15T15:39:30.631 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-15T15:39:30.743 INFO:tasks.ceph.mgr.x.smithi084.stderr:2024-05-15T15:39:30.741+0000 7f1aa1e37040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-15T15:39:30.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:30.768+0000 7efc30e49640 1 Processor -- start 2024-05-15T15:39:30.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:30.768+0000 7efc30e49640 1 -- start start 2024-05-15T15:39:30.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:30.770+0000 7efc30e49640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7efc2c09fb90 0x7efc2c14b620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:30.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:30.770+0000 7efc30e49640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc2c0bf8d0 con 0x7efc2c145660 2024-05-15T15:39:30.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:30.770+0000 7efc30e49640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc2c070080 con 0x7efc2c14bb60 2024-05-15T15:39:30.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:30.770+0000 7efc30e49640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7efc2c0befa0 con 0x7efc2c09fb90 2024-05-15T15:39:30.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:30.770+0000 7efc2a59c640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7efc2c145660 0x7efc2c06f970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:52978/0 (socket says 172.21.15.12:52978) 2024-05-15T15:39:30.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:30.770+0000 7efc2a59c640 1 -- 172.21.15.12:0/3525590416 learned_addr learned my addr 172.21.15.12:0/3525590416 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-05-15T15:39:30.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:30.770+0000 7efc29d9b640 1 --2- 172.21.15.12:0/3525590416 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7efc2c09fb90 0x7efc2c14b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:30.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:30.770+0000 7efc2959a640 1 -- 172.21.15.12:0/3525590416 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1257148052 0 0) 0x7efc1c001110 con 0x7efc2c145660 2024-05-15T15:39:30.773 INFO:tasks.ceph.mgr.y.smithi012.stderr:2024-05-15T15:39:30.770+0000 7f40e3a62040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-15T15:39:30.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:30.770+0000 7efc2959a640 1 -- 172.21.15.12:0/3525590416 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efc18003520 con 0x7efc2c145660 2024-05-15T15:39:30.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:30.770+0000 7efc2959a640 1 -- 172.21.15.12:0/3525590416 <== mon.1 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2992535627 0 0) 0x7efc24001490 con 0x7efc2c14bb60 2024-05-15T15:39:30.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:30.770+0000 7efc2959a640 1 -- 172.21.15.12:0/3525590416 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efc1c001110 con 0x7efc2c14bb60 2024-05-15T15:39:30.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:30.771+0000 7efc29d9b640 1 -- 172.21.15.12:0/3525590416 >> v1:172.21.15.84:6789/0 conn(0x7efc2c14bb60 legacy=0x7efc2c155a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:30.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:30.771+0000 7efc29d9b640 1 -- 172.21.15.12:0/3525590416 >> v1:172.21.15.12:6789/0 conn(0x7efc2c145660 legacy=0x7efc2c06f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:30.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:30.771+0000 7efc2959a640 1 -- 172.21.15.12:0/3525590416 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1362141948 0 0) 0x7efc18003520 con 0x7efc2c145660 2024-05-15T15:39:30.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:30.771+0000 7efc29d9b640 1 -- 172.21.15.12:0/3525590416 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc2c0bf280 con 0x7efc2c09fb90 2024-05-15T15:39:30.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:30.771+0000 7efc29d9b640 1 --2- 172.21.15.12:0/3525590416 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7efc2c09fb90 0x7efc2c14b620 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7efc140097d0 tx=0x7efc1402a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f4fb99b590661c64 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:39:30.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:30.772+0000 7efc2959a640 1 -- 172.21.15.12:0/3525590416 <== mon.2 v2:172.21.15.84:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc14037070 con 0x7efc2c09fb90 2024-05-15T15:39:30.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:30.772+0000 7efc2959a640 1 -- 172.21.15.12:0/3525590416 <== mon.2 v2:172.21.15.84:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc1402ac30 con 0x7efc2c09fb90 2024-05-15T15:39:30.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:30.772+0000 7efc2959a640 1 -- 172.21.15.12:0/3525590416 <== mon.2 v2:172.21.15.84:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc1c0018c0 con 0x7efc2c09fb90 2024-05-15T15:39:30.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:30.772+0000 7efc30e49640 1 -- 172.21.15.12:0/3525590416 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7efc2c09fb90 msgr2=0x7efc2c14b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:30.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:30.772+0000 7efc30e49640 1 --2- 172.21.15.12:0/3525590416 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7efc2c09fb90 0x7efc2c14b620 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7efc140097d0 tx=0x7efc1402a1a0 comp rx=0 tx=0).stop 2024-05-15T15:39:30.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:30.773+0000 7efc30e49640 1 -- 172.21.15.12:0/3525590416 shutdown_connections 2024-05-15T15:39:30.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:30.773+0000 7efc30e49640 1 --2- 172.21.15.12:0/3525590416 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7efc2c09fb90 0x7efc2c14b620 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:30.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:30.773+0000 7efc30e49640 1 -- 172.21.15.12:0/3525590416 >> 172.21.15.12:0/3525590416 conn(0x7efc2c0bd1d0 msgr2=0x7efc2c0bd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:39:30.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:30.773+0000 7efc30e49640 1 -- 172.21.15.12:0/3525590416 shutdown_connections 2024-05-15T15:39:30.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:30.773+0000 7efc30e49640 1 -- 172.21.15.12:0/3525590416 wait complete. 2024-05-15T15:39:30.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:30.775+0000 7efc30e49640 1 Processor -- start 2024-05-15T15:39:30.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:30.775+0000 7efc30e49640 1 -- start start 2024-05-15T15:39:30.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:30.776+0000 7efc30e49640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efc2c09fb90 0x7efc2c13c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:30.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:30.776+0000 7efc30e49640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7efc2c145660 0x7efc2c1e31d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:30.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:30.776+0000 7efc30e49640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc2c14bb60 0x7efc2c1e5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:30.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:30.776+0000 7efc30e49640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7efc2c09ffa0 con 0x7efc2c14bb60 2024-05-15T15:39:30.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:30.776+0000 7efc30e49640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7efc2c14bf70 con 0x7efc2c09fb90 2024-05-15T15:39:30.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:30.776+0000 7efc30e49640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7efc2c0be6f0 con 0x7efc2c145660 2024-05-15T15:39:30.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:30.776+0000 7efc2ad9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc2c14bb60 0x7efc2c1e5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:30.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:30.776+0000 7efc2ad9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc2c14bb60 0x7efc2c1e5dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44048/0 (socket says 172.21.15.12:44048) 2024-05-15T15:39:30.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:30.776+0000 7efc2ad9d640 1 -- 172.21.15.12:0/2887337385 learned_addr learned my addr 172.21.15.12:0/2887337385 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:39:30.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:30.776+0000 7efc2a59c640 1 --2- 172.21.15.12:0/2887337385 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efc2c09fb90 0x7efc2c13c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:30.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:30.776+0000 7efc29d9b640 1 --2- 172.21.15.12:0/2887337385 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7efc2c145660 0x7efc2c1e31d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:30.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:30.776+0000 7efc2ad9d640 1 -- 172.21.15.12:0/2887337385 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7efc2c145660 msgr2=0x7efc2c1e31d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:30.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:30.776+0000 7efc2ad9d640 1 --2- 172.21.15.12:0/2887337385 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7efc2c145660 0x7efc2c1e31d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:30.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:30.776+0000 7efc2ad9d640 1 -- 172.21.15.12:0/2887337385 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efc2c09fb90 msgr2=0x7efc2c13c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:30.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:30.776+0000 7efc2ad9d640 1 --2- 172.21.15.12:0/2887337385 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efc2c09fb90 0x7efc2c13c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:30.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:30.776+0000 7efc2ad9d640 1 -- 172.21.15.12:0/2887337385 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc2c14b0c0 con 0x7efc2c14bb60 2024-05-15T15:39:30.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:30.777+0000 7efc2ad9d640 1 --2- 172.21.15.12:0/2887337385 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc2c14bb60 0x7efc2c1e5dc0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7efc2400c6b0 tx=0x7efc2400cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:39:30.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:30.777+0000 7efc22ffd640 1 -- 172.21.15.12:0/2887337385 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc24003b70 con 0x7efc2c14bb60 2024-05-15T15:39:30.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:30.777+0000 7efc22ffd640 1 -- 172.21.15.12:0/2887337385 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc24003d30 con 0x7efc2c14bb60 2024-05-15T15:39:30.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:30.777+0000 7efc22ffd640 1 -- 172.21.15.12:0/2887337385 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc24005310 con 0x7efc2c14bb60 2024-05-15T15:39:30.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:30.777+0000 7efc30e49640 1 -- 172.21.15.12:0/2887337385 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc2c13cc10 con 0x7efc2c14bb60 2024-05-15T15:39:30.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:30.777+0000 7efc30e49640 1 -- 172.21.15.12:0/2887337385 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc2c14ab00 con 0x7efc2c14bb60 2024-05-15T15:39:30.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:30.777+0000 7efc22ffd640 1 -- 172.21.15.12:0/2887337385 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7efc240054b0 con 0x7efc2c14bb60 2024-05-15T15:39:30.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:30.777+0000 7efc22ffd640 1 -- 172.21.15.12:0/2887337385 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7efc240057a0 con 0x7efc2c14bb60 2024-05-15T15:39:30.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:30.778+0000 7efc30e49640 1 -- 172.21.15.12:0/2887337385 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc2c14a910 con 0x7efc2c14bb60 2024-05-15T15:39:30.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:30.780+0000 7efc22ffd640 1 -- 172.21.15.12:0/2887337385 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7efc2c070080 con 0x7efc2c14bb60 2024-05-15T15:39:30.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:30.842+0000 7efc30e49640 1 -- 172.21.15.12:0/2887337385 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efc2c0be4d0 con 0x7efc2c14bb60 2024-05-15T15:39:30.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:30.843+0000 7efc22ffd640 1 -- 172.21.15.12:0/2887337385 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7efc2400a640 con 0x7efc2c14bb60 2024-05-15T15:39:30.846 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-05-15T15:39:30.846 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":10,"fsid":"3b7fc4b2-b85c-49b5-a5de-38444eeed40d","created":"2024-05-15T15:39:28.392476+0000","modified":"2024-05-15T15:39:30.591216+0000","last_up_change":"0.000000","last_in_change":"2024-05-15T15:39:30.591216+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"0d06a12a-866a-418e-9776-704d74354579","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"09d0fa19-9ef8-4f35-bf99-6e86658c6f10","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"b204c6ad-f431-40a5-ba27-9844294f0ece","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"660a9ccb-2ee5-42d8-8481-0835047a8260","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"9eef1461-a961-457c-9a78-43b5098a46a0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"5f924e2f-6c71-4741-a727-d3710c438431","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"efae9975-8c16-4ad3-892f-71f3c59718d0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"6426efba-ee4d-4e44-83d1-c76c75aec30c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-15T15:39:30.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:30.844+0000 7efc30e49640 1 -- 172.21.15.12:0/2887337385 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc2c14bb60 msgr2=0x7efc2c1e5dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:30.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:30.844+0000 7efc30e49640 1 --2- 172.21.15.12:0/2887337385 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc2c14bb60 0x7efc2c1e5dc0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7efc2400c6b0 tx=0x7efc2400cb70 comp rx=0 tx=0).stop 2024-05-15T15:39:30.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:30.844+0000 7efc30e49640 1 -- 172.21.15.12:0/2887337385 shutdown_connections 2024-05-15T15:39:30.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:30.844+0000 7efc30e49640 1 --2- 172.21.15.12:0/2887337385 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc2c14bb60 0x7efc2c1e5dc0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:30.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:30.844+0000 7efc30e49640 1 --2- 172.21.15.12:0/2887337385 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7efc2c145660 0x7efc2c1e31d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:30.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:30.844+0000 7efc30e49640 1 --2- 172.21.15.12:0/2887337385 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efc2c09fb90 0x7efc2c13c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:30.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:30.844+0000 7efc30e49640 1 -- 172.21.15.12:0/2887337385 >> 172.21.15.12:0/2887337385 conn(0x7efc2c0bd1d0 msgr2=0x7efc2c06f970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:39:30.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:30.844+0000 7efc30e49640 1 -- 172.21.15.12:0/2887337385 shutdown_connections 2024-05-15T15:39:30.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:30.844+0000 7efc30e49640 1 -- 172.21.15.12:0/2887337385 wait complete. 2024-05-15T15:39:30.857 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-05-15T15:39:30.857 INFO:tasks.ceph:Waiting for OSDs to come up 2024-05-15T15:39:30.882 INFO:tasks.ceph.mgr.x.smithi084.stderr:2024-05-15T15:39:30.880+0000 7f1aa1e37040 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-15T15:39:30.919 INFO:tasks.ceph.mgr.y.smithi012.stderr:2024-05-15T15:39:30.918+0000 7f40e3a62040 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-15T15:39:31.142 INFO:tasks.ceph.mgr.x.smithi084.stderr:2024-05-15T15:39:31.137+0000 7f1aa1e37040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-15T15:39:31.191 INFO:tasks.ceph.mgr.y.smithi012.stderr:2024-05-15T15:39:31.189+0000 7f40e3a62040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-15T15:39:31.192 INFO:tasks.ceph.mgr.x.smithi084.stderr:2024-05-15T15:39:31.189+0000 7f1aa1e37040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-15T15:39:31.232 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-05-15T15:39:31.229+0000 7f35c29a7640 -1 Falling back to public interface 2024-05-15T15:39:31.234 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-05-15T15:39:31.232+0000 7f054c357640 -1 Falling back to public interface 2024-05-15T15:39:31.242 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-05-15T15:39:31.239+0000 7f5cb7a86640 -1 Falling back to public interface 2024-05-15T15:39:31.243 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-05-15T15:39:31.241+0000 7f4121701640 -1 Falling back to public interface 2024-05-15T15:39:31.246 INFO:tasks.ceph.mgr.y.smithi012.stderr:2024-05-15T15:39:31.244+0000 7f40e3a62040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-15T15:39:31.263 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-05-15T15:39:31.261+0000 7f140f020640 -1 Falling back to public interface 2024-05-15T15:39:31.264 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-05-15T15:39:31.262+0000 7fb23841e640 -1 Falling back to public interface 2024-05-15T15:39:31.264 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-05-15T15:39:31.262+0000 7fb236e72640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6810/0: (98) Address already in use 2024-05-15T15:39:31.265 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-05-15T15:39:31.263+0000 7efd37b57640 -1 Falling back to public interface 2024-05-15T15:39:31.278 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-05-15T15:39:31.275+0000 7fc307c41640 -1 Falling back to public interface 2024-05-15T15:39:31.311 INFO:tasks.ceph.mgr.x.smithi084.stderr:2024-05-15T15:39:31.308+0000 7f1aa1e37040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-15T15:39:31.372 INFO:tasks.ceph.mgr.y.smithi012.stderr:2024-05-15T15:39:31.370+0000 7f40e3a62040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-15T15:39:31.591 INFO:tasks.ceph.mgr.x.smithi084.stderr:2024-05-15T15:39:31.588+0000 7f1aa1e37040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-15T15:39:31.638 INFO:tasks.ceph.mgr.x.smithi084.stderr:2024-05-15T15:39:31.635+0000 7f1aa1e37040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-15T15:39:31.662 DEBUG:teuthology.orchestra.run.smithi012:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-15T15:39:31.666 INFO:tasks.ceph.mgr.y.smithi012.stderr:2024-05-15T15:39:31.665+0000 7f40e3a62040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-15T15:39:31.717 INFO:tasks.ceph.mgr.y.smithi012.stderr:2024-05-15T15:39:31.716+0000 7f40e3a62040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-15T15:39:31.765 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:31.763+0000 7f25942bd640 1 Processor -- start 2024-05-15T15:39:31.766 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:31.763+0000 7f25942bd640 1 -- start start 2024-05-15T15:39:31.767 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:31.765+0000 7f25942bd640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f258c1488e0 0x7f258c0c0c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:31.767 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:31.765+0000 7f25942bd640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f258c14e420 0x7f258c14e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:31.767 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:31.765+0000 7f25942bd640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f258c0be210 con 0x7f258c0c1250 2024-05-15T15:39:31.767 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:31.765+0000 7f25942bd640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f258c0be820 con 0x7f258c14e420 2024-05-15T15:39:31.768 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:31.765+0000 7f25942bd640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f258c0be4b0 con 0x7f258c1488e0 2024-05-15T15:39:31.768 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:31.765+0000 7f2592059640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f258c0c1250 0x7f258c0bd6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:52994/0 (socket says 172.21.15.12:52994) 2024-05-15T15:39:31.768 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:31.765+0000 7f2592059640 1 -- 172.21.15.12:0/1173168423 learned_addr learned my addr 172.21.15.12:0/1173168423 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-05-15T15:39:31.768 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:31.765+0000 7f2591858640 1 --2- 172.21.15.12:0/1173168423 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f258c1488e0 0x7f258c0c0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:31.768 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:31.765+0000 7f259285a640 1 --2- 172.21.15.12:0/1173168423 >> v2:172.21.15.84:3300/0 conn(0x7f258c14e420 0x7f258c14e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:31.768 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:31.765+0000 7f2591057640 1 -- 172.21.15.12:0/1173168423 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2348192395 0 0) 0x7f258c0be210 con 0x7f258c0c1250 2024-05-15T15:39:31.768 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:31.765+0000 7f2591057640 1 -- 172.21.15.12:0/1173168423 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2578003520 con 0x7f258c0c1250 2024-05-15T15:39:31.768 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:31.765+0000 7f2591858640 1 -- 172.21.15.12:0/1173168423 >> v2:172.21.15.84:3300/0 conn(0x7f258c14e420 msgr2=0x7f258c14e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:39:31.768 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:31.765+0000 7f2591858640 1 --2- 172.21.15.12:0/1173168423 >> v2:172.21.15.84:3300/0 conn(0x7f258c14e420 0x7f258c14e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:31.768 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:31.765+0000 7f2591858640 1 -- 172.21.15.12:0/1173168423 >> v1:172.21.15.12:6789/0 conn(0x7f258c0c1250 legacy=0x7f258c0bd6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:31.768 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:31.765+0000 7f2591858640 1 -- 172.21.15.12:0/1173168423 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f258c14ed70 con 0x7f258c1488e0 2024-05-15T15:39:31.768 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:31.765+0000 7f259285a640 1 --2- 172.21.15.12:0/1173168423 >> v2:172.21.15.84:3300/0 conn(0x7f258c14e420 0x7f258c14e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-15T15:39:31.769 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:31.766+0000 7f2591858640 1 --2- 172.21.15.12:0/1173168423 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f258c1488e0 0x7f258c0c0c30 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f257c0097a0 tx=0x7f257c02a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de26a73f7ec54b37 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:39:31.770 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:31.766+0000 7f2591057640 1 -- 172.21.15.12:0/1173168423 <== mon.2 v2:172.21.15.84:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f257c037070 con 0x7f258c1488e0 2024-05-15T15:39:31.770 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:31.766+0000 7f2591057640 1 -- 172.21.15.12:0/1173168423 <== mon.2 v2:172.21.15.84:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f257c032440 con 0x7f258c1488e0 2024-05-15T15:39:31.770 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:31.766+0000 7f2591057640 1 -- 172.21.15.12:0/1173168423 <== mon.2 v2:172.21.15.84:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f257c032810 con 0x7f258c1488e0 2024-05-15T15:39:31.770 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:31.767+0000 7f25942bd640 1 -- 172.21.15.12:0/1173168423 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f258c1488e0 msgr2=0x7f258c0c0c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:31.770 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:31.767+0000 7f25942bd640 1 --2- 172.21.15.12:0/1173168423 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f258c1488e0 0x7f258c0c0c30 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f257c0097a0 tx=0x7f257c02a210 comp rx=0 tx=0).stop 2024-05-15T15:39:31.770 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:31.767+0000 7f25942bd640 1 -- 172.21.15.12:0/1173168423 shutdown_connections 2024-05-15T15:39:31.770 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:31.767+0000 7f25942bd640 1 --2- 172.21.15.12:0/1173168423 >> v2:172.21.15.84:3300/0 conn(0x7f258c14e420 0x7f258c14e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:31.770 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:31.767+0000 7f25942bd640 1 --2- 172.21.15.12:0/1173168423 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f258c1488e0 0x7f258c0c0c30 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:31.770 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:31.767+0000 7f25942bd640 1 -- 172.21.15.12:0/1173168423 >> 172.21.15.12:0/1173168423 conn(0x7f258c0c1670 msgr2=0x7f258c0c1a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:39:31.770 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:31.767+0000 7f25942bd640 1 -- 172.21.15.12:0/1173168423 shutdown_connections 2024-05-15T15:39:31.770 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:31.767+0000 7f25942bd640 1 -- 172.21.15.12:0/1173168423 wait complete. 2024-05-15T15:39:31.771 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:31.769+0000 7f25942bd640 1 Processor -- start 2024-05-15T15:39:31.771 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:31.769+0000 7f25942bd640 1 -- start start 2024-05-15T15:39:31.773 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:31.770+0000 7f25942bd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f258c1488e0 0x7f258c14b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:31.773 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:31.770+0000 7f25942bd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f258c14e420 0x7f258c1493a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:31.773 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:31.770+0000 7f25942bd640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f258c1e40b0 0x7f258c0b7b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:31.773 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:31.770+0000 7f25942bd640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f258c0bc5d0 con 0x7f258c1488e0 2024-05-15T15:39:31.773 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:31.770+0000 7f25942bd640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f258c0bc450 con 0x7f258c14e420 2024-05-15T15:39:31.774 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:31.770+0000 7f25942bd640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f258c0bc070 con 0x7f258c1e40b0 2024-05-15T15:39:31.774 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:31.770+0000 7f2592059640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f258c1488e0 0x7f258c14b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:31.774 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:31.770+0000 7f2592059640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f258c1488e0 0x7f258c14b010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44062/0 (socket says 172.21.15.12:44062) 2024-05-15T15:39:31.774 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:31.770+0000 7f2592059640 1 -- 172.21.15.12:0/4210607220 learned_addr learned my addr 172.21.15.12:0/4210607220 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:39:31.774 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:31.770+0000 7f2591858640 1 --2- 172.21.15.12:0/4210607220 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f258c14e420 0x7f258c1493a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:31.774 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:31.770+0000 7f259285a640 1 --2- 172.21.15.12:0/4210607220 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f258c1e40b0 0x7f258c0b7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:31.774 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:31.770+0000 7f2592059640 1 -- 172.21.15.12:0/4210607220 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f258c1e40b0 msgr2=0x7f258c0b7b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:31.774 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:31.770+0000 7f2592059640 1 --2- 172.21.15.12:0/4210607220 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f258c1e40b0 0x7f258c0b7b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:31.774 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:31.770+0000 7f2592059640 1 -- 172.21.15.12:0/4210607220 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f258c14e420 msgr2=0x7f258c1493a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:31.774 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:31.770+0000 7f2592059640 1 --2- 172.21.15.12:0/4210607220 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f258c14e420 0x7f258c1493a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:31.774 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:31.770+0000 7f2592059640 1 -- 172.21.15.12:0/4210607220 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f258c140840 con 0x7f258c1488e0 2024-05-15T15:39:31.774 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:31.770+0000 7f2591858640 1 --2- 172.21.15.12:0/4210607220 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f258c14e420 0x7f258c1493a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-15T15:39:31.775 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:31.770+0000 7f2592059640 1 --2- 172.21.15.12:0/4210607220 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f258c1488e0 0x7f258c14b010 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f258800c430 tx=0x7f258800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:39:31.775 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:31.771+0000 7f2582ffd640 1 -- 172.21.15.12:0/4210607220 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2588017070 con 0x7f258c1488e0 2024-05-15T15:39:31.775 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:31.771+0000 7f2582ffd640 1 -- 172.21.15.12:0/4210607220 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2588005ce0 con 0x7f258c1488e0 2024-05-15T15:39:31.775 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:31.771+0000 7f2582ffd640 1 -- 172.21.15.12:0/4210607220 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25880072d0 con 0x7f258c1488e0 2024-05-15T15:39:31.775 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:31.771+0000 7f25942bd640 1 -- 172.21.15.12:0/4210607220 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f258c14b550 con 0x7f258c1488e0 2024-05-15T15:39:31.775 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:31.771+0000 7f25942bd640 1 -- 172.21.15.12:0/4210607220 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f258c1e4790 con 0x7f258c1488e0 2024-05-15T15:39:31.775 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:31.771+0000 7f2582ffd640 1 -- 172.21.15.12:0/4210607220 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f258801a070 con 0x7f258c1488e0 2024-05-15T15:39:31.775 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:31.771+0000 7f2582ffd640 1 -- 172.21.15.12:0/4210607220 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f258801cc10 con 0x7f258c1488e0 2024-05-15T15:39:31.776 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:31.772+0000 7f25942bd640 1 -- 172.21.15.12:0/4210607220 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f258c06a050 con 0x7f258c1488e0 2024-05-15T15:39:31.776 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:31.774+0000 7f2582ffd640 1 -- 172.21.15.12:0/4210607220 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f25880074d0 con 0x7f258c1488e0 2024-05-15T15:39:31.793 INFO:tasks.ceph.mgr.x.smithi084.stderr:2024-05-15T15:39:31.790+0000 7f1aa1e37040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-15T15:39:31.839 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:31.837+0000 7f25942bd640 1 -- 172.21.15.12:0/4210607220 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f258c0bfe70 con 0x7f258c1488e0 2024-05-15T15:39:31.840 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:31.838+0000 7f2582ffd640 1 -- 172.21.15.12:0/4210607220 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f25880076f0 con 0x7f258c1488e0 2024-05-15T15:39:31.840 INFO:teuthology.misc.health.smithi012.stdout: 2024-05-15T15:39:31.840 INFO:teuthology.misc.health.smithi012.stdout:{"epoch":10,"fsid":"3b7fc4b2-b85c-49b5-a5de-38444eeed40d","created":"2024-05-15T15:39:28.392476+0000","modified":"2024-05-15T15:39:30.591216+0000","last_up_change":"0.000000","last_in_change":"2024-05-15T15:39:30.591216+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"0d06a12a-866a-418e-9776-704d74354579","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"09d0fa19-9ef8-4f35-bf99-6e86658c6f10","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"b204c6ad-f431-40a5-ba27-9844294f0ece","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"660a9ccb-2ee5-42d8-8481-0835047a8260","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"9eef1461-a961-457c-9a78-43b5098a46a0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"5f924e2f-6c71-4741-a727-d3710c438431","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"efae9975-8c16-4ad3-892f-71f3c59718d0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"6426efba-ee4d-4e44-83d1-c76c75aec30c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-15T15:39:31.841 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:31.839+0000 7f25942bd640 1 -- 172.21.15.12:0/4210607220 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f258c1488e0 msgr2=0x7f258c14b010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:31.841 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:31.839+0000 7f25942bd640 1 --2- 172.21.15.12:0/4210607220 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f258c1488e0 0x7f258c14b010 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f258800c430 tx=0x7f258800c830 comp rx=0 tx=0).stop 2024-05-15T15:39:31.841 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:31.839+0000 7f25942bd640 1 -- 172.21.15.12:0/4210607220 shutdown_connections 2024-05-15T15:39:31.841 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:31.839+0000 7f25942bd640 1 --2- 172.21.15.12:0/4210607220 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f258c1e40b0 0x7f258c0b7b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:31.842 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:31.839+0000 7f25942bd640 1 --2- 172.21.15.12:0/4210607220 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f258c14e420 0x7f258c1493a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:31.842 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:31.839+0000 7f25942bd640 1 --2- 172.21.15.12:0/4210607220 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f258c1488e0 0x7f258c14b010 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:31.842 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:31.839+0000 7f25942bd640 1 -- 172.21.15.12:0/4210607220 >> 172.21.15.12:0/4210607220 conn(0x7f258c0c1670 msgr2=0x7f258c0c0a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:39:31.842 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:31.839+0000 7f25942bd640 1 -- 172.21.15.12:0/4210607220 shutdown_connections 2024-05-15T15:39:31.842 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:31.839+0000 7f25942bd640 1 -- 172.21.15.12:0/4210607220 wait complete. 2024-05-15T15:39:31.851 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-05-15T15:39:31.887 INFO:tasks.ceph.mgr.y.smithi012.stderr:2024-05-15T15:39:31.885+0000 7f40e3a62040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-15T15:39:31.928 INFO:tasks.ceph.mgr.x.smithi084.stderr:2024-05-15T15:39:31.925+0000 7f1aa1e37040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-15T15:39:31.976 INFO:tasks.ceph.mgr.x.smithi084.stderr:2024-05-15T15:39:31.974+0000 7f1aa1e37040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-15T15:39:32.031 INFO:tasks.ceph.mgr.y.smithi012.stderr:2024-05-15T15:39:32.029+0000 7f40e3a62040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-15T15:39:32.046 INFO:tasks.ceph.mgr.x.smithi084.stderr:2024-05-15T15:39:32.044+0000 7f1aa1e37040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-15T15:39:32.082 INFO:tasks.ceph.mgr.y.smithi012.stderr:2024-05-15T15:39:32.081+0000 7f40e3a62040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-15T15:39:32.092 INFO:tasks.ceph.mgr.x.smithi084.stderr:2024-05-15T15:39:32.090+0000 7f1aa1e37040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-15T15:39:32.157 INFO:tasks.ceph.mgr.y.smithi012.stderr:2024-05-15T15:39:32.155+0000 7f40e3a62040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-15T15:39:32.204 INFO:tasks.ceph.mgr.y.smithi012.stderr:2024-05-15T15:39:32.202+0000 7f40e3a62040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-15T15:39:32.567 INFO:tasks.ceph.mgr.x.smithi084.stderr:2024-05-15T15:39:32.565+0000 7f1aa1e37040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-15T15:39:32.684 INFO:tasks.ceph.mgr.x.smithi084.stderr:2024-05-15T15:39:32.682+0000 7f1aa1e37040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-15T15:39:32.708 INFO:tasks.ceph.mgr.y.smithi012.stderr:2024-05-15T15:39:32.706+0000 7f40e3a62040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-15T15:39:32.831 INFO:tasks.ceph.mgr.y.smithi012.stderr:2024-05-15T15:39:32.829+0000 7f40e3a62040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-15T15:39:33.703 INFO:tasks.ceph.mgr.x.smithi084.stderr:2024-05-15T15:39:33.701+0000 7f1a40ffd640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-05-15T15:39:33.704 INFO:tasks.ceph.mgr.x.smithi084.stderr:2024-05-15T15:39:33.701+0000 7f1a40ffd640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-05-15T15:39:34.691 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-05-15T15:39:34.688+0000 7f054c357640 -1 osd.4 0 log_to_monitors true 2024-05-15T15:39:34.727 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-05-15T15:39:34.725+0000 7f4121701640 -1 osd.3 0 log_to_monitors true 2024-05-15T15:39:34.728 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-05-15T15:39:34.726+0000 7f35c29a7640 -1 osd.5 0 log_to_monitors true 2024-05-15T15:39:34.751 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-05-15T15:39:34.748+0000 7f5cb7a86640 -1 osd.6 0 log_to_monitors true 2024-05-15T15:39:34.783 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-05-15T15:39:34.781+0000 7fc307c41640 -1 osd.7 0 log_to_monitors true 2024-05-15T15:39:34.793 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-05-15T15:39:34.791+0000 7efd37b57640 -1 osd.2 0 log_to_monitors true 2024-05-15T15:39:34.799 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-05-15T15:39:34.797+0000 7f140f020640 -1 osd.0 0 log_to_monitors true 2024-05-15T15:39:34.800 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-05-15T15:39:34.799+0000 7fb23841e640 -1 osd.1 0 log_to_monitors true 2024-05-15T15:39:36.501 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-05-15T15:39:36.498+0000 7f05482ed640 -1 osd.4 0 waiting for initial osdmap 2024-05-15T15:39:36.510 INFO:tasks.ceph.osd.4.smithi084.stderr:2024-05-15T15:39:36.508+0000 7f05400e8640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-15T15:39:38.353 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-05-15T15:39:38.351+0000 7f5cb3a1c640 -1 osd.6 0 waiting for initial osdmap 2024-05-15T15:39:38.362 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-05-15T15:39:38.360+0000 7fc303bd7640 -1 osd.7 0 waiting for initial osdmap 2024-05-15T15:39:38.365 INFO:tasks.ceph.osd.6.smithi084.stderr:2024-05-15T15:39:38.363+0000 7f5cab817640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-15T15:39:38.373 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-05-15T15:39:38.370+0000 7f35be93d640 -1 osd.5 0 waiting for initial osdmap 2024-05-15T15:39:38.376 INFO:tasks.ceph.osd.7.smithi084.stderr:2024-05-15T15:39:38.374+0000 7fc2fb9d2640 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-15T15:39:38.384 INFO:tasks.ceph.osd.5.smithi084.stderr:2024-05-15T15:39:38.382+0000 7f35b6738640 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-15T15:39:38.658 DEBUG:teuthology.orchestra.run.smithi012:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-15T15:39:38.732 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-05-15T15:39:38.729+0000 7fb233e59640 -1 osd.1 0 waiting for initial osdmap 2024-05-15T15:39:38.753 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-05-15T15:39:38.751+0000 7fb22bc65640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-15T15:39:38.792 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:38.790+0000 7f7d587a9640 1 Processor -- start 2024-05-15T15:39:38.793 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:38.791+0000 7f7d587a9640 1 -- start start 2024-05-15T15:39:38.795 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:38.792+0000 7f7d587a9640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7d5014cb00 0x7f7d5014cf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:38.795 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:38.792+0000 7f7d587a9640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f7d500bfa30 0x7f7d500bfe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:38.795 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:38.792+0000 7f7d587a9640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d50071d40 con 0x7f7d500be330 2024-05-15T15:39:38.795 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:38.792+0000 7f7d587a9640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f7d50072300 con 0x7f7d500bfa30 2024-05-15T15:39:38.795 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:38.792+0000 7f7d587a9640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f7d500bf5a0 con 0x7f7d5014cb00 2024-05-15T15:39:38.795 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:38.792+0000 7f7d55d44640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7d5014cb00 0x7f7d5014cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:38.795 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:38.792+0000 7f7d55d44640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7d5014cb00 0x7f7d5014cf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.12:42836/0 (socket says 172.21.15.12:42836) 2024-05-15T15:39:38.795 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:38.792+0000 7f7d55d44640 1 -- 172.21.15.12:0/4026741959 learned_addr learned my addr 172.21.15.12:0/4026741959 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:39:38.795 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:38.792+0000 7f7d56d46640 1 --2- 172.21.15.12:0/4026741959 >> v2:172.21.15.12:3300/0 conn(0x7f7d500bfa30 0x7f7d500bfe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:38.795 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:38.793+0000 7f7d55d44640 1 -- 172.21.15.12:0/4026741959 >> v2:172.21.15.12:3300/0 conn(0x7f7d500bfa30 msgr2=0x7f7d500bfe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:39:38.796 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:38.793+0000 7f7d55d44640 1 --2- 172.21.15.12:0/4026741959 >> v2:172.21.15.12:3300/0 conn(0x7f7d500bfa30 0x7f7d500bfe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:38.796 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:38.793+0000 7f7d55d44640 1 -- 172.21.15.12:0/4026741959 >> v1:172.21.15.84:6789/0 conn(0x7f7d500be330 legacy=0x7f7d50071480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:38.796 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:38.793+0000 7f7d55d44640 1 -- 172.21.15.12:0/4026741959 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d50072020 con 0x7f7d5014cb00 2024-05-15T15:39:38.797 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:38.794+0000 7f7d55d44640 1 --2- 172.21.15.12:0/4026741959 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7d5014cb00 0x7f7d5014cf10 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7d50073b40 tx=0x7f7d4c02a310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c28f01b76b4cf2b server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:39:38.797 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:38.794+0000 7f7d55543640 1 -- 172.21.15.12:0/4026741959 <== mon.1 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d4c037070 con 0x7f7d5014cb00 2024-05-15T15:39:38.797 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:38.794+0000 7f7d55543640 1 -- 172.21.15.12:0/4026741959 <== mon.1 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d4c032640 con 0x7f7d5014cb00 2024-05-15T15:39:38.797 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:38.794+0000 7f7d55543640 1 -- 172.21.15.12:0/4026741959 <== mon.1 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d4c02ae60 con 0x7f7d5014cb00 2024-05-15T15:39:38.798 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:38.795+0000 7f7d587a9640 1 -- 172.21.15.12:0/4026741959 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7d5014cb00 msgr2=0x7f7d5014cf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:38.798 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:38.795+0000 7f7d587a9640 1 --2- 172.21.15.12:0/4026741959 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7d5014cb00 0x7f7d5014cf10 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7d50073b40 tx=0x7f7d4c02a310 comp rx=0 tx=0).stop 2024-05-15T15:39:38.798 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:38.795+0000 7f7d587a9640 1 -- 172.21.15.12:0/4026741959 shutdown_connections 2024-05-15T15:39:38.798 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:38.795+0000 7f7d587a9640 1 --2- 172.21.15.12:0/4026741959 >> v2:172.21.15.12:3300/0 conn(0x7f7d500bfa30 0x7f7d500bfe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:38.798 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:38.795+0000 7f7d587a9640 1 --2- 172.21.15.12:0/4026741959 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7d5014cb00 0x7f7d5014cf10 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:38.798 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:38.795+0000 7f7d587a9640 1 -- 172.21.15.12:0/4026741959 >> 172.21.15.12:0/4026741959 conn(0x7f7d500c1670 msgr2=0x7f7d500c1a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:39:38.798 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:38.795+0000 7f7d587a9640 1 -- 172.21.15.12:0/4026741959 shutdown_connections 2024-05-15T15:39:38.798 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:38.795+0000 7f7d587a9640 1 -- 172.21.15.12:0/4026741959 wait complete. 2024-05-15T15:39:38.799 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:38.797+0000 7f7d587a9640 1 Processor -- start 2024-05-15T15:39:38.799 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:38.797+0000 7f7d587a9640 1 -- start start 2024-05-15T15:39:38.801 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:38.798+0000 7f7d587a9640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7d500be330 0x7f7d500a2720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:38.801 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:38.798+0000 7f7d587a9640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7d500bfa30 0x7f7d500a1570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:38.802 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:38.798+0000 7f7d587a9640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f7d5014cb00 0x7f7d500a3480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:38.802 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:38.798+0000 7f7d56545640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7d500be330 0x7f7d500a2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:38.802 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:38.798+0000 7f7d587a9640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f7d500be8c0 con 0x7f7d500be330 2024-05-15T15:39:38.802 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:38.799+0000 7f7d56545640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7d500be330 0x7f7d500a2720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43830/0 (socket says 172.21.15.12:43830) 2024-05-15T15:39:38.802 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:38.799+0000 7f7d56545640 1 -- 172.21.15.12:0/1156274451 learned_addr learned my addr 172.21.15.12:0/1156274451 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:39:38.802 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:38.799+0000 7f7d587a9640 1 -- 172.21.15.12:0/1156274451 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f7d500be740 con 0x7f7d500bfa30 2024-05-15T15:39:38.802 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:38.799+0000 7f7d587a9640 1 -- 172.21.15.12:0/1156274451 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f7d500c1220 con 0x7f7d5014cb00 2024-05-15T15:39:38.802 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:38.799+0000 7f7d55d44640 1 --2- 172.21.15.12:0/1156274451 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7d500bfa30 0x7f7d500a1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:38.802 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:38.799+0000 7f7d56d46640 1 --2- 172.21.15.12:0/1156274451 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f7d5014cb00 0x7f7d500a3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:38.802 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:38.799+0000 7f7d55d44640 1 -- 172.21.15.12:0/1156274451 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f7d5014cb00 msgr2=0x7f7d500a3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:38.802 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:38.799+0000 7f7d55d44640 1 --2- 172.21.15.12:0/1156274451 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f7d5014cb00 0x7f7d500a3480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:38.802 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:38.799+0000 7f7d55d44640 1 -- 172.21.15.12:0/1156274451 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7d500be330 msgr2=0x7f7d500a2720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:38.802 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:38.799+0000 7f7d55d44640 1 --2- 172.21.15.12:0/1156274451 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7d500be330 0x7f7d500a2720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:38.803 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:38.799+0000 7f7d55d44640 1 -- 172.21.15.12:0/1156274451 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d500bbc40 con 0x7f7d500bfa30 2024-05-15T15:39:38.803 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:38.799+0000 7f7d55d44640 1 --2- 172.21.15.12:0/1156274451 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7d500bfa30 0x7f7d500a1570 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7d4c031000 tx=0x7f7d4c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:39:38.803 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:38.800+0000 7f7d46ffd640 1 -- 172.21.15.12:0/1156274451 <== mon.1 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d4c037040 con 0x7f7d500bfa30 2024-05-15T15:39:38.803 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:38.800+0000 7f7d46ffd640 1 -- 172.21.15.12:0/1156274451 <== mon.1 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d4c042070 con 0x7f7d500bfa30 2024-05-15T15:39:38.803 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:38.800+0000 7f7d46ffd640 1 -- 172.21.15.12:0/1156274451 <== mon.1 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d4c02ae60 con 0x7f7d500bfa30 2024-05-15T15:39:38.803 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:38.801+0000 7f7d587a9640 1 -- 172.21.15.12:0/1156274451 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d500a2c60 con 0x7f7d500bfa30 2024-05-15T15:39:38.803 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:38.801+0000 7f7d587a9640 1 -- 172.21.15.12:0/1156274451 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d500a1d10 con 0x7f7d500bfa30 2024-05-15T15:39:38.804 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:38.802+0000 7f7d587a9640 1 -- 172.21.15.12:0/1156274451 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d5006a050 con 0x7f7d500bfa30 2024-05-15T15:39:38.804 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:38.803+0000 7f7d46ffd640 1 -- 172.21.15.12:0/1156274451 <== mon.1 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) ==== 98145+0+0 (secure 0 0 0) 0x7f7d4c030cb0 con 0x7f7d500bfa30 2024-05-15T15:39:38.805 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:38.803+0000 7f7d46ffd640 1 --2- 172.21.15.12:0/1156274451 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f7d34076290 0x7f7d340787a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:38.805 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-05-15T15:39:38.803+0000 7efd33aed640 -1 osd.2 0 waiting for initial osdmap 2024-05-15T15:39:38.806 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:38.804+0000 7f7d46ffd640 1 -- 172.21.15.12:0/1156274451 <== mon.1 v2:172.21.15.84:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2511+0+0 (secure 0 0 0) 0x7f7d4c0b70c0 con 0x7f7d500bfa30 2024-05-15T15:39:38.806 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:38.804+0000 7f7d56545640 1 --2- 172.21.15.12:0/1156274451 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f7d34076290 0x7f7d340787a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:38.806 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:38.804+0000 7f7d56545640 1 --2- 172.21.15.12:0/1156274451 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f7d34076290 0x7f7d340787a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f7d400017e0 tx=0x7f7d40009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:39:38.810 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:38.809+0000 7f7d46ffd640 1 -- 172.21.15.12:0/1156274451 <== mon.1 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f7d4c081210 con 0x7f7d500bfa30 2024-05-15T15:39:38.823 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-05-15T15:39:38.821+0000 7efd2b8e8640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-15T15:39:38.840 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-05-15T15:39:38.838+0000 7f411deab640 -1 osd.3 0 waiting for initial osdmap 2024-05-15T15:39:38.848 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-05-15T15:39:38.847+0000 7f4115492640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-15T15:39:38.849 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-05-15T15:39:38.848+0000 7f140a917640 -1 osd.0 0 waiting for initial osdmap 2024-05-15T15:39:38.867 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-05-15T15:39:38.866+0000 7f1402712640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-15T15:39:39.018 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:39.015+0000 7f7d587a9640 1 -- 172.21.15.12:0/1156274451 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7d500c0c40 con 0x7f7d500bfa30 2024-05-15T15:39:39.018 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:39.016+0000 7f7d46ffd640 1 -- 172.21.15.12:0/1156274451 <== mon.1 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) ==== 74+0+7578 (secure 0 0 0) 0x7f7d4c085510 con 0x7f7d500bfa30 2024-05-15T15:39:39.018 INFO:teuthology.misc.health.smithi012.stdout: 2024-05-15T15:39:39.018 INFO:teuthology.misc.health.smithi012.stdout:{"epoch":14,"fsid":"3b7fc4b2-b85c-49b5-a5de-38444eeed40d","created":"2024-05-15T15:39:28.392476+0000","modified":"2024-05-15T15:39:38.069508+0000","last_up_change":"2024-05-15T15:39:36.697578+0000","last_in_change":"2024-05-15T15:39:30.591216+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"0d06a12a-866a-418e-9776-704d74354579","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"09d0fa19-9ef8-4f35-bf99-6e86658c6f10","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"b204c6ad-f431-40a5-ba27-9844294f0ece","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"660a9ccb-2ee5-42d8-8481-0835047a8260","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"9eef1461-a961-457c-9a78-43b5098a46a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":1021092792},{"type":"v1","addr":"172.21.15.84:6809","nonce":1021092792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":1021092792},{"type":"v1","addr":"172.21.15.84:6811","nonce":1021092792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":1021092792},{"type":"v1","addr":"172.21.15.84:6815","nonce":1021092792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":1021092792},{"type":"v1","addr":"172.21.15.84:6813","nonce":1021092792}]},"public_addr":"172.21.15.84:6809/1021092792","cluster_addr":"172.21.15.84:6811/1021092792","heartbeat_back_addr":"172.21.15.84:6815/1021092792","heartbeat_front_addr":"172.21.15.84:6813/1021092792","state":["exists","up"]},{"osd":5,"uuid":"5f924e2f-6c71-4741-a727-d3710c438431","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"efae9975-8c16-4ad3-892f-71f3c59718d0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"6426efba-ee4d-4e44-83d1-c76c75aec30c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.699228+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-15T15:39:39.020 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:39.018+0000 7f7d587a9640 1 -- 172.21.15.12:0/1156274451 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f7d34076290 msgr2=0x7f7d340787a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:39.020 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:39.018+0000 7f7d587a9640 1 --2- 172.21.15.12:0/1156274451 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f7d34076290 0x7f7d340787a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f7d400017e0 tx=0x7f7d40009040 comp rx=0 tx=0).stop 2024-05-15T15:39:39.020 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:39.018+0000 7f7d587a9640 1 -- 172.21.15.12:0/1156274451 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7d500bfa30 msgr2=0x7f7d500a1570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:39.020 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:39.018+0000 7f7d587a9640 1 --2- 172.21.15.12:0/1156274451 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7d500bfa30 0x7f7d500a1570 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7d4c031000 tx=0x7f7d4c0046c0 comp rx=0 tx=0).stop 2024-05-15T15:39:39.020 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:39.018+0000 7f7d587a9640 1 -- 172.21.15.12:0/1156274451 shutdown_connections 2024-05-15T15:39:39.020 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:39.018+0000 7f7d587a9640 1 --2- 172.21.15.12:0/1156274451 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f7d5014cb00 0x7f7d500a3480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:39.020 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:39.018+0000 7f7d587a9640 1 --2- 172.21.15.12:0/1156274451 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7d500bfa30 0x7f7d500a1570 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:39.020 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:39.018+0000 7f7d587a9640 1 --2- 172.21.15.12:0/1156274451 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f7d34076290 0x7f7d340787a0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:39.021 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:39.018+0000 7f7d587a9640 1 --2- 172.21.15.12:0/1156274451 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7d500be330 0x7f7d500a2720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:39.021 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:39.018+0000 7f7d587a9640 1 -- 172.21.15.12:0/1156274451 >> 172.21.15.12:0/1156274451 conn(0x7f7d500c1670 msgr2=0x7f7d500bd010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:39:39.021 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:39.018+0000 7f7d587a9640 1 -- 172.21.15.12:0/1156274451 shutdown_connections 2024-05-15T15:39:39.021 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:39.018+0000 7f7d587a9640 1 -- 172.21.15.12:0/1156274451 wait complete. 2024-05-15T15:39:39.030 DEBUG:teuthology.misc:1 of 8 OSDs are up 2024-05-15T15:39:45.837 DEBUG:teuthology.orchestra.run.smithi012:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-15T15:39:45.954 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:45.951+0000 7f84e66c8640 1 Processor -- start 2024-05-15T15:39:45.954 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:45.951+0000 7f84e66c8640 1 -- start start 2024-05-15T15:39:45.955 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:45.953+0000 7f84e66c8640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f84e00742c0 0x7f84e0072f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:45.955 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:45.953+0000 7f84e66c8640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f84e0148870 0x7f84e006c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:45.955 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:45.953+0000 7f84e66c8640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84e00738b0 con 0x7f84e00bc6e0 2024-05-15T15:39:45.955 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:45.953+0000 7f84e66c8640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f84e0073f00 con 0x7f84e0148870 2024-05-15T15:39:45.955 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:45.953+0000 7f84e66c8640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f84e00735a0 con 0x7f84e00742c0 2024-05-15T15:39:45.955 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:45.953+0000 7f84df7fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f84e0148870 0x7f84e006c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:45.956 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:45.953+0000 7f84df7fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f84e0148870 0x7f84e006c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43834/0 (socket says 172.21.15.12:43834) 2024-05-15T15:39:45.956 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:45.953+0000 7f84df7fe640 1 -- 172.21.15.12:0/3590845865 learned_addr learned my addr 172.21.15.12:0/3590845865 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:39:45.956 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:45.953+0000 7f84dffff640 1 --2- 172.21.15.12:0/3590845865 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f84e00742c0 0x7f84e0072f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:45.956 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:45.953+0000 7f84df7fe640 1 -- 172.21.15.12:0/3590845865 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f84e00742c0 msgr2=0x7f84e0072f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:39:45.956 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:45.953+0000 7f84df7fe640 1 --2- 172.21.15.12:0/3590845865 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f84e00742c0 0x7f84e0072f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:45.956 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:45.953+0000 7f84df7fe640 1 -- 172.21.15.12:0/3590845865 >> v1:172.21.15.84:6789/0 conn(0x7f84e00bc6e0 legacy=0x7f84e006f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:45.956 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:45.953+0000 7f84df7fe640 1 -- 172.21.15.12:0/3590845865 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84e0073b90 con 0x7f84e0148870 2024-05-15T15:39:45.957 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:45.954+0000 7f84df7fe640 1 --2- 172.21.15.12:0/3590845865 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f84e0148870 0x7f84e006c6e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f84d0009870 tx=0x7f84d002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64b1c3b4128a229 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:39:45.957 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:45.954+0000 7f84deffd640 1 -- 172.21.15.12:0/3590845865 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d0037070 con 0x7f84e0148870 2024-05-15T15:39:45.957 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:45.954+0000 7f84deffd640 1 -- 172.21.15.12:0/3590845865 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84d0032440 con 0x7f84e0148870 2024-05-15T15:39:45.957 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:45.954+0000 7f84deffd640 1 -- 172.21.15.12:0/3590845865 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d0032810 con 0x7f84e0148870 2024-05-15T15:39:45.957 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:45.955+0000 7f84e66c8640 1 -- 172.21.15.12:0/3590845865 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f84e0148870 msgr2=0x7f84e006c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:45.957 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:45.955+0000 7f84e66c8640 1 --2- 172.21.15.12:0/3590845865 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f84e0148870 0x7f84e006c6e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f84d0009870 tx=0x7f84d002a270 comp rx=0 tx=0).stop 2024-05-15T15:39:45.958 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:45.955+0000 7f84e66c8640 1 -- 172.21.15.12:0/3590845865 shutdown_connections 2024-05-15T15:39:45.958 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:45.955+0000 7f84e66c8640 1 --2- 172.21.15.12:0/3590845865 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f84e0148870 0x7f84e006c6e0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:45.958 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:45.955+0000 7f84e66c8640 1 --2- 172.21.15.12:0/3590845865 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f84e00742c0 0x7f84e0072f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:45.958 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:45.955+0000 7f84e66c8640 1 -- 172.21.15.12:0/3590845865 >> 172.21.15.12:0/3590845865 conn(0x7f84e006e3f0 msgr2=0x7f84e00c05b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:39:45.958 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:45.955+0000 7f84e66c8640 1 -- 172.21.15.12:0/3590845865 shutdown_connections 2024-05-15T15:39:45.958 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:45.955+0000 7f84e66c8640 1 -- 172.21.15.12:0/3590845865 wait complete. 2024-05-15T15:39:45.958 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:45.956+0000 7f84e66c8640 1 Processor -- start 2024-05-15T15:39:45.959 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:45.957+0000 7f84e66c8640 1 -- start start 2024-05-15T15:39:45.960 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:45.958+0000 7f84e66c8640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f84e00742c0 0x7f84e01e46e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:45.961 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:45.958+0000 7f84e66c8640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84e00bc6e0 0x7f84e00a52c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:45.961 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:45.958+0000 7f84e66c8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f84e0148870 0x7f84e0142a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:45.961 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:45.958+0000 7f84e66c8640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f84e00bb170 con 0x7f84e0148870 2024-05-15T15:39:45.961 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:45.958+0000 7f84e66c8640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f84e00baff0 con 0x7f84e00bc6e0 2024-05-15T15:39:45.961 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:45.958+0000 7f84e66c8640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f84e006cc20 con 0x7f84e00742c0 2024-05-15T15:39:45.961 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:45.958+0000 7f84e4c65640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f84e0148870 0x7f84e0142a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:45.961 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:45.958+0000 7f84e4c65640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f84e0148870 0x7f84e0142a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43838/0 (socket says 172.21.15.12:43838) 2024-05-15T15:39:45.961 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:45.958+0000 7f84e4c65640 1 -- 172.21.15.12:0/1045374710 learned_addr learned my addr 172.21.15.12:0/1045374710 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:39:45.961 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:45.958+0000 7f84dffff640 1 --2- 172.21.15.12:0/1045374710 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f84e00742c0 0x7f84e01e46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:45.961 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:45.958+0000 7f84df7fe640 1 --2- 172.21.15.12:0/1045374710 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84e00bc6e0 0x7f84e00a52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:45.961 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:45.958+0000 7f84e4c65640 1 -- 172.21.15.12:0/1045374710 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f84e00742c0 msgr2=0x7f84e01e46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:45.961 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:45.958+0000 7f84e4c65640 1 --2- 172.21.15.12:0/1045374710 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f84e00742c0 0x7f84e01e46e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:45.961 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:45.958+0000 7f84e4c65640 1 -- 172.21.15.12:0/1045374710 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84e00bc6e0 msgr2=0x7f84e00a52c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:45.962 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:45.958+0000 7f84e4c65640 1 --2- 172.21.15.12:0/1045374710 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84e00bc6e0 0x7f84e00a52c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:45.962 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:45.958+0000 7f84e4c65640 1 -- 172.21.15.12:0/1045374710 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84e01e4c20 con 0x7f84e0148870 2024-05-15T15:39:45.962 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:45.958+0000 7f84e4c65640 1 --2- 172.21.15.12:0/1045374710 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f84e0148870 0x7f84e0142a80 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f84d800c6b0 tx=0x7f84d800cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:39:45.962 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:45.958+0000 7f84dcff9640 1 -- 172.21.15.12:0/1045374710 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d8003b70 con 0x7f84e0148870 2024-05-15T15:39:45.962 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:45.959+0000 7f84dcff9640 1 -- 172.21.15.12:0/1045374710 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84d8003d10 con 0x7f84e0148870 2024-05-15T15:39:45.962 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:45.959+0000 7f84e66c8640 1 -- 172.21.15.12:0/1045374710 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84e00a38d0 con 0x7f84e0148870 2024-05-15T15:39:45.962 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:45.959+0000 7f84dcff9640 1 -- 172.21.15.12:0/1045374710 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d80052f0 con 0x7f84e0148870 2024-05-15T15:39:45.962 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:45.959+0000 7f84e66c8640 1 -- 172.21.15.12:0/1045374710 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84e01e4e30 con 0x7f84e0148870 2024-05-15T15:39:45.963 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:45.960+0000 7f84e66c8640 1 -- 172.21.15.12:0/1045374710 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84e0069940 con 0x7f84e0148870 2024-05-15T15:39:45.963 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:45.960+0000 7f84dcff9640 1 -- 172.21.15.12:0/1045374710 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f84d8005490 con 0x7f84e0148870 2024-05-15T15:39:45.963 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:45.961+0000 7f84dcff9640 1 --2- 172.21.15.12:0/1045374710 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f84c00762d0 0x7f84c00787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:45.963 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:45.961+0000 7f84dcff9640 1 -- 172.21.15.12:0/1045374710 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7f84d8096fa0 con 0x7f84e0148870 2024-05-15T15:39:45.963 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:45.961+0000 7f84dffff640 1 --2- 172.21.15.12:0/1045374710 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f84c00762d0 0x7f84c00787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:45.963 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:45.962+0000 7f84dffff640 1 --2- 172.21.15.12:0/1045374710 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f84c00762d0 0x7f84c00787e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f84c80079a0 tx=0x7f84c8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:39:45.968 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:45.966+0000 7f84dcff9640 1 -- 172.21.15.12:0/1045374710 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f84d8060610 con 0x7f84e0148870 2024-05-15T15:39:46.158 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:46.156+0000 7f84e66c8640 1 -- 172.21.15.12:0/1045374710 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f84e00b58e0 con 0x7f84e0148870 2024-05-15T15:39:46.159 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:46.157+0000 7f84dcff9640 1 -- 172.21.15.12:0/1045374710 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+12848 (secure 0 0 0) 0x7f84d8064910 con 0x7f84e0148870 2024-05-15T15:39:46.159 INFO:teuthology.misc.health.smithi012.stdout: 2024-05-15T15:39:46.159 INFO:teuthology.misc.health.smithi012.stdout:{"epoch":19,"fsid":"3b7fc4b2-b85c-49b5-a5de-38444eeed40d","created":"2024-05-15T15:39:28.392476+0000","modified":"2024-05-15T15:39:43.389718+0000","last_up_change":"2024-05-15T15:39:39.363983+0000","last_in_change":"2024-05-15T15:39:30.591216+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-15T15:39:40.715999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0d06a12a-866a-418e-9776-704d74354579","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":3943681952},{"type":"v1","addr":"172.21.15.12:6809","nonce":3943681952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":3943681952},{"type":"v1","addr":"172.21.15.12:6812","nonce":3943681952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":3943681952},{"type":"v1","addr":"172.21.15.12:6821","nonce":3943681952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":3943681952},{"type":"v1","addr":"172.21.15.12:6816","nonce":3943681952}]},"public_addr":"172.21.15.12:6809/3943681952","cluster_addr":"172.21.15.12:6812/3943681952","heartbeat_back_addr":"172.21.15.12:6821/3943681952","heartbeat_front_addr":"172.21.15.12:6816/3943681952","state":["exists","up"]},{"osd":1,"uuid":"09d0fa19-9ef8-4f35-bf99-6e86658c6f10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6811","nonce":1763752148},{"type":"v1","addr":"172.21.15.12:6813","nonce":1763752148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":1763752148},{"type":"v1","addr":"172.21.15.12:6817","nonce":1763752148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":1763752148},{"type":"v1","addr":"172.21.15.12:6827","nonce":1763752148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6819","nonce":1763752148},{"type":"v1","addr":"172.21.15.12:6822","nonce":1763752148}]},"public_addr":"172.21.15.12:6813/1763752148","cluster_addr":"172.21.15.12:6817/1763752148","heartbeat_back_addr":"172.21.15.12:6827/1763752148","heartbeat_front_addr":"172.21.15.12:6822/1763752148","state":["exists","up"]},{"osd":2,"uuid":"b204c6ad-f431-40a5-ba27-9844294f0ece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":2173702802},{"type":"v1","addr":"172.21.15.12:6823","nonce":2173702802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":2173702802},{"type":"v1","addr":"172.21.15.12:6826","nonce":2173702802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":2173702802},{"type":"v1","addr":"172.21.15.12:6831","nonce":2173702802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":2173702802},{"type":"v1","addr":"172.21.15.12:6829","nonce":2173702802}]},"public_addr":"172.21.15.12:6823/2173702802","cluster_addr":"172.21.15.12:6826/2173702802","heartbeat_back_addr":"172.21.15.12:6831/2173702802","heartbeat_front_addr":"172.21.15.12:6829/2173702802","state":["exists","up"]},{"osd":3,"uuid":"660a9ccb-2ee5-42d8-8481-0835047a8260","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":3956443113},{"type":"v1","addr":"172.21.15.12:6801","nonce":3956443113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":3956443113},{"type":"v1","addr":"172.21.15.12:6803","nonce":3956443113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":3956443113},{"type":"v1","addr":"172.21.15.12:6807","nonce":3956443113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":3956443113},{"type":"v1","addr":"172.21.15.12:6805","nonce":3956443113}]},"public_addr":"172.21.15.12:6801/3956443113","cluster_addr":"172.21.15.12:6803/3956443113","heartbeat_back_addr":"172.21.15.12:6807/3956443113","heartbeat_front_addr":"172.21.15.12:6805/3956443113","state":["exists","up"]},{"osd":4,"uuid":"9eef1461-a961-457c-9a78-43b5098a46a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":1021092792},{"type":"v1","addr":"172.21.15.84:6809","nonce":1021092792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":1021092792},{"type":"v1","addr":"172.21.15.84:6811","nonce":1021092792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":1021092792},{"type":"v1","addr":"172.21.15.84:6815","nonce":1021092792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":1021092792},{"type":"v1","addr":"172.21.15.84:6813","nonce":1021092792}]},"public_addr":"172.21.15.84:6809/1021092792","cluster_addr":"172.21.15.84:6811/1021092792","heartbeat_back_addr":"172.21.15.84:6815/1021092792","heartbeat_front_addr":"172.21.15.84:6813/1021092792","state":["exists","up"]},{"osd":5,"uuid":"5f924e2f-6c71-4741-a727-d3710c438431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":3173527851},{"type":"v1","addr":"172.21.15.84:6801","nonce":3173527851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":3173527851},{"type":"v1","addr":"172.21.15.84:6803","nonce":3173527851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":3173527851},{"type":"v1","addr":"172.21.15.84:6807","nonce":3173527851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":3173527851},{"type":"v1","addr":"172.21.15.84:6805","nonce":3173527851}]},"public_addr":"172.21.15.84:6801/3173527851","cluster_addr":"172.21.15.84:6803/3173527851","heartbeat_back_addr":"172.21.15.84:6807/3173527851","heartbeat_front_addr":"172.21.15.84:6805/3173527851","state":["exists","up"]},{"osd":6,"uuid":"efae9975-8c16-4ad3-892f-71f3c59718d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3029180670},{"type":"v1","addr":"172.21.15.84:6817","nonce":3029180670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3029180670},{"type":"v1","addr":"172.21.15.84:6819","nonce":3029180670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3029180670},{"type":"v1","addr":"172.21.15.84:6823","nonce":3029180670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3029180670},{"type":"v1","addr":"172.21.15.84:6821","nonce":3029180670}]},"public_addr":"172.21.15.84:6817/3029180670","cluster_addr":"172.21.15.84:6819/3029180670","heartbeat_back_addr":"172.21.15.84:6823/3029180670","heartbeat_front_addr":"172.21.15.84:6821/3029180670","state":["exists","up"]},{"osd":7,"uuid":"6426efba-ee4d-4e44-83d1-c76c75aec30c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3067620602},{"type":"v1","addr":"172.21.15.84:6825","nonce":3067620602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3067620602},{"type":"v1","addr":"172.21.15.84:6827","nonce":3067620602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":3067620602},{"type":"v1","addr":"172.21.15.84:6831","nonce":3067620602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":3067620602},{"type":"v1","addr":"172.21.15.84:6829","nonce":3067620602}]},"public_addr":"172.21.15.84:6825/3067620602","cluster_addr":"172.21.15.84:6827/3067620602","heartbeat_back_addr":"172.21.15.84:6831/3067620602","heartbeat_front_addr":"172.21.15.84:6829/3067620602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.809514+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.845364+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.762733+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.688597+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.699228+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.747865+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.712415+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.820683+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-15T15:39:46.161 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:46.159+0000 7f84e66c8640 1 -- 172.21.15.12:0/1045374710 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f84c00762d0 msgr2=0x7f84c00787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:46.162 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:46.159+0000 7f84e66c8640 1 --2- 172.21.15.12:0/1045374710 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f84c00762d0 0x7f84c00787e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f84c80079a0 tx=0x7f84c8008040 comp rx=0 tx=0).stop 2024-05-15T15:39:46.162 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:46.159+0000 7f84e66c8640 1 -- 172.21.15.12:0/1045374710 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f84e0148870 msgr2=0x7f84e0142a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:46.162 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:46.159+0000 7f84e66c8640 1 --2- 172.21.15.12:0/1045374710 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f84e0148870 0x7f84e0142a80 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f84d800c6b0 tx=0x7f84d800cb70 comp rx=0 tx=0).stop 2024-05-15T15:39:46.162 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:46.159+0000 7f84e66c8640 1 -- 172.21.15.12:0/1045374710 shutdown_connections 2024-05-15T15:39:46.162 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:46.159+0000 7f84e66c8640 1 --2- 172.21.15.12:0/1045374710 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f84c00762d0 0x7f84c00787e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:46.162 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:46.159+0000 7f84e66c8640 1 --2- 172.21.15.12:0/1045374710 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f84e0148870 0x7f84e0142a80 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:46.162 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:46.159+0000 7f84e66c8640 1 --2- 172.21.15.12:0/1045374710 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84e00bc6e0 0x7f84e00a52c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:46.162 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:46.159+0000 7f84e66c8640 1 --2- 172.21.15.12:0/1045374710 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f84e00742c0 0x7f84e01e46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:46.162 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:46.159+0000 7f84e66c8640 1 -- 172.21.15.12:0/1045374710 >> 172.21.15.12:0/1045374710 conn(0x7f84e006e3f0 msgr2=0x7f84e01d7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:39:46.162 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:46.159+0000 7f84e66c8640 1 -- 172.21.15.12:0/1045374710 shutdown_connections 2024-05-15T15:39:46.163 INFO:teuthology.misc.health.smithi012.stderr:2024-05-15T15:39:46.159+0000 7f84e66c8640 1 -- 172.21.15.12:0/1045374710 wait complete. 2024-05-15T15:39:46.172 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-05-15T15:39:46.172 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-05-15T15:39:46.172 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-15T15:39:46.173 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-15T15:39:46.175 INFO:tasks.ceph.mds.a:Started 2024-05-15T15:39:46.175 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-15T15:39:46.176 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-05-15T15:39:46.178 INFO:tasks.ceph.mds.c:Started 2024-05-15T15:39:46.178 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-15T15:39:46.178 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-15T15:39:46.181 INFO:tasks.ceph.mds.b:Started 2024-05-15T15:39:46.181 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-05-15T15:39:46.181 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-15T15:39:46.264 INFO:tasks.ceph.mds.a.smithi012.stdout:starting mds.a at 2024-05-15T15:39:46.265 INFO:tasks.ceph.mds.c.smithi012.stdout:starting mds.c at 2024-05-15T15:39:46.275 INFO:tasks.ceph.mds.b.smithi084.stdout:starting mds.b at 2024-05-15T15:39:46.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:46.298+0000 7fb27b59d640 1 Processor -- start 2024-05-15T15:39:46.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:46.298+0000 7fb27b59d640 1 -- start start 2024-05-15T15:39:46.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:46.299+0000 7fb27b59d640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb2741462e0 0x7fb27406c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:46.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:46.299+0000 7fb27b59d640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb2740bc350 0x7fb27406f590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:46.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:46.299+0000 7fb27b59d640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2740bad80 con 0x7fb2740bc760 2024-05-15T15:39:46.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:46.299+0000 7fb27ad9c640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fb2740bc760 0x7fb2740b64f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:48588/0 (socket says 172.21.15.12:48588) 2024-05-15T15:39:46.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:46.299+0000 7fb27ad9c640 1 -- 172.21.15.12:0/114650919 learned_addr learned my addr 172.21.15.12:0/114650919 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-05-15T15:39:46.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:46.299+0000 7fb27b59d640 1 -- 172.21.15.12:0/114650919 --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7fb2741466f0 con 0x7fb2741462e0 2024-05-15T15:39:46.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:46.299+0000 7fb27b59d640 1 -- 172.21.15.12:0/114650919 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fb2740bb6b0 con 0x7fb2740bc350 2024-05-15T15:39:46.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:46.300+0000 7fb279d9a640 1 --2- 172.21.15.12:0/114650919 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb2740bc350 0x7fb27406f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:46.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:46.300+0000 7fb27a59b640 1 --2- 172.21.15.12:0/114650919 >> v2:172.21.15.84:3300/0 conn(0x7fb2741462e0 0x7fb27406c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:46.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:46.300+0000 7fb279599640 1 -- 172.21.15.12:0/114650919 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 721166821 0 0) 0x7fb2740bad80 con 0x7fb2740bc760 2024-05-15T15:39:46.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:46.300+0000 7fb279599640 1 -- 172.21.15.12:0/114650919 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb260003520 con 0x7fb2740bc760 2024-05-15T15:39:46.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:46.300+0000 7fb279599640 1 -- 172.21.15.12:0/114650919 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3692267339 0 0) 0x7fb260003520 con 0x7fb2740bc760 2024-05-15T15:39:46.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:46.300+0000 7fb279599640 1 -- 172.21.15.12:0/114650919 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb2740bc350 msgr2=0x7fb27406f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:39:46.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:46.300+0000 7fb279599640 1 --2- 172.21.15.12:0/114650919 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb2740bc350 0x7fb27406f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:46.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:46.300+0000 7fb279599640 1 -- 172.21.15.12:0/114650919 >> v2:172.21.15.84:3300/0 conn(0x7fb2741462e0 msgr2=0x7fb27406c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:39:46.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:46.300+0000 7fb279599640 1 --2- 172.21.15.12:0/114650919 >> v2:172.21.15.84:3300/0 conn(0x7fb2741462e0 0x7fb27406c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:46.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:46.300+0000 7fb279599640 1 -- 172.21.15.12:0/114650919 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2740bb060 con 0x7fb2740bc760 2024-05-15T15:39:46.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:46.300+0000 7fb279599640 1 -- 172.21.15.12:0/114650919 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 38171736 0 0) 0x7fb26c001a70 con 0x7fb2740bc760 2024-05-15T15:39:46.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:46.300+0000 7fb279599640 1 -- 172.21.15.12:0/114650919 >> v1:172.21.15.12:6789/0 conn(0x7fb2740bc760 legacy=0x7fb2740b64f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:46.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:46.300+0000 7fb279599640 1 --2- 172.21.15.12:0/114650919 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb2740bc350 0x7fb260003a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:46.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:46.300+0000 7fb279599640 1 --2- 172.21.15.12:0/114650919 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb260004020 0x7fb260004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:46.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:46.300+0000 7fb279599640 1 --2- 172.21.15.12:0/114650919 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb260004d40 0x7fb260005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:46.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:46.300+0000 7fb279599640 1 -- 172.21.15.12:0/114650919 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fb2741466f0 con 0x7fb260004020 2024-05-15T15:39:46.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:46.300+0000 7fb279599640 1 -- 172.21.15.12:0/114650919 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fb2740bb6b0 con 0x7fb260004d40 2024-05-15T15:39:46.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:46.300+0000 7fb279599640 1 -- 172.21.15.12:0/114650919 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fb26000bbb0 con 0x7fb2740bc350 2024-05-15T15:39:46.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:46.300+0000 7fb279d9a640 1 --2- 172.21.15.12:0/114650919 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb260004020 0x7fb260004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:46.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:46.300+0000 7fb27ad9c640 1 --2- 172.21.15.12:0/114650919 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb260004d40 0x7fb260005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:46.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:46.300+0000 7fb27a59b640 1 --2- 172.21.15.12:0/114650919 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb2740bc350 0x7fb260003a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:46.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:46.300+0000 7fb279d9a640 1 -- 172.21.15.12:0/114650919 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb2740bc350 msgr2=0x7fb260003a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:39:46.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:46.300+0000 7fb279d9a640 1 --2- 172.21.15.12:0/114650919 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb2740bc350 0x7fb260003a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:46.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:46.300+0000 7fb279d9a640 1 -- 172.21.15.12:0/114650919 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb260004d40 msgr2=0x7fb260005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:39:46.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:46.300+0000 7fb279d9a640 1 --2- 172.21.15.12:0/114650919 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb260004d40 0x7fb260005150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:46.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:46.300+0000 7fb279d9a640 1 -- 172.21.15.12:0/114650919 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb260003520 con 0x7fb260004020 2024-05-15T15:39:46.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:46.300+0000 7fb27a59b640 1 --2- 172.21.15.12:0/114650919 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb2740bc350 0x7fb260003a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-15T15:39:46.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:46.301+0000 7fb279d9a640 1 --2- 172.21.15.12:0/114650919 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb260004020 0x7fb260004800 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fb270009a90 tx=0x7fb260005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dd68f546b5f12c7 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:39:46.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:46.301+0000 7fb279599640 1 -- 172.21.15.12:0/114650919 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb270036070 con 0x7fb260004020 2024-05-15T15:39:46.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:46.301+0000 7fb279599640 1 -- 172.21.15.12:0/114650919 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb270031400 con 0x7fb260004020 2024-05-15T15:39:46.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:46.301+0000 7fb279599640 1 -- 172.21.15.12:0/114650919 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb270009690 con 0x7fb260004020 2024-05-15T15:39:46.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:46.302+0000 7fb27b59d640 1 -- 172.21.15.12:0/114650919 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb260004020 msgr2=0x7fb260004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:46.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:46.302+0000 7fb27b59d640 1 --2- 172.21.15.12:0/114650919 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb260004020 0x7fb260004800 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fb270009a90 tx=0x7fb260005830 comp rx=0 tx=0).stop 2024-05-15T15:39:46.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:46.302+0000 7fb27ad9c640 1 -- 172.21.15.12:0/114650919 reap_dead start 2024-05-15T15:39:46.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:46.302+0000 7fb27b59d640 1 -- 172.21.15.12:0/114650919 shutdown_connections 2024-05-15T15:39:46.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:46.302+0000 7fb27b59d640 1 -- 172.21.15.12:0/114650919 >> 172.21.15.12:0/114650919 conn(0x7fb2740bcfc0 msgr2=0x7fb2740bd3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:39:46.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:46.302+0000 7fb27b59d640 1 -- 172.21.15.12:0/114650919 shutdown_connections 2024-05-15T15:39:46.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:46.302+0000 7fb27b59d640 1 -- 172.21.15.12:0/114650919 wait complete. 2024-05-15T15:39:46.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:46.303+0000 7fb27b59d640 1 Processor -- start 2024-05-15T15:39:46.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:46.303+0000 7fb27b59d640 1 -- start start 2024-05-15T15:39:46.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:46.305+0000 7fb27b59d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb260004020 0x7fb27414e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:46.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:46.305+0000 7fb27b59d640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb27414f580 0x7fb27414da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:46.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:46.305+0000 7fb27b59d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb2741e00c0 0x7fb27414c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:46.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:46.305+0000 7fb27b59d640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fb2740a1e50 con 0x7fb2741e00c0 2024-05-15T15:39:46.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:46.305+0000 7fb27b59d640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fb2740a1cd0 con 0x7fb260004020 2024-05-15T15:39:46.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:46.305+0000 7fb27b59d640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fb27406cc20 con 0x7fb27414f580 2024-05-15T15:39:46.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:46.305+0000 7fb279d9a640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb27414f580 0x7fb27414da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:46.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:46.305+0000 7fb27a59b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb260004020 0x7fb27414e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:46.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:46.305+0000 7fb279d9a640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb27414f580 0x7fb27414da00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3301/0 says I am v2:172.21.15.12:44570/0 (socket says 172.21.15.12:44570) 2024-05-15T15:39:46.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:46.305+0000 7fb279d9a640 1 -- 172.21.15.12:0/1793892595 learned_addr learned my addr 172.21.15.12:0/1793892595 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:39:46.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:46.305+0000 7fb27a59b640 1 --2- 172.21.15.12:0/1793892595 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb260004020 0x7fb27414e9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.12:42932/0 (socket says 172.21.15.12:42932) 2024-05-15T15:39:46.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:46.305+0000 7fb27ad9c640 1 --2- 172.21.15.12:0/1793892595 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb2741e00c0 0x7fb27414c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:46.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:46.305+0000 7fb27ad9c640 1 -- 172.21.15.12:0/1793892595 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb27414f580 msgr2=0x7fb27414da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:46.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:46.305+0000 7fb27ad9c640 1 --2- 172.21.15.12:0/1793892595 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb27414f580 0x7fb27414da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:46.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:46.305+0000 7fb27ad9c640 1 -- 172.21.15.12:0/1793892595 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb260004020 msgr2=0x7fb27414e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:46.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:46.305+0000 7fb27ad9c640 1 --2- 172.21.15.12:0/1793892595 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb260004020 0x7fb27414e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:46.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:46.305+0000 7fb27ad9c640 1 -- 172.21.15.12:0/1793892595 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb27414ef00 con 0x7fb2741e00c0 2024-05-15T15:39:46.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:46.305+0000 7fb279d9a640 1 --2- 172.21.15.12:0/1793892595 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb27414f580 0x7fb27414da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-15T15:39:46.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:46.305+0000 7fb27a59b640 1 --2- 172.21.15.12:0/1793892595 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb260004020 0x7fb27414e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-15T15:39:46.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:46.305+0000 7fb27ad9c640 1 --2- 172.21.15.12:0/1793892595 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb2741e00c0 0x7fb27414c570 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fb2740a3110 tx=0x7fb26c007bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:39:46.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:46.306+0000 7fb26affd640 1 -- 172.21.15.12:0/1793892595 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb26c00eb00 con 0x7fb2741e00c0 2024-05-15T15:39:46.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:46.306+0000 7fb26affd640 1 -- 172.21.15.12:0/1793892595 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb26c018070 con 0x7fb2741e00c0 2024-05-15T15:39:46.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:46.306+0000 7fb27b59d640 1 -- 172.21.15.12:0/1793892595 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb27414df40 con 0x7fb2741e00c0 2024-05-15T15:39:46.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:46.306+0000 7fb26affd640 1 -- 172.21.15.12:0/1793892595 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb26c013420 con 0x7fb2741e00c0 2024-05-15T15:39:46.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:46.306+0000 7fb27b59d640 1 -- 172.21.15.12:0/1793892595 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2741e0ae0 con 0x7fb2741e00c0 2024-05-15T15:39:46.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:46.307+0000 7fb268ff9640 1 -- 172.21.15.12:0/1793892595 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb250005290 con 0x7fb2741e00c0 2024-05-15T15:39:46.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:46.307+0000 7fb26affd640 1 -- 172.21.15.12:0/1793892595 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb26c0135c0 con 0x7fb2741e00c0 2024-05-15T15:39:46.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:46.308+0000 7fb26affd640 1 --2- 172.21.15.12:0/1793892595 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fb258076300 0x7fb258078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:46.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:46.308+0000 7fb26affd640 1 -- 172.21.15.12:0/1793892595 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7fb26c097340 con 0x7fb2741e00c0 2024-05-15T15:39:46.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:46.308+0000 7fb27a59b640 1 --2- 172.21.15.12:0/1793892595 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fb258076300 0x7fb258078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:46.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:46.309+0000 7fb27a59b640 1 --2- 172.21.15.12:0/1793892595 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fb258076300 0x7fb258078810 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb264009fa0 tx=0x7fb264008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:39:46.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:46.313+0000 7fb26affd640 1 -- 172.21.15.12:0/1793892595 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fb26c0609a0 con 0x7fb2741e00c0 2024-05-15T15:39:46.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:46.541+0000 7fb268ff9640 1 -- 172.21.15.12:0/1793892595 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb250005850 con 0x7fb2741e00c0 2024-05-15T15:39:46.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:46.541+0000 7fb26affd640 1 -- 172.21.15.12:0/1793892595 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1392 (secure 0 0 0) 0x7fb26c064ca0 con 0x7fb2741e00c0 2024-05-15T15:39:46.543 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-05-15T15:39:46.543 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6834/1290912681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":1290912681},{"type":"v1","addr":"172.21.15.12:6834","nonce":1290912681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-05-15T15:39:46.544 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 2 2024-05-15T15:39:46.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:46.543+0000 7fb268ff9640 1 -- 172.21.15.12:0/1793892595 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fb258076300 msgr2=0x7fb258078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:46.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:46.543+0000 7fb268ff9640 1 --2- 172.21.15.12:0/1793892595 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fb258076300 0x7fb258078810 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb264009fa0 tx=0x7fb264008040 comp rx=0 tx=0).stop 2024-05-15T15:39:46.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:46.543+0000 7fb268ff9640 1 -- 172.21.15.12:0/1793892595 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb2741e00c0 msgr2=0x7fb27414c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:46.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:46.543+0000 7fb268ff9640 1 --2- 172.21.15.12:0/1793892595 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb2741e00c0 0x7fb27414c570 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fb2740a3110 tx=0x7fb26c007bc0 comp rx=0 tx=0).stop 2024-05-15T15:39:46.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:46.543+0000 7fb268ff9640 1 -- 172.21.15.12:0/1793892595 shutdown_connections 2024-05-15T15:39:46.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:46.543+0000 7fb268ff9640 1 --2- 172.21.15.12:0/1793892595 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fb258076300 0x7fb258078810 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:46.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:46.543+0000 7fb268ff9640 1 --2- 172.21.15.12:0/1793892595 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb2741e00c0 0x7fb27414c570 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:46.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:46.543+0000 7fb268ff9640 1 --2- 172.21.15.12:0/1793892595 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb27414f580 0x7fb27414da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:46.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:46.543+0000 7fb268ff9640 1 --2- 172.21.15.12:0/1793892595 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb260004020 0x7fb27414e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:46.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:46.543+0000 7fb268ff9640 1 -- 172.21.15.12:0/1793892595 >> 172.21.15.12:0/1793892595 conn(0x7fb2740bcfc0 msgr2=0x7fb274142f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:39:46.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:46.544+0000 7fb268ff9640 1 -- 172.21.15.12:0/1793892595 shutdown_connections 2024-05-15T15:39:46.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:46.544+0000 7fb268ff9640 1 -- 172.21.15.12:0/1793892595 wait complete. 2024-05-15T15:39:48.558 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-15T15:39:48.683 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:48.681+0000 7f172f2d9640 1 Processor -- start 2024-05-15T15:39:48.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:48.682+0000 7f172f2d9640 1 -- start start 2024-05-15T15:39:48.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:48.683+0000 7f172f2d9640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f17280bf050 0x7f1728159ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:48.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:48.683+0000 7f172f2d9640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f172806e140 con 0x7f17280bd6d0 2024-05-15T15:39:48.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:48.683+0000 7f172f2d9640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17280c36f0 con 0x7f1728151fc0 2024-05-15T15:39:48.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:48.683+0000 7f172f2d9640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f1728152530 con 0x7f17280bf050 2024-05-15T15:39:48.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:48.683+0000 7f172c874640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f17280bd6d0 0x7f17280be940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:34232/0 (socket says 172.21.15.12:34232) 2024-05-15T15:39:48.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:48.683+0000 7f172c874640 1 -- 172.21.15.12:0/1030023822 learned_addr learned my addr 172.21.15.12:0/1030023822 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-05-15T15:39:48.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:48.683+0000 7f172d876640 1 --2- 172.21.15.12:0/1030023822 >> v2:172.21.15.12:3300/0 conn(0x7f17280bf050 0x7f1728159ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:48.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:48.683+0000 7f172d876640 1 -- 172.21.15.12:0/1030023822 >> v1:172.21.15.84:6789/0 conn(0x7f1728151fc0 legacy=0x7f172806da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:48.686 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:48.683+0000 7f172d876640 1 -- 172.21.15.12:0/1030023822 >> v1:172.21.15.12:6789/0 conn(0x7f17280bd6d0 legacy=0x7f17280be940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:48.686 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:48.683+0000 7f172d876640 1 -- 172.21.15.12:0/1030023822 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1728152810 con 0x7f17280bf050 2024-05-15T15:39:48.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:48.684+0000 7f172d876640 1 --2- 172.21.15.12:0/1030023822 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f17280bf050 0x7f1728159ea0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f1720009d90 tx=0x7f172002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7776647f1da7cc7e server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:39:48.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:48.684+0000 7f171ffff640 1 -- 172.21.15.12:0/1030023822 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1720007740 con 0x7f17280bf050 2024-05-15T15:39:48.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:48.684+0000 7f171ffff640 1 -- 172.21.15.12:0/1030023822 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17200078e0 con 0x7f17280bf050 2024-05-15T15:39:48.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:48.684+0000 7f171ffff640 1 -- 172.21.15.12:0/1030023822 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1720007cb0 con 0x7f17280bf050 2024-05-15T15:39:48.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:48.685+0000 7f172f2d9640 1 -- 172.21.15.12:0/1030023822 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f17280bf050 msgr2=0x7f1728159ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:48.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:48.685+0000 7f172f2d9640 1 --2- 172.21.15.12:0/1030023822 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f17280bf050 0x7f1728159ea0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f1720009d90 tx=0x7f172002a6f0 comp rx=0 tx=0).stop 2024-05-15T15:39:48.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:48.685+0000 7f172f2d9640 1 -- 172.21.15.12:0/1030023822 shutdown_connections 2024-05-15T15:39:48.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:48.685+0000 7f172f2d9640 1 --2- 172.21.15.12:0/1030023822 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f17280bf050 0x7f1728159ea0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:48.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:48.685+0000 7f172f2d9640 1 -- 172.21.15.12:0/1030023822 >> 172.21.15.12:0/1030023822 conn(0x7f17280c3d20 msgr2=0x7f17280c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:39:48.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:48.685+0000 7f172f2d9640 1 -- 172.21.15.12:0/1030023822 shutdown_connections 2024-05-15T15:39:48.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:48.685+0000 7f172f2d9640 1 -- 172.21.15.12:0/1030023822 wait complete. 2024-05-15T15:39:48.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:48.687+0000 7f172f2d9640 1 Processor -- start 2024-05-15T15:39:48.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:48.687+0000 7f172f2d9640 1 -- start start 2024-05-15T15:39:48.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:48.688+0000 7f172f2d9640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f17280bd6d0 0x7f172814ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:48.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:48.688+0000 7f172f2d9640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f17280bf050 0x7f17280b9320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:48.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:48.688+0000 7f172f2d9640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1728151fc0 0x7f17281e4920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:48.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:48.688+0000 7f172f2d9640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f17280a2ed0 con 0x7f17280bf050 2024-05-15T15:39:48.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:48.688+0000 7f172f2d9640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f17280bdae0 con 0x7f17280bd6d0 2024-05-15T15:39:48.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:48.688+0000 7f172f2d9640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f17280a3050 con 0x7f1728151fc0 2024-05-15T15:39:48.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:48.688+0000 7f172c874640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f17280bf050 0x7f17280b9320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:48.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:48.688+0000 7f172c874640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f17280bf050 0x7f17280b9320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35528/0 (socket says 172.21.15.12:35528) 2024-05-15T15:39:48.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:48.688+0000 7f172c874640 1 -- 172.21.15.12:0/767161951 learned_addr learned my addr 172.21.15.12:0/767161951 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:39:48.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:48.688+0000 7f172d876640 1 --2- 172.21.15.12:0/767161951 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1728151fc0 0x7f17281e4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:48.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:48.688+0000 7f172d075640 1 --2- 172.21.15.12:0/767161951 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f17280bd6d0 0x7f172814ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:48.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:48.688+0000 7f172c874640 1 -- 172.21.15.12:0/767161951 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1728151fc0 msgr2=0x7f17281e4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:48.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:48.688+0000 7f172c874640 1 --2- 172.21.15.12:0/767161951 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1728151fc0 0x7f17281e4920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:48.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:48.688+0000 7f172c874640 1 -- 172.21.15.12:0/767161951 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f17280bd6d0 msgr2=0x7f172814ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:48.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:48.688+0000 7f172c874640 1 --2- 172.21.15.12:0/767161951 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f17280bd6d0 0x7f172814ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:48.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:48.688+0000 7f172c874640 1 -- 172.21.15.12:0/767161951 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f172814f270 con 0x7f17280bf050 2024-05-15T15:39:48.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:48.688+0000 7f172c874640 1 --2- 172.21.15.12:0/767161951 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f17280bf050 0x7f17280b9320 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f171800c3a0 tx=0x7f171800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:39:48.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:48.688+0000 7f171dffb640 1 -- 172.21.15.12:0/767161951 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1718017070 con 0x7f17280bf050 2024-05-15T15:39:48.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:48.689+0000 7f171dffb640 1 -- 172.21.15.12:0/767161951 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1718005ce0 con 0x7f17280bf050 2024-05-15T15:39:48.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:48.689+0000 7f171dffb640 1 -- 172.21.15.12:0/767161951 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1718007310 con 0x7f17280bf050 2024-05-15T15:39:48.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:48.689+0000 7f172f2d9640 1 -- 172.21.15.12:0/767161951 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17280b9860 con 0x7f17280bf050 2024-05-15T15:39:48.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:48.689+0000 7f172f2d9640 1 -- 172.21.15.12:0/767161951 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17280ba0a0 con 0x7f17280bf050 2024-05-15T15:39:48.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:48.690+0000 7f172f2d9640 1 -- 172.21.15.12:0/767161951 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1728050940 con 0x7f17280bf050 2024-05-15T15:39:48.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:48.690+0000 7f171dffb640 1 -- 172.21.15.12:0/767161951 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f171801a070 con 0x7f17280bf050 2024-05-15T15:39:48.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:48.691+0000 7f171dffb640 1 --2- 172.21.15.12:0/767161951 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f170c0762d0 0x7f170c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:48.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:48.691+0000 7f171dffb640 1 -- 172.21.15.12:0/767161951 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7f17180965d0 con 0x7f17280bf050 2024-05-15T15:39:48.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:48.691+0000 7f172d075640 1 --2- 172.21.15.12:0/767161951 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f170c0762d0 0x7f170c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:48.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:48.692+0000 7f172d075640 1 --2- 172.21.15.12:0/767161951 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f170c0762d0 0x7f170c0787e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1724000f60 tx=0x7f1724009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:39:48.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:48.696+0000 7f171dffb640 1 -- 172.21.15.12:0/767161951 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f17280b9860 con 0x7f17280bf050 2024-05-15T15:39:48.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:48.927+0000 7f172f2d9640 1 -- 172.21.15.12:0/767161951 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f17280a4670 con 0x7f17280bf050 2024-05-15T15:39:48.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:48.928+0000 7f171dffb640 1 -- 172.21.15.12:0/767161951 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3040 (secure 0 0 0) 0x7f172806e140 con 0x7f17280bf050 2024-05-15T15:39:48.930 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-05-15T15:39:48.930 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6834/1290912681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":1290912681},{"type":"v1","addr":"172.21.15.12:6834","nonce":1290912681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/2920770671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6833","nonce":2920770671},{"type":"v1","addr":"172.21.15.12:6835","nonce":2920770671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4288,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/3699736653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3699736653},{"type":"v1","addr":"172.21.15.84:6835","nonce":3699736653}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-05-15T15:39:48.930 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 3 2024-05-15T15:39:48.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:48.930+0000 7f172f2d9640 1 -- 172.21.15.12:0/767161951 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f170c0762d0 msgr2=0x7f170c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:48.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:48.930+0000 7f172f2d9640 1 --2- 172.21.15.12:0/767161951 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f170c0762d0 0x7f170c0787e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1724000f60 tx=0x7f1724009040 comp rx=0 tx=0).stop 2024-05-15T15:39:48.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:48.930+0000 7f172f2d9640 1 -- 172.21.15.12:0/767161951 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f17280bf050 msgr2=0x7f17280b9320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:48.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:48.930+0000 7f172f2d9640 1 --2- 172.21.15.12:0/767161951 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f17280bf050 0x7f17280b9320 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f171800c3a0 tx=0x7f171800c860 comp rx=0 tx=0).stop 2024-05-15T15:39:48.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:48.930+0000 7f172f2d9640 1 -- 172.21.15.12:0/767161951 shutdown_connections 2024-05-15T15:39:48.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:48.930+0000 7f172f2d9640 1 --2- 172.21.15.12:0/767161951 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1728151fc0 0x7f17281e4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:48.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:48.930+0000 7f172f2d9640 1 --2- 172.21.15.12:0/767161951 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f170c0762d0 0x7f170c0787e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:48.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:48.930+0000 7f172f2d9640 1 --2- 172.21.15.12:0/767161951 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f17280bf050 0x7f17280b9320 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:48.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:48.930+0000 7f172f2d9640 1 --2- 172.21.15.12:0/767161951 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f17280bd6d0 0x7f172814ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:48.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:48.930+0000 7f172f2d9640 1 -- 172.21.15.12:0/767161951 >> 172.21.15.12:0/767161951 conn(0x7f17280c3d20 msgr2=0x7f17280c0a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:39:48.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:48.930+0000 7f172f2d9640 1 -- 172.21.15.12:0/767161951 shutdown_connections 2024-05-15T15:39:48.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:48.930+0000 7f172f2d9640 1 -- 172.21.15.12:0/767161951 wait complete. 2024-05-15T15:39:48.943 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-15T15:39:49.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.052+0000 7f17f8251640 1 Processor -- start 2024-05-15T15:39:49.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.052+0000 7f17f8251640 1 -- start start 2024-05-15T15:39:49.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.053+0000 7f17f8251640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f17f00be3f0 0x7f17f014cb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:49.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.053+0000 7f17f8251640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f17f014fad0 0x7f17f014fee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:49.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.053+0000 7f17f8251640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17f00bb890 con 0x7f17f0074b00 2024-05-15T15:39:49.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.053+0000 7f17f8251640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f17f00bb470 con 0x7f17f014fad0 2024-05-15T15:39:49.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.053+0000 7f17f8251640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f17f00bbb30 con 0x7f17f00be3f0 2024-05-15T15:39:49.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.053+0000 7f17f5fed640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f17f0074b00 0x7f17f006c8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:34248/0 (socket says 172.21.15.12:34248) 2024-05-15T15:39:49.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.053+0000 7f17f5fed640 1 -- 172.21.15.12:0/182996304 learned_addr learned my addr 172.21.15.12:0/182996304 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-05-15T15:39:49.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.053+0000 7f17f67ee640 1 --2- 172.21.15.12:0/182996304 >> v2:172.21.15.12:3300/0 conn(0x7f17f014fad0 0x7f17f014fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:49.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.053+0000 7f17f57ec640 1 --2- 172.21.15.12:0/182996304 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f17f00be3f0 0x7f17f014cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:49.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.054+0000 7f17f67ee640 1 -- 172.21.15.12:0/182996304 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f17f00be3f0 msgr2=0x7f17f014cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:39:49.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.054+0000 7f17f67ee640 1 --2- 172.21.15.12:0/182996304 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f17f00be3f0 0x7f17f014cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:49.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.054+0000 7f17f67ee640 1 -- 172.21.15.12:0/182996304 >> v1:172.21.15.12:6789/0 conn(0x7f17f0074b00 legacy=0x7f17f006c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:49.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.054+0000 7f17f4feb640 1 -- 172.21.15.12:0/182996304 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 994290934 0 0) 0x7f17f00bb890 con 0x7f17f0074b00 2024-05-15T15:39:49.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.054+0000 7f17f67ee640 1 -- 172.21.15.12:0/182996304 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17f00bbe10 con 0x7f17f014fad0 2024-05-15T15:39:49.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.054+0000 7f17f57ec640 1 --2- 172.21.15.12:0/182996304 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f17f00be3f0 0x7f17f014cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-15T15:39:49.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.054+0000 7f17f67ee640 1 --2- 172.21.15.12:0/182996304 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f17f014fad0 0x7f17f014fee0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f17e8009d90 tx=0x7f17e802a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3f99b9420c66a2b server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:39:49.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.054+0000 7f17f4feb640 1 -- 172.21.15.12:0/182996304 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17e8031600 con 0x7f17f014fad0 2024-05-15T15:39:49.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.055+0000 7f17f4feb640 1 -- 172.21.15.12:0/182996304 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17e80317a0 con 0x7f17f014fad0 2024-05-15T15:39:49.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.055+0000 7f17f4feb640 1 -- 172.21.15.12:0/182996304 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17e8031b70 con 0x7f17f014fad0 2024-05-15T15:39:49.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.055+0000 7f17f8251640 1 -- 172.21.15.12:0/182996304 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f17f014fad0 msgr2=0x7f17f014fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:49.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.055+0000 7f17f8251640 1 --2- 172.21.15.12:0/182996304 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f17f014fad0 0x7f17f014fee0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f17e8009d90 tx=0x7f17e802a5d0 comp rx=0 tx=0).stop 2024-05-15T15:39:49.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.055+0000 7f17f8251640 1 -- 172.21.15.12:0/182996304 shutdown_connections 2024-05-15T15:39:49.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.055+0000 7f17f8251640 1 --2- 172.21.15.12:0/182996304 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f17f014fad0 0x7f17f014fee0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:49.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.055+0000 7f17f8251640 1 --2- 172.21.15.12:0/182996304 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f17f00be3f0 0x7f17f014cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:49.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.055+0000 7f17f8251640 1 -- 172.21.15.12:0/182996304 >> 172.21.15.12:0/182996304 conn(0x7f17f00bd0f0 msgr2=0x7f17f00bd500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:39:49.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.055+0000 7f17f8251640 1 -- 172.21.15.12:0/182996304 shutdown_connections 2024-05-15T15:39:49.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.055+0000 7f17f8251640 1 -- 172.21.15.12:0/182996304 wait complete. 2024-05-15T15:39:49.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.057+0000 7f17f8251640 1 Processor -- start 2024-05-15T15:39:49.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.057+0000 7f17f8251640 1 -- start start 2024-05-15T15:39:49.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.058+0000 7f17f8251640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f17f0074b00 0x7f17f0143c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:49.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.058+0000 7f17f8251640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f17f00be3f0 0x7f17f0148160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:49.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.058+0000 7f17f8251640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f17f014fad0 0x7f17f014ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:49.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.058+0000 7f17f8251640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f17f00bc3d0 con 0x7f17f00be3f0 2024-05-15T15:39:49.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.058+0000 7f17f8251640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f17f0150420 con 0x7f17f014fad0 2024-05-15T15:39:49.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.058+0000 7f17f8251640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f17f014d060 con 0x7f17f0074b00 2024-05-15T15:39:49.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.058+0000 7f17f57ec640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f17f00be3f0 0x7f17f0148160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:49.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.058+0000 7f17f57ec640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f17f00be3f0 0x7f17f0148160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35550/0 (socket says 172.21.15.12:35550) 2024-05-15T15:39:49.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.058+0000 7f17f57ec640 1 -- 172.21.15.12:0/3625740593 learned_addr learned my addr 172.21.15.12:0/3625740593 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:39:49.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.058+0000 7f17f5fed640 1 --2- 172.21.15.12:0/3625740593 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f17f0074b00 0x7f17f0143c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:49.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.058+0000 7f17f67ee640 1 --2- 172.21.15.12:0/3625740593 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f17f014fad0 0x7f17f014ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:49.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.058+0000 7f17f57ec640 1 -- 172.21.15.12:0/3625740593 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f17f0074b00 msgr2=0x7f17f0143c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:49.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.058+0000 7f17f57ec640 1 --2- 172.21.15.12:0/3625740593 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f17f0074b00 0x7f17f0143c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:49.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.058+0000 7f17f57ec640 1 -- 172.21.15.12:0/3625740593 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f17f014fad0 msgr2=0x7f17f014ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:49.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.058+0000 7f17f57ec640 1 --2- 172.21.15.12:0/3625740593 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f17f014fad0 0x7f17f014ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:49.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.058+0000 7f17f57ec640 1 -- 172.21.15.12:0/3625740593 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17f014d4c0 con 0x7f17f00be3f0 2024-05-15T15:39:49.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.058+0000 7f17f5fed640 1 --2- 172.21.15.12:0/3625740593 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f17f0074b00 0x7f17f0143c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-15T15:39:49.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.059+0000 7f17f57ec640 1 --2- 172.21.15.12:0/3625740593 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f17f00be3f0 0x7f17f0148160 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f17e000d800 tx=0x7f17e000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:39:49.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.059+0000 7f17e67fc640 1 -- 172.21.15.12:0/3625740593 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17e0004030 con 0x7f17f00be3f0 2024-05-15T15:39:49.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.059+0000 7f17e67fc640 1 -- 172.21.15.12:0/3625740593 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17e00041d0 con 0x7f17f00be3f0 2024-05-15T15:39:49.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.059+0000 7f17f8251640 1 -- 172.21.15.12:0/3625740593 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17f01486a0 con 0x7f17f00be3f0 2024-05-15T15:39:49.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.059+0000 7f17e67fc640 1 -- 172.21.15.12:0/3625740593 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17e000b6c0 con 0x7f17f00be3f0 2024-05-15T15:39:49.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.059+0000 7f17f8251640 1 -- 172.21.15.12:0/3625740593 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17f014e760 con 0x7f17f00be3f0 2024-05-15T15:39:49.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.060+0000 7f17f8251640 1 -- 172.21.15.12:0/3625740593 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17f0050940 con 0x7f17f00be3f0 2024-05-15T15:39:49.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.060+0000 7f17e67fc640 1 -- 172.21.15.12:0/3625740593 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f17e000b860 con 0x7f17f00be3f0 2024-05-15T15:39:49.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.061+0000 7f17e67fc640 1 --2- 172.21.15.12:0/3625740593 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f17d40762d0 0x7f17d40787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:49.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.061+0000 7f17e67fc640 1 -- 172.21.15.12:0/3625740593 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7f17e0097550 con 0x7f17f00be3f0 2024-05-15T15:39:49.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.061+0000 7f17f5fed640 1 --2- 172.21.15.12:0/3625740593 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f17d40762d0 0x7f17d40787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:49.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.062+0000 7f17f5fed640 1 --2- 172.21.15.12:0/3625740593 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f17d40762d0 0x7f17d40787e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f17ec000f60 tx=0x7f17ec009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:39:49.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.066+0000 7f17e67fc640 1 -- 172.21.15.12:0/3625740593 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f17e0061170 con 0x7f17f00be3f0 2024-05-15T15:39:49.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.258+0000 7f17f8251640 1 -- 172.21.15.12:0/3625740593 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f17f00742e0 con 0x7f17f00be3f0 2024-05-15T15:39:49.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.259+0000 7f17e67fc640 1 -- 172.21.15.12:0/3625740593 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v19) ==== 84+0+65 (secure 0 0 0) 0x7f17e0060a70 con 0x7f17f00be3f0 2024-05-15T15:39:49.261 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-05-15T15:39:49.261 INFO:teuthology.orchestra.run.smithi012.stdout:[ 2024-05-15T15:39:49.261 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-05-15T15:39:49.261 INFO:teuthology.orchestra.run.smithi012.stdout: "poolnum": 1, 2024-05-15T15:39:49.261 INFO:teuthology.orchestra.run.smithi012.stdout: "poolname": ".mgr" 2024-05-15T15:39:49.261 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-05-15T15:39:49.261 INFO:teuthology.orchestra.run.smithi012.stdout:] 2024-05-15T15:39:49.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.261+0000 7f17f8251640 1 -- 172.21.15.12:0/3625740593 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f17d40762d0 msgr2=0x7f17d40787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:49.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.261+0000 7f17f8251640 1 --2- 172.21.15.12:0/3625740593 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f17d40762d0 0x7f17d40787e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f17ec000f60 tx=0x7f17ec009040 comp rx=0 tx=0).stop 2024-05-15T15:39:49.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.261+0000 7f17f8251640 1 -- 172.21.15.12:0/3625740593 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f17f00be3f0 msgr2=0x7f17f0148160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:49.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.261+0000 7f17f8251640 1 --2- 172.21.15.12:0/3625740593 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f17f00be3f0 0x7f17f0148160 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f17e000d800 tx=0x7f17e000dcc0 comp rx=0 tx=0).stop 2024-05-15T15:39:49.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.261+0000 7f17f8251640 1 -- 172.21.15.12:0/3625740593 shutdown_connections 2024-05-15T15:39:49.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.261+0000 7f17f8251640 1 --2- 172.21.15.12:0/3625740593 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f17f014fad0 0x7f17f014ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:49.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.261+0000 7f17f8251640 1 --2- 172.21.15.12:0/3625740593 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f17d40762d0 0x7f17d40787e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:49.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.261+0000 7f17f8251640 1 --2- 172.21.15.12:0/3625740593 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f17f00be3f0 0x7f17f0148160 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:49.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.261+0000 7f17f8251640 1 --2- 172.21.15.12:0/3625740593 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f17f0074b00 0x7f17f0143c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:49.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.261+0000 7f17f8251640 1 -- 172.21.15.12:0/3625740593 >> 172.21.15.12:0/3625740593 conn(0x7f17f00bd0f0 msgr2=0x7f17f00be890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:39:49.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.261+0000 7f17f8251640 1 -- 172.21.15.12:0/3625740593 shutdown_connections 2024-05-15T15:39:49.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.261+0000 7f17f8251640 1 -- 172.21.15.12:0/3625740593 wait complete. 2024-05-15T15:39:49.274 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-15T15:39:49.274 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-15T15:39:49.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.387+0000 7fb7d5514640 1 Processor -- start 2024-05-15T15:39:49.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.387+0000 7fb7d5514640 1 -- start start 2024-05-15T15:39:49.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.388+0000 7fb7d5514640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb7d00bf6f0 0x7fb7d00bfb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:49.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.388+0000 7fb7d5514640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb7d00b8ed0 0x7fb7d00b92e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:49.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.388+0000 7fb7d5514640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7d00ba4d0 con 0x7fb7d0151b30 2024-05-15T15:39:49.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.388+0000 7fb7d5514640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fb7d00baa90 con 0x7fb7d00b8ed0 2024-05-15T15:39:49.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.388+0000 7fb7d5514640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fb7d00ba7b0 con 0x7fb7d00bf6f0 2024-05-15T15:39:49.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.388+0000 7fb7c67fc640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb7d00b8ed0 0x7fb7d00b92e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:49.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.388+0000 7fb7c67fc640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb7d00b8ed0 0x7fb7d00b92e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35556/0 (socket says 172.21.15.12:35556) 2024-05-15T15:39:49.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.388+0000 7fb7c67fc640 1 -- 172.21.15.12:0/311505588 learned_addr learned my addr 172.21.15.12:0/311505588 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:39:49.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.388+0000 7fb7ceffd640 1 --2- 172.21.15.12:0/311505588 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb7d00bf6f0 0x7fb7d00bfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:49.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.388+0000 7fb7c67fc640 1 -- 172.21.15.12:0/311505588 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb7d00bf6f0 msgr2=0x7fb7d00bfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:39:49.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.388+0000 7fb7c67fc640 1 --2- 172.21.15.12:0/311505588 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb7d00bf6f0 0x7fb7d00bfb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:49.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.388+0000 7fb7c67fc640 1 -- 172.21.15.12:0/311505588 >> v1:172.21.15.84:6789/0 conn(0x7fb7d0151b30 legacy=0x7fb7d0151f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:39:49.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.389+0000 7fb7c67fc640 1 -- 172.21.15.12:0/311505588 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7d00b9820 con 0x7fb7d00b8ed0 2024-05-15T15:39:49.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.389+0000 7fb7c67fc640 1 --2- 172.21.15.12:0/311505588 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb7d00b8ed0 0x7fb7d00b92e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb7b8009870 tx=0x7fb7b802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cba8d5ea44694b6 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:39:49.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.389+0000 7fb7ce7fc640 1 -- 172.21.15.12:0/311505588 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7b8037070 con 0x7fb7d00b8ed0 2024-05-15T15:39:49.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.389+0000 7fb7ce7fc640 1 -- 172.21.15.12:0/311505588 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7b8032440 con 0x7fb7d00b8ed0 2024-05-15T15:39:49.394 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.389+0000 7fb7ce7fc640 1 -- 172.21.15.12:0/311505588 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7b8032810 con 0x7fb7d00b8ed0 2024-05-15T15:39:49.394 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.390+0000 7fb7d5514640 1 -- 172.21.15.12:0/311505588 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb7d00b8ed0 msgr2=0x7fb7d00b92e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:49.394 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.390+0000 7fb7d5514640 1 --2- 172.21.15.12:0/311505588 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb7d00b8ed0 0x7fb7d00b92e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb7b8009870 tx=0x7fb7b802a1c0 comp rx=0 tx=0).stop 2024-05-15T15:39:49.394 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.390+0000 7fb7d5514640 1 -- 172.21.15.12:0/311505588 shutdown_connections 2024-05-15T15:39:49.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.390+0000 7fb7d5514640 1 --2- 172.21.15.12:0/311505588 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb7d00b8ed0 0x7fb7d00b92e0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:49.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.390+0000 7fb7d5514640 1 --2- 172.21.15.12:0/311505588 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb7d00bf6f0 0x7fb7d00bfb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:49.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.390+0000 7fb7d5514640 1 -- 172.21.15.12:0/311505588 >> 172.21.15.12:0/311505588 conn(0x7fb7d00c0570 msgr2=0x7fb7d00c0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:39:49.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.390+0000 7fb7d5514640 1 -- 172.21.15.12:0/311505588 shutdown_connections 2024-05-15T15:39:49.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.390+0000 7fb7d5514640 1 -- 172.21.15.12:0/311505588 wait complete. 2024-05-15T15:39:49.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.392+0000 7fb7d5514640 1 Processor -- start 2024-05-15T15:39:49.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.392+0000 7fb7d5514640 1 -- start start 2024-05-15T15:39:49.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.393+0000 7fb7d5514640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb7d00b8ed0 0x7fb7d0146000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:49.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.393+0000 7fb7d5514640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb7d00bf6f0 0x7fb7d0148ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:49.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.393+0000 7fb7d5514640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb7d0151b30 0x7fb7d013e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:49.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.393+0000 7fb7d5514640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fb7d01527d0 con 0x7fb7d00bf6f0 2024-05-15T15:39:49.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.393+0000 7fb7d5514640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fb7d0152650 con 0x7fb7d0151b30 2024-05-15T15:39:49.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.393+0000 7fb7d5514640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fb7d0152950 con 0x7fb7d00b8ed0 2024-05-15T15:39:49.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.393+0000 7fb7c67fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb7d00bf6f0 0x7fb7d0148ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:49.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.393+0000 7fb7c67fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb7d00bf6f0 0x7fb7d0148ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35572/0 (socket says 172.21.15.12:35572) 2024-05-15T15:39:49.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.393+0000 7fb7c67fc640 1 -- 172.21.15.12:0/828596642 learned_addr learned my addr 172.21.15.12:0/828596642 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:39:49.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.393+0000 7fb7ceffd640 1 --2- 172.21.15.12:0/828596642 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb7d00b8ed0 0x7fb7d0146000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:49.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.393+0000 7fb7cf7fe640 1 --2- 172.21.15.12:0/828596642 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb7d0151b30 0x7fb7d013e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:49.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.393+0000 7fb7c67fc640 1 -- 172.21.15.12:0/828596642 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb7d00b8ed0 msgr2=0x7fb7d0146000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:49.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.393+0000 7fb7c67fc640 1 --2- 172.21.15.12:0/828596642 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb7d00b8ed0 0x7fb7d0146000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:49.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.393+0000 7fb7c67fc640 1 -- 172.21.15.12:0/828596642 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb7d0151b30 msgr2=0x7fb7d013e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:49.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.393+0000 7fb7c67fc640 1 --2- 172.21.15.12:0/828596642 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb7d0151b30 0x7fb7d013e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:49.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.393+0000 7fb7c67fc640 1 -- 172.21.15.12:0/828596642 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7d0146540 con 0x7fb7d00bf6f0 2024-05-15T15:39:49.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.394+0000 7fb7c67fc640 1 --2- 172.21.15.12:0/828596642 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb7d00bf6f0 0x7fb7d0148ca0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fb7b8009870 tx=0x7fb7b80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:39:49.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.394+0000 7fb7c7fff640 1 -- 172.21.15.12:0/828596642 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7b8041020 con 0x7fb7d00bf6f0 2024-05-15T15:39:49.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.394+0000 7fb7c7fff640 1 -- 172.21.15.12:0/828596642 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7b80306c0 con 0x7fb7d00bf6f0 2024-05-15T15:39:49.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.394+0000 7fb7d5514640 1 -- 172.21.15.12:0/828596642 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7d01491e0 con 0x7fb7d00bf6f0 2024-05-15T15:39:49.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.394+0000 7fb7c7fff640 1 -- 172.21.15.12:0/828596642 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7b8037040 con 0x7fb7d00bf6f0 2024-05-15T15:39:49.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.394+0000 7fb7d5514640 1 -- 172.21.15.12:0/828596642 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7d01e4a80 con 0x7fb7d00bf6f0 2024-05-15T15:39:49.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.395+0000 7fb7d5514640 1 -- 172.21.15.12:0/828596642 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7d01496b0 con 0x7fb7d00bf6f0 2024-05-15T15:39:49.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.396+0000 7fb7c7fff640 1 -- 172.21.15.12:0/828596642 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb7b8044020 con 0x7fb7d00bf6f0 2024-05-15T15:39:49.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.396+0000 7fb7c7fff640 1 --2- 172.21.15.12:0/828596642 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fb7b0076300 0x7fb7b0078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:49.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.396+0000 7fb7c7fff640 1 -- 172.21.15.12:0/828596642 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7fb7b80b7a30 con 0x7fb7d00bf6f0 2024-05-15T15:39:49.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.397+0000 7fb7ceffd640 1 --2- 172.21.15.12:0/828596642 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fb7b0076300 0x7fb7b0078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:49.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.397+0000 7fb7ceffd640 1 --2- 172.21.15.12:0/828596642 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fb7b0076300 0x7fb7b0078810 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb7c0006fd0 tx=0x7fb7c0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:39:49.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.401+0000 7fb7c7fff640 1 -- 172.21.15.12:0/828596642 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fb7b804b030 con 0x7fb7d00bf6f0 2024-05-15T15:39:49.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:49.594+0000 7fb7d5514640 1 -- 172.21.15.12:0/828596642 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fb7d014bdd0 con 0x7fb7d00bf6f0 2024-05-15T15:39:50.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:50.428+0000 7fb7c7fff640 1 -- 172.21.15.12:0/828596642 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v20) ==== 138+0+0 (secure 0 0 0) 0x7fb7b8081770 con 0x7fb7d00bf6f0 2024-05-15T15:39:50.430 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_metadata' created 2024-05-15T15:39:50.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:50.432+0000 7fb7d5514640 1 -- 172.21.15.12:0/828596642 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fb7b0076300 msgr2=0x7fb7b0078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:50.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:50.432+0000 7fb7d5514640 1 --2- 172.21.15.12:0/828596642 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fb7b0076300 0x7fb7b0078810 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb7c0006fd0 tx=0x7fb7c0008040 comp rx=0 tx=0).stop 2024-05-15T15:39:50.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:50.432+0000 7fb7d5514640 1 -- 172.21.15.12:0/828596642 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb7d00bf6f0 msgr2=0x7fb7d0148ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:50.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:50.432+0000 7fb7d5514640 1 --2- 172.21.15.12:0/828596642 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb7d00bf6f0 0x7fb7d0148ca0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fb7b8009870 tx=0x7fb7b80046c0 comp rx=0 tx=0).stop 2024-05-15T15:39:50.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:50.432+0000 7fb7d5514640 1 -- 172.21.15.12:0/828596642 shutdown_connections 2024-05-15T15:39:50.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:50.432+0000 7fb7d5514640 1 --2- 172.21.15.12:0/828596642 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb7d0151b30 0x7fb7d013e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:50.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:50.432+0000 7fb7d5514640 1 --2- 172.21.15.12:0/828596642 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fb7b0076300 0x7fb7b0078810 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:50.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:50.432+0000 7fb7d5514640 1 --2- 172.21.15.12:0/828596642 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb7d00bf6f0 0x7fb7d0148ca0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:50.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:50.432+0000 7fb7d5514640 1 --2- 172.21.15.12:0/828596642 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb7d00b8ed0 0x7fb7d0146000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:50.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:50.432+0000 7fb7d5514640 1 -- 172.21.15.12:0/828596642 >> 172.21.15.12:0/828596642 conn(0x7fb7d00c0570 msgr2=0x7fb7d00a8e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:39:50.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:50.432+0000 7fb7d5514640 1 -- 172.21.15.12:0/828596642 shutdown_connections 2024-05-15T15:39:50.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:50.432+0000 7fb7d5514640 1 -- 172.21.15.12:0/828596642 wait complete. 2024-05-15T15:39:50.452 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-05-15T15:39:50.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:50.574+0000 7fadc889f640 1 Processor -- start 2024-05-15T15:39:50.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:50.574+0000 7fadc889f640 1 -- start start 2024-05-15T15:39:50.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:50.576+0000 7fadc889f640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fadc4151fc0 0x7fadc40bd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:50.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:50.576+0000 7fadc889f640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fadc40bf050 0x7fadc4158e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:50.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:50.576+0000 7fadc889f640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fadc40c36f0 con 0x7fadc406da30 2024-05-15T15:39:50.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:50.576+0000 7fadc889f640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fadc40bdc10 con 0x7fadc4151fc0 2024-05-15T15:39:50.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:50.576+0000 7fadc889f640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7fadc4152530 con 0x7fadc40bf050 2024-05-15T15:39:50.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:50.576+0000 7fadc259c640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fadc4151fc0 0x7fadc40bd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:50.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:50.576+0000 7fadc1d9b640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fadc406da30 0x7fadc40be940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:34258/0 (socket says 172.21.15.12:34258) 2024-05-15T15:39:50.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:50.576+0000 7fadc1d9b640 1 -- 172.21.15.12:0/2692029903 learned_addr learned my addr 172.21.15.12:0/2692029903 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-05-15T15:39:50.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:50.576+0000 7fadc259c640 1 --2- 172.21.15.12:0/2692029903 >> v2:172.21.15.12:3300/0 conn(0x7fadc4151fc0 0x7fadc40bd6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35582/0 (socket says 172.21.15.12:35582) 2024-05-15T15:39:50.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:50.576+0000 7fadc2d9d640 1 --2- 172.21.15.12:0/2692029903 >> v2:172.21.15.84:3300/0 conn(0x7fadc40bf050 0x7fadc4158e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:50.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:50.576+0000 7fadc259c640 1 -- 172.21.15.12:0/2692029903 >> v2:172.21.15.84:3300/0 conn(0x7fadc40bf050 msgr2=0x7fadc4158e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:39:50.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:50.576+0000 7fadc259c640 1 --2- 172.21.15.12:0/2692029903 >> v2:172.21.15.84:3300/0 conn(0x7fadc40bf050 0x7fadc4158e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:50.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:50.576+0000 7fadc259c640 1 -- 172.21.15.12:0/2692029903 >> v1:172.21.15.12:6789/0 conn(0x7fadc406da30 legacy=0x7fadc40be940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:50.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:50.576+0000 7fadc259c640 1 -- 172.21.15.12:0/2692029903 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadc4152810 con 0x7fadc4151fc0 2024-05-15T15:39:50.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:50.576+0000 7fadc159a640 1 -- 172.21.15.12:0/2692029903 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1418067128 0 0) 0x7fadc40c36f0 con 0x7fadc406da30 2024-05-15T15:39:50.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:50.576+0000 7fadc2d9d640 1 --2- 172.21.15.12:0/2692029903 >> v2:172.21.15.84:3300/0 conn(0x7fadc40bf050 0x7fadc4158e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-15T15:39:50.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:50.577+0000 7fadc259c640 1 --2- 172.21.15.12:0/2692029903 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fadc4151fc0 0x7fadc40bd6d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fadc40bf8f0 tx=0x7fadbc02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8a494687788207a server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:39:50.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:50.577+0000 7fadc159a640 1 -- 172.21.15.12:0/2692029903 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadbc037070 con 0x7fadc4151fc0 2024-05-15T15:39:50.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:50.577+0000 7fadc159a640 1 -- 172.21.15.12:0/2692029903 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadbc032440 con 0x7fadc4151fc0 2024-05-15T15:39:50.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:50.577+0000 7fadc159a640 1 -- 172.21.15.12:0/2692029903 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadbc032810 con 0x7fadc4151fc0 2024-05-15T15:39:50.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:50.578+0000 7fadc889f640 1 -- 172.21.15.12:0/2692029903 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fadc4151fc0 msgr2=0x7fadc40bd6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:50.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:50.578+0000 7fadc889f640 1 --2- 172.21.15.12:0/2692029903 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fadc4151fc0 0x7fadc40bd6d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fadc40bf8f0 tx=0x7fadbc02a1a0 comp rx=0 tx=0).stop 2024-05-15T15:39:50.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:50.578+0000 7fadc889f640 1 -- 172.21.15.12:0/2692029903 shutdown_connections 2024-05-15T15:39:50.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:50.578+0000 7fadc889f640 1 --2- 172.21.15.12:0/2692029903 >> v2:172.21.15.84:3300/0 conn(0x7fadc40bf050 0x7fadc4158e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:50.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:50.578+0000 7fadc889f640 1 --2- 172.21.15.12:0/2692029903 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fadc4151fc0 0x7fadc40bd6d0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:50.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:50.578+0000 7fadc889f640 1 -- 172.21.15.12:0/2692029903 >> 172.21.15.12:0/2692029903 conn(0x7fadc40c3d20 msgr2=0x7fadc40c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:39:50.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:50.578+0000 7fadc889f640 1 -- 172.21.15.12:0/2692029903 shutdown_connections 2024-05-15T15:39:50.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:50.578+0000 7fadc889f640 1 -- 172.21.15.12:0/2692029903 wait complete. 2024-05-15T15:39:50.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:50.579+0000 7fadc889f640 1 Processor -- start 2024-05-15T15:39:50.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:50.580+0000 7fadc889f640 1 -- start start 2024-05-15T15:39:50.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:50.581+0000 7fadc889f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fadc406da30 0x7fadc41e8030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:50.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:50.581+0000 7fadc889f640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fadc40bf050 0x7fadc414b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:50.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:50.581+0000 7fadc889f640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fadc4151fc0 0x7fadc40b9f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:50.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:50.581+0000 7fadc889f640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fadc40a3050 con 0x7fadc406da30 2024-05-15T15:39:50.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:50.581+0000 7fadc889f640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fadc40a2ed0 con 0x7fadc4151fc0 2024-05-15T15:39:50.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:50.581+0000 7fadc889f640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fadc406de40 con 0x7fadc40bf050 2024-05-15T15:39:50.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:50.581+0000 7fadc259c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fadc406da30 0x7fadc41e8030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:50.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:50.581+0000 7fadc259c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fadc406da30 0x7fadc41e8030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35598/0 (socket says 172.21.15.12:35598) 2024-05-15T15:39:50.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:50.581+0000 7fadc259c640 1 -- 172.21.15.12:0/1511331136 learned_addr learned my addr 172.21.15.12:0/1511331136 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:39:50.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:50.581+0000 7fadc2d9d640 1 --2- 172.21.15.12:0/1511331136 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fadc4151fc0 0x7fadc40b9f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:50.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:50.581+0000 7fadc1d9b640 1 --2- 172.21.15.12:0/1511331136 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fadc40bf050 0x7fadc414b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:50.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:50.581+0000 7fadc259c640 1 -- 172.21.15.12:0/1511331136 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fadc40bf050 msgr2=0x7fadc414b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:50.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:50.581+0000 7fadc259c640 1 --2- 172.21.15.12:0/1511331136 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fadc40bf050 0x7fadc414b0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:50.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:50.581+0000 7fadc259c640 1 -- 172.21.15.12:0/1511331136 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fadc4151fc0 msgr2=0x7fadc40b9f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:50.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:50.581+0000 7fadc259c640 1 --2- 172.21.15.12:0/1511331136 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fadc4151fc0 0x7fadc40b9f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:50.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:50.581+0000 7fadc259c640 1 -- 172.21.15.12:0/1511331136 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadc41e8570 con 0x7fadc406da30 2024-05-15T15:39:50.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:50.581+0000 7fadc1d9b640 1 --2- 172.21.15.12:0/1511331136 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fadc40bf050 0x7fadc414b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-15T15:39:50.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:50.581+0000 7fadc259c640 1 --2- 172.21.15.12:0/1511331136 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fadc406da30 0x7fadc41e8030 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fadbc000c00 tx=0x7fadbc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:39:50.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:50.581+0000 7fadb2ffd640 1 -- 172.21.15.12:0/1511331136 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadbc037040 con 0x7fadc406da30 2024-05-15T15:39:50.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:50.581+0000 7fadb2ffd640 1 -- 172.21.15.12:0/1511331136 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadbc042070 con 0x7fadc406da30 2024-05-15T15:39:50.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:50.581+0000 7fadc889f640 1 -- 172.21.15.12:0/1511331136 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadc414ef30 con 0x7fadc406da30 2024-05-15T15:39:50.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:50.581+0000 7fadb2ffd640 1 -- 172.21.15.12:0/1511331136 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadbc030bd0 con 0x7fadc406da30 2024-05-15T15:39:50.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:50.581+0000 7fadc889f640 1 -- 172.21.15.12:0/1511331136 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadc41e7b10 con 0x7fadc406da30 2024-05-15T15:39:50.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:50.583+0000 7fadc889f640 1 -- 172.21.15.12:0/1511331136 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fadc4050940 con 0x7fadc406da30 2024-05-15T15:39:50.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:50.583+0000 7fadb2ffd640 1 -- 172.21.15.12:0/1511331136 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fadbc047460 con 0x7fadc406da30 2024-05-15T15:39:50.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:50.584+0000 7fadb2ffd640 1 --2- 172.21.15.12:0/1511331136 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fada4076300 0x7fada4078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:50.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:50.584+0000 7fadb2ffd640 1 -- 172.21.15.12:0/1511331136 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5227+0+0 (secure 0 0 0) 0x7fadbc0b7e70 con 0x7fadc406da30 2024-05-15T15:39:50.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:50.584+0000 7fadc1d9b640 1 --2- 172.21.15.12:0/1511331136 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fada4076300 0x7fada4078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:50.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:50.585+0000 7fadc1d9b640 1 --2- 172.21.15.12:0/1511331136 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fada4076300 0x7fada4078810 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fadc41e2030 tx=0x7fadb8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:39:50.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:50.589+0000 7fadb2ffd640 1 -- 172.21.15.12:0/1511331136 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fadbc032e20 con 0x7fadc406da30 2024-05-15T15:39:50.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:50.779+0000 7fadc889f640 1 -- 172.21.15.12:0/1511331136 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fadc406eb40 con 0x7fadc406da30 2024-05-15T15:39:51.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:51.430+0000 7fadb2ffd640 1 -- 172.21.15.12:0/1511331136 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v21) ==== 170+0+0 (secure 0 0 0) 0x7fadbc0819b0 con 0x7fadc406da30 2024-05-15T15:39:51.432 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_data' created 2024-05-15T15:39:51.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:51.434+0000 7fadc889f640 1 -- 172.21.15.12:0/1511331136 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fada4076300 msgr2=0x7fada4078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:51.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:51.434+0000 7fadc889f640 1 --2- 172.21.15.12:0/1511331136 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fada4076300 0x7fada4078810 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fadc41e2030 tx=0x7fadb8009040 comp rx=0 tx=0).stop 2024-05-15T15:39:51.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:51.434+0000 7fadc889f640 1 -- 172.21.15.12:0/1511331136 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fadc406da30 msgr2=0x7fadc41e8030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:51.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:51.434+0000 7fadc889f640 1 --2- 172.21.15.12:0/1511331136 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fadc406da30 0x7fadc41e8030 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fadbc000c00 tx=0x7fadbc0046c0 comp rx=0 tx=0).stop 2024-05-15T15:39:51.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:51.435+0000 7fadc889f640 1 -- 172.21.15.12:0/1511331136 shutdown_connections 2024-05-15T15:39:51.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:51.435+0000 7fadc889f640 1 --2- 172.21.15.12:0/1511331136 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fadc4151fc0 0x7fadc40b9f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:51.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:51.435+0000 7fadc889f640 1 --2- 172.21.15.12:0/1511331136 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fadc40bf050 0x7fadc414b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:51.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:51.435+0000 7fadc889f640 1 --2- 172.21.15.12:0/1511331136 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fada4076300 0x7fada4078810 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:51.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:51.435+0000 7fadc889f640 1 --2- 172.21.15.12:0/1511331136 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fadc406da30 0x7fadc41e8030 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:51.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:51.435+0000 7fadc889f640 1 -- 172.21.15.12:0/1511331136 >> 172.21.15.12:0/1511331136 conn(0x7fadc40c3d20 msgr2=0x7fadc40c09d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:39:51.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:51.435+0000 7fadc889f640 1 -- 172.21.15.12:0/1511331136 shutdown_connections 2024-05-15T15:39:51.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:51.435+0000 7fadc889f640 1 -- 172.21.15.12:0/1511331136 wait complete. 2024-05-15T15:39:51.467 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-15T15:39:51.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:51.584+0000 7f478055e640 1 Processor -- start 2024-05-15T15:39:51.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:51.584+0000 7f478055e640 1 -- start start 2024-05-15T15:39:51.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:51.585+0000 7f478055e640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4778146070 0x7f4778146480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:51.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:51.585+0000 7f478055e640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f477814c7e0 0x7f477814cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:51.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:51.585+0000 7f478055e640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47781469c0 con 0x7f47780c10a0 2024-05-15T15:39:51.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:51.585+0000 7f478055e640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f47780a1200 con 0x7f4778146070 2024-05-15T15:39:51.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:51.585+0000 7f478055e640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f477814c350 con 0x7f477814c7e0 2024-05-15T15:39:51.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:51.585+0000 7f477daf9640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4778146070 0x7f4778146480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:51.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:51.585+0000 7f477eafb640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f477814c7e0 0x7f477814cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:51.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:51.585+0000 7f477daf9640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4778146070 0x7f4778146480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.12:47994/0 (socket says 172.21.15.12:47994) 2024-05-15T15:39:51.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:51.585+0000 7f477eafb640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f477814c7e0 0x7f477814cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3301/0 says I am v2:172.21.15.12:39934/0 (socket says 172.21.15.12:39934) 2024-05-15T15:39:51.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:51.585+0000 7f477daf9640 1 -- 172.21.15.12:0/2773327549 learned_addr learned my addr 172.21.15.12:0/2773327549 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:39:51.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:51.585+0000 7f477e2fa640 1 --1- 172.21.15.12:0/2773327549 >> v1:172.21.15.84:6789/0 conn(0x7f47780c10a0 0x7f477814f770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.12:44438/0 (socket says 172.21.15.12:44438) 2024-05-15T15:39:51.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:51.586+0000 7f477daf9640 1 -- 172.21.15.12:0/2773327549 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f477814c7e0 msgr2=0x7f477814cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:39:51.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:51.586+0000 7f477daf9640 1 --2- 172.21.15.12:0/2773327549 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f477814c7e0 0x7f477814cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:51.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:51.586+0000 7f477daf9640 1 -- 172.21.15.12:0/2773327549 >> v1:172.21.15.84:6789/0 conn(0x7f47780c10a0 legacy=0x7f477814f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:51.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:51.586+0000 7f477d2f8640 1 -- 172.21.15.12:0/2773327549 <== mon.1 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2836915485 0 0) 0x7f47781469c0 con 0x7f47780c10a0 2024-05-15T15:39:51.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:51.586+0000 7f477daf9640 1 -- 172.21.15.12:0/2773327549 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f477814ffe0 con 0x7f4778146070 2024-05-15T15:39:51.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:51.586+0000 7f477eafb640 1 --2- 172.21.15.12:0/2773327549 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f477814c7e0 0x7f477814cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-15T15:39:51.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:51.586+0000 7f477daf9640 1 --2- 172.21.15.12:0/2773327549 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4778146070 0x7f4778146480 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f4768009870 tx=0x7f476802a300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=63ce13fe4dce700a server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:39:51.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:51.587+0000 7f477d2f8640 1 -- 172.21.15.12:0/2773327549 <== mon.1 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4768037070 con 0x7f4778146070 2024-05-15T15:39:51.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:51.587+0000 7f477d2f8640 1 -- 172.21.15.12:0/2773327549 <== mon.1 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f476802ae50 con 0x7f4778146070 2024-05-15T15:39:51.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:51.587+0000 7f477d2f8640 1 -- 172.21.15.12:0/2773327549 <== mon.1 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4768032860 con 0x7f4778146070 2024-05-15T15:39:51.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:51.587+0000 7f478055e640 1 -- 172.21.15.12:0/2773327549 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4778146070 msgr2=0x7f4778146480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:51.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:51.587+0000 7f478055e640 1 --2- 172.21.15.12:0/2773327549 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4778146070 0x7f4778146480 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f4768009870 tx=0x7f476802a300 comp rx=0 tx=0).stop 2024-05-15T15:39:51.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:51.587+0000 7f478055e640 1 -- 172.21.15.12:0/2773327549 shutdown_connections 2024-05-15T15:39:51.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:51.587+0000 7f478055e640 1 --2- 172.21.15.12:0/2773327549 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f477814c7e0 0x7f477814cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:51.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:51.587+0000 7f478055e640 1 --2- 172.21.15.12:0/2773327549 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4778146070 0x7f4778146480 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:51.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:51.587+0000 7f478055e640 1 -- 172.21.15.12:0/2773327549 >> 172.21.15.12:0/2773327549 conn(0x7f47780c1830 msgr2=0x7f47780c1c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:39:51.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:51.587+0000 7f478055e640 1 -- 172.21.15.12:0/2773327549 shutdown_connections 2024-05-15T15:39:51.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:51.587+0000 7f478055e640 1 -- 172.21.15.12:0/2773327549 wait complete. 2024-05-15T15:39:51.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:51.589+0000 7f478055e640 1 Processor -- start 2024-05-15T15:39:51.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:51.589+0000 7f478055e640 1 -- start start 2024-05-15T15:39:51.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:51.590+0000 7f478055e640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f47780c10a0 0x7f4778146d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:51.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:51.590+0000 7f478055e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4778146070 0x7f47781e5310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:51.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:51.590+0000 7f478055e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f477814c7e0 0x7f47781d87f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:51.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:51.590+0000 7f478055e640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f47780c14b0 con 0x7f477814c7e0 2024-05-15T15:39:51.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:51.590+0000 7f478055e640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f47781505a0 con 0x7f4778146070 2024-05-15T15:39:51.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:51.590+0000 7f478055e640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f477814d130 con 0x7f47780c10a0 2024-05-15T15:39:51.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:51.590+0000 7f477eafb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f477814c7e0 0x7f47781d87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:51.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:51.590+0000 7f477eafb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f477814c7e0 0x7f47781d87f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35608/0 (socket says 172.21.15.12:35608) 2024-05-15T15:39:51.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:51.590+0000 7f477eafb640 1 -- 172.21.15.12:0/560602857 learned_addr learned my addr 172.21.15.12:0/560602857 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:39:51.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:51.590+0000 7f477e2fa640 1 --2- 172.21.15.12:0/560602857 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f47780c10a0 0x7f4778146d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:51.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:51.590+0000 7f477daf9640 1 --2- 172.21.15.12:0/560602857 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4778146070 0x7f47781e5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:51.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:51.591+0000 7f477eafb640 1 -- 172.21.15.12:0/560602857 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f47780c10a0 msgr2=0x7f4778146d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:51.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:51.591+0000 7f477eafb640 1 --2- 172.21.15.12:0/560602857 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f47780c10a0 0x7f4778146d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:51.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:51.591+0000 7f477eafb640 1 -- 172.21.15.12:0/560602857 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4778146070 msgr2=0x7f47781e5310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:51.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:51.591+0000 7f477eafb640 1 --2- 172.21.15.12:0/560602857 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4778146070 0x7f47781e5310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:51.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:51.591+0000 7f477eafb640 1 -- 172.21.15.12:0/560602857 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47781472b0 con 0x7f477814c7e0 2024-05-15T15:39:51.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:51.591+0000 7f477eafb640 1 --2- 172.21.15.12:0/560602857 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f477814c7e0 0x7f47781d87f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f477000efc0 tx=0x7f477000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:39:51.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:51.591+0000 7f476effd640 1 -- 172.21.15.12:0/560602857 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4770018030 con 0x7f477814c7e0 2024-05-15T15:39:51.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:51.591+0000 7f476effd640 1 -- 172.21.15.12:0/560602857 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f477000ccd0 con 0x7f477814c7e0 2024-05-15T15:39:51.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:51.591+0000 7f476effd640 1 -- 172.21.15.12:0/560602857 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4770003bb0 con 0x7f477814c7e0 2024-05-15T15:39:51.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:51.591+0000 7f478055e640 1 -- 172.21.15.12:0/560602857 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47781486b0 con 0x7f477814c7e0 2024-05-15T15:39:51.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:51.591+0000 7f478055e640 1 -- 172.21.15.12:0/560602857 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47781e61b0 con 0x7f477814c7e0 2024-05-15T15:39:51.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:51.592+0000 7f478055e640 1 -- 172.21.15.12:0/560602857 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4778050940 con 0x7f477814c7e0 2024-05-15T15:39:51.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:51.593+0000 7f476effd640 1 -- 172.21.15.12:0/560602857 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f4770005d10 con 0x7f477814c7e0 2024-05-15T15:39:51.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:51.593+0000 7f476effd640 1 --2- 172.21.15.12:0/560602857 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f475c0762d0 0x7f475c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:51.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:51.594+0000 7f476effd640 1 -- 172.21.15.12:0/560602857 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5609+0+0 (secure 0 0 0) 0x7f4770097e20 con 0x7f477814c7e0 2024-05-15T15:39:51.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:51.594+0000 7f477e2fa640 1 --2- 172.21.15.12:0/560602857 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f475c0762d0 0x7f475c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:51.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:51.594+0000 7f477e2fa640 1 --2- 172.21.15.12:0/560602857 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f475c0762d0 0x7f475c0787e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f4774007fd0 tx=0x7f4774007e00 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:39:51.600 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:51.598+0000 7f476effd640 1 -- 172.21.15.12:0/560602857 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f4770022070 con 0x7f477814c7e0 2024-05-15T15:39:51.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:51.828+0000 7f478055e640 1 -- 172.21.15.12:0/560602857 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f47780a7270 con 0x7f477814c7e0 2024-05-15T15:39:52.338 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:39:52.342 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:39:52.345 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:39:52.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.442+0000 7f476effd640 1 -- 172.21.15.12:0/560602857 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7f4770010040 con 0x7f477814c7e0 2024-05-15T15:39:52.444 INFO:teuthology.orchestra.run.smithi012.stderr:new fs with metadata pool 2 and data pool 3 2024-05-15T15:39:52.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.446+0000 7f478055e640 1 -- 172.21.15.12:0/560602857 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f475c0762d0 msgr2=0x7f475c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:52.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.447+0000 7f478055e640 1 --2- 172.21.15.12:0/560602857 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f475c0762d0 0x7f475c0787e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f4774007fd0 tx=0x7f4774007e00 comp rx=0 tx=0).stop 2024-05-15T15:39:52.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.447+0000 7f478055e640 1 -- 172.21.15.12:0/560602857 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f477814c7e0 msgr2=0x7f47781d87f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:52.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.447+0000 7f478055e640 1 --2- 172.21.15.12:0/560602857 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f477814c7e0 0x7f47781d87f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f477000efc0 tx=0x7f477000c490 comp rx=0 tx=0).stop 2024-05-15T15:39:52.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.450+0000 7f478055e640 1 -- 172.21.15.12:0/560602857 shutdown_connections 2024-05-15T15:39:52.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.450+0000 7f478055e640 1 --2- 172.21.15.12:0/560602857 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f475c0762d0 0x7f475c0787e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:52.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.450+0000 7f478055e640 1 --2- 172.21.15.12:0/560602857 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f477814c7e0 0x7f47781d87f0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:52.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.450+0000 7f478055e640 1 --2- 172.21.15.12:0/560602857 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4778146070 0x7f47781e5310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:52.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.450+0000 7f478055e640 1 --2- 172.21.15.12:0/560602857 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f47780c10a0 0x7f4778146d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:52.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.450+0000 7f478055e640 1 -- 172.21.15.12:0/560602857 >> 172.21.15.12:0/560602857 conn(0x7f47780c1830 msgr2=0x7f47780be540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:39:52.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.450+0000 7f478055e640 1 -- 172.21.15.12:0/560602857 shutdown_connections 2024-05-15T15:39:52.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.450+0000 7f478055e640 1 -- 172.21.15.12:0/560602857 wait complete. 2024-05-15T15:39:52.486 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-15T15:39:52.601 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.599+0000 7fb067827640 1 Processor -- start 2024-05-15T15:39:52.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.600+0000 7fb067827640 1 -- start start 2024-05-15T15:39:52.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.601+0000 7fb067827640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb06014e260 0x7fb06014e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:52.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.601+0000 7fb067827640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb0600bfaa0 0x7fb0600bfeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:52.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.601+0000 7fb067827640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0600be9d0 con 0x7fb060148330 2024-05-15T15:39:52.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.601+0000 7fb067827640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7fb060148740 con 0x7fb0600bfaa0 2024-05-15T15:39:52.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.601+0000 7fb067827640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fb0601518d0 con 0x7fb06014e260 2024-05-15T15:39:52.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.601+0000 7fb0655c3640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fb060148330 0x7fb0600be2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:34270/0 (socket says 172.21.15.12:34270) 2024-05-15T15:39:52.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.601+0000 7fb0655c3640 1 -- 172.21.15.12:0/3380765746 learned_addr learned my addr 172.21.15.12:0/3380765746 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-05-15T15:39:52.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.601+0000 7fb065dc4640 1 --2- 172.21.15.12:0/3380765746 >> v2:172.21.15.84:3300/0 conn(0x7fb0600bfaa0 0x7fb0600bfeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:52.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.601+0000 7fb05ffff640 1 -- 172.21.15.12:0/3380765746 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 123090378 0 0) 0x7fb058001110 con 0x7fb060148330 2024-05-15T15:39:52.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.601+0000 7fb064dc2640 1 --2- 172.21.15.12:0/3380765746 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb06014e260 0x7fb06014e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:52.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.601+0000 7fb05ffff640 1 -- 172.21.15.12:0/3380765746 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb048003520 con 0x7fb060148330 2024-05-15T15:39:52.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.601+0000 7fb05ffff640 1 -- 172.21.15.12:0/3380765746 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4191360820 0 0) 0x7fb048003520 con 0x7fb060148330 2024-05-15T15:39:52.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.601+0000 7fb05ffff640 1 -- 172.21.15.12:0/3380765746 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb06014e260 msgr2=0x7fb06014e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:39:52.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.601+0000 7fb05ffff640 1 --2- 172.21.15.12:0/3380765746 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb06014e260 0x7fb06014e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:52.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.601+0000 7fb05ffff640 1 -- 172.21.15.12:0/3380765746 >> v2:172.21.15.84:3300/0 conn(0x7fb0600bfaa0 msgr2=0x7fb0600bfeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:39:52.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.601+0000 7fb05ffff640 1 --2- 172.21.15.12:0/3380765746 >> v2:172.21.15.84:3300/0 conn(0x7fb0600bfaa0 0x7fb0600bfeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:52.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.601+0000 7fb05ffff640 1 -- 172.21.15.12:0/3380765746 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb060151bb0 con 0x7fb060148330 2024-05-15T15:39:52.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.601+0000 7fb05ffff640 1 -- 172.21.15.12:0/3380765746 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 38171736 0 0) 0x7fb0580018c0 con 0x7fb060148330 2024-05-15T15:39:52.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.602+0000 7fb05ffff640 1 -- 172.21.15.12:0/3380765746 >> v1:172.21.15.12:6789/0 conn(0x7fb060148330 legacy=0x7fb0600be2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:52.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.602+0000 7fb05ffff640 1 --2- 172.21.15.12:0/3380765746 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb048003a50 0x7fb048003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:52.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.602+0000 7fb05ffff640 1 --2- 172.21.15.12:0/3380765746 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb048004800 0x7fb048004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:52.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.602+0000 7fb05ffff640 1 --2- 172.21.15.12:0/3380765746 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb06014e260 0x7fb048005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:52.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.602+0000 7fb05ffff640 1 -- 172.21.15.12:0/3380765746 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fb060148740 con 0x7fb048004800 2024-05-15T15:39:52.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.602+0000 7fb05ffff640 1 -- 172.21.15.12:0/3380765746 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fb0601518d0 con 0x7fb048003a50 2024-05-15T15:39:52.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.602+0000 7fb05ffff640 1 -- 172.21.15.12:0/3380765746 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fb04800baa0 con 0x7fb06014e260 2024-05-15T15:39:52.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.602+0000 7fb064dc2640 1 --2- 172.21.15.12:0/3380765746 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb048004800 0x7fb048004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:52.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.602+0000 7fb0655c3640 1 --2- 172.21.15.12:0/3380765746 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb048003a50 0x7fb048003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:52.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.602+0000 7fb065dc4640 1 --2- 172.21.15.12:0/3380765746 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb06014e260 0x7fb048005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:52.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.602+0000 7fb064dc2640 1 -- 172.21.15.12:0/3380765746 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb06014e260 msgr2=0x7fb048005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:39:52.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.602+0000 7fb064dc2640 1 --2- 172.21.15.12:0/3380765746 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb06014e260 0x7fb048005150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:52.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.602+0000 7fb064dc2640 1 -- 172.21.15.12:0/3380765746 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb048003a50 msgr2=0x7fb048003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:39:52.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.602+0000 7fb064dc2640 1 --2- 172.21.15.12:0/3380765746 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb048003a50 0x7fb048003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:52.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.602+0000 7fb064dc2640 1 -- 172.21.15.12:0/3380765746 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb048003520 con 0x7fb048004800 2024-05-15T15:39:52.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.603+0000 7fb064dc2640 1 --2- 172.21.15.12:0/3380765746 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb048004800 0x7fb048004c10 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb054009ac0 tx=0x7fb048005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c925b530f0a1d1fb server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:39:52.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.603+0000 7fb05ffff640 1 -- 172.21.15.12:0/3380765746 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb054036070 con 0x7fb048004800 2024-05-15T15:39:52.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.603+0000 7fb05ffff640 1 -- 172.21.15.12:0/3380765746 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb054031400 con 0x7fb048004800 2024-05-15T15:39:52.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.603+0000 7fb05ffff640 1 -- 172.21.15.12:0/3380765746 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb054009690 con 0x7fb048004800 2024-05-15T15:39:52.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.603+0000 7fb067827640 1 -- 172.21.15.12:0/3380765746 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb048004800 msgr2=0x7fb048004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:52.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.603+0000 7fb067827640 1 --2- 172.21.15.12:0/3380765746 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb048004800 0x7fb048004c10 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb054009ac0 tx=0x7fb048005830 comp rx=0 tx=0).stop 2024-05-15T15:39:52.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.604+0000 7fb065dc4640 1 -- 172.21.15.12:0/3380765746 reap_dead start 2024-05-15T15:39:52.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.604+0000 7fb067827640 1 -- 172.21.15.12:0/3380765746 shutdown_connections 2024-05-15T15:39:52.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.604+0000 7fb067827640 1 -- 172.21.15.12:0/3380765746 >> 172.21.15.12:0/3380765746 conn(0x7fb0600c17c0 msgr2=0x7fb0600c1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:39:52.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.604+0000 7fb067827640 1 -- 172.21.15.12:0/3380765746 shutdown_connections 2024-05-15T15:39:52.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.604+0000 7fb067827640 1 -- 172.21.15.12:0/3380765746 wait complete. 2024-05-15T15:39:52.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.605+0000 7fb067827640 1 Processor -- start 2024-05-15T15:39:52.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.605+0000 7fb067827640 1 -- start start 2024-05-15T15:39:52.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.606+0000 7fb067827640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb048004800 0x7fb0600b7980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:52.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.606+0000 7fb067827640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb0600bd1f0 0x7fb060143990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:52.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.606+0000 7fb067827640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb060143ed0 0x7fb060150400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:52.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.606+0000 7fb067827640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fb0600c10b0 con 0x7fb0600bd1f0 2024-05-15T15:39:52.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.606+0000 7fb067827640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fb060152170 con 0x7fb060143ed0 2024-05-15T15:39:52.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.606+0000 7fb067827640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fb060152690 con 0x7fb048004800 2024-05-15T15:39:52.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.606+0000 7fb064dc2640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb0600bd1f0 0x7fb060143990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:52.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.606+0000 7fb064dc2640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb0600bd1f0 0x7fb060143990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35618/0 (socket says 172.21.15.12:35618) 2024-05-15T15:39:52.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.606+0000 7fb064dc2640 1 -- 172.21.15.12:0/3088472403 learned_addr learned my addr 172.21.15.12:0/3088472403 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:39:52.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.607+0000 7fb0655c3640 1 --2- 172.21.15.12:0/3088472403 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb048004800 0x7fb0600b7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:52.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.607+0000 7fb065dc4640 1 --2- 172.21.15.12:0/3088472403 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb060143ed0 0x7fb060150400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:52.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.607+0000 7fb064dc2640 1 -- 172.21.15.12:0/3088472403 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb048004800 msgr2=0x7fb0600b7980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:52.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.607+0000 7fb064dc2640 1 --2- 172.21.15.12:0/3088472403 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb048004800 0x7fb0600b7980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:52.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.607+0000 7fb064dc2640 1 -- 172.21.15.12:0/3088472403 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb060143ed0 msgr2=0x7fb060150400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:52.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.607+0000 7fb064dc2640 1 --2- 172.21.15.12:0/3088472403 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb060143ed0 0x7fb060150400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:52.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.607+0000 7fb064dc2640 1 -- 172.21.15.12:0/3088472403 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0600b7ec0 con 0x7fb0600bd1f0 2024-05-15T15:39:52.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.607+0000 7fb064dc2640 1 --2- 172.21.15.12:0/3088472403 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb0600bd1f0 0x7fb060143990 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fb054009be0 tx=0x7fb054004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:39:52.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.607+0000 7fb05dffb640 1 -- 172.21.15.12:0/3088472403 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb054040020 con 0x7fb0600bd1f0 2024-05-15T15:39:52.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.607+0000 7fb05dffb640 1 -- 172.21.15.12:0/3088472403 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb054003940 con 0x7fb0600bd1f0 2024-05-15T15:39:52.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.607+0000 7fb067827640 1 -- 172.21.15.12:0/3088472403 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0600bdfe0 con 0x7fb0600bd1f0 2024-05-15T15:39:52.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.607+0000 7fb05dffb640 1 -- 172.21.15.12:0/3088472403 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb054036040 con 0x7fb0600bd1f0 2024-05-15T15:39:52.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.607+0000 7fb067827640 1 -- 172.21.15.12:0/3088472403 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb06014f8c0 con 0x7fb0600bd1f0 2024-05-15T15:39:52.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.608+0000 7fb067827640 1 -- 172.21.15.12:0/3088472403 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0600b86c0 con 0x7fb0600bd1f0 2024-05-15T15:39:52.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.609+0000 7fb05dffb640 1 -- 172.21.15.12:0/3088472403 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb054043020 con 0x7fb0600bd1f0 2024-05-15T15:39:52.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.610+0000 7fb05dffb640 1 --2- 172.21.15.12:0/3088472403 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fb04c076300 0x7fb04c078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:52.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.610+0000 7fb05dffb640 1 -- 172.21.15.12:0/3088472403 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fb0540b78d0 con 0x7fb0600bd1f0 2024-05-15T15:39:52.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.610+0000 7fb0655c3640 1 --2- 172.21.15.12:0/3088472403 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fb04c076300 0x7fb04c078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:52.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.610+0000 7fb0655c3640 1 --2- 172.21.15.12:0/3088472403 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fb04c076300 0x7fb04c078810 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb060073fb0 tx=0x7fb058009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:39:52.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.614+0000 7fb05dffb640 1 -- 172.21.15.12:0/3088472403 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fb05404a070 con 0x7fb0600bd1f0 2024-05-15T15:39:52.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.807+0000 7fb067827640 1 -- 172.21.15.12:0/3088472403 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb0600be240 con 0x7fb0600bd1f0 2024-05-15T15:39:52.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.809+0000 7fb05dffb640 1 -- 172.21.15.12:0/3088472403 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16586 (secure 0 0 0) 0x7fb054081190 con 0x7fb0600bd1f0 2024-05-15T15:39:52.811 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-05-15T15:39:52.811 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":22,"fsid":"3b7fc4b2-b85c-49b5-a5de-38444eeed40d","created":"2024-05-15T15:39:28.392476+0000","modified":"2024-05-15T15:39:51.829539+0000","last_up_change":"2024-05-15T15:39:39.363983+0000","last_in_change":"2024-05-15T15:39:30.591216+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-15T15:39:40.715999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-15T15:39:49.598723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-15T15:39:50.783054+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0d06a12a-866a-418e-9776-704d74354579","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":3943681952},{"type":"v1","addr":"172.21.15.12:6809","nonce":3943681952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":3943681952},{"type":"v1","addr":"172.21.15.12:6812","nonce":3943681952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":3943681952},{"type":"v1","addr":"172.21.15.12:6821","nonce":3943681952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":3943681952},{"type":"v1","addr":"172.21.15.12:6816","nonce":3943681952}]},"public_addr":"172.21.15.12:6809/3943681952","cluster_addr":"172.21.15.12:6812/3943681952","heartbeat_back_addr":"172.21.15.12:6821/3943681952","heartbeat_front_addr":"172.21.15.12:6816/3943681952","state":["exists","up"]},{"osd":1,"uuid":"09d0fa19-9ef8-4f35-bf99-6e86658c6f10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6811","nonce":1763752148},{"type":"v1","addr":"172.21.15.12:6813","nonce":1763752148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":1763752148},{"type":"v1","addr":"172.21.15.12:6817","nonce":1763752148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":1763752148},{"type":"v1","addr":"172.21.15.12:6827","nonce":1763752148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6819","nonce":1763752148},{"type":"v1","addr":"172.21.15.12:6822","nonce":1763752148}]},"public_addr":"172.21.15.12:6813/1763752148","cluster_addr":"172.21.15.12:6817/1763752148","heartbeat_back_addr":"172.21.15.12:6827/1763752148","heartbeat_front_addr":"172.21.15.12:6822/1763752148","state":["exists","up"]},{"osd":2,"uuid":"b204c6ad-f431-40a5-ba27-9844294f0ece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":2173702802},{"type":"v1","addr":"172.21.15.12:6823","nonce":2173702802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":2173702802},{"type":"v1","addr":"172.21.15.12:6826","nonce":2173702802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":2173702802},{"type":"v1","addr":"172.21.15.12:6831","nonce":2173702802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":2173702802},{"type":"v1","addr":"172.21.15.12:6829","nonce":2173702802}]},"public_addr":"172.21.15.12:6823/2173702802","cluster_addr":"172.21.15.12:6826/2173702802","heartbeat_back_addr":"172.21.15.12:6831/2173702802","heartbeat_front_addr":"172.21.15.12:6829/2173702802","state":["exists","up"]},{"osd":3,"uuid":"660a9ccb-2ee5-42d8-8481-0835047a8260","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":3956443113},{"type":"v1","addr":"172.21.15.12:6801","nonce":3956443113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":3956443113},{"type":"v1","addr":"172.21.15.12:6803","nonce":3956443113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":3956443113},{"type":"v1","addr":"172.21.15.12:6807","nonce":3956443113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":3956443113},{"type":"v1","addr":"172.21.15.12:6805","nonce":3956443113}]},"public_addr":"172.21.15.12:6801/3956443113","cluster_addr":"172.21.15.12:6803/3956443113","heartbeat_back_addr":"172.21.15.12:6807/3956443113","heartbeat_front_addr":"172.21.15.12:6805/3956443113","state":["exists","up"]},{"osd":4,"uuid":"9eef1461-a961-457c-9a78-43b5098a46a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":1021092792},{"type":"v1","addr":"172.21.15.84:6809","nonce":1021092792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":1021092792},{"type":"v1","addr":"172.21.15.84:6811","nonce":1021092792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":1021092792},{"type":"v1","addr":"172.21.15.84:6815","nonce":1021092792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":1021092792},{"type":"v1","addr":"172.21.15.84:6813","nonce":1021092792}]},"public_addr":"172.21.15.84:6809/1021092792","cluster_addr":"172.21.15.84:6811/1021092792","heartbeat_back_addr":"172.21.15.84:6815/1021092792","heartbeat_front_addr":"172.21.15.84:6813/1021092792","state":["exists","up"]},{"osd":5,"uuid":"5f924e2f-6c71-4741-a727-d3710c438431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":3173527851},{"type":"v1","addr":"172.21.15.84:6801","nonce":3173527851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":3173527851},{"type":"v1","addr":"172.21.15.84:6803","nonce":3173527851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":3173527851},{"type":"v1","addr":"172.21.15.84:6807","nonce":3173527851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":3173527851},{"type":"v1","addr":"172.21.15.84:6805","nonce":3173527851}]},"public_addr":"172.21.15.84:6801/3173527851","cluster_addr":"172.21.15.84:6803/3173527851","heartbeat_back_addr":"172.21.15.84:6807/3173527851","heartbeat_front_addr":"172.21.15.84:6805/3173527851","state":["exists","up"]},{"osd":6,"uuid":"efae9975-8c16-4ad3-892f-71f3c59718d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3029180670},{"type":"v1","addr":"172.21.15.84:6817","nonce":3029180670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3029180670},{"type":"v1","addr":"172.21.15.84:6819","nonce":3029180670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3029180670},{"type":"v1","addr":"172.21.15.84:6823","nonce":3029180670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3029180670},{"type":"v1","addr":"172.21.15.84:6821","nonce":3029180670}]},"public_addr":"172.21.15.84:6817/3029180670","cluster_addr":"172.21.15.84:6819/3029180670","heartbeat_back_addr":"172.21.15.84:6823/3029180670","heartbeat_front_addr":"172.21.15.84:6821/3029180670","state":["exists","up"]},{"osd":7,"uuid":"6426efba-ee4d-4e44-83d1-c76c75aec30c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3067620602},{"type":"v1","addr":"172.21.15.84:6825","nonce":3067620602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3067620602},{"type":"v1","addr":"172.21.15.84:6827","nonce":3067620602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":3067620602},{"type":"v1","addr":"172.21.15.84:6831","nonce":3067620602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":3067620602},{"type":"v1","addr":"172.21.15.84:6829","nonce":3067620602}]},"public_addr":"172.21.15.84:6825/3067620602","cluster_addr":"172.21.15.84:6827/3067620602","heartbeat_back_addr":"172.21.15.84:6831/3067620602","heartbeat_front_addr":"172.21.15.84:6829/3067620602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.809514+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.845364+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.762733+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.688597+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.699228+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.747865+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.712415+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.820683+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-15T15:39:52.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.811+0000 7fb067827640 1 -- 172.21.15.12:0/3088472403 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fb04c076300 msgr2=0x7fb04c078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:52.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.811+0000 7fb067827640 1 --2- 172.21.15.12:0/3088472403 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fb04c076300 0x7fb04c078810 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb060073fb0 tx=0x7fb058009040 comp rx=0 tx=0).stop 2024-05-15T15:39:52.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.811+0000 7fb067827640 1 -- 172.21.15.12:0/3088472403 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb0600bd1f0 msgr2=0x7fb060143990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:52.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.811+0000 7fb067827640 1 --2- 172.21.15.12:0/3088472403 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb0600bd1f0 0x7fb060143990 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fb054009be0 tx=0x7fb054004730 comp rx=0 tx=0).stop 2024-05-15T15:39:52.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.811+0000 7fb067827640 1 -- 172.21.15.12:0/3088472403 shutdown_connections 2024-05-15T15:39:52.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.811+0000 7fb067827640 1 --2- 172.21.15.12:0/3088472403 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb060143ed0 0x7fb060150400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:52.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.811+0000 7fb067827640 1 --2- 172.21.15.12:0/3088472403 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fb04c076300 0x7fb04c078810 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:52.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.811+0000 7fb067827640 1 --2- 172.21.15.12:0/3088472403 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb0600bd1f0 0x7fb060143990 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:52.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.811+0000 7fb067827640 1 --2- 172.21.15.12:0/3088472403 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb048004800 0x7fb0600b7980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:52.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.811+0000 7fb067827640 1 -- 172.21.15.12:0/3088472403 >> 172.21.15.12:0/3088472403 conn(0x7fb0600c17c0 msgr2=0x7fb06014e670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:39:52.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.811+0000 7fb067827640 1 -- 172.21.15.12:0/3088472403 shutdown_connections 2024-05-15T15:39:52.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.811+0000 7fb067827640 1 -- 172.21.15.12:0/3088472403 wait complete. 2024-05-15T15:39:52.824 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-15T15:39:52.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.932+0000 7fc3411f3640 1 Processor -- start 2024-05-15T15:39:52.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.932+0000 7fc3411f3640 1 -- start start 2024-05-15T15:39:52.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.933+0000 7fc3411f3640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc33c0bd440 0x7fc33c0bd850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:52.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.933+0000 7fc3411f3640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fc33c0b8d70 0x7fc33c0b9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:52.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.934+0000 7fc3411f3640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc33c0bdd90 con 0x7fc33c14e530 2024-05-15T15:39:52.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.934+0000 7fc3411f3640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fc33c0b88e0 con 0x7fc33c0b8d70 2024-05-15T15:39:52.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.934+0000 7fc3411f3640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fc33c14ece0 con 0x7fc33c0bd440 2024-05-15T15:39:52.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.934+0000 7fc33b59e640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fc33c0b8d70 0x7fc33c0b9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:52.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.934+0000 7fc33b59e640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fc33c0b8d70 0x7fc33c0b9180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35630/0 (socket says 172.21.15.12:35630) 2024-05-15T15:39:52.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.934+0000 7fc33b59e640 1 -- 172.21.15.12:0/2566567834 learned_addr learned my addr 172.21.15.12:0/2566567834 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:39:52.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.934+0000 7fc33a59c640 1 --2- 172.21.15.12:0/2566567834 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc33c0bd440 0x7fc33c0bd850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:52.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.934+0000 7fc33b59e640 1 -- 172.21.15.12:0/2566567834 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc33c0bd440 msgr2=0x7fc33c0bd850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:39:52.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.934+0000 7fc33b59e640 1 --2- 172.21.15.12:0/2566567834 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc33c0bd440 0x7fc33c0bd850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:52.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.934+0000 7fc33b59e640 1 -- 172.21.15.12:0/2566567834 >> v1:172.21.15.84:6789/0 conn(0x7fc33c14e530 legacy=0x7fc33c0ba320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:52.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.934+0000 7fc33b59e640 1 -- 172.21.15.12:0/2566567834 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc33c14efc0 con 0x7fc33c0b8d70 2024-05-15T15:39:52.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.935+0000 7fc33b59e640 1 --2- 172.21.15.12:0/2566567834 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc33c0b8d70 0x7fc33c0b9180 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc32c009e50 tx=0x7fc32c02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a582e61fd3a4d79 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:39:52.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.935+0000 7fc339d9b640 1 -- 172.21.15.12:0/2566567834 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc32c036070 con 0x7fc33c0b8d70 2024-05-15T15:39:52.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.935+0000 7fc339d9b640 1 -- 172.21.15.12:0/2566567834 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc32c031600 con 0x7fc33c0b8d70 2024-05-15T15:39:52.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.935+0000 7fc339d9b640 1 -- 172.21.15.12:0/2566567834 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc32c0319d0 con 0x7fc33c0b8d70 2024-05-15T15:39:52.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.935+0000 7fc3411f3640 1 -- 172.21.15.12:0/2566567834 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc33c0b8d70 msgr2=0x7fc33c0b9180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:52.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.935+0000 7fc3411f3640 1 --2- 172.21.15.12:0/2566567834 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc33c0b8d70 0x7fc33c0b9180 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc32c009e50 tx=0x7fc32c02a710 comp rx=0 tx=0).stop 2024-05-15T15:39:52.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.936+0000 7fc3411f3640 1 -- 172.21.15.12:0/2566567834 shutdown_connections 2024-05-15T15:39:52.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.936+0000 7fc3411f3640 1 --2- 172.21.15.12:0/2566567834 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc33c0b8d70 0x7fc33c0b9180 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:52.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.936+0000 7fc3411f3640 1 --2- 172.21.15.12:0/2566567834 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc33c0bd440 0x7fc33c0bd850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:52.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.936+0000 7fc3411f3640 1 -- 172.21.15.12:0/2566567834 >> 172.21.15.12:0/2566567834 conn(0x7fc33c0c0570 msgr2=0x7fc33c0c0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:39:52.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.936+0000 7fc3411f3640 1 -- 172.21.15.12:0/2566567834 shutdown_connections 2024-05-15T15:39:52.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.936+0000 7fc3411f3640 1 -- 172.21.15.12:0/2566567834 wait complete. 2024-05-15T15:39:52.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.937+0000 7fc3411f3640 1 Processor -- start 2024-05-15T15:39:52.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.937+0000 7fc3411f3640 1 -- start start 2024-05-15T15:39:52.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.938+0000 7fc3411f3640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc33c0b8d70 0x7fc33c14b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:52.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.938+0000 7fc3411f3640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc33c0bd440 0x7fc33c1e7970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:52.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.939+0000 7fc3411f3640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc33c14e530 0x7fc33c142ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:52.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.939+0000 7fc3411f3640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fc33c0b96c0 con 0x7fc33c14e530 2024-05-15T15:39:52.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.939+0000 7fc3411f3640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fc33c0bbb70 con 0x7fc33c0b8d70 2024-05-15T15:39:52.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.939+0000 7fc3411f3640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fc33c14e940 con 0x7fc33c0bd440 2024-05-15T15:39:52.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.939+0000 7fc33b59e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc33c14e530 0x7fc33c142ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:52.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.939+0000 7fc33b59e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc33c14e530 0x7fc33c142ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35640/0 (socket says 172.21.15.12:35640) 2024-05-15T15:39:52.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.939+0000 7fc33b59e640 1 -- 172.21.15.12:0/1312856881 learned_addr learned my addr 172.21.15.12:0/1312856881 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:39:52.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.939+0000 7fc33a59c640 1 --2- 172.21.15.12:0/1312856881 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc33c0bd440 0x7fc33c1e7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:52.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.939+0000 7fc33ad9d640 1 --2- 172.21.15.12:0/1312856881 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc33c0b8d70 0x7fc33c14b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:52.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.939+0000 7fc33b59e640 1 -- 172.21.15.12:0/1312856881 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc33c0bd440 msgr2=0x7fc33c1e7970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:52.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.939+0000 7fc33b59e640 1 --2- 172.21.15.12:0/1312856881 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc33c0bd440 0x7fc33c1e7970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:52.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.939+0000 7fc33b59e640 1 -- 172.21.15.12:0/1312856881 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc33c0b8d70 msgr2=0x7fc33c14b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:52.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.939+0000 7fc33b59e640 1 --2- 172.21.15.12:0/1312856881 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc33c0b8d70 0x7fc33c14b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:52.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.939+0000 7fc33b59e640 1 -- 172.21.15.12:0/1312856881 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc33c14be40 con 0x7fc33c14e530 2024-05-15T15:39:52.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.939+0000 7fc33ad9d640 1 --2- 172.21.15.12:0/1312856881 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc33c0b8d70 0x7fc33c14b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-15T15:39:52.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.939+0000 7fc33b59e640 1 --2- 172.21.15.12:0/1312856881 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc33c14e530 0x7fc33c142ed0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc32c034040 tx=0x7fc32c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:39:52.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.939+0000 7fc3237fe640 1 -- 172.21.15.12:0/1312856881 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc32c036050 con 0x7fc33c14e530 2024-05-15T15:39:52.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.939+0000 7fc3237fe640 1 -- 172.21.15.12:0/1312856881 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc32c042070 con 0x7fc33c14e530 2024-05-15T15:39:52.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.939+0000 7fc3411f3640 1 -- 172.21.15.12:0/1312856881 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc33c1da780 con 0x7fc33c14e530 2024-05-15T15:39:52.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.939+0000 7fc3237fe640 1 -- 172.21.15.12:0/1312856881 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc32c009510 con 0x7fc33c14e530 2024-05-15T15:39:52.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.939+0000 7fc3411f3640 1 -- 172.21.15.12:0/1312856881 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc33c1d9e50 con 0x7fc33c14e530 2024-05-15T15:39:52.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.941+0000 7fc3411f3640 1 -- 172.21.15.12:0/1312856881 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc33c1e76d0 con 0x7fc33c14e530 2024-05-15T15:39:52.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.941+0000 7fc3237fe640 1 -- 172.21.15.12:0/1312856881 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc32c007bf0 con 0x7fc33c14e530 2024-05-15T15:39:52.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.942+0000 7fc3237fe640 1 --2- 172.21.15.12:0/1312856881 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fc328076300 0x7fc328078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:52.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.942+0000 7fc3237fe640 1 -- 172.21.15.12:0/1312856881 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fc32c0b8410 con 0x7fc33c14e530 2024-05-15T15:39:52.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.942+0000 7fc33ad9d640 1 --2- 172.21.15.12:0/1312856881 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fc328076300 0x7fc328078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:52.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.942+0000 7fc33ad9d640 1 --2- 172.21.15.12:0/1312856881 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fc328076300 0x7fc328078810 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc334001650 tx=0x7fc334009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:39:52.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:52.946+0000 7fc3237fe640 1 -- 172.21.15.12:0/1312856881 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fc32c081d70 con 0x7fc33c14e530 2024-05-15T15:39:53.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:53.139+0000 7fc3411f3640 1 -- 172.21.15.12:0/1312856881 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc33c050940 con 0x7fc33c14e530 2024-05-15T15:39:53.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:53.140+0000 7fc3237fe640 1 -- 172.21.15.12:0/1312856881 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16586 (secure 0 0 0) 0x7fc32c081670 con 0x7fc33c14e530 2024-05-15T15:39:53.143 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-05-15T15:39:53.143 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":22,"fsid":"3b7fc4b2-b85c-49b5-a5de-38444eeed40d","created":"2024-05-15T15:39:28.392476+0000","modified":"2024-05-15T15:39:51.829539+0000","last_up_change":"2024-05-15T15:39:39.363983+0000","last_in_change":"2024-05-15T15:39:30.591216+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-15T15:39:40.715999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-15T15:39:49.598723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-15T15:39:50.783054+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0d06a12a-866a-418e-9776-704d74354579","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":3943681952},{"type":"v1","addr":"172.21.15.12:6809","nonce":3943681952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":3943681952},{"type":"v1","addr":"172.21.15.12:6812","nonce":3943681952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":3943681952},{"type":"v1","addr":"172.21.15.12:6821","nonce":3943681952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":3943681952},{"type":"v1","addr":"172.21.15.12:6816","nonce":3943681952}]},"public_addr":"172.21.15.12:6809/3943681952","cluster_addr":"172.21.15.12:6812/3943681952","heartbeat_back_addr":"172.21.15.12:6821/3943681952","heartbeat_front_addr":"172.21.15.12:6816/3943681952","state":["exists","up"]},{"osd":1,"uuid":"09d0fa19-9ef8-4f35-bf99-6e86658c6f10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6811","nonce":1763752148},{"type":"v1","addr":"172.21.15.12:6813","nonce":1763752148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":1763752148},{"type":"v1","addr":"172.21.15.12:6817","nonce":1763752148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":1763752148},{"type":"v1","addr":"172.21.15.12:6827","nonce":1763752148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6819","nonce":1763752148},{"type":"v1","addr":"172.21.15.12:6822","nonce":1763752148}]},"public_addr":"172.21.15.12:6813/1763752148","cluster_addr":"172.21.15.12:6817/1763752148","heartbeat_back_addr":"172.21.15.12:6827/1763752148","heartbeat_front_addr":"172.21.15.12:6822/1763752148","state":["exists","up"]},{"osd":2,"uuid":"b204c6ad-f431-40a5-ba27-9844294f0ece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":2173702802},{"type":"v1","addr":"172.21.15.12:6823","nonce":2173702802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":2173702802},{"type":"v1","addr":"172.21.15.12:6826","nonce":2173702802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":2173702802},{"type":"v1","addr":"172.21.15.12:6831","nonce":2173702802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":2173702802},{"type":"v1","addr":"172.21.15.12:6829","nonce":2173702802}]},"public_addr":"172.21.15.12:6823/2173702802","cluster_addr":"172.21.15.12:6826/2173702802","heartbeat_back_addr":"172.21.15.12:6831/2173702802","heartbeat_front_addr":"172.21.15.12:6829/2173702802","state":["exists","up"]},{"osd":3,"uuid":"660a9ccb-2ee5-42d8-8481-0835047a8260","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":3956443113},{"type":"v1","addr":"172.21.15.12:6801","nonce":3956443113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":3956443113},{"type":"v1","addr":"172.21.15.12:6803","nonce":3956443113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":3956443113},{"type":"v1","addr":"172.21.15.12:6807","nonce":3956443113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":3956443113},{"type":"v1","addr":"172.21.15.12:6805","nonce":3956443113}]},"public_addr":"172.21.15.12:6801/3956443113","cluster_addr":"172.21.15.12:6803/3956443113","heartbeat_back_addr":"172.21.15.12:6807/3956443113","heartbeat_front_addr":"172.21.15.12:6805/3956443113","state":["exists","up"]},{"osd":4,"uuid":"9eef1461-a961-457c-9a78-43b5098a46a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":1021092792},{"type":"v1","addr":"172.21.15.84:6809","nonce":1021092792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":1021092792},{"type":"v1","addr":"172.21.15.84:6811","nonce":1021092792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":1021092792},{"type":"v1","addr":"172.21.15.84:6815","nonce":1021092792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":1021092792},{"type":"v1","addr":"172.21.15.84:6813","nonce":1021092792}]},"public_addr":"172.21.15.84:6809/1021092792","cluster_addr":"172.21.15.84:6811/1021092792","heartbeat_back_addr":"172.21.15.84:6815/1021092792","heartbeat_front_addr":"172.21.15.84:6813/1021092792","state":["exists","up"]},{"osd":5,"uuid":"5f924e2f-6c71-4741-a727-d3710c438431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":3173527851},{"type":"v1","addr":"172.21.15.84:6801","nonce":3173527851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":3173527851},{"type":"v1","addr":"172.21.15.84:6803","nonce":3173527851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":3173527851},{"type":"v1","addr":"172.21.15.84:6807","nonce":3173527851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":3173527851},{"type":"v1","addr":"172.21.15.84:6805","nonce":3173527851}]},"public_addr":"172.21.15.84:6801/3173527851","cluster_addr":"172.21.15.84:6803/3173527851","heartbeat_back_addr":"172.21.15.84:6807/3173527851","heartbeat_front_addr":"172.21.15.84:6805/3173527851","state":["exists","up"]},{"osd":6,"uuid":"efae9975-8c16-4ad3-892f-71f3c59718d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3029180670},{"type":"v1","addr":"172.21.15.84:6817","nonce":3029180670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3029180670},{"type":"v1","addr":"172.21.15.84:6819","nonce":3029180670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3029180670},{"type":"v1","addr":"172.21.15.84:6823","nonce":3029180670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3029180670},{"type":"v1","addr":"172.21.15.84:6821","nonce":3029180670}]},"public_addr":"172.21.15.84:6817/3029180670","cluster_addr":"172.21.15.84:6819/3029180670","heartbeat_back_addr":"172.21.15.84:6823/3029180670","heartbeat_front_addr":"172.21.15.84:6821/3029180670","state":["exists","up"]},{"osd":7,"uuid":"6426efba-ee4d-4e44-83d1-c76c75aec30c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3067620602},{"type":"v1","addr":"172.21.15.84:6825","nonce":3067620602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3067620602},{"type":"v1","addr":"172.21.15.84:6827","nonce":3067620602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":3067620602},{"type":"v1","addr":"172.21.15.84:6831","nonce":3067620602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":3067620602},{"type":"v1","addr":"172.21.15.84:6829","nonce":3067620602}]},"public_addr":"172.21.15.84:6825/3067620602","cluster_addr":"172.21.15.84:6827/3067620602","heartbeat_back_addr":"172.21.15.84:6831/3067620602","heartbeat_front_addr":"172.21.15.84:6829/3067620602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.809514+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.845364+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.762733+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.688597+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.699228+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.747865+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.712415+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.820683+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-15T15:39:53.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:53.143+0000 7fc3411f3640 1 -- 172.21.15.12:0/1312856881 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fc328076300 msgr2=0x7fc328078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:53.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:53.143+0000 7fc3411f3640 1 --2- 172.21.15.12:0/1312856881 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fc328076300 0x7fc328078810 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc334001650 tx=0x7fc334009040 comp rx=0 tx=0).stop 2024-05-15T15:39:53.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:53.143+0000 7fc3411f3640 1 -- 172.21.15.12:0/1312856881 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc33c14e530 msgr2=0x7fc33c142ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:53.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:53.143+0000 7fc3411f3640 1 --2- 172.21.15.12:0/1312856881 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc33c14e530 0x7fc33c142ed0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc32c034040 tx=0x7fc32c004a40 comp rx=0 tx=0).stop 2024-05-15T15:39:53.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:53.143+0000 7fc3411f3640 1 -- 172.21.15.12:0/1312856881 shutdown_connections 2024-05-15T15:39:53.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:53.143+0000 7fc3411f3640 1 --2- 172.21.15.12:0/1312856881 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fc328076300 0x7fc328078810 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:53.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:53.143+0000 7fc3411f3640 1 --2- 172.21.15.12:0/1312856881 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc33c14e530 0x7fc33c142ed0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:53.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:53.143+0000 7fc3411f3640 1 --2- 172.21.15.12:0/1312856881 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc33c0bd440 0x7fc33c1e7970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:53.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:53.143+0000 7fc3411f3640 1 --2- 172.21.15.12:0/1312856881 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc33c0b8d70 0x7fc33c14b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:53.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:53.143+0000 7fc3411f3640 1 -- 172.21.15.12:0/1312856881 >> 172.21.15.12:0/1312856881 conn(0x7fc33c0c0570 msgr2=0x7fc33c0ba320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:39:53.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:53.143+0000 7fc3411f3640 1 -- 172.21.15.12:0/1312856881 shutdown_connections 2024-05-15T15:39:53.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:53.143+0000 7fc3411f3640 1 -- 172.21.15.12:0/1312856881 wait complete. 2024-05-15T15:39:53.156 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-15T15:39:53.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:53.269+0000 7efec72eb640 1 Processor -- start 2024-05-15T15:39:53.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:53.269+0000 7efec72eb640 1 -- start start 2024-05-15T15:39:53.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:53.270+0000 7efec72eb640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7efec0151fc0 0x7efec00bd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:53.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:53.270+0000 7efec72eb640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7efec006da30 0x7efec00be940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:53.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:53.270+0000 7efec72eb640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efec00c36f0 con 0x7efec006de40 2024-05-15T15:39:53.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:53.270+0000 7efec72eb640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7efec00bdc10 con 0x7efec006da30 2024-05-15T15:39:53.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:53.270+0000 7efec72eb640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7efec0152530 con 0x7efec0151fc0 2024-05-15T15:39:53.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:53.270+0000 7efec4886640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7efec006da30 0x7efec00be940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:53.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:53.270+0000 7efec4886640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7efec006da30 0x7efec00be940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35648/0 (socket says 172.21.15.12:35648) 2024-05-15T15:39:53.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:53.270+0000 7efec5888640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7efec006de40 0x7efec014e570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:34276/0 (socket says 172.21.15.12:34276) 2024-05-15T15:39:53.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:53.270+0000 7efec4886640 1 -- 172.21.15.12:0/1086418139 learned_addr learned my addr 172.21.15.12:0/1086418139 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:39:53.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:53.270+0000 7efec5087640 1 --2- 172.21.15.12:0/1086418139 >> v2:172.21.15.84:3300/0 conn(0x7efec0151fc0 0x7efec00bd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:53.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:53.270+0000 7efec4886640 1 -- 172.21.15.12:0/1086418139 >> v2:172.21.15.84:3300/0 conn(0x7efec0151fc0 msgr2=0x7efec00bd6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:39:53.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:53.270+0000 7efec4886640 1 --2- 172.21.15.12:0/1086418139 >> v2:172.21.15.84:3300/0 conn(0x7efec0151fc0 0x7efec00bd6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:53.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:53.270+0000 7efec4886640 1 -- 172.21.15.12:0/1086418139 >> v1:172.21.15.12:6789/0 conn(0x7efec006de40 legacy=0x7efec014e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:53.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:53.271+0000 7efec4886640 1 -- 172.21.15.12:0/1086418139 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efec0152810 con 0x7efec006da30 2024-05-15T15:39:53.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:53.270+0000 7efeb7fff640 1 -- 172.21.15.12:0/1086418139 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 906768889 0 0) 0x7efec00c36f0 con 0x7efec006de40 2024-05-15T15:39:53.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:53.271+0000 7efec4886640 1 --2- 172.21.15.12:0/1086418139 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efec006da30 0x7efec00be940 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7efec008d300 tx=0x7efeb002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbea4f93d8769b3 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:39:53.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:53.271+0000 7efeb7fff640 1 -- 172.21.15.12:0/1086418139 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeb0037070 con 0x7efec006da30 2024-05-15T15:39:53.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:53.271+0000 7efeb7fff640 1 -- 172.21.15.12:0/1086418139 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efeb0032440 con 0x7efec006da30 2024-05-15T15:39:53.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:53.271+0000 7efeb7fff640 1 -- 172.21.15.12:0/1086418139 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeb0032810 con 0x7efec006da30 2024-05-15T15:39:53.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:53.272+0000 7efec72eb640 1 -- 172.21.15.12:0/1086418139 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efec006da30 msgr2=0x7efec00be940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:53.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:53.272+0000 7efec72eb640 1 --2- 172.21.15.12:0/1086418139 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efec006da30 0x7efec00be940 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7efec008d300 tx=0x7efeb002a1e0 comp rx=0 tx=0).stop 2024-05-15T15:39:53.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:53.272+0000 7efec72eb640 1 -- 172.21.15.12:0/1086418139 shutdown_connections 2024-05-15T15:39:53.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:53.272+0000 7efec72eb640 1 --2- 172.21.15.12:0/1086418139 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efec006da30 0x7efec00be940 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:53.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:53.272+0000 7efec72eb640 1 --2- 172.21.15.12:0/1086418139 >> v2:172.21.15.84:3300/0 conn(0x7efec0151fc0 0x7efec00bd6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:53.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:53.272+0000 7efec72eb640 1 -- 172.21.15.12:0/1086418139 >> 172.21.15.12:0/1086418139 conn(0x7efec00c3d20 msgr2=0x7efec00c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:39:53.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:53.272+0000 7efec72eb640 1 -- 172.21.15.12:0/1086418139 shutdown_connections 2024-05-15T15:39:53.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:53.272+0000 7efec72eb640 1 -- 172.21.15.12:0/1086418139 wait complete. 2024-05-15T15:39:53.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:53.274+0000 7efec72eb640 1 Processor -- start 2024-05-15T15:39:53.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:53.274+0000 7efec72eb640 1 -- start start 2024-05-15T15:39:53.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:53.275+0000 7efec72eb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efec006da30 0x7efec00a25a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:53.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:53.275+0000 7efec72eb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efec006de40 0x7efec00b8810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:53.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:53.275+0000 7efec72eb640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7efec0151fc0 0x7efec01e7a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:53.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:53.275+0000 7efec72eb640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7efec00a3050 con 0x7efec006de40 2024-05-15T15:39:53.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:53.275+0000 7efec72eb640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7efec00a2ed0 con 0x7efec006da30 2024-05-15T15:39:53.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:53.275+0000 7efec72eb640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7efec00bee80 con 0x7efec0151fc0 2024-05-15T15:39:53.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:53.275+0000 7efec4886640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efec006de40 0x7efec00b8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:53.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:53.275+0000 7efec4886640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efec006de40 0x7efec00b8810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35664/0 (socket says 172.21.15.12:35664) 2024-05-15T15:39:53.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:53.275+0000 7efec4886640 1 -- 172.21.15.12:0/3057998391 learned_addr learned my addr 172.21.15.12:0/3057998391 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:39:53.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:53.275+0000 7efec5888640 1 --2- 172.21.15.12:0/3057998391 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7efec0151fc0 0x7efec01e7a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:53.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:53.275+0000 7efec4886640 1 -- 172.21.15.12:0/3057998391 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7efec0151fc0 msgr2=0x7efec01e7a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:53.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:53.275+0000 7efec5087640 1 --2- 172.21.15.12:0/3057998391 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efec006da30 0x7efec00a25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:53.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:53.275+0000 7efec4886640 1 --2- 172.21.15.12:0/3057998391 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7efec0151fc0 0x7efec01e7a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:53.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:53.275+0000 7efec4886640 1 -- 172.21.15.12:0/3057998391 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efec006da30 msgr2=0x7efec00a25a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:53.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:53.275+0000 7efec4886640 1 --2- 172.21.15.12:0/3057998391 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efec006da30 0x7efec00a25a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:53.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:53.275+0000 7efec4886640 1 -- 172.21.15.12:0/3057998391 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efec00b9cb0 con 0x7efec006de40 2024-05-15T15:39:53.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:53.275+0000 7efec5888640 1 --2- 172.21.15.12:0/3057998391 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7efec0151fc0 0x7efec01e7a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-15T15:39:53.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:53.275+0000 7efec5087640 1 --2- 172.21.15.12:0/3057998391 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efec006da30 0x7efec00a25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-15T15:39:53.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:53.275+0000 7efec4886640 1 --2- 172.21.15.12:0/3057998391 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efec006de40 0x7efec00b8810 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7efeb0000c00 tx=0x7efeb00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:39:53.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:53.276+0000 7efeb5ffb640 1 -- 172.21.15.12:0/3057998391 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeb0041020 con 0x7efec006de40 2024-05-15T15:39:53.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:53.276+0000 7efeb5ffb640 1 -- 172.21.15.12:0/3057998391 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efeb00306c0 con 0x7efec006de40 2024-05-15T15:39:53.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:53.276+0000 7efec72eb640 1 -- 172.21.15.12:0/3057998391 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efec00a2ae0 con 0x7efec006de40 2024-05-15T15:39:53.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:53.276+0000 7efeb5ffb640 1 -- 172.21.15.12:0/3057998391 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeb0037040 con 0x7efec006de40 2024-05-15T15:39:53.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:53.276+0000 7efec72eb640 1 -- 172.21.15.12:0/3057998391 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efec00ba440 con 0x7efec006de40 2024-05-15T15:39:53.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:53.277+0000 7efec72eb640 1 -- 172.21.15.12:0/3057998391 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efec00ba610 con 0x7efec006de40 2024-05-15T15:39:53.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:53.277+0000 7efeb5ffb640 1 -- 172.21.15.12:0/3057998391 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7efeb0044020 con 0x7efec006de40 2024-05-15T15:39:53.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:53.278+0000 7efeb5ffb640 1 --2- 172.21.15.12:0/3057998391 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7efea4076300 0x7efea4078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:53.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:53.278+0000 7efeb5ffb640 1 -- 172.21.15.12:0/3057998391 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7efeb00b7f40 con 0x7efec006de40 2024-05-15T15:39:53.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:53.278+0000 7efec5087640 1 --2- 172.21.15.12:0/3057998391 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7efea4076300 0x7efea4078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:53.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:53.279+0000 7efec5087640 1 --2- 172.21.15.12:0/3057998391 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7efea4076300 0x7efea4078810 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7efebc006fd0 tx=0x7efebc008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:39:53.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:53.283+0000 7efeb5ffb640 1 -- 172.21.15.12:0/3057998391 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7efec00ba610 con 0x7efec006de40 2024-05-15T15:39:53.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:53.515+0000 7efec72eb640 1 -- 172.21.15.12:0/3057998391 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7efec0050940 con 0x7efec006de40 2024-05-15T15:39:54.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:54.461+0000 7efeb5ffb640 1 -- 172.21.15.12:0/3057998391 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v6) ==== 118+0+0 (secure 0 0 0) 0x7efeb004b030 con 0x7efec006de40 2024-05-15T15:39:54.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:54.463+0000 7efec72eb640 1 -- 172.21.15.12:0/3057998391 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7efea4076300 msgr2=0x7efea4078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:54.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:54.463+0000 7efec72eb640 1 --2- 172.21.15.12:0/3057998391 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7efea4076300 0x7efea4078810 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7efebc006fd0 tx=0x7efebc008040 comp rx=0 tx=0).stop 2024-05-15T15:39:54.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:54.463+0000 7efec72eb640 1 -- 172.21.15.12:0/3057998391 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efec006de40 msgr2=0x7efec00b8810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:54.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:54.463+0000 7efec72eb640 1 --2- 172.21.15.12:0/3057998391 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efec006de40 0x7efec00b8810 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7efeb0000c00 tx=0x7efeb00046c0 comp rx=0 tx=0).stop 2024-05-15T15:39:54.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:54.464+0000 7efec72eb640 1 -- 172.21.15.12:0/3057998391 shutdown_connections 2024-05-15T15:39:54.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:54.464+0000 7efec72eb640 1 --2- 172.21.15.12:0/3057998391 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7efec0151fc0 0x7efec01e7a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:54.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:54.464+0000 7efec72eb640 1 --2- 172.21.15.12:0/3057998391 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7efea4076300 0x7efea4078810 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:54.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:54.464+0000 7efec72eb640 1 --2- 172.21.15.12:0/3057998391 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efec006de40 0x7efec00b8810 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:54.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:54.464+0000 7efec72eb640 1 --2- 172.21.15.12:0/3057998391 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efec006da30 0x7efec00a25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:54.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:54.464+0000 7efec72eb640 1 -- 172.21.15.12:0/3057998391 >> 172.21.15.12:0/3057998391 conn(0x7efec00c3d20 msgr2=0x7efec00c09d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:39:54.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:54.464+0000 7efec72eb640 1 -- 172.21.15.12:0/3057998391 shutdown_connections 2024-05-15T15:39:54.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:54.464+0000 7efec72eb640 1 -- 172.21.15.12:0/3057998391 wait complete. 2024-05-15T15:39:54.480 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-05-15T15:39:54.480 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-05-15T15:39:54.601 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:54.599+0000 7f6dd0d35640 1 Processor -- start 2024-05-15T15:39:54.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:54.599+0000 7f6dd0d35640 1 -- start start 2024-05-15T15:39:54.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:54.601+0000 7f6dd0d35640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f6dcc146070 0x7f6dcc146480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:54.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:54.601+0000 7f6dd0d35640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6dcc14c7e0 0x7f6dcc14cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:54.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:54.601+0000 7f6dd0d35640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6dcc1469c0 con 0x7f6dcc0c10a0 2024-05-15T15:39:54.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:54.601+0000 7f6dd0d35640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f6dcc0a1200 con 0x7f6dcc14c7e0 2024-05-15T15:39:54.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:54.601+0000 7f6dd0d35640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f6dcc14c350 con 0x7f6dcc146070 2024-05-15T15:39:54.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:54.601+0000 7f6dca59c640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f6dcc0c10a0 0x7f6dcc14f770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:34282/0 (socket says 172.21.15.12:34282) 2024-05-15T15:39:54.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:54.601+0000 7f6dca59c640 1 -- 172.21.15.12:0/1775992919 learned_addr learned my addr 172.21.15.12:0/1775992919 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-05-15T15:39:54.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:54.601+0000 7f6dcad9d640 1 --2- 172.21.15.12:0/1775992919 >> v2:172.21.15.84:3300/0 conn(0x7f6dcc14c7e0 0x7f6dcc14cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:54.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:54.601+0000 7f6dc9d9b640 1 --2- 172.21.15.12:0/1775992919 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f6dcc146070 0x7f6dcc146480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:54.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:54.601+0000 7f6dc959a640 1 -- 172.21.15.12:0/1775992919 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1544913025 0 0) 0x7f6dcc1469c0 con 0x7f6dcc0c10a0 2024-05-15T15:39:54.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:54.601+0000 7f6dc959a640 1 -- 172.21.15.12:0/1775992919 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6db8003520 con 0x7f6dcc0c10a0 2024-05-15T15:39:54.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:54.601+0000 7f6dc959a640 1 -- 172.21.15.12:0/1775992919 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4112127996 0 0) 0x7f6db8003520 con 0x7f6dcc0c10a0 2024-05-15T15:39:54.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:54.601+0000 7f6dc959a640 1 -- 172.21.15.12:0/1775992919 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f6dcc146070 msgr2=0x7f6dcc146480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:39:54.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:54.601+0000 7f6dc959a640 1 --2- 172.21.15.12:0/1775992919 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f6dcc146070 0x7f6dcc146480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:54.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:54.601+0000 7f6dc959a640 1 -- 172.21.15.12:0/1775992919 >> v2:172.21.15.84:3300/0 conn(0x7f6dcc14c7e0 msgr2=0x7f6dcc14cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:39:54.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:54.601+0000 7f6dc959a640 1 --2- 172.21.15.12:0/1775992919 >> v2:172.21.15.84:3300/0 conn(0x7f6dcc14c7e0 0x7f6dcc14cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:54.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:54.601+0000 7f6dc959a640 1 -- 172.21.15.12:0/1775992919 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dcc14ffe0 con 0x7f6dcc0c10a0 2024-05-15T15:39:54.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:54.601+0000 7f6dc959a640 1 -- 172.21.15.12:0/1775992919 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 38171736 0 0) 0x7f6dc4001710 con 0x7f6dcc0c10a0 2024-05-15T15:39:54.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:54.601+0000 7f6dc959a640 1 -- 172.21.15.12:0/1775992919 >> v1:172.21.15.12:6789/0 conn(0x7f6dcc0c10a0 legacy=0x7f6dcc14f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:54.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:54.601+0000 7f6dc959a640 1 --2- 172.21.15.12:0/1775992919 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f6dcc146070 0x7f6db8003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:54.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:54.601+0000 7f6dc959a640 1 --2- 172.21.15.12:0/1775992919 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6db8003fd0 0x7f6db8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:54.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:54.601+0000 7f6dc959a640 1 --2- 172.21.15.12:0/1775992919 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6db8004d40 0x7f6db8005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:54.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:54.601+0000 7f6dc959a640 1 -- 172.21.15.12:0/1775992919 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f6dcc14c350 con 0x7f6db8004d40 2024-05-15T15:39:54.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:54.601+0000 7f6dc959a640 1 -- 172.21.15.12:0/1775992919 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f6db800bad0 con 0x7f6db8003fd0 2024-05-15T15:39:54.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:54.601+0000 7f6dc959a640 1 -- 172.21.15.12:0/1775992919 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f6db800bcd0 con 0x7f6dcc146070 2024-05-15T15:39:54.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:54.602+0000 7f6dcad9d640 1 --2- 172.21.15.12:0/1775992919 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6db8004d40 0x7f6db8005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:54.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:54.602+0000 7f6dca59c640 1 --2- 172.21.15.12:0/1775992919 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f6dcc146070 0x7f6db8003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:54.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:54.602+0000 7f6dc9d9b640 1 --2- 172.21.15.12:0/1775992919 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6db8003fd0 0x7f6db8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:54.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:54.602+0000 7f6dcad9d640 1 -- 172.21.15.12:0/1775992919 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f6dcc146070 msgr2=0x7f6db8003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:39:54.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:54.602+0000 7f6dcad9d640 1 --2- 172.21.15.12:0/1775992919 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f6dcc146070 0x7f6db8003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:54.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:54.602+0000 7f6dcad9d640 1 -- 172.21.15.12:0/1775992919 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6db8003fd0 msgr2=0x7f6db8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:39:54.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:54.602+0000 7f6dcad9d640 1 --2- 172.21.15.12:0/1775992919 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6db8003fd0 0x7f6db8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:54.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:54.602+0000 7f6dcad9d640 1 -- 172.21.15.12:0/1775992919 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6db8003520 con 0x7f6db8004d40 2024-05-15T15:39:54.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:54.603+0000 7f6dcad9d640 1 --2- 172.21.15.12:0/1775992919 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6db8004d40 0x7f6db8005150 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6dcc14c300 tx=0x7f6db8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cbb7a92ddeb58ad server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:39:54.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:54.603+0000 7f6dc959a640 1 -- 172.21.15.12:0/1775992919 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dbc034020 con 0x7f6db8004d40 2024-05-15T15:39:54.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:54.603+0000 7f6dc959a640 1 -- 172.21.15.12:0/1775992919 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6dbc0305f0 con 0x7f6db8004d40 2024-05-15T15:39:54.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:54.603+0000 7f6dc959a640 1 -- 172.21.15.12:0/1775992919 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dbc009c10 con 0x7f6db8004d40 2024-05-15T15:39:54.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:54.603+0000 7f6dd0d35640 1 -- 172.21.15.12:0/1775992919 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6db8004d40 msgr2=0x7f6db8005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:54.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:54.603+0000 7f6dd0d35640 1 --2- 172.21.15.12:0/1775992919 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6db8004d40 0x7f6db8005150 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6dcc14c300 tx=0x7f6db8005830 comp rx=0 tx=0).stop 2024-05-15T15:39:54.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:54.603+0000 7f6dcad9d640 1 -- 172.21.15.12:0/1775992919 reap_dead start 2024-05-15T15:39:54.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:54.604+0000 7f6dd0d35640 1 -- 172.21.15.12:0/1775992919 shutdown_connections 2024-05-15T15:39:54.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:54.604+0000 7f6dd0d35640 1 -- 172.21.15.12:0/1775992919 >> 172.21.15.12:0/1775992919 conn(0x7f6dcc0c1830 msgr2=0x7f6dcc0c1c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:39:54.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:54.604+0000 7f6dd0d35640 1 -- 172.21.15.12:0/1775992919 shutdown_connections 2024-05-15T15:39:54.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:54.604+0000 7f6dd0d35640 1 -- 172.21.15.12:0/1775992919 wait complete. 2024-05-15T15:39:54.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:54.605+0000 7f6dd0d35640 1 Processor -- start 2024-05-15T15:39:54.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:54.605+0000 7f6dd0d35640 1 -- start start 2024-05-15T15:39:54.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:54.606+0000 7f6dd0d35640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6db8004d40 0x7f6dcc148fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:54.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:54.606+0000 7f6dd0d35640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f6dcc0a67a0 0x7f6dcc0a7380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:54.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:54.606+0000 7f6dd0d35640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6dcc0a78c0 0x7f6dcc142c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:54.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:54.606+0000 7f6dd0d35640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f6dcc0c14b0 con 0x7f6dcc0a78c0 2024-05-15T15:39:54.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:54.606+0000 7f6dd0d35640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f6dcc1505a0 con 0x7f6db8004d40 2024-05-15T15:39:54.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:54.606+0000 7f6dd0d35640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f6dcc14d130 con 0x7f6dcc0a67a0 2024-05-15T15:39:54.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:54.606+0000 7f6dcad9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6dcc0a78c0 0x7f6dcc142c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:54.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:54.607+0000 7f6dcad9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6dcc0a78c0 0x7f6dcc142c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35684/0 (socket says 172.21.15.12:35684) 2024-05-15T15:39:54.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:54.607+0000 7f6dcad9d640 1 -- 172.21.15.12:0/3195144917 learned_addr learned my addr 172.21.15.12:0/3195144917 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:39:54.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:54.607+0000 7f6dca59c640 1 --2- 172.21.15.12:0/3195144917 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6db8004d40 0x7f6dcc148fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:54.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:54.607+0000 7f6dc9d9b640 1 --2- 172.21.15.12:0/3195144917 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f6dcc0a67a0 0x7f6dcc0a7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:54.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:54.607+0000 7f6dcad9d640 1 -- 172.21.15.12:0/3195144917 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f6dcc0a67a0 msgr2=0x7f6dcc0a7380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:54.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:54.607+0000 7f6dcad9d640 1 --2- 172.21.15.12:0/3195144917 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f6dcc0a67a0 0x7f6dcc0a7380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:54.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:54.607+0000 7f6dcad9d640 1 -- 172.21.15.12:0/3195144917 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6db8004d40 msgr2=0x7f6dcc148fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:54.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:54.607+0000 7f6dcad9d640 1 --2- 172.21.15.12:0/3195144917 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6db8004d40 0x7f6dcc148fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:54.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:54.607+0000 7f6dcad9d640 1 -- 172.21.15.12:0/3195144917 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dcc149510 con 0x7f6dcc0a78c0 2024-05-15T15:39:54.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:54.607+0000 7f6dcad9d640 1 --2- 172.21.15.12:0/3195144917 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6dcc0a78c0 0x7f6dcc142c20 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc02af30 tx=0x7f6dbc009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:39:54.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:54.607+0000 7f6dc2ffd640 1 -- 172.21.15.12:0/3195144917 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dbc034040 con 0x7f6dcc0a78c0 2024-05-15T15:39:54.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:54.607+0000 7f6dc2ffd640 1 -- 172.21.15.12:0/3195144917 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6dbc003990 con 0x7f6dcc0a78c0 2024-05-15T15:39:54.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:54.607+0000 7f6dc2ffd640 1 -- 172.21.15.12:0/3195144917 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dbc009c10 con 0x7f6dcc0a78c0 2024-05-15T15:39:54.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:54.607+0000 7f6dd0d35640 1 -- 172.21.15.12:0/3195144917 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6dcc0a53c0 con 0x7f6dcc0a78c0 2024-05-15T15:39:54.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:54.607+0000 7f6dd0d35640 1 -- 172.21.15.12:0/3195144917 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6dcc0a5980 con 0x7f6dcc0a78c0 2024-05-15T15:39:54.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:54.608+0000 7f6dd0d35640 1 -- 172.21.15.12:0/3195144917 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6dcc050940 con 0x7f6dcc0a78c0 2024-05-15T15:39:54.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:54.609+0000 7f6dc2ffd640 1 -- 172.21.15.12:0/3195144917 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f6dbc037020 con 0x7f6dcc0a78c0 2024-05-15T15:39:54.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:54.609+0000 7f6dc2ffd640 1 --2- 172.21.15.12:0/3195144917 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f6dac0762d0 0x7f6dac0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:54.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:54.610+0000 7f6dc2ffd640 1 -- 172.21.15.12:0/3195144917 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f6dbc0b85e0 con 0x7f6dcc0a78c0 2024-05-15T15:39:54.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:54.610+0000 7f6dca59c640 1 --2- 172.21.15.12:0/3195144917 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f6dac0762d0 0x7f6dac0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:54.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:54.610+0000 7f6dca59c640 1 --2- 172.21.15.12:0/3195144917 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f6dac0762d0 0x7f6dac0787e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6dc4000ff0 tx=0x7f6dc4001c60 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:39:54.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:54.614+0000 7f6dc2ffd640 1 -- 172.21.15.12:0/3195144917 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f6dbc049060 con 0x7f6dcc0a78c0 2024-05-15T15:39:54.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:54.850+0000 7f6dd0d35640 1 -- 172.21.15.12:0/3195144917 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f6dcc0a6c80 con 0x7f6dcc0a78c0 2024-05-15T15:39:55.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.472+0000 7f6dc2ffd640 1 -- 172.21.15.12:0/3195144917 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v7) ==== 122+0+0 (secure 0 0 0) 0x7f6dbc081e10 con 0x7f6dcc0a78c0 2024-05-15T15:39:55.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.475+0000 7f6dd0d35640 1 -- 172.21.15.12:0/3195144917 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f6dac0762d0 msgr2=0x7f6dac0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:55.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.475+0000 7f6dd0d35640 1 --2- 172.21.15.12:0/3195144917 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f6dac0762d0 0x7f6dac0787e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6dc4000ff0 tx=0x7f6dc4001c60 comp rx=0 tx=0).stop 2024-05-15T15:39:55.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.475+0000 7f6dd0d35640 1 -- 172.21.15.12:0/3195144917 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6dcc0a78c0 msgr2=0x7f6dcc142c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:55.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.475+0000 7f6dd0d35640 1 --2- 172.21.15.12:0/3195144917 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6dcc0a78c0 0x7f6dcc142c20 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc02af30 tx=0x7f6dbc009750 comp rx=0 tx=0).stop 2024-05-15T15:39:55.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.475+0000 7f6dd0d35640 1 -- 172.21.15.12:0/3195144917 shutdown_connections 2024-05-15T15:39:55.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.475+0000 7f6dd0d35640 1 --2- 172.21.15.12:0/3195144917 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f6dac0762d0 0x7f6dac0787e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:55.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.475+0000 7f6dd0d35640 1 --2- 172.21.15.12:0/3195144917 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6dcc0a78c0 0x7f6dcc142c20 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:55.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.475+0000 7f6dd0d35640 1 --2- 172.21.15.12:0/3195144917 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f6dcc0a67a0 0x7f6dcc0a7380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:55.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.475+0000 7f6dd0d35640 1 --2- 172.21.15.12:0/3195144917 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6db8004d40 0x7f6dcc148fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:55.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.475+0000 7f6dd0d35640 1 -- 172.21.15.12:0/3195144917 >> 172.21.15.12:0/3195144917 conn(0x7f6dcc0c1830 msgr2=0x7f6dcc0a14e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:39:55.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.475+0000 7f6dd0d35640 1 -- 172.21.15.12:0/3195144917 shutdown_connections 2024-05-15T15:39:55.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.475+0000 7f6dd0d35640 1 -- 172.21.15.12:0/3195144917 wait complete. 2024-05-15T15:39:55.490 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-05-15T15:39:55.491 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-15T15:39:55.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.607+0000 7f0adf83b640 1 Processor -- start 2024-05-15T15:39:55.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.607+0000 7f0adf83b640 1 -- start start 2024-05-15T15:39:55.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.608+0000 7f0adf83b640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0ad8151fc0 0x7f0ad80bd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:55.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.608+0000 7f0adf83b640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ad80c36f0 con 0x7f0ad806da30 2024-05-15T15:39:55.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.608+0000 7f0adf83b640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ad8152530 con 0x7f0ad80bf050 2024-05-15T15:39:55.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.608+0000 7f0adf83b640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f0ad80bdc10 con 0x7f0ad8151fc0 2024-05-15T15:39:55.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.608+0000 7f0add5d7640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0ad8151fc0 0x7f0ad80bd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:55.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.608+0000 7f0add5d7640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0ad8151fc0 0x7f0ad80bd6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35692/0 (socket says 172.21.15.12:35692) 2024-05-15T15:39:55.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.608+0000 7f0adcdd6640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f0ad806da30 0x7f0ad80be940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:34290/0 (socket says 172.21.15.12:34290) 2024-05-15T15:39:55.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.608+0000 7f0add5d7640 1 -- 172.21.15.12:0/1871707148 learned_addr learned my addr 172.21.15.12:0/1871707148 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:39:55.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.609+0000 7f0add5d7640 1 -- 172.21.15.12:0/1871707148 >> v1:172.21.15.84:6789/0 conn(0x7f0ad80bf050 legacy=0x7f0ad8158e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:55.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.609+0000 7f0add5d7640 1 -- 172.21.15.12:0/1871707148 >> v1:172.21.15.12:6789/0 conn(0x7f0ad806da30 legacy=0x7f0ad80be940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:55.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.609+0000 7f0acffff640 1 -- 172.21.15.12:0/1871707148 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4075214035 0 0) 0x7f0ad80c36f0 con 0x7f0ad806da30 2024-05-15T15:39:55.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.609+0000 7f0add5d7640 1 -- 172.21.15.12:0/1871707148 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ad8152810 con 0x7f0ad8151fc0 2024-05-15T15:39:55.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.609+0000 7f0add5d7640 1 --2- 172.21.15.12:0/1871707148 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ad8151fc0 0x7f0ad80bd6d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0ad4009870 tx=0x7f0ad402a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=737db649b6a04e1a server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:39:55.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.610+0000 7f0acffff640 1 -- 172.21.15.12:0/1871707148 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ad4037070 con 0x7f0ad8151fc0 2024-05-15T15:39:55.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.610+0000 7f0acffff640 1 -- 172.21.15.12:0/1871707148 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ad402ae50 con 0x7f0ad8151fc0 2024-05-15T15:39:55.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.610+0000 7f0acffff640 1 -- 172.21.15.12:0/1871707148 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ad4032860 con 0x7f0ad8151fc0 2024-05-15T15:39:55.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.610+0000 7f0adf83b640 1 -- 172.21.15.12:0/1871707148 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ad8151fc0 msgr2=0x7f0ad80bd6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:55.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.610+0000 7f0adf83b640 1 --2- 172.21.15.12:0/1871707148 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ad8151fc0 0x7f0ad80bd6d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0ad4009870 tx=0x7f0ad402a300 comp rx=0 tx=0).stop 2024-05-15T15:39:55.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.610+0000 7f0adf83b640 1 -- 172.21.15.12:0/1871707148 shutdown_connections 2024-05-15T15:39:55.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.610+0000 7f0adf83b640 1 --2- 172.21.15.12:0/1871707148 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ad8151fc0 0x7f0ad80bd6d0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:55.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.610+0000 7f0adf83b640 1 -- 172.21.15.12:0/1871707148 >> 172.21.15.12:0/1871707148 conn(0x7f0ad80c3d20 msgr2=0x7f0ad80c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:39:55.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.610+0000 7f0adf83b640 1 -- 172.21.15.12:0/1871707148 shutdown_connections 2024-05-15T15:39:55.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.610+0000 7f0adf83b640 1 -- 172.21.15.12:0/1871707148 wait complete. 2024-05-15T15:39:55.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.612+0000 7f0adf83b640 1 Processor -- start 2024-05-15T15:39:55.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.612+0000 7f0adf83b640 1 -- start start 2024-05-15T15:39:55.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.613+0000 7f0adf83b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ad806da30 0x7f0ad81d8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:55.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.613+0000 7f0adf83b640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f0ad80bf050 0x7f0ad81d79e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:55.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.613+0000 7f0adf83b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ad8151fc0 0x7f0ad814e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:55.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.613+0000 7f0adf83b640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f0ad80a3050 con 0x7f0ad806da30 2024-05-15T15:39:55.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.613+0000 7f0adf83b640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f0ad80a2ed0 con 0x7f0ad8151fc0 2024-05-15T15:39:55.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.613+0000 7f0adf83b640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f0ad806de40 con 0x7f0ad80bf050 2024-05-15T15:39:55.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.613+0000 7f0add5d7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ad806da30 0x7f0ad81d8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:55.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.613+0000 7f0add5d7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ad806da30 0x7f0ad81d8560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35708/0 (socket says 172.21.15.12:35708) 2024-05-15T15:39:55.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.613+0000 7f0add5d7640 1 -- 172.21.15.12:0/87643603 learned_addr learned my addr 172.21.15.12:0/87643603 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:39:55.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.613+0000 7f0adddd8640 1 --2- 172.21.15.12:0/87643603 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ad8151fc0 0x7f0ad814e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:55.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.613+0000 7f0adcdd6640 1 --2- 172.21.15.12:0/87643603 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f0ad80bf050 0x7f0ad81d79e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:55.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.613+0000 7f0add5d7640 1 -- 172.21.15.12:0/87643603 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f0ad80bf050 msgr2=0x7f0ad81d79e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:55.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.613+0000 7f0add5d7640 1 --2- 172.21.15.12:0/87643603 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f0ad80bf050 0x7f0ad81d79e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:55.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.613+0000 7f0add5d7640 1 -- 172.21.15.12:0/87643603 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ad8151fc0 msgr2=0x7f0ad814e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:55.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.613+0000 7f0add5d7640 1 --2- 172.21.15.12:0/87643603 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ad8151fc0 0x7f0ad814e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:55.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.613+0000 7f0add5d7640 1 -- 172.21.15.12:0/87643603 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ad81d8aa0 con 0x7f0ad806da30 2024-05-15T15:39:55.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.614+0000 7f0adddd8640 1 --2- 172.21.15.12:0/87643603 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ad8151fc0 0x7f0ad814e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-15T15:39:55.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.614+0000 7f0add5d7640 1 --2- 172.21.15.12:0/87643603 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ad806da30 0x7f0ad81d8560 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0ad4009870 tx=0x7f0ad40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:39:55.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.614+0000 7f0acdffb640 1 -- 172.21.15.12:0/87643603 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ad4042070 con 0x7f0ad806da30 2024-05-15T15:39:55.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.614+0000 7f0acdffb640 1 -- 172.21.15.12:0/87643603 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ad403e870 con 0x7f0ad806da30 2024-05-15T15:39:55.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.614+0000 7f0acdffb640 1 -- 172.21.15.12:0/87643603 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ad4037040 con 0x7f0ad806da30 2024-05-15T15:39:55.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.614+0000 7f0adf83b640 1 -- 172.21.15.12:0/87643603 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ad80ba220 con 0x7f0ad806da30 2024-05-15T15:39:55.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.614+0000 7f0adf83b640 1 -- 172.21.15.12:0/87643603 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ad81e4c70 con 0x7f0ad806da30 2024-05-15T15:39:55.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.615+0000 7f0adf83b640 1 -- 172.21.15.12:0/87643603 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ad80c10e0 con 0x7f0ad806da30 2024-05-15T15:39:55.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.616+0000 7f0acdffb640 1 -- 172.21.15.12:0/87643603 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0ad4045070 con 0x7f0ad806da30 2024-05-15T15:39:55.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.616+0000 7f0acdffb640 1 --2- 172.21.15.12:0/87643603 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f0abc0762d0 0x7f0abc0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:55.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.616+0000 7f0acdffb640 1 -- 172.21.15.12:0/87643603 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f0ad40b8130 con 0x7f0ad806da30 2024-05-15T15:39:55.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.617+0000 7f0adcdd6640 1 --2- 172.21.15.12:0/87643603 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f0abc0762d0 0x7f0abc0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:55.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.617+0000 7f0adcdd6640 1 --2- 172.21.15.12:0/87643603 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f0abc0762d0 0x7f0abc0787e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0ad81e1fa0 tx=0x7f0ac8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:39:55.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.621+0000 7f0acdffb640 1 -- 172.21.15.12:0/87643603 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f0ad80c10e0 con 0x7f0ad806da30 2024-05-15T15:39:55.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.849+0000 7f0adf83b640 1 -- 172.21.15.12:0/87643603 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0ad8050940 con 0x7f0ad806da30 2024-05-15T15:39:55.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.849+0000 7f0acdffb640 1 -- 172.21.15.12:0/87643603 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+4351 (secure 0 0 0) 0x7f0ad40819f0 con 0x7f0ad806da30 2024-05-15T15:39:55.854 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-05-15T15:39:55.854 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6834/1290912681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":1290912681},{"type":"v1","addr":"172.21.15.12:6834","nonce":1290912681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/2920770671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6833","nonce":2920770671},{"type":"v1","addr":"172.21.15.12:6835","nonce":2920770671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-15T15:39:51.829483+0000","modified":"2024-05-15T15:39:54.852086+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6835/3699736653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3699736653},{"type":"v1","addr":"172.21.15.84:6835","nonce":3699736653}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4288,"qdb_cluster":[4288]},"id":1}]} 2024-05-15T15:39:55.855 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 7 2024-05-15T15:39:55.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.851+0000 7f0adf83b640 1 -- 172.21.15.12:0/87643603 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f0abc0762d0 msgr2=0x7f0abc0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:55.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.851+0000 7f0adf83b640 1 --2- 172.21.15.12:0/87643603 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f0abc0762d0 0x7f0abc0787e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0ad81e1fa0 tx=0x7f0ac8009040 comp rx=0 tx=0).stop 2024-05-15T15:39:55.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.851+0000 7f0adf83b640 1 -- 172.21.15.12:0/87643603 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ad806da30 msgr2=0x7f0ad81d8560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:55.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.851+0000 7f0adf83b640 1 --2- 172.21.15.12:0/87643603 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ad806da30 0x7f0ad81d8560 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0ad4009870 tx=0x7f0ad40046c0 comp rx=0 tx=0).stop 2024-05-15T15:39:55.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.851+0000 7f0adf83b640 1 -- 172.21.15.12:0/87643603 shutdown_connections 2024-05-15T15:39:55.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.851+0000 7f0adf83b640 1 --2- 172.21.15.12:0/87643603 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ad8151fc0 0x7f0ad814e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:55.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.851+0000 7f0adf83b640 1 --2- 172.21.15.12:0/87643603 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f0ad80bf050 0x7f0ad81d79e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:55.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.851+0000 7f0adf83b640 1 --2- 172.21.15.12:0/87643603 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f0abc0762d0 0x7f0abc0787e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:55.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.851+0000 7f0adf83b640 1 --2- 172.21.15.12:0/87643603 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ad806da30 0x7f0ad81d8560 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:55.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.851+0000 7f0adf83b640 1 -- 172.21.15.12:0/87643603 >> 172.21.15.12:0/87643603 conn(0x7f0ad80c3d20 msgr2=0x7f0ad80c09d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:39:55.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.851+0000 7f0adf83b640 1 -- 172.21.15.12:0/87643603 shutdown_connections 2024-05-15T15:39:55.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.851+0000 7f0adf83b640 1 -- 172.21.15.12:0/87643603 wait complete. 2024-05-15T15:39:55.864 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-15T15:39:55.975 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.974+0000 7fab52dbe640 1 Processor -- start 2024-05-15T15:39:55.976 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.974+0000 7fab52dbe640 1 -- start start 2024-05-15T15:39:55.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.975+0000 7fab52dbe640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fab4c1519c0 0x7fab4c14ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:55.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.975+0000 7fab52dbe640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab4c0bf720 con 0x7fab4c06c6e0 2024-05-15T15:39:55.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.975+0000 7fab52dbe640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab4c06cfe0 con 0x7fab4c074a10 2024-05-15T15:39:55.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.975+0000 7fab52dbe640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7fab4c14f480 con 0x7fab4c1519c0 2024-05-15T15:39:55.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.975+0000 7fab50b5a640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fab4c06c6e0 0x7fab4c0bf010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:34304/0 (socket says 172.21.15.12:34304) 2024-05-15T15:39:55.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.975+0000 7fab50b5a640 1 -- 172.21.15.12:0/2595976844 learned_addr learned my addr 172.21.15.12:0/2595976844 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-05-15T15:39:55.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.975+0000 7fab5135b640 1 --2- 172.21.15.12:0/2595976844 >> v2:172.21.15.84:3300/0 conn(0x7fab4c1519c0 0x7fab4c14ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:55.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.975+0000 7fab437fe640 1 -- 172.21.15.12:0/2595976844 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3038728891 0 0) 0x7fab48001490 con 0x7fab4c06c6e0 2024-05-15T15:39:55.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.975+0000 7fab437fe640 1 -- 172.21.15.12:0/2595976844 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fab34003520 con 0x7fab4c06c6e0 2024-05-15T15:39:55.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.975+0000 7fab437fe640 1 -- 172.21.15.12:0/2595976844 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2873670486 0 0) 0x7fab34003520 con 0x7fab4c06c6e0 2024-05-15T15:39:55.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.975+0000 7fab437fe640 1 -- 172.21.15.12:0/2595976844 >> v2:172.21.15.84:3300/0 conn(0x7fab4c1519c0 msgr2=0x7fab4c14ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:39:55.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.975+0000 7fab437fe640 1 --2- 172.21.15.12:0/2595976844 >> v2:172.21.15.84:3300/0 conn(0x7fab4c1519c0 0x7fab4c14ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:55.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.975+0000 7fab437fe640 1 -- 172.21.15.12:0/2595976844 >> v1:172.21.15.84:6789/0 conn(0x7fab4c074a10 legacy=0x7fab4c156d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:55.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.975+0000 7fab437fe640 1 -- 172.21.15.12:0/2595976844 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab4c06cd00 con 0x7fab4c06c6e0 2024-05-15T15:39:55.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.975+0000 7fab437fe640 1 -- 172.21.15.12:0/2595976844 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 38171736 0 0) 0x7fab48001c40 con 0x7fab4c06c6e0 2024-05-15T15:39:55.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.975+0000 7fab437fe640 1 -- 172.21.15.12:0/2595976844 >> v1:172.21.15.12:6789/0 conn(0x7fab4c06c6e0 legacy=0x7fab4c0bf010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:55.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.975+0000 7fab437fe640 1 --2- 172.21.15.12:0/2595976844 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fab34003a50 0x7fab34003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:55.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.975+0000 7fab437fe640 1 --2- 172.21.15.12:0/2595976844 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab34004800 0x7fab34004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:55.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.975+0000 7fab437fe640 1 --2- 172.21.15.12:0/2595976844 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab34005250 0x7fab3400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:55.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.976+0000 7fab437fe640 1 -- 172.21.15.12:0/2595976844 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fab4c14f480 con 0x7fab34005250 2024-05-15T15:39:55.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.976+0000 7fab437fe640 1 -- 172.21.15.12:0/2595976844 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fab3400c1d0 con 0x7fab34004800 2024-05-15T15:39:55.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.976+0000 7fab437fe640 1 -- 172.21.15.12:0/2595976844 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fab3400c3d0 con 0x7fab34003a50 2024-05-15T15:39:55.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.976+0000 7fab5135b640 1 --2- 172.21.15.12:0/2595976844 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab34005250 0x7fab3400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:55.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.976+0000 7fab43fff640 1 --2- 172.21.15.12:0/2595976844 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab34004800 0x7fab34004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:55.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.976+0000 7fab50b5a640 1 --2- 172.21.15.12:0/2595976844 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fab34003a50 0x7fab34003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:55.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.976+0000 7fab5135b640 1 -- 172.21.15.12:0/2595976844 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fab34003a50 msgr2=0x7fab34003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:39:55.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.976+0000 7fab5135b640 1 --2- 172.21.15.12:0/2595976844 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fab34003a50 0x7fab34003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:55.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.976+0000 7fab5135b640 1 -- 172.21.15.12:0/2595976844 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab34004800 msgr2=0x7fab34004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:39:55.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.976+0000 7fab5135b640 1 --2- 172.21.15.12:0/2595976844 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab34004800 0x7fab34004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:55.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.976+0000 7fab5135b640 1 -- 172.21.15.12:0/2595976844 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab34003520 con 0x7fab34005250 2024-05-15T15:39:55.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.977+0000 7fab5135b640 1 -- 172.21.15.12:0/2595976844 reap_dead start 2024-05-15T15:39:55.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.977+0000 7fab5135b640 1 --2- 172.21.15.12:0/2595976844 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab34005250 0x7fab3400b9c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fab44009a90 tx=0x7fab34005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f77b162185eb5a2c server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:39:55.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.977+0000 7fab437fe640 1 -- 172.21.15.12:0/2595976844 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab44009690 con 0x7fab34005250 2024-05-15T15:39:55.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.977+0000 7fab437fe640 1 -- 172.21.15.12:0/2595976844 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab44004020 con 0x7fab34005250 2024-05-15T15:39:55.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.977+0000 7fab437fe640 1 -- 172.21.15.12:0/2595976844 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab440043d0 con 0x7fab34005250 2024-05-15T15:39:55.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.977+0000 7fab52dbe640 1 -- 172.21.15.12:0/2595976844 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab34005250 msgr2=0x7fab3400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:55.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.977+0000 7fab52dbe640 1 --2- 172.21.15.12:0/2595976844 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab34005250 0x7fab3400b9c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fab44009a90 tx=0x7fab34005830 comp rx=0 tx=0).stop 2024-05-15T15:39:55.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.977+0000 7fab52dbe640 1 -- 172.21.15.12:0/2595976844 shutdown_connections 2024-05-15T15:39:55.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.977+0000 7fab52dbe640 1 --2- 172.21.15.12:0/2595976844 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab34005250 0x7fab3400b9c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:55.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.977+0000 7fab52dbe640 1 -- 172.21.15.12:0/2595976844 >> 172.21.15.12:0/2595976844 conn(0x7fab4c0bd0f0 msgr2=0x7fab4c0bd500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:39:55.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.978+0000 7fab52dbe640 1 -- 172.21.15.12:0/2595976844 shutdown_connections 2024-05-15T15:39:55.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.978+0000 7fab52dbe640 1 -- 172.21.15.12:0/2595976844 wait complete. 2024-05-15T15:39:55.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.979+0000 7fab52dbe640 1 Processor -- start 2024-05-15T15:39:55.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.979+0000 7fab52dbe640 1 -- start start 2024-05-15T15:39:55.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.980+0000 7fab52dbe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab34005250 0x7fab4c06f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:55.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.980+0000 7fab52dbe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab4c147e40 0x7fab4c0a0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:55.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.980+0000 7fab52dbe640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fab4c0a1210 0x7fab4c146850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:55.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.980+0000 7fab52dbe640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fab4c151dd0 con 0x7fab4c147e40 2024-05-15T15:39:55.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.980+0000 7fab52dbe640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fab4c0744f0 con 0x7fab34005250 2024-05-15T15:39:55.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.980+0000 7fab52dbe640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fab4c0be460 con 0x7fab4c0a1210 2024-05-15T15:39:55.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.980+0000 7fab43fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab4c147e40 0x7fab4c0a0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:55.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.980+0000 7fab43fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab4c147e40 0x7fab4c0a0cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35738/0 (socket says 172.21.15.12:35738) 2024-05-15T15:39:55.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.980+0000 7fab43fff640 1 -- 172.21.15.12:0/2909087755 learned_addr learned my addr 172.21.15.12:0/2909087755 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:39:55.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.981+0000 7fab50b5a640 1 --2- 172.21.15.12:0/2909087755 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab34005250 0x7fab4c06f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:55.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.981+0000 7fab5135b640 1 --2- 172.21.15.12:0/2909087755 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fab4c0a1210 0x7fab4c146850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:55.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.981+0000 7fab43fff640 1 -- 172.21.15.12:0/2909087755 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fab4c0a1210 msgr2=0x7fab4c146850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:55.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.981+0000 7fab43fff640 1 --2- 172.21.15.12:0/2909087755 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fab4c0a1210 0x7fab4c146850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:55.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.981+0000 7fab43fff640 1 -- 172.21.15.12:0/2909087755 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab34005250 msgr2=0x7fab4c06f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:55.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.981+0000 7fab43fff640 1 --2- 172.21.15.12:0/2909087755 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab34005250 0x7fab4c06f920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:55.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.981+0000 7fab43fff640 1 -- 172.21.15.12:0/2909087755 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab4c0bc580 con 0x7fab4c147e40 2024-05-15T15:39:55.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.981+0000 7fab50b5a640 1 --2- 172.21.15.12:0/2909087755 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab34005250 0x7fab4c06f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-15T15:39:55.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.981+0000 7fab43fff640 1 --2- 172.21.15.12:0/2909087755 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab4c147e40 0x7fab4c0a0cd0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fab3c00f610 tx=0x7fab3c00fad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:39:55.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.981+0000 7fab417fa640 1 -- 172.21.15.12:0/2909087755 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab3c01a070 con 0x7fab4c147e40 2024-05-15T15:39:55.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.981+0000 7fab417fa640 1 -- 172.21.15.12:0/2909087755 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab3c005320 con 0x7fab4c147e40 2024-05-15T15:39:55.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.981+0000 7fab52dbe640 1 -- 172.21.15.12:0/2909087755 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab4c0a1d80 con 0x7fab4c147e40 2024-05-15T15:39:55.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.981+0000 7fab417fa640 1 -- 172.21.15.12:0/2909087755 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab3c007290 con 0x7fab4c147e40 2024-05-15T15:39:55.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.981+0000 7fab52dbe640 1 -- 172.21.15.12:0/2909087755 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab4c0a0310 con 0x7fab4c147e40 2024-05-15T15:39:55.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.982+0000 7fab52dbe640 1 -- 172.21.15.12:0/2909087755 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab4c069b50 con 0x7fab4c147e40 2024-05-15T15:39:55.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.983+0000 7fab417fa640 1 -- 172.21.15.12:0/2909087755 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fab3c01d070 con 0x7fab4c147e40 2024-05-15T15:39:55.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.983+0000 7fab417fa640 1 --2- 172.21.15.12:0/2909087755 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fab380762d0 0x7fab380787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:55.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.984+0000 7fab417fa640 1 -- 172.21.15.12:0/2909087755 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fab3c096ef0 con 0x7fab4c147e40 2024-05-15T15:39:55.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.984+0000 7fab50b5a640 1 --2- 172.21.15.12:0/2909087755 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fab380762d0 0x7fab380787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:55.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.984+0000 7fab50b5a640 1 --2- 172.21.15.12:0/2909087755 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fab380762d0 0x7fab380787e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fab48001790 tx=0x7fab48006040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:39:55.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:55.988+0000 7fab417fa640 1 -- 172.21.15.12:0/2909087755 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fab3c060720 con 0x7fab4c147e40 2024-05-15T15:39:56.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.179+0000 7fab52dbe640 1 -- 172.21.15.12:0/2909087755 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fab4c0bcb60 con 0x7fab4c147e40 2024-05-15T15:39:56.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.181+0000 7fab417fa640 1 -- 172.21.15.12:0/2909087755 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16573 (secure 0 0 0) 0x7fab3c060020 con 0x7fab4c147e40 2024-05-15T15:39:56.183 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-05-15T15:39:56.183 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":23,"fsid":"3b7fc4b2-b85c-49b5-a5de-38444eeed40d","created":"2024-05-15T15:39:28.392476+0000","modified":"2024-05-15T15:39:53.451332+0000","last_up_change":"2024-05-15T15:39:39.363983+0000","last_in_change":"2024-05-15T15:39:30.591216+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-15T15:39:40.715999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-15T15:39:49.598723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-15T15:39:50.783054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0d06a12a-866a-418e-9776-704d74354579","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":3943681952},{"type":"v1","addr":"172.21.15.12:6809","nonce":3943681952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":3943681952},{"type":"v1","addr":"172.21.15.12:6812","nonce":3943681952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":3943681952},{"type":"v1","addr":"172.21.15.12:6821","nonce":3943681952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":3943681952},{"type":"v1","addr":"172.21.15.12:6816","nonce":3943681952}]},"public_addr":"172.21.15.12:6809/3943681952","cluster_addr":"172.21.15.12:6812/3943681952","heartbeat_back_addr":"172.21.15.12:6821/3943681952","heartbeat_front_addr":"172.21.15.12:6816/3943681952","state":["exists","up"]},{"osd":1,"uuid":"09d0fa19-9ef8-4f35-bf99-6e86658c6f10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6811","nonce":1763752148},{"type":"v1","addr":"172.21.15.12:6813","nonce":1763752148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":1763752148},{"type":"v1","addr":"172.21.15.12:6817","nonce":1763752148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":1763752148},{"type":"v1","addr":"172.21.15.12:6827","nonce":1763752148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6819","nonce":1763752148},{"type":"v1","addr":"172.21.15.12:6822","nonce":1763752148}]},"public_addr":"172.21.15.12:6813/1763752148","cluster_addr":"172.21.15.12:6817/1763752148","heartbeat_back_addr":"172.21.15.12:6827/1763752148","heartbeat_front_addr":"172.21.15.12:6822/1763752148","state":["exists","up"]},{"osd":2,"uuid":"b204c6ad-f431-40a5-ba27-9844294f0ece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":2173702802},{"type":"v1","addr":"172.21.15.12:6823","nonce":2173702802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":2173702802},{"type":"v1","addr":"172.21.15.12:6826","nonce":2173702802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":2173702802},{"type":"v1","addr":"172.21.15.12:6831","nonce":2173702802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":2173702802},{"type":"v1","addr":"172.21.15.12:6829","nonce":2173702802}]},"public_addr":"172.21.15.12:6823/2173702802","cluster_addr":"172.21.15.12:6826/2173702802","heartbeat_back_addr":"172.21.15.12:6831/2173702802","heartbeat_front_addr":"172.21.15.12:6829/2173702802","state":["exists","up"]},{"osd":3,"uuid":"660a9ccb-2ee5-42d8-8481-0835047a8260","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":3956443113},{"type":"v1","addr":"172.21.15.12:6801","nonce":3956443113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":3956443113},{"type":"v1","addr":"172.21.15.12:6803","nonce":3956443113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":3956443113},{"type":"v1","addr":"172.21.15.12:6807","nonce":3956443113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":3956443113},{"type":"v1","addr":"172.21.15.12:6805","nonce":3956443113}]},"public_addr":"172.21.15.12:6801/3956443113","cluster_addr":"172.21.15.12:6803/3956443113","heartbeat_back_addr":"172.21.15.12:6807/3956443113","heartbeat_front_addr":"172.21.15.12:6805/3956443113","state":["exists","up"]},{"osd":4,"uuid":"9eef1461-a961-457c-9a78-43b5098a46a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":1021092792},{"type":"v1","addr":"172.21.15.84:6809","nonce":1021092792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":1021092792},{"type":"v1","addr":"172.21.15.84:6811","nonce":1021092792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":1021092792},{"type":"v1","addr":"172.21.15.84:6815","nonce":1021092792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":1021092792},{"type":"v1","addr":"172.21.15.84:6813","nonce":1021092792}]},"public_addr":"172.21.15.84:6809/1021092792","cluster_addr":"172.21.15.84:6811/1021092792","heartbeat_back_addr":"172.21.15.84:6815/1021092792","heartbeat_front_addr":"172.21.15.84:6813/1021092792","state":["exists","up"]},{"osd":5,"uuid":"5f924e2f-6c71-4741-a727-d3710c438431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":3173527851},{"type":"v1","addr":"172.21.15.84:6801","nonce":3173527851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":3173527851},{"type":"v1","addr":"172.21.15.84:6803","nonce":3173527851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":3173527851},{"type":"v1","addr":"172.21.15.84:6807","nonce":3173527851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":3173527851},{"type":"v1","addr":"172.21.15.84:6805","nonce":3173527851}]},"public_addr":"172.21.15.84:6801/3173527851","cluster_addr":"172.21.15.84:6803/3173527851","heartbeat_back_addr":"172.21.15.84:6807/3173527851","heartbeat_front_addr":"172.21.15.84:6805/3173527851","state":["exists","up"]},{"osd":6,"uuid":"efae9975-8c16-4ad3-892f-71f3c59718d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3029180670},{"type":"v1","addr":"172.21.15.84:6817","nonce":3029180670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3029180670},{"type":"v1","addr":"172.21.15.84:6819","nonce":3029180670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3029180670},{"type":"v1","addr":"172.21.15.84:6823","nonce":3029180670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3029180670},{"type":"v1","addr":"172.21.15.84:6821","nonce":3029180670}]},"public_addr":"172.21.15.84:6817/3029180670","cluster_addr":"172.21.15.84:6819/3029180670","heartbeat_back_addr":"172.21.15.84:6823/3029180670","heartbeat_front_addr":"172.21.15.84:6821/3029180670","state":["exists","up"]},{"osd":7,"uuid":"6426efba-ee4d-4e44-83d1-c76c75aec30c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3067620602},{"type":"v1","addr":"172.21.15.84:6825","nonce":3067620602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3067620602},{"type":"v1","addr":"172.21.15.84:6827","nonce":3067620602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":3067620602},{"type":"v1","addr":"172.21.15.84:6831","nonce":3067620602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":3067620602},{"type":"v1","addr":"172.21.15.84:6829","nonce":3067620602}]},"public_addr":"172.21.15.84:6825/3067620602","cluster_addr":"172.21.15.84:6827/3067620602","heartbeat_back_addr":"172.21.15.84:6831/3067620602","heartbeat_front_addr":"172.21.15.84:6829/3067620602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.809514+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.845364+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.762733+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.688597+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.699228+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.747865+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.712415+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.820683+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-15T15:39:56.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.183+0000 7fab52dbe640 1 -- 172.21.15.12:0/2909087755 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fab380762d0 msgr2=0x7fab380787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:56.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.183+0000 7fab52dbe640 1 --2- 172.21.15.12:0/2909087755 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fab380762d0 0x7fab380787e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fab48001790 tx=0x7fab48006040 comp rx=0 tx=0).stop 2024-05-15T15:39:56.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.183+0000 7fab52dbe640 1 -- 172.21.15.12:0/2909087755 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab4c147e40 msgr2=0x7fab4c0a0cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:56.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.183+0000 7fab52dbe640 1 --2- 172.21.15.12:0/2909087755 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab4c147e40 0x7fab4c0a0cd0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fab3c00f610 tx=0x7fab3c00fad0 comp rx=0 tx=0).stop 2024-05-15T15:39:56.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.183+0000 7fab52dbe640 1 -- 172.21.15.12:0/2909087755 shutdown_connections 2024-05-15T15:39:56.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.183+0000 7fab52dbe640 1 --2- 172.21.15.12:0/2909087755 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fab4c0a1210 0x7fab4c146850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:56.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.183+0000 7fab52dbe640 1 --2- 172.21.15.12:0/2909087755 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fab380762d0 0x7fab380787e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:56.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.183+0000 7fab52dbe640 1 --2- 172.21.15.12:0/2909087755 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab4c147e40 0x7fab4c0a0cd0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:56.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.183+0000 7fab52dbe640 1 --2- 172.21.15.12:0/2909087755 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab34005250 0x7fab4c06f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:56.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.183+0000 7fab52dbe640 1 -- 172.21.15.12:0/2909087755 >> 172.21.15.12:0/2909087755 conn(0x7fab4c0bd0f0 msgr2=0x7fab4c06df40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:39:56.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.183+0000 7fab52dbe640 1 -- 172.21.15.12:0/2909087755 shutdown_connections 2024-05-15T15:39:56.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.183+0000 7fab52dbe640 1 -- 172.21.15.12:0/2909087755 wait complete. 2024-05-15T15:39:56.196 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-15T15:39:56.197 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-15T15:39:56.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.305+0000 7f8c3ce51640 1 Processor -- start 2024-05-15T15:39:56.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.305+0000 7f8c3ce51640 1 -- start start 2024-05-15T15:39:56.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.306+0000 7f8c3ce51640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8c38151fc0 0x7f8c380bd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:56.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.306+0000 7f8c3ce51640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c380c36f0 con 0x7f8c380bf050 2024-05-15T15:39:56.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.306+0000 7f8c3ce51640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c38152530 con 0x7f8c3806da30 2024-05-15T15:39:56.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.306+0000 7f8c3ce51640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f8c380bdc10 con 0x7f8c38151fc0 2024-05-15T15:39:56.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.306+0000 7f8c36d9d640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f8c380bf050 0x7f8c38158e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:34310/0 (socket says 172.21.15.12:34310) 2024-05-15T15:39:56.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.307+0000 7f8c36d9d640 1 -- 172.21.15.12:0/1164235083 learned_addr learned my addr 172.21.15.12:0/1164235083 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-05-15T15:39:56.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.307+0000 7f8c3659c640 1 --2- 172.21.15.12:0/1164235083 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8c38151fc0 0x7f8c380bd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:56.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.307+0000 7f8c35d9b640 1 -- 172.21.15.12:0/1164235083 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 693144329 0 0) 0x7f8c380c36f0 con 0x7f8c380bf050 2024-05-15T15:39:56.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.307+0000 7f8c35d9b640 1 -- 172.21.15.12:0/1164235083 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8c24003520 con 0x7f8c380bf050 2024-05-15T15:39:56.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.307+0000 7f8c35d9b640 1 -- 172.21.15.12:0/1164235083 <== mon.1 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 334234257 0 0) 0x7f8c38152530 con 0x7f8c3806da30 2024-05-15T15:39:56.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.307+0000 7f8c35d9b640 1 -- 172.21.15.12:0/1164235083 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8c380c36f0 con 0x7f8c3806da30 2024-05-15T15:39:56.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.307+0000 7f8c3659c640 1 -- 172.21.15.12:0/1164235083 >> v1:172.21.15.84:6789/0 conn(0x7f8c3806da30 legacy=0x7f8c380be940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:56.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.307+0000 7f8c3659c640 1 -- 172.21.15.12:0/1164235083 >> v1:172.21.15.12:6789/0 conn(0x7f8c380bf050 legacy=0x7f8c38158e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:56.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.307+0000 7f8c3659c640 1 -- 172.21.15.12:0/1164235083 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c38152810 con 0x7f8c38151fc0 2024-05-15T15:39:56.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.308+0000 7f8c3659c640 1 --2- 172.21.15.12:0/1164235083 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8c38151fc0 0x7f8c380bd6d0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8c280097d0 tx=0x7f8c2802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd3ac0b5039bc6bc server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:39:56.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.308+0000 7f8c35d9b640 1 -- 172.21.15.12:0/1164235083 <== mon.2 v2:172.21.15.84:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c28037070 con 0x7f8c38151fc0 2024-05-15T15:39:56.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.308+0000 7f8c35d9b640 1 -- 172.21.15.12:0/1164235083 <== mon.2 v2:172.21.15.84:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c28032440 con 0x7f8c38151fc0 2024-05-15T15:39:56.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.308+0000 7f8c35d9b640 1 -- 172.21.15.12:0/1164235083 <== mon.2 v2:172.21.15.84:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c280327f0 con 0x7f8c38151fc0 2024-05-15T15:39:56.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.309+0000 7f8c3ce51640 1 -- 172.21.15.12:0/1164235083 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8c38151fc0 msgr2=0x7f8c380bd6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:56.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.309+0000 7f8c3ce51640 1 --2- 172.21.15.12:0/1164235083 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8c38151fc0 0x7f8c380bd6d0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8c280097d0 tx=0x7f8c2802a180 comp rx=0 tx=0).stop 2024-05-15T15:39:56.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.309+0000 7f8c3ce51640 1 -- 172.21.15.12:0/1164235083 shutdown_connections 2024-05-15T15:39:56.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.309+0000 7f8c3ce51640 1 --2- 172.21.15.12:0/1164235083 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8c38151fc0 0x7f8c380bd6d0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:56.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.309+0000 7f8c3ce51640 1 -- 172.21.15.12:0/1164235083 >> 172.21.15.12:0/1164235083 conn(0x7f8c380c3d20 msgr2=0x7f8c380c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:39:56.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.309+0000 7f8c3ce51640 1 -- 172.21.15.12:0/1164235083 shutdown_connections 2024-05-15T15:39:56.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.309+0000 7f8c3ce51640 1 -- 172.21.15.12:0/1164235083 wait complete. 2024-05-15T15:39:56.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.311+0000 7f8c3ce51640 1 Processor -- start 2024-05-15T15:39:56.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.311+0000 7f8c3ce51640 1 -- start start 2024-05-15T15:39:56.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.312+0000 7f8c3ce51640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8c3806da30 0x7f8c380b8b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:56.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.312+0000 7f8c3ce51640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8c380bf050 0x7f8c380b7570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:56.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.312+0000 7f8c3ce51640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c38151fc0 0x7f8c380a20a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:56.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.312+0000 7f8c3ce51640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f8c380a3050 con 0x7f8c3806da30 2024-05-15T15:39:56.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.312+0000 7f8c3ce51640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f8c380a2ed0 con 0x7f8c38151fc0 2024-05-15T15:39:56.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.312+0000 7f8c3ce51640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f8c3806de40 con 0x7f8c380bf050 2024-05-15T15:39:56.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.312+0000 7f8c3659c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8c3806da30 0x7f8c380b8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:56.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.312+0000 7f8c3659c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8c3806da30 0x7f8c380b8b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35748/0 (socket says 172.21.15.12:35748) 2024-05-15T15:39:56.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.312+0000 7f8c3659c640 1 -- 172.21.15.12:0/3199247283 learned_addr learned my addr 172.21.15.12:0/3199247283 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:39:56.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.312+0000 7f8c36d9d640 1 --2- 172.21.15.12:0/3199247283 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c38151fc0 0x7f8c380a20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:56.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.312+0000 7f8c2dd9b640 1 --2- 172.21.15.12:0/3199247283 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8c380bf050 0x7f8c380b7570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:56.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.312+0000 7f8c3659c640 1 -- 172.21.15.12:0/3199247283 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8c380bf050 msgr2=0x7f8c380b7570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:56.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.312+0000 7f8c3659c640 1 --2- 172.21.15.12:0/3199247283 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8c380bf050 0x7f8c380b7570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:56.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.312+0000 7f8c3659c640 1 -- 172.21.15.12:0/3199247283 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c38151fc0 msgr2=0x7f8c380a20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:56.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.312+0000 7f8c3659c640 1 --2- 172.21.15.12:0/3199247283 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c38151fc0 0x7f8c380a20a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:56.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.312+0000 7f8c3659c640 1 -- 172.21.15.12:0/3199247283 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c380b9080 con 0x7f8c3806da30 2024-05-15T15:39:56.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.312+0000 7f8c2dd9b640 1 --2- 172.21.15.12:0/3199247283 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8c380bf050 0x7f8c380b7570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-15T15:39:56.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.312+0000 7f8c3659c640 1 --2- 172.21.15.12:0/3199247283 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8c3806da30 0x7f8c380b8b40 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8c28035040 tx=0x7f8c280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:39:56.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.312+0000 7f8c2f7fe640 1 -- 172.21.15.12:0/3199247283 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c28041020 con 0x7f8c3806da30 2024-05-15T15:39:56.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.313+0000 7f8c2f7fe640 1 -- 172.21.15.12:0/3199247283 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c2803d6e0 con 0x7f8c3806da30 2024-05-15T15:39:56.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.313+0000 7f8c3ce51640 1 -- 172.21.15.12:0/3199247283 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c380b7ab0 con 0x7f8c3806da30 2024-05-15T15:39:56.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.313+0000 7f8c2f7fe640 1 -- 172.21.15.12:0/3199247283 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c28037040 con 0x7f8c3806da30 2024-05-15T15:39:56.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.313+0000 7f8c3ce51640 1 -- 172.21.15.12:0/3199247283 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c381e4c50 con 0x7f8c3806da30 2024-05-15T15:39:56.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.314+0000 7f8c3ce51640 1 -- 172.21.15.12:0/3199247283 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c380c10e0 con 0x7f8c3806da30 2024-05-15T15:39:56.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.314+0000 7f8c2f7fe640 1 -- 172.21.15.12:0/3199247283 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8c28044020 con 0x7f8c3806da30 2024-05-15T15:39:56.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.315+0000 7f8c2f7fe640 1 --2- 172.21.15.12:0/3199247283 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f8c180762d0 0x7f8c180787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:56.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.315+0000 7f8c2f7fe640 1 -- 172.21.15.12:0/3199247283 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f8c280b7e30 con 0x7f8c3806da30 2024-05-15T15:39:56.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.315+0000 7f8c2dd9b640 1 --2- 172.21.15.12:0/3199247283 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f8c180762d0 0x7f8c180787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:56.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.316+0000 7f8c2dd9b640 1 --2- 172.21.15.12:0/3199247283 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f8c180762d0 0x7f8c180787e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8c380b7080 tx=0x7f8c20009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:39:56.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.319+0000 7f8c2f7fe640 1 -- 172.21.15.12:0/3199247283 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f8c380c10e0 con 0x7f8c3806da30 2024-05-15T15:39:56.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.508+0000 7f8c3ce51640 1 -- 172.21.15.12:0/3199247283 --> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8c38050940 con 0x7f8c180762d0 2024-05-15T15:39:56.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.515+0000 7f8c2f7fe640 1 -- 172.21.15.12:0/3199247283 <== mgr.4106 v2:172.21.15.84:6832/4173299311 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+238356 (secure 0 0 0) 0x7f8c38050940 con 0x7f8c180762d0 2024-05-15T15:39:56.520 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-05-15T15:39:56.521 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-05-15T15:39:56.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.517+0000 7f8c3ce51640 1 -- 172.21.15.12:0/3199247283 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f8c180762d0 msgr2=0x7f8c180787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:56.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.517+0000 7f8c3ce51640 1 --2- 172.21.15.12:0/3199247283 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f8c180762d0 0x7f8c180787e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8c380b7080 tx=0x7f8c20009040 comp rx=0 tx=0).stop 2024-05-15T15:39:56.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.517+0000 7f8c3ce51640 1 -- 172.21.15.12:0/3199247283 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8c3806da30 msgr2=0x7f8c380b8b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:56.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.517+0000 7f8c3ce51640 1 --2- 172.21.15.12:0/3199247283 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8c3806da30 0x7f8c380b8b40 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8c28035040 tx=0x7f8c280046c0 comp rx=0 tx=0).stop 2024-05-15T15:39:56.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.517+0000 7f8c3ce51640 1 -- 172.21.15.12:0/3199247283 shutdown_connections 2024-05-15T15:39:56.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.517+0000 7f8c3ce51640 1 --2- 172.21.15.12:0/3199247283 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c38151fc0 0x7f8c380a20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:56.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.517+0000 7f8c3ce51640 1 --2- 172.21.15.12:0/3199247283 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8c380bf050 0x7f8c380b7570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:56.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.517+0000 7f8c3ce51640 1 --2- 172.21.15.12:0/3199247283 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f8c180762d0 0x7f8c180787e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:56.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.517+0000 7f8c3ce51640 1 --2- 172.21.15.12:0/3199247283 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8c3806da30 0x7f8c380b8b40 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:56.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.517+0000 7f8c3ce51640 1 -- 172.21.15.12:0/3199247283 >> 172.21.15.12:0/3199247283 conn(0x7f8c380c3d20 msgr2=0x7f8c380c09d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:39:56.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.518+0000 7f8c3ce51640 1 -- 172.21.15.12:0/3199247283 shutdown_connections 2024-05-15T15:39:56.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.518+0000 7f8c3ce51640 1 -- 172.21.15.12:0/3199247283 wait complete. 2024-05-15T15:39:56.531 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-05-15T15:39:54.700579+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":3,"kb":754974720,"kb_used":219276,"kb_used_data":2612,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755444,"statfs":{"total":773094113280,"available":772869574656,"internally_reserved":0,"allocated":2674688,"data_stored":1635097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.270947"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:39:51.428802+0000","last_change":"2024-05-15T15:39:51.428802+0000","last_active":"2024-05-15T15:39:51.428802+0000","last_peered":"2024-05-15T15:39:51.428802+0000","last_clean":"2024-05-15T15:39:51.428802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:39:51.428802+0000","last_undegraded":"2024-05-15T15:39:51.428802+0000","last_fullsized":"2024-05-15T15:39:51.428802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:39:51.428802+0000","last_change":"2024-05-15T15:39:51.428802+0000","last_active":"2024-05-15T15:39:51.428802+0000","last_peered":"2024-05-15T15:39:51.428802+0000","last_clean":"2024-05-15T15:39:51.428802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:39:51.428802+0000","last_undegraded":"2024-05-15T15:39:51.428802+0000","last_fullsized":"2024-05-15T15:39:51.428802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:39:51.428802+0000","last_change":"2024-05-15T15:39:51.428802+0000","last_active":"2024-05-15T15:39:51.428802+0000","last_peered":"2024-05-15T15:39:51.428802+0000","last_clean":"2024-05-15T15:39:51.428802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:39:51.428802+0000","last_undegraded":"2024-05-15T15:39:51.428802+0000","last_fullsized":"2024-05-15T15:39:51.428802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:39:51.428802+0000","last_change":"2024-05-15T15:39:51.428802+0000","last_active":"2024-05-15T15:39:51.428802+0000","last_peered":"2024-05-15T15:39:51.428802+0000","last_clean":"2024-05-15T15:39:51.428802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:39:51.428802+0000","last_undegraded":"2024-05-15T15:39:51.428802+0000","last_fullsized":"2024-05-15T15:39:51.428802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:39:51.428802+0000","last_change":"2024-05-15T15:39:51.428802+0000","last_active":"2024-05-15T15:39:51.428802+0000","last_peered":"2024-05-15T15:39:51.428802+0000","last_clean":"2024-05-15T15:39:51.428802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:39:51.428802+0000","last_undegraded":"2024-05-15T15:39:51.428802+0000","last_fullsized":"2024-05-15T15:39:51.428802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:39:51.428802+0000","last_change":"2024-05-15T15:39:51.428802+0000","last_active":"2024-05-15T15:39:51.428802+0000","last_peered":"2024-05-15T15:39:51.428802+0000","last_clean":"2024-05-15T15:39:51.428802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:39:51.428802+0000","last_undegraded":"2024-05-15T15:39:51.428802+0000","last_fullsized":"2024-05-15T15:39:51.428802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:39:51.428802+0000","last_change":"2024-05-15T15:39:51.428802+0000","last_active":"2024-05-15T15:39:51.428802+0000","last_peered":"2024-05-15T15:39:51.428802+0000","last_clean":"2024-05-15T15:39:51.428802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:39:51.428802+0000","last_undegraded":"2024-05-15T15:39:51.428802+0000","last_fullsized":"2024-05-15T15:39:51.428802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:39:51.428802+0000","last_change":"2024-05-15T15:39:51.428802+0000","last_active":"2024-05-15T15:39:51.428802+0000","last_peered":"2024-05-15T15:39:51.428802+0000","last_clean":"2024-05-15T15:39:51.428802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:39:51.428802+0000","last_undegraded":"2024-05-15T15:39:51.428802+0000","last_fullsized":"2024-05-15T15:39:51.428802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:39:51.428802+0000","last_change":"2024-05-15T15:39:51.428802+0000","last_active":"2024-05-15T15:39:51.428802+0000","last_peered":"2024-05-15T15:39:51.428802+0000","last_clean":"2024-05-15T15:39:51.428802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:39:51.428802+0000","last_undegraded":"2024-05-15T15:39:51.428802+0000","last_fullsized":"2024-05-15T15:39:51.428802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:39:51.428802+0000","last_change":"2024-05-15T15:39:51.428802+0000","last_active":"2024-05-15T15:39:51.428802+0000","last_peered":"2024-05-15T15:39:51.428802+0000","last_clean":"2024-05-15T15:39:51.428802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:39:51.428802+0000","last_undegraded":"2024-05-15T15:39:51.428802+0000","last_fullsized":"2024-05-15T15:39:51.428802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:39:51.428802+0000","last_change":"2024-05-15T15:39:51.428802+0000","last_active":"2024-05-15T15:39:51.428802+0000","last_peered":"2024-05-15T15:39:51.428802+0000","last_clean":"2024-05-15T15:39:51.428802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:39:51.428802+0000","last_undegraded":"2024-05-15T15:39:51.428802+0000","last_fullsized":"2024-05-15T15:39:51.428802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:39:51.428802+0000","last_change":"2024-05-15T15:39:51.428802+0000","last_active":"2024-05-15T15:39:51.428802+0000","last_peered":"2024-05-15T15:39:51.428802+0000","last_clean":"2024-05-15T15:39:51.428802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:39:51.428802+0000","last_undegraded":"2024-05-15T15:39:51.428802+0000","last_fullsized":"2024-05-15T15:39:51.428802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:39:51.428802+0000","last_change":"2024-05-15T15:39:51.428802+0000","last_active":"2024-05-15T15:39:51.428802+0000","last_peered":"2024-05-15T15:39:51.428802+0000","last_clean":"2024-05-15T15:39:51.428802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:39:51.428802+0000","last_undegraded":"2024-05-15T15:39:51.428802+0000","last_fullsized":"2024-05-15T15:39:51.428802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:39:51.428802+0000","last_change":"2024-05-15T15:39:51.428802+0000","last_active":"2024-05-15T15:39:51.428802+0000","last_peered":"2024-05-15T15:39:51.428802+0000","last_clean":"2024-05-15T15:39:51.428802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:39:51.428802+0000","last_undegraded":"2024-05-15T15:39:51.428802+0000","last_fullsized":"2024-05-15T15:39:51.428802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:39:51.428802+0000","last_change":"2024-05-15T15:39:51.428802+0000","last_active":"2024-05-15T15:39:51.428802+0000","last_peered":"2024-05-15T15:39:51.428802+0000","last_clean":"2024-05-15T15:39:51.428802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:39:51.428802+0000","last_undegraded":"2024-05-15T15:39:51.428802+0000","last_fullsized":"2024-05-15T15:39:51.428802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:39:51.428802+0000","last_change":"2024-05-15T15:39:51.428802+0000","last_active":"2024-05-15T15:39:51.428802+0000","last_peered":"2024-05-15T15:39:51.428802+0000","last_clean":"2024-05-15T15:39:51.428802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:39:51.428802+0000","last_undegraded":"2024-05-15T15:39:51.428802+0000","last_fullsized":"2024-05-15T15:39:51.428802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:39:51.428802+0000","last_change":"2024-05-15T15:39:51.428802+0000","last_active":"2024-05-15T15:39:51.428802+0000","last_peered":"2024-05-15T15:39:51.428802+0000","last_clean":"2024-05-15T15:39:51.428802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:39:51.428802+0000","last_undegraded":"2024-05-15T15:39:51.428802+0000","last_fullsized":"2024-05-15T15:39:51.428802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:39:51.428802+0000","last_change":"2024-05-15T15:39:51.428802+0000","last_active":"2024-05-15T15:39:51.428802+0000","last_peered":"2024-05-15T15:39:51.428802+0000","last_clean":"2024-05-15T15:39:51.428802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:39:51.428802+0000","last_undegraded":"2024-05-15T15:39:51.428802+0000","last_fullsized":"2024-05-15T15:39:51.428802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:39:51.428802+0000","last_change":"2024-05-15T15:39:51.428802+0000","last_active":"2024-05-15T15:39:51.428802+0000","last_peered":"2024-05-15T15:39:51.428802+0000","last_clean":"2024-05-15T15:39:51.428802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:39:51.428802+0000","last_undegraded":"2024-05-15T15:39:51.428802+0000","last_fullsized":"2024-05-15T15:39:51.428802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:39:51.428802+0000","last_change":"2024-05-15T15:39:51.428802+0000","last_active":"2024-05-15T15:39:51.428802+0000","last_peered":"2024-05-15T15:39:51.428802+0000","last_clean":"2024-05-15T15:39:51.428802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:39:51.428802+0000","last_undegraded":"2024-05-15T15:39:51.428802+0000","last_fullsized":"2024-05-15T15:39:51.428802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-15T15:39:51.440698+0000","last_change":"2024-05-15T15:39:51.440698+0000","last_active":"2024-05-15T15:39:51.428802+0000","last_peered":"2024-05-15T15:39:51.428802+0000","last_clean":"2024-05-15T15:39:51.428802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:39:51.440698+0000","last_undegraded":"2024-05-15T15:39:51.440698+0000","last_fullsized":"2024-05-15T15:39:51.440698+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:39:51.428802+0000","last_change":"2024-05-15T15:39:51.428802+0000","last_active":"2024-05-15T15:39:51.428802+0000","last_peered":"2024-05-15T15:39:51.428802+0000","last_clean":"2024-05-15T15:39:51.428802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:39:51.428802+0000","last_undegraded":"2024-05-15T15:39:51.428802+0000","last_fullsized":"2024-05-15T15:39:51.428802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:39:51.428802+0000","last_change":"2024-05-15T15:39:51.428802+0000","last_active":"2024-05-15T15:39:51.428802+0000","last_peered":"2024-05-15T15:39:51.428802+0000","last_clean":"2024-05-15T15:39:51.428802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:39:51.428802+0000","last_undegraded":"2024-05-15T15:39:51.428802+0000","last_fullsized":"2024-05-15T15:39:51.428802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:39:51.428802+0000","last_change":"2024-05-15T15:39:51.428802+0000","last_active":"2024-05-15T15:39:51.428802+0000","last_peered":"2024-05-15T15:39:51.428802+0000","last_clean":"2024-05-15T15:39:51.428802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:39:51.428802+0000","last_undegraded":"2024-05-15T15:39:51.428802+0000","last_fullsized":"2024-05-15T15:39:51.428802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:39:51.428802+0000","last_change":"2024-05-15T15:39:51.428802+0000","last_active":"2024-05-15T15:39:51.428802+0000","last_peered":"2024-05-15T15:39:51.428802+0000","last_clean":"2024-05-15T15:39:51.428802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:39:51.428802+0000","last_undegraded":"2024-05-15T15:39:51.428802+0000","last_fullsized":"2024-05-15T15:39:51.428802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:39:51.428802+0000","last_change":"2024-05-15T15:39:51.428802+0000","last_active":"2024-05-15T15:39:51.428802+0000","last_peered":"2024-05-15T15:39:51.428802+0000","last_clean":"2024-05-15T15:39:51.428802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:39:51.428802+0000","last_undegraded":"2024-05-15T15:39:51.428802+0000","last_fullsized":"2024-05-15T15:39:51.428802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:39:51.428802+0000","last_change":"2024-05-15T15:39:51.428802+0000","last_active":"2024-05-15T15:39:51.428802+0000","last_peered":"2024-05-15T15:39:51.428802+0000","last_clean":"2024-05-15T15:39:51.428802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:39:51.428802+0000","last_undegraded":"2024-05-15T15:39:51.428802+0000","last_fullsized":"2024-05-15T15:39:51.428802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:39:51.428802+0000","last_change":"2024-05-15T15:39:51.428802+0000","last_active":"2024-05-15T15:39:51.428802+0000","last_peered":"2024-05-15T15:39:51.428802+0000","last_clean":"2024-05-15T15:39:51.428802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:39:51.428802+0000","last_undegraded":"2024-05-15T15:39:51.428802+0000","last_fullsized":"2024-05-15T15:39:51.428802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:39:51.428802+0000","last_change":"2024-05-15T15:39:51.428802+0000","last_active":"2024-05-15T15:39:51.428802+0000","last_peered":"2024-05-15T15:39:51.428802+0000","last_clean":"2024-05-15T15:39:51.428802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:39:51.428802+0000","last_undegraded":"2024-05-15T15:39:51.428802+0000","last_fullsized":"2024-05-15T15:39:51.428802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:39:51.428802+0000","last_change":"2024-05-15T15:39:51.428802+0000","last_active":"2024-05-15T15:39:51.428802+0000","last_peered":"2024-05-15T15:39:51.428802+0000","last_clean":"2024-05-15T15:39:51.428802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:39:51.428802+0000","last_undegraded":"2024-05-15T15:39:51.428802+0000","last_fullsized":"2024-05-15T15:39:51.428802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:39:51.428802+0000","last_change":"2024-05-15T15:39:51.428802+0000","last_active":"2024-05-15T15:39:51.428802+0000","last_peered":"2024-05-15T15:39:51.428802+0000","last_clean":"2024-05-15T15:39:51.428802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:39:51.428802+0000","last_undegraded":"2024-05-15T15:39:51.428802+0000","last_fullsized":"2024-05-15T15:39:51.428802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:39:51.428802+0000","last_change":"2024-05-15T15:39:51.428802+0000","last_active":"2024-05-15T15:39:51.428802+0000","last_peered":"2024-05-15T15:39:51.428802+0000","last_clean":"2024-05-15T15:39:51.428802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:39:51.428802+0000","last_undegraded":"2024-05-15T15:39:51.428802+0000","last_fullsized":"2024-05-15T15:39:51.428802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:39:51.428802+0000","last_change":"2024-05-15T15:39:51.428802+0000","last_active":"2024-05-15T15:39:51.428802+0000","last_peered":"2024-05-15T15:39:51.428802+0000","last_clean":"2024-05-15T15:39:51.428802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:39:51.428802+0000","last_undegraded":"2024-05-15T15:39:51.428802+0000","last_fullsized":"2024-05-15T15:39:51.428802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:39:50.421276+0000","last_change":"2024-05-15T15:39:50.421276+0000","last_active":"2024-05-15T15:39:50.421276+0000","last_peered":"2024-05-15T15:39:50.421276+0000","last_clean":"2024-05-15T15:39:50.421276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:39:50.421276+0000","last_undegraded":"2024-05-15T15:39:50.421276+0000","last_fullsized":"2024-05-15T15:39:50.421276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-15T15:39:51.436958+0000","last_change":"2024-05-15T15:39:51.436958+0000","last_active":"2024-05-15T15:39:51.428802+0000","last_peered":"2024-05-15T15:39:51.428802+0000","last_clean":"2024-05-15T15:39:51.428802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:39:51.436958+0000","last_undegraded":"2024-05-15T15:39:51.436958+0000","last_fullsized":"2024-05-15T15:39:51.436958+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:39:50.421276+0000","last_change":"2024-05-15T15:39:50.421276+0000","last_active":"2024-05-15T15:39:50.421276+0000","last_peered":"2024-05-15T15:39:50.421276+0000","last_clean":"2024-05-15T15:39:50.421276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:39:50.421276+0000","last_undegraded":"2024-05-15T15:39:50.421276+0000","last_fullsized":"2024-05-15T15:39:50.421276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:39:50.421276+0000","last_change":"2024-05-15T15:39:50.421276+0000","last_active":"2024-05-15T15:39:50.421276+0000","last_peered":"2024-05-15T15:39:50.421276+0000","last_clean":"2024-05-15T15:39:50.421276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:39:50.421276+0000","last_undegraded":"2024-05-15T15:39:50.421276+0000","last_fullsized":"2024-05-15T15:39:50.421276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:39:51.428802+0000","last_change":"2024-05-15T15:39:51.428802+0000","last_active":"2024-05-15T15:39:51.428802+0000","last_peered":"2024-05-15T15:39:51.428802+0000","last_clean":"2024-05-15T15:39:51.428802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:39:51.428802+0000","last_undegraded":"2024-05-15T15:39:51.428802+0000","last_fullsized":"2024-05-15T15:39:51.428802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:39:50.421276+0000","last_change":"2024-05-15T15:39:50.421276+0000","last_active":"2024-05-15T15:39:50.421276+0000","last_peered":"2024-05-15T15:39:50.421276+0000","last_clean":"2024-05-15T15:39:50.421276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:39:50.421276+0000","last_undegraded":"2024-05-15T15:39:50.421276+0000","last_fullsized":"2024-05-15T15:39:50.421276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-15T15:39:51.437645+0000","last_change":"2024-05-15T15:39:51.437645+0000","last_active":"2024-05-15T15:39:51.428802+0000","last_peered":"2024-05-15T15:39:51.428802+0000","last_clean":"2024-05-15T15:39:51.428802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:39:51.437645+0000","last_undegraded":"2024-05-15T15:39:51.437645+0000","last_fullsized":"2024-05-15T15:39:51.437645+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:39:50.421276+0000","last_change":"2024-05-15T15:39:50.421276+0000","last_active":"2024-05-15T15:39:50.421276+0000","last_peered":"2024-05-15T15:39:50.421276+0000","last_clean":"2024-05-15T15:39:50.421276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:39:50.421276+0000","last_undegraded":"2024-05-15T15:39:50.421276+0000","last_fullsized":"2024-05-15T15:39:50.421276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:39:51.428802+0000","last_change":"2024-05-15T15:39:51.428802+0000","last_active":"2024-05-15T15:39:51.428802+0000","last_peered":"2024-05-15T15:39:51.428802+0000","last_clean":"2024-05-15T15:39:51.428802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:39:51.428802+0000","last_undegraded":"2024-05-15T15:39:51.428802+0000","last_fullsized":"2024-05-15T15:39:51.428802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:39:50.421276+0000","last_change":"2024-05-15T15:39:50.421276+0000","last_active":"2024-05-15T15:39:50.421276+0000","last_peered":"2024-05-15T15:39:50.421276+0000","last_clean":"2024-05-15T15:39:50.421276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:39:50.421276+0000","last_undegraded":"2024-05-15T15:39:50.421276+0000","last_fullsized":"2024-05-15T15:39:50.421276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:39:51.428802+0000","last_change":"2024-05-15T15:39:51.428802+0000","last_active":"2024-05-15T15:39:51.428802+0000","last_peered":"2024-05-15T15:39:51.428802+0000","last_clean":"2024-05-15T15:39:51.428802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:39:51.428802+0000","last_undegraded":"2024-05-15T15:39:51.428802+0000","last_fullsized":"2024-05-15T15:39:51.428802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:39:50.421276+0000","last_change":"2024-05-15T15:39:50.421276+0000","last_active":"2024-05-15T15:39:50.421276+0000","last_peered":"2024-05-15T15:39:50.421276+0000","last_clean":"2024-05-15T15:39:50.421276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:39:50.421276+0000","last_undegraded":"2024-05-15T15:39:50.421276+0000","last_fullsized":"2024-05-15T15:39:50.421276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:39:51.428802+0000","last_change":"2024-05-15T15:39:51.428802+0000","last_active":"2024-05-15T15:39:51.428802+0000","last_peered":"2024-05-15T15:39:51.428802+0000","last_clean":"2024-05-15T15:39:51.428802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:39:51.428802+0000","last_undegraded":"2024-05-15T15:39:51.428802+0000","last_fullsized":"2024-05-15T15:39:51.428802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:39:50.421276+0000","last_change":"2024-05-15T15:39:50.421276+0000","last_active":"2024-05-15T15:39:50.421276+0000","last_peered":"2024-05-15T15:39:50.421276+0000","last_clean":"2024-05-15T15:39:50.421276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:39:50.421276+0000","last_undegraded":"2024-05-15T15:39:50.421276+0000","last_fullsized":"2024-05-15T15:39:50.421276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:39:51.428802+0000","last_change":"2024-05-15T15:39:51.428802+0000","last_active":"2024-05-15T15:39:51.428802+0000","last_peered":"2024-05-15T15:39:51.428802+0000","last_clean":"2024-05-15T15:39:51.428802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:39:51.428802+0000","last_undegraded":"2024-05-15T15:39:51.428802+0000","last_fullsized":"2024-05-15T15:39:51.428802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:39:50.421276+0000","last_change":"2024-05-15T15:39:50.421276+0000","last_active":"2024-05-15T15:39:50.421276+0000","last_peered":"2024-05-15T15:39:50.421276+0000","last_clean":"2024-05-15T15:39:50.421276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:39:50.421276+0000","last_undegraded":"2024-05-15T15:39:50.421276+0000","last_fullsized":"2024-05-15T15:39:50.421276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:39:51.428802+0000","last_change":"2024-05-15T15:39:51.428802+0000","last_active":"2024-05-15T15:39:51.428802+0000","last_peered":"2024-05-15T15:39:51.428802+0000","last_clean":"2024-05-15T15:39:51.428802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:39:51.428802+0000","last_undegraded":"2024-05-15T15:39:51.428802+0000","last_fullsized":"2024-05-15T15:39:51.428802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:39:50.421276+0000","last_change":"2024-05-15T15:39:50.421276+0000","last_active":"2024-05-15T15:39:50.421276+0000","last_peered":"2024-05-15T15:39:50.421276+0000","last_clean":"2024-05-15T15:39:50.421276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:39:50.421276+0000","last_undegraded":"2024-05-15T15:39:50.421276+0000","last_fullsized":"2024-05-15T15:39:50.421276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:39:51.428802+0000","last_change":"2024-05-15T15:39:51.428802+0000","last_active":"2024-05-15T15:39:51.428802+0000","last_peered":"2024-05-15T15:39:51.428802+0000","last_clean":"2024-05-15T15:39:51.428802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:39:51.428802+0000","last_undegraded":"2024-05-15T15:39:51.428802+0000","last_fullsized":"2024-05-15T15:39:51.428802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:39:50.421276+0000","last_change":"2024-05-15T15:39:50.421276+0000","last_active":"2024-05-15T15:39:50.421276+0000","last_peered":"2024-05-15T15:39:50.421276+0000","last_clean":"2024-05-15T15:39:50.421276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:39:50.421276+0000","last_undegraded":"2024-05-15T15:39:50.421276+0000","last_fullsized":"2024-05-15T15:39:50.421276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:39:51.428802+0000","last_change":"2024-05-15T15:39:51.428802+0000","last_active":"2024-05-15T15:39:51.428802+0000","last_peered":"2024-05-15T15:39:51.428802+0000","last_clean":"2024-05-15T15:39:51.428802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:39:51.428802+0000","last_undegraded":"2024-05-15T15:39:51.428802+0000","last_fullsized":"2024-05-15T15:39:51.428802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T15:39:51.447890+0000","last_change":"2024-05-15T15:39:51.446711+0000","last_active":"2024-05-15T15:39:51.447890+0000","last_peered":"2024-05-15T15:39:51.447890+0000","last_clean":"2024-05-15T15:39:51.447890+0000","last_became_active":"2024-05-15T15:39:51.446392+0000","last_became_peered":"2024-05-15T15:39:51.446392+0000","last_unstale":"2024-05-15T15:39:51.447890+0000","last_undegraded":"2024-05-15T15:39:51.447890+0000","last_fullsized":"2024-05-15T15:39:51.447890+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:15:48.685660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:39:51.428802+0000","last_change":"2024-05-15T15:39:51.428802+0000","last_active":"2024-05-15T15:39:51.428802+0000","last_peered":"2024-05-15T15:39:51.428802+0000","last_clean":"2024-05-15T15:39:51.428802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:39:51.428802+0000","last_undegraded":"2024-05-15T15:39:51.428802+0000","last_fullsized":"2024-05-15T15:39:51.428802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:39:50.421276+0000","last_change":"2024-05-15T15:39:50.421276+0000","last_active":"2024-05-15T15:39:50.421276+0000","last_peered":"2024-05-15T15:39:50.421276+0000","last_clean":"2024-05-15T15:39:50.421276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:39:50.421276+0000","last_undegraded":"2024-05-15T15:39:50.421276+0000","last_fullsized":"2024-05-15T15:39:50.421276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:39:51.428802+0000","last_change":"2024-05-15T15:39:51.428802+0000","last_active":"2024-05-15T15:39:51.428802+0000","last_peered":"2024-05-15T15:39:51.428802+0000","last_clean":"2024-05-15T15:39:51.428802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:39:51.428802+0000","last_undegraded":"2024-05-15T15:39:51.428802+0000","last_fullsized":"2024-05-15T15:39:51.428802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T15:39:51.452447+0000","last_change":"2024-05-15T15:39:51.451802+0000","last_active":"2024-05-15T15:39:51.452447+0000","last_peered":"2024-05-15T15:39:51.452447+0000","last_clean":"2024-05-15T15:39:51.452447+0000","last_became_active":"2024-05-15T15:39:51.451413+0000","last_became_peered":"2024-05-15T15:39:51.451413+0000","last_unstale":"2024-05-15T15:39:51.452447+0000","last_undegraded":"2024-05-15T15:39:51.452447+0000","last_fullsized":"2024-05-15T15:39:51.452447+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:44:16.985300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:39:51.428802+0000","last_change":"2024-05-15T15:39:51.428802+0000","last_active":"2024-05-15T15:39:51.428802+0000","last_peered":"2024-05-15T15:39:51.428802+0000","last_clean":"2024-05-15T15:39:51.428802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:39:51.428802+0000","last_undegraded":"2024-05-15T15:39:51.428802+0000","last_fullsized":"2024-05-15T15:39:51.428802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:39:50.421276+0000","last_change":"2024-05-15T15:39:50.421276+0000","last_active":"2024-05-15T15:39:50.421276+0000","last_peered":"2024-05-15T15:39:50.421276+0000","last_clean":"2024-05-15T15:39:50.421276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:39:50.421276+0000","last_undegraded":"2024-05-15T15:39:50.421276+0000","last_fullsized":"2024-05-15T15:39:50.421276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:39:51.428802+0000","last_change":"2024-05-15T15:39:51.428802+0000","last_active":"2024-05-15T15:39:51.428802+0000","last_peered":"2024-05-15T15:39:51.428802+0000","last_clean":"2024-05-15T15:39:51.428802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:39:51.428802+0000","last_undegraded":"2024-05-15T15:39:51.428802+0000","last_fullsized":"2024-05-15T15:39:51.428802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:39:50.421276+0000","last_change":"2024-05-15T15:39:50.421276+0000","last_active":"2024-05-15T15:39:50.421276+0000","last_peered":"2024-05-15T15:39:50.421276+0000","last_clean":"2024-05-15T15:39:50.421276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:39:50.421276+0000","last_undegraded":"2024-05-15T15:39:50.421276+0000","last_fullsized":"2024-05-15T15:39:50.421276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:39:51.428802+0000","last_change":"2024-05-15T15:39:51.428802+0000","last_active":"2024-05-15T15:39:51.428802+0000","last_peered":"2024-05-15T15:39:51.428802+0000","last_clean":"2024-05-15T15:39:51.428802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:39:51.428802+0000","last_undegraded":"2024-05-15T15:39:51.428802+0000","last_fullsized":"2024-05-15T15:39:51.428802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":102,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-15T15:39:44.204635+0000","last_change":"2024-05-15T15:39:42.584601+0000","last_active":"2024-05-15T15:39:44.204635+0000","last_peered":"2024-05-15T15:39:44.204635+0000","last_clean":"2024-05-15T15:39:44.204635+0000","last_became_active":"2024-05-15T15:39:42.584129+0000","last_became_peered":"2024-05-15T15:39:42.584129+0000","last_unstale":"2024-05-15T15:39:44.204635+0000","last_undegraded":"2024-05-15T15:39:44.204635+0000","last_fullsized":"2024-05-15T15:39:44.204635+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:41.378107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:41.378107+0000","last_clean_scrub_stamp":"2024-05-15T15:39:41.378107+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:23:25.285669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:39:50.421276+0000","last_change":"2024-05-15T15:39:50.421276+0000","last_active":"2024-05-15T15:39:50.421276+0000","last_peered":"2024-05-15T15:39:50.421276+0000","last_clean":"2024-05-15T15:39:50.421276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:39:50.421276+0000","last_undegraded":"2024-05-15T15:39:50.421276+0000","last_fullsized":"2024-05-15T15:39:50.421276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-15T15:39:51.438340+0000","last_change":"2024-05-15T15:39:51.438340+0000","last_active":"2024-05-15T15:39:51.428802+0000","last_peered":"2024-05-15T15:39:51.428802+0000","last_clean":"2024-05-15T15:39:51.428802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:39:51.438340+0000","last_undegraded":"2024-05-15T15:39:51.438340+0000","last_fullsized":"2024-05-15T15:39:51.438340+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:39:50.421276+0000","last_change":"2024-05-15T15:39:50.421276+0000","last_active":"2024-05-15T15:39:50.421276+0000","last_peered":"2024-05-15T15:39:50.421276+0000","last_clean":"2024-05-15T15:39:50.421276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:39:50.421276+0000","last_undegraded":"2024-05-15T15:39:50.421276+0000","last_fullsized":"2024-05-15T15:39:50.421276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:39:51.428802+0000","last_change":"2024-05-15T15:39:51.428802+0000","last_active":"2024-05-15T15:39:51.428802+0000","last_peered":"2024-05-15T15:39:51.428802+0000","last_clean":"2024-05-15T15:39:51.428802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:39:51.428802+0000","last_undegraded":"2024-05-15T15:39:51.428802+0000","last_fullsized":"2024-05-15T15:39:51.428802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:39:50.421276+0000","last_change":"2024-05-15T15:39:50.421276+0000","last_active":"2024-05-15T15:39:50.421276+0000","last_peered":"2024-05-15T15:39:50.421276+0000","last_clean":"2024-05-15T15:39:50.421276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:39:50.421276+0000","last_undegraded":"2024-05-15T15:39:50.421276+0000","last_fullsized":"2024-05-15T15:39:50.421276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:39:51.428802+0000","last_change":"2024-05-15T15:39:51.428802+0000","last_active":"2024-05-15T15:39:51.428802+0000","last_peered":"2024-05-15T15:39:51.428802+0000","last_clean":"2024-05-15T15:39:51.428802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:39:51.428802+0000","last_undegraded":"2024-05-15T15:39:51.428802+0000","last_fullsized":"2024-05-15T15:39:51.428802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:39:50.421276+0000","last_change":"2024-05-15T15:39:50.421276+0000","last_active":"2024-05-15T15:39:50.421276+0000","last_peered":"2024-05-15T15:39:50.421276+0000","last_clean":"2024-05-15T15:39:50.421276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:39:50.421276+0000","last_undegraded":"2024-05-15T15:39:50.421276+0000","last_fullsized":"2024-05-15T15:39:50.421276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:39:51.428802+0000","last_change":"2024-05-15T15:39:51.428802+0000","last_active":"2024-05-15T15:39:51.428802+0000","last_peered":"2024-05-15T15:39:51.428802+0000","last_clean":"2024-05-15T15:39:51.428802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:39:51.428802+0000","last_undegraded":"2024-05-15T15:39:51.428802+0000","last_fullsized":"2024-05-15T15:39:51.428802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:39:50.421276+0000","last_change":"2024-05-15T15:39:50.421276+0000","last_active":"2024-05-15T15:39:50.421276+0000","last_peered":"2024-05-15T15:39:50.421276+0000","last_clean":"2024-05-15T15:39:50.421276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:39:50.421276+0000","last_undegraded":"2024-05-15T15:39:50.421276+0000","last_fullsized":"2024-05-15T15:39:50.421276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:39:51.428802+0000","last_change":"2024-05-15T15:39:51.428802+0000","last_active":"2024-05-15T15:39:51.428802+0000","last_peered":"2024-05-15T15:39:51.428802+0000","last_clean":"2024-05-15T15:39:51.428802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:39:51.428802+0000","last_undegraded":"2024-05-15T15:39:51.428802+0000","last_fullsized":"2024-05-15T15:39:51.428802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:39:50.421276+0000","last_change":"2024-05-15T15:39:50.421276+0000","last_active":"2024-05-15T15:39:50.421276+0000","last_peered":"2024-05-15T15:39:50.421276+0000","last_clean":"2024-05-15T15:39:50.421276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:39:50.421276+0000","last_undegraded":"2024-05-15T15:39:50.421276+0000","last_fullsized":"2024-05-15T15:39:50.421276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:39:51.428802+0000","last_change":"2024-05-15T15:39:51.428802+0000","last_active":"2024-05-15T15:39:51.428802+0000","last_peered":"2024-05-15T15:39:51.428802+0000","last_clean":"2024-05-15T15:39:51.428802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:39:51.428802+0000","last_undegraded":"2024-05-15T15:39:51.428802+0000","last_fullsized":"2024-05-15T15:39:51.428802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T15:39:51.456912+0000","last_change":"2024-05-15T15:39:51.455435+0000","last_active":"2024-05-15T15:39:51.456912+0000","last_peered":"2024-05-15T15:39:51.456912+0000","last_clean":"2024-05-15T15:39:51.456912+0000","last_became_active":"2024-05-15T15:39:51.455047+0000","last_became_peered":"2024-05-15T15:39:51.455047+0000","last_unstale":"2024-05-15T15:39:51.456912+0000","last_undegraded":"2024-05-15T15:39:51.456912+0000","last_fullsized":"2024-05-15T15:39:51.456912+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:16:06.081249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-15T15:39:51.439295+0000","last_change":"2024-05-15T15:39:51.439295+0000","last_active":"2024-05-15T15:39:51.428802+0000","last_peered":"2024-05-15T15:39:51.428802+0000","last_clean":"2024-05-15T15:39:51.428802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:39:51.439295+0000","last_undegraded":"2024-05-15T15:39:51.439295+0000","last_fullsized":"2024-05-15T15:39:51.439295+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:39:50.421276+0000","last_change":"2024-05-15T15:39:50.421276+0000","last_active":"2024-05-15T15:39:50.421276+0000","last_peered":"2024-05-15T15:39:50.421276+0000","last_clean":"2024-05-15T15:39:50.421276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:39:50.421276+0000","last_undegraded":"2024-05-15T15:39:50.421276+0000","last_fullsized":"2024-05-15T15:39:50.421276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-15T15:39:51.438842+0000","last_change":"2024-05-15T15:39:51.438842+0000","last_active":"2024-05-15T15:39:51.428802+0000","last_peered":"2024-05-15T15:39:51.428802+0000","last_clean":"2024-05-15T15:39:51.428802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:39:51.438842+0000","last_undegraded":"2024-05-15T15:39:51.438842+0000","last_fullsized":"2024-05-15T15:39:51.438842+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:39:50.421276+0000","last_change":"2024-05-15T15:39:50.421276+0000","last_active":"2024-05-15T15:39:50.421276+0000","last_peered":"2024-05-15T15:39:50.421276+0000","last_clean":"2024-05-15T15:39:50.421276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:39:50.421276+0000","last_undegraded":"2024-05-15T15:39:50.421276+0000","last_fullsized":"2024-05-15T15:39:50.421276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:39:51.428802+0000","last_change":"2024-05-15T15:39:51.428802+0000","last_active":"2024-05-15T15:39:51.428802+0000","last_peered":"2024-05-15T15:39:51.428802+0000","last_clean":"2024-05-15T15:39:51.428802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:39:51.428802+0000","last_undegraded":"2024-05-15T15:39:51.428802+0000","last_fullsized":"2024-05-15T15:39:51.428802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T15:39:51.457637+0000","last_change":"2024-05-15T15:39:51.456133+0000","last_active":"2024-05-15T15:39:51.457637+0000","last_peered":"2024-05-15T15:39:51.457637+0000","last_clean":"2024-05-15T15:39:51.457637+0000","last_became_active":"2024-05-15T15:39:51.455602+0000","last_became_peered":"2024-05-15T15:39:51.455602+0000","last_unstale":"2024-05-15T15:39:51.457637+0000","last_undegraded":"2024-05-15T15:39:51.457637+0000","last_fullsized":"2024-05-15T15:39:51.457637+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:04:40.612468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-15T15:39:51.437692+0000","last_change":"2024-05-15T15:39:51.437692+0000","last_active":"2024-05-15T15:39:51.428802+0000","last_peered":"2024-05-15T15:39:51.428802+0000","last_clean":"2024-05-15T15:39:51.428802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:39:51.437692+0000","last_undegraded":"2024-05-15T15:39:51.437692+0000","last_fullsized":"2024-05-15T15:39:51.437692+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:39:50.421276+0000","last_change":"2024-05-15T15:39:50.421276+0000","last_active":"2024-05-15T15:39:50.421276+0000","last_peered":"2024-05-15T15:39:50.421276+0000","last_clean":"2024-05-15T15:39:50.421276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:39:50.421276+0000","last_undegraded":"2024-05-15T15:39:50.421276+0000","last_fullsized":"2024-05-15T15:39:50.421276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:39:51.428802+0000","last_change":"2024-05-15T15:39:51.428802+0000","last_active":"2024-05-15T15:39:51.428802+0000","last_peered":"2024-05-15T15:39:51.428802+0000","last_clean":"2024-05-15T15:39:51.428802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:39:51.428802+0000","last_undegraded":"2024-05-15T15:39:51.428802+0000","last_fullsized":"2024-05-15T15:39:51.428802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:39:50.421276+0000","last_change":"2024-05-15T15:39:50.421276+0000","last_active":"2024-05-15T15:39:50.421276+0000","last_peered":"2024-05-15T15:39:50.421276+0000","last_clean":"2024-05-15T15:39:50.421276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:39:50.421276+0000","last_undegraded":"2024-05-15T15:39:50.421276+0000","last_fullsized":"2024-05-15T15:39:50.421276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:39:51.428802+0000","last_change":"2024-05-15T15:39:51.428802+0000","last_active":"2024-05-15T15:39:51.428802+0000","last_peered":"2024-05-15T15:39:51.428802+0000","last_clean":"2024-05-15T15:39:51.428802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:39:51.428802+0000","last_undegraded":"2024-05-15T15:39:51.428802+0000","last_fullsized":"2024-05-15T15:39:51.428802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:39:51.428802+0000","last_change":"2024-05-15T15:39:51.428802+0000","last_active":"2024-05-15T15:39:51.428802+0000","last_peered":"2024-05-15T15:39:51.428802+0000","last_clean":"2024-05-15T15:39:51.428802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:39:51.428802+0000","last_undegraded":"2024-05-15T15:39:51.428802+0000","last_fullsized":"2024-05-15T15:39:51.428802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:39:50.421276+0000","last_change":"2024-05-15T15:39:50.421276+0000","last_active":"2024-05-15T15:39:50.421276+0000","last_peered":"2024-05-15T15:39:50.421276+0000","last_clean":"2024-05-15T15:39:50.421276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:39:50.421276+0000","last_undegraded":"2024-05-15T15:39:50.421276+0000","last_fullsized":"2024-05-15T15:39:50.421276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:39:51.428802+0000","last_change":"2024-05-15T15:39:51.428802+0000","last_active":"2024-05-15T15:39:51.428802+0000","last_peered":"2024-05-15T15:39:51.428802+0000","last_clean":"2024-05-15T15:39:51.428802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:39:51.428802+0000","last_undegraded":"2024-05-15T15:39:51.428802+0000","last_fullsized":"2024-05-15T15:39:51.428802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:39:50.421276+0000","last_change":"2024-05-15T15:39:50.421276+0000","last_active":"2024-05-15T15:39:50.421276+0000","last_peered":"2024-05-15T15:39:50.421276+0000","last_clean":"2024-05-15T15:39:50.421276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:39:50.421276+0000","last_undegraded":"2024-05-15T15:39:50.421276+0000","last_fullsized":"2024-05-15T15:39:50.421276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:39:51.428802+0000","last_change":"2024-05-15T15:39:51.428802+0000","last_active":"2024-05-15T15:39:51.428802+0000","last_peered":"2024-05-15T15:39:51.428802+0000","last_clean":"2024-05-15T15:39:51.428802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:39:51.428802+0000","last_undegraded":"2024-05-15T15:39:51.428802+0000","last_fullsized":"2024-05-15T15:39:51.428802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:39:50.421276+0000","last_change":"2024-05-15T15:39:50.421276+0000","last_active":"2024-05-15T15:39:50.421276+0000","last_peered":"2024-05-15T15:39:50.421276+0000","last_clean":"2024-05-15T15:39:50.421276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:39:50.421276+0000","last_undegraded":"2024-05-15T15:39:50.421276+0000","last_fullsized":"2024-05-15T15:39:50.421276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:39:51.428802+0000","last_change":"2024-05-15T15:39:51.428802+0000","last_active":"2024-05-15T15:39:51.428802+0000","last_peered":"2024-05-15T15:39:51.428802+0000","last_clean":"2024-05-15T15:39:51.428802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:39:51.428802+0000","last_undegraded":"2024-05-15T15:39:51.428802+0000","last_fullsized":"2024-05-15T15:39:51.428802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T15:39:51.447704+0000","last_change":"2024-05-15T15:39:51.445161+0000","last_active":"2024-05-15T15:39:51.447704+0000","last_peered":"2024-05-15T15:39:51.447704+0000","last_clean":"2024-05-15T15:39:51.447704+0000","last_became_active":"2024-05-15T15:39:51.444855+0000","last_became_peered":"2024-05-15T15:39:51.444855+0000","last_unstale":"2024-05-15T15:39:51.447704+0000","last_undegraded":"2024-05-15T15:39:51.447704+0000","last_fullsized":"2024-05-15T15:39:51.447704+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:58:42.762068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":14,"acting":14,"num_store_stats":1},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":10,"acting":10,"num_store_stats":1},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27200,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":184320,"data_stored":56068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27200,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":184320,"data_stored":56068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509445,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28028,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343812,"statfs":{"total":96636764160,"available":96608063488,"internally_reserved":0,"allocated":778240,"data_stored":646436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27200,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":184320,"data_stored":56068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27200,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":184320,"data_stored":56068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28028,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343812,"statfs":{"total":96636764160,"available":96608063488,"internally_reserved":0,"allocated":778240,"data_stored":646436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27208,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":184320,"data_stored":56068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":196608,"data_stored":61885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-15T15:39:56.535 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-15T15:39:56.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.679+0000 7f8e4215e640 1 Processor -- start 2024-05-15T15:39:56.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.679+0000 7f8e4215e640 1 -- start start 2024-05-15T15:39:56.683 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.681+0000 7f8e4215e640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8e3c06c8c0 0x7f8e3c0bb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:56.683 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.681+0000 7f8e4215e640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8e3c074a30 0x7f8e3c152590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:56.683 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.681+0000 7f8e4215e640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e3c0bb9f0 con 0x7f8e3c152180 2024-05-15T15:39:56.683 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.681+0000 7f8e4215e640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f8e3c151a10 con 0x7f8e3c06c8c0 2024-05-15T15:39:56.683 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.681+0000 7f8e4215e640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f8e3c0bb090 con 0x7f8e3c074a30 2024-05-15T15:39:56.683 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.681+0000 7f8e3bfff640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8e3c074a30 0x7f8e3c152590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:56.683 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.681+0000 7f8e3b7fe640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8e3c06c8c0 0x7f8e3c0bb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:56.683 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.681+0000 7f8e3bfff640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8e3c074a30 0x7f8e3c152590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3301/0 says I am v2:172.21.15.12:37506/0 (socket says 172.21.15.12:37506) 2024-05-15T15:39:56.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.681+0000 7f8e3affd640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f8e3c152180 0x7f8e3c074320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.12:53652/0 (socket says 172.21.15.12:53652) 2024-05-15T15:39:56.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.681+0000 7f8e3b7fe640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8e3c06c8c0 0x7f8e3c0bb4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.12:35704/0 (socket says 172.21.15.12:35704) 2024-05-15T15:39:56.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.681+0000 7f8e3bfff640 1 -- 172.21.15.12:0/3368699323 learned_addr learned my addr 172.21.15.12:0/3368699323 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:39:56.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.681+0000 7f8e3b7fe640 1 -- 172.21.15.12:0/3368699323 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8e3c074a30 msgr2=0x7f8e3c152590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:39:56.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.681+0000 7f8e3b7fe640 1 --2- 172.21.15.12:0/3368699323 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8e3c074a30 0x7f8e3c152590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:56.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.681+0000 7f8e3b7fe640 1 -- 172.21.15.12:0/3368699323 >> v1:172.21.15.84:6789/0 conn(0x7f8e3c152180 legacy=0x7f8e3c074320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:56.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.681+0000 7f8e3b7fe640 1 -- 172.21.15.12:0/3368699323 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e3c0bbc80 con 0x7f8e3c06c8c0 2024-05-15T15:39:56.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.682+0000 7f8e3b7fe640 1 --2- 172.21.15.12:0/3368699323 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8e3c06c8c0 0x7f8e3c0bb4b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c0097a0 tx=0x7f8e2c02a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d01fa8d7dc90bc69 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:39:56.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.682+0000 7f8e3a7fc640 1 -- 172.21.15.12:0/3368699323 <== mon.1 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e2c037070 con 0x7f8e3c06c8c0 2024-05-15T15:39:56.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.682+0000 7f8e3a7fc640 1 -- 172.21.15.12:0/3368699323 <== mon.1 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e2c032440 con 0x7f8e3c06c8c0 2024-05-15T15:39:56.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.682+0000 7f8e3a7fc640 1 -- 172.21.15.12:0/3368699323 <== mon.1 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e2c032810 con 0x7f8e3c06c8c0 2024-05-15T15:39:56.686 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.683+0000 7f8e4215e640 1 -- 172.21.15.12:0/3368699323 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8e3c06c8c0 msgr2=0x7f8e3c0bb4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:56.686 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.683+0000 7f8e4215e640 1 --2- 172.21.15.12:0/3368699323 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8e3c06c8c0 0x7f8e3c0bb4b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c0097a0 tx=0x7f8e2c02a180 comp rx=0 tx=0).stop 2024-05-15T15:39:56.686 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.683+0000 7f8e4215e640 1 -- 172.21.15.12:0/3368699323 shutdown_connections 2024-05-15T15:39:56.686 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.683+0000 7f8e4215e640 1 --2- 172.21.15.12:0/3368699323 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8e3c074a30 0x7f8e3c152590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:56.686 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.683+0000 7f8e4215e640 1 --2- 172.21.15.12:0/3368699323 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8e3c06c8c0 0x7f8e3c0bb4b0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:56.686 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.683+0000 7f8e4215e640 1 -- 172.21.15.12:0/3368699323 >> 172.21.15.12:0/3368699323 conn(0x7f8e3c0bd0f0 msgr2=0x7f8e3c0bd500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:39:56.686 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.683+0000 7f8e4215e640 1 -- 172.21.15.12:0/3368699323 shutdown_connections 2024-05-15T15:39:56.686 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.683+0000 7f8e4215e640 1 -- 172.21.15.12:0/3368699323 wait complete. 2024-05-15T15:39:56.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.685+0000 7f8e4215e640 1 Processor -- start 2024-05-15T15:39:56.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.685+0000 7f8e4215e640 1 -- start start 2024-05-15T15:39:56.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.686+0000 7f8e4215e640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8e3c06c8c0 0x7f8e3c1d9d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:56.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.686+0000 7f8e4215e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e3c074a30 0x7f8e3c149830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:56.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.686+0000 7f8e4215e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8e3c152180 0x7f8e3c149d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:56.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.686+0000 7f8e4215e640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f8e3c14e4c0 con 0x7f8e3c074a30 2024-05-15T15:39:56.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.686+0000 7f8e4215e640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f8e3c151c60 con 0x7f8e3c152180 2024-05-15T15:39:56.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.686+0000 7f8e4215e640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f8e3c06ccd0 con 0x7f8e3c06c8c0 2024-05-15T15:39:56.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.686+0000 7f8e3affd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e3c074a30 0x7f8e3c149830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:56.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.686+0000 7f8e3affd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e3c074a30 0x7f8e3c149830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59352/0 (socket says 172.21.15.12:59352) 2024-05-15T15:39:56.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.686+0000 7f8e3affd640 1 -- 172.21.15.12:0/2290912665 learned_addr learned my addr 172.21.15.12:0/2290912665 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:39:56.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.686+0000 7f8e3bfff640 1 --2- 172.21.15.12:0/2290912665 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8e3c152180 0x7f8e3c149d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:56.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.686+0000 7f8e3b7fe640 1 --2- 172.21.15.12:0/2290912665 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8e3c06c8c0 0x7f8e3c1d9d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:56.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.686+0000 7f8e3affd640 1 -- 172.21.15.12:0/2290912665 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8e3c06c8c0 msgr2=0x7f8e3c1d9d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:56.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.686+0000 7f8e3affd640 1 --2- 172.21.15.12:0/2290912665 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8e3c06c8c0 0x7f8e3c1d9d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:56.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.686+0000 7f8e3affd640 1 -- 172.21.15.12:0/2290912665 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8e3c152180 msgr2=0x7f8e3c149d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:56.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.686+0000 7f8e3affd640 1 --2- 172.21.15.12:0/2290912665 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8e3c152180 0x7f8e3c149d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:56.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.686+0000 7f8e3affd640 1 -- 172.21.15.12:0/2290912665 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e3c1da2a0 con 0x7f8e3c074a30 2024-05-15T15:39:56.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.687+0000 7f8e3affd640 1 --2- 172.21.15.12:0/2290912665 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e3c074a30 0x7f8e3c149830 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8e3000c370 tx=0x7f8e3000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:39:56.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.687+0000 7f8e23fff640 1 -- 172.21.15.12:0/2290912665 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e300074e0 con 0x7f8e3c074a30 2024-05-15T15:39:56.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.687+0000 7f8e23fff640 1 -- 172.21.15.12:0/2290912665 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e30007680 con 0x7f8e3c074a30 2024-05-15T15:39:56.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.687+0000 7f8e4215e640 1 -- 172.21.15.12:0/2290912665 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e3c1e7c20 con 0x7f8e3c074a30 2024-05-15T15:39:56.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.687+0000 7f8e23fff640 1 -- 172.21.15.12:0/2290912665 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e30004a20 con 0x7f8e3c074a30 2024-05-15T15:39:56.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.687+0000 7f8e4215e640 1 -- 172.21.15.12:0/2290912665 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e3c1e81e0 con 0x7f8e3c074a30 2024-05-15T15:39:56.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.688+0000 7f8e4215e640 1 -- 172.21.15.12:0/2290912665 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e3c069e20 con 0x7f8e3c074a30 2024-05-15T15:39:56.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.688+0000 7f8e23fff640 1 -- 172.21.15.12:0/2290912665 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8e3001a020 con 0x7f8e3c074a30 2024-05-15T15:39:56.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.689+0000 7f8e23fff640 1 --2- 172.21.15.12:0/2290912665 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f8e280762d0 0x7f8e280787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:56.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.689+0000 7f8e23fff640 1 -- 172.21.15.12:0/2290912665 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f8e30096df0 con 0x7f8e3c074a30 2024-05-15T15:39:56.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.689+0000 7f8e3b7fe640 1 --2- 172.21.15.12:0/2290912665 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f8e280762d0 0x7f8e280787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:56.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.690+0000 7f8e3b7fe640 1 --2- 172.21.15.12:0/2290912665 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f8e280762d0 0x7f8e280787e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c034000 tx=0x7f8e2c02e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:39:56.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.694+0000 7f8e23fff640 1 -- 172.21.15.12:0/2290912665 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f8e300606c0 con 0x7f8e3c074a30 2024-05-15T15:39:56.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.879+0000 7f8e4215e640 1 -- 172.21.15.12:0/2290912665 --> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8e3c14c320 con 0x7f8e280762d0 2024-05-15T15:39:56.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.886+0000 7f8e23fff640 1 -- 172.21.15.12:0/2290912665 <== mgr.4106 v2:172.21.15.84:6832/4173299311 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251340 (secure 0 0 0) 0x7f8e3c14c320 con 0x7f8e280762d0 2024-05-15T15:39:56.890 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-05-15T15:39:56.892 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-05-15T15:39:56.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.889+0000 7f8e4215e640 1 -- 172.21.15.12:0/2290912665 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f8e280762d0 msgr2=0x7f8e280787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:56.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.889+0000 7f8e4215e640 1 --2- 172.21.15.12:0/2290912665 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f8e280762d0 0x7f8e280787e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c034000 tx=0x7f8e2c02e000 comp rx=0 tx=0).stop 2024-05-15T15:39:56.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.889+0000 7f8e4215e640 1 -- 172.21.15.12:0/2290912665 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e3c074a30 msgr2=0x7f8e3c149830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:56.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.889+0000 7f8e4215e640 1 --2- 172.21.15.12:0/2290912665 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e3c074a30 0x7f8e3c149830 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8e3000c370 tx=0x7f8e3000c830 comp rx=0 tx=0).stop 2024-05-15T15:39:56.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.889+0000 7f8e4215e640 1 -- 172.21.15.12:0/2290912665 shutdown_connections 2024-05-15T15:39:56.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.889+0000 7f8e4215e640 1 --2- 172.21.15.12:0/2290912665 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8e3c152180 0x7f8e3c149d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:56.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.889+0000 7f8e4215e640 1 --2- 172.21.15.12:0/2290912665 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f8e280762d0 0x7f8e280787e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:56.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.889+0000 7f8e4215e640 1 --2- 172.21.15.12:0/2290912665 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e3c074a30 0x7f8e3c149830 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:56.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.889+0000 7f8e4215e640 1 --2- 172.21.15.12:0/2290912665 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8e3c06c8c0 0x7f8e3c1d9d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:56.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.889+0000 7f8e4215e640 1 -- 172.21.15.12:0/2290912665 >> 172.21.15.12:0/2290912665 conn(0x7f8e3c0bd0f0 msgr2=0x7f8e3c06df40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:39:56.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.889+0000 7f8e4215e640 1 -- 172.21.15.12:0/2290912665 shutdown_connections 2024-05-15T15:39:56.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:56.889+0000 7f8e4215e640 1 -- 172.21.15.12:0/2290912665 wait complete. 2024-05-15T15:39:56.902 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2024-05-15T15:39:56.701057+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592196,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":126,"num_write_kb":1641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":96,"ondisk_log_size":96,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":129,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219144,"kb_used_data":2968,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755576,"statfs":{"total":773094113280,"available":772869709824,"internally_reserved":0,"allocated":3039232,"data_stored":1801202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1828,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001482"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057108+0000","last_change":"2024-05-15T15:39:52.474245+0000","last_active":"2024-05-15T15:39:54.057108+0000","last_peered":"2024-05-15T15:39:54.057108+0000","last_clean":"2024-05-15T15:39:54.057108+0000","last_became_active":"2024-05-15T15:39:52.473919+0000","last_became_peered":"2024-05-15T15:39:52.473919+0000","last_unstale":"2024-05-15T15:39:54.057108+0000","last_undegraded":"2024-05-15T15:39:54.057108+0000","last_fullsized":"2024-05-15T15:39:54.057108+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:35:07.996967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.464974+0000","last_change":"2024-05-15T15:39:52.472587+0000","last_active":"2024-05-15T15:39:53.464974+0000","last_peered":"2024-05-15T15:39:53.464974+0000","last_clean":"2024-05-15T15:39:53.464974+0000","last_became_active":"2024-05-15T15:39:52.472268+0000","last_became_peered":"2024-05-15T15:39:52.472268+0000","last_unstale":"2024-05-15T15:39:53.464974+0000","last_undegraded":"2024-05-15T15:39:53.464974+0000","last_fullsized":"2024-05-15T15:39:53.464974+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:39:07.633570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.464154+0000","last_change":"2024-05-15T15:39:52.474404+0000","last_active":"2024-05-15T15:39:53.464154+0000","last_peered":"2024-05-15T15:39:53.464154+0000","last_clean":"2024-05-15T15:39:53.464154+0000","last_became_active":"2024-05-15T15:39:52.474102+0000","last_became_peered":"2024-05-15T15:39:52.474102+0000","last_unstale":"2024-05-15T15:39:53.464154+0000","last_undegraded":"2024-05-15T15:39:53.464154+0000","last_fullsized":"2024-05-15T15:39:53.464154+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:13:19.570085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.056856+0000","last_change":"2024-05-15T15:39:52.462504+0000","last_active":"2024-05-15T15:39:54.056856+0000","last_peered":"2024-05-15T15:39:54.056856+0000","last_clean":"2024-05-15T15:39:54.056856+0000","last_became_active":"2024-05-15T15:39:52.462135+0000","last_became_peered":"2024-05-15T15:39:52.462135+0000","last_unstale":"2024-05-15T15:39:54.056856+0000","last_undegraded":"2024-05-15T15:39:54.056856+0000","last_fullsized":"2024-05-15T15:39:54.056856+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:53:35.715007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057365+0000","last_change":"2024-05-15T15:39:52.477733+0000","last_active":"2024-05-15T15:39:54.057365+0000","last_peered":"2024-05-15T15:39:54.057365+0000","last_clean":"2024-05-15T15:39:54.057365+0000","last_became_active":"2024-05-15T15:39:52.474778+0000","last_became_peered":"2024-05-15T15:39:52.474778+0000","last_unstale":"2024-05-15T15:39:54.057365+0000","last_undegraded":"2024-05-15T15:39:54.057365+0000","last_fullsized":"2024-05-15T15:39:54.057365+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:18:51.904529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057477+0000","last_change":"2024-05-15T15:39:52.458241+0000","last_active":"2024-05-15T15:39:54.057477+0000","last_peered":"2024-05-15T15:39:54.057477+0000","last_clean":"2024-05-15T15:39:54.057477+0000","last_became_active":"2024-05-15T15:39:52.457883+0000","last_became_peered":"2024-05-15T15:39:52.457883+0000","last_unstale":"2024-05-15T15:39:54.057477+0000","last_undegraded":"2024-05-15T15:39:54.057477+0000","last_fullsized":"2024-05-15T15:39:54.057477+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:19:06.288701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.056535+0000","last_change":"2024-05-15T15:39:52.474619+0000","last_active":"2024-05-15T15:39:54.056535+0000","last_peered":"2024-05-15T15:39:54.056535+0000","last_clean":"2024-05-15T15:39:54.056535+0000","last_became_active":"2024-05-15T15:39:52.474314+0000","last_became_peered":"2024-05-15T15:39:52.474314+0000","last_unstale":"2024-05-15T15:39:54.056535+0000","last_undegraded":"2024-05-15T15:39:54.056535+0000","last_fullsized":"2024-05-15T15:39:54.056535+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:07:46.287281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.463913+0000","last_change":"2024-05-15T15:39:52.468997+0000","last_active":"2024-05-15T15:39:53.463913+0000","last_peered":"2024-05-15T15:39:53.463913+0000","last_clean":"2024-05-15T15:39:53.463913+0000","last_became_active":"2024-05-15T15:39:52.468155+0000","last_became_peered":"2024-05-15T15:39:52.468155+0000","last_unstale":"2024-05-15T15:39:53.463913+0000","last_undegraded":"2024-05-15T15:39:53.463913+0000","last_fullsized":"2024-05-15T15:39:53.463913+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:07:46.287281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.506277+0000","last_change":"2024-05-15T15:39:52.468077+0000","last_active":"2024-05-15T15:39:53.506277+0000","last_peered":"2024-05-15T15:39:53.506277+0000","last_clean":"2024-05-15T15:39:53.506277+0000","last_became_active":"2024-05-15T15:39:52.467754+0000","last_became_peered":"2024-05-15T15:39:52.467754+0000","last_unstale":"2024-05-15T15:39:53.506277+0000","last_undegraded":"2024-05-15T15:39:53.506277+0000","last_fullsized":"2024-05-15T15:39:53.506277+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:46:06.269771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057388+0000","last_change":"2024-05-15T15:39:52.480897+0000","last_active":"2024-05-15T15:39:54.057388+0000","last_peered":"2024-05-15T15:39:54.057388+0000","last_clean":"2024-05-15T15:39:54.057388+0000","last_became_active":"2024-05-15T15:39:52.479910+0000","last_became_peered":"2024-05-15T15:39:52.479910+0000","last_unstale":"2024-05-15T15:39:54.057388+0000","last_undegraded":"2024-05-15T15:39:54.057388+0000","last_fullsized":"2024-05-15T15:39:54.057388+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:13:19.570085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057782+0000","last_change":"2024-05-15T15:39:52.473167+0000","last_active":"2024-05-15T15:39:54.057782+0000","last_peered":"2024-05-15T15:39:54.057782+0000","last_clean":"2024-05-15T15:39:54.057782+0000","last_became_active":"2024-05-15T15:39:52.472835+0000","last_became_peered":"2024-05-15T15:39:52.472835+0000","last_unstale":"2024-05-15T15:39:54.057782+0000","last_undegraded":"2024-05-15T15:39:54.057782+0000","last_fullsized":"2024-05-15T15:39:54.057782+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:39:30.074726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057803+0000","last_change":"2024-05-15T15:39:52.467676+0000","last_active":"2024-05-15T15:39:54.057803+0000","last_peered":"2024-05-15T15:39:54.057803+0000","last_clean":"2024-05-15T15:39:54.057803+0000","last_became_active":"2024-05-15T15:39:52.467064+0000","last_became_peered":"2024-05-15T15:39:52.467064+0000","last_unstale":"2024-05-15T15:39:54.057803+0000","last_undegraded":"2024-05-15T15:39:54.057803+0000","last_fullsized":"2024-05-15T15:39:54.057803+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:58:23.539973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.463567+0000","last_change":"2024-05-15T15:39:52.472464+0000","last_active":"2024-05-15T15:39:53.463567+0000","last_peered":"2024-05-15T15:39:53.463567+0000","last_clean":"2024-05-15T15:39:53.463567+0000","last_became_active":"2024-05-15T15:39:52.472129+0000","last_became_peered":"2024-05-15T15:39:52.472129+0000","last_unstale":"2024-05-15T15:39:53.463567+0000","last_undegraded":"2024-05-15T15:39:53.463567+0000","last_fullsized":"2024-05-15T15:39:53.463567+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:14:40.347641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.463905+0000","last_change":"2024-05-15T15:39:52.465747+0000","last_active":"2024-05-15T15:39:53.463905+0000","last_peered":"2024-05-15T15:39:53.463905+0000","last_clean":"2024-05-15T15:39:53.463905+0000","last_became_active":"2024-05-15T15:39:52.465239+0000","last_became_peered":"2024-05-15T15:39:52.465239+0000","last_unstale":"2024-05-15T15:39:53.463905+0000","last_undegraded":"2024-05-15T15:39:53.463905+0000","last_fullsized":"2024-05-15T15:39:53.463905+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:56:24.242548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.463549+0000","last_change":"2024-05-15T15:39:52.467317+0000","last_active":"2024-05-15T15:39:53.463549+0000","last_peered":"2024-05-15T15:39:53.463549+0000","last_clean":"2024-05-15T15:39:53.463549+0000","last_became_active":"2024-05-15T15:39:52.466968+0000","last_became_peered":"2024-05-15T15:39:52.466968+0000","last_unstale":"2024-05-15T15:39:53.463549+0000","last_undegraded":"2024-05-15T15:39:53.463549+0000","last_fullsized":"2024-05-15T15:39:53.463549+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:36:37.195191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.462383+0000","last_change":"2024-05-15T15:39:52.469584+0000","last_active":"2024-05-15T15:39:53.462383+0000","last_peered":"2024-05-15T15:39:53.462383+0000","last_clean":"2024-05-15T15:39:53.462383+0000","last_became_active":"2024-05-15T15:39:52.469257+0000","last_became_peered":"2024-05-15T15:39:52.469257+0000","last_unstale":"2024-05-15T15:39:53.462383+0000","last_undegraded":"2024-05-15T15:39:53.462383+0000","last_fullsized":"2024-05-15T15:39:53.462383+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:52:43.064362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.463038+0000","last_change":"2024-05-15T15:39:52.473647+0000","last_active":"2024-05-15T15:39:53.463038+0000","last_peered":"2024-05-15T15:39:53.463038+0000","last_clean":"2024-05-15T15:39:53.463038+0000","last_became_active":"2024-05-15T15:39:52.472719+0000","last_became_peered":"2024-05-15T15:39:52.472719+0000","last_unstale":"2024-05-15T15:39:53.463038+0000","last_undegraded":"2024-05-15T15:39:53.463038+0000","last_fullsized":"2024-05-15T15:39:53.463038+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:48:23.434946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.056800+0000","last_change":"2024-05-15T15:39:52.465815+0000","last_active":"2024-05-15T15:39:54.056800+0000","last_peered":"2024-05-15T15:39:54.056800+0000","last_clean":"2024-05-15T15:39:54.056800+0000","last_became_active":"2024-05-15T15:39:52.465471+0000","last_became_peered":"2024-05-15T15:39:52.465471+0000","last_unstale":"2024-05-15T15:39:54.056800+0000","last_undegraded":"2024-05-15T15:39:54.056800+0000","last_fullsized":"2024-05-15T15:39:54.056800+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:53:35.715007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.463021+0000","last_change":"2024-05-15T15:39:52.463837+0000","last_active":"2024-05-15T15:39:53.463021+0000","last_peered":"2024-05-15T15:39:53.463021+0000","last_clean":"2024-05-15T15:39:53.463021+0000","last_became_active":"2024-05-15T15:39:52.459388+0000","last_became_peered":"2024-05-15T15:39:52.459388+0000","last_unstale":"2024-05-15T15:39:53.463021+0000","last_undegraded":"2024-05-15T15:39:53.463021+0000","last_fullsized":"2024-05-15T15:39:53.463021+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:55:50.961472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057274+0000","last_change":"2024-05-15T15:39:52.467411+0000","last_active":"2024-05-15T15:39:54.057274+0000","last_peered":"2024-05-15T15:39:54.057274+0000","last_clean":"2024-05-15T15:39:54.057274+0000","last_became_active":"2024-05-15T15:39:52.466666+0000","last_became_peered":"2024-05-15T15:39:52.466666+0000","last_unstale":"2024-05-15T15:39:54.057274+0000","last_undegraded":"2024-05-15T15:39:54.057274+0000","last_fullsized":"2024-05-15T15:39:54.057274+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:22:17.968105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-15T15:39:51.440698+0000","last_change":"2024-05-15T15:39:51.440698+0000","last_active":"2024-05-15T15:39:51.428802+0000","last_peered":"2024-05-15T15:39:51.428802+0000","last_clean":"2024-05-15T15:39:51.428802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:39:51.440698+0000","last_undegraded":"2024-05-15T15:39:51.440698+0000","last_fullsized":"2024-05-15T15:39:51.440698+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.506016+0000","last_change":"2024-05-15T15:39:52.477675+0000","last_active":"2024-05-15T15:39:53.506016+0000","last_peered":"2024-05-15T15:39:53.506016+0000","last_clean":"2024-05-15T15:39:53.506016+0000","last_became_active":"2024-05-15T15:39:52.477314+0000","last_became_peered":"2024-05-15T15:39:52.477314+0000","last_unstale":"2024-05-15T15:39:53.506016+0000","last_undegraded":"2024-05-15T15:39:53.506016+0000","last_fullsized":"2024-05-15T15:39:53.506016+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:49:27.658296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.463806+0000","last_change":"2024-05-15T15:39:52.471743+0000","last_active":"2024-05-15T15:39:53.463806+0000","last_peered":"2024-05-15T15:39:53.463806+0000","last_clean":"2024-05-15T15:39:53.463806+0000","last_became_active":"2024-05-15T15:39:52.471382+0000","last_became_peered":"2024-05-15T15:39:52.471382+0000","last_unstale":"2024-05-15T15:39:53.463806+0000","last_undegraded":"2024-05-15T15:39:53.463806+0000","last_fullsized":"2024-05-15T15:39:53.463806+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:01:48.794566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.462381+0000","last_change":"2024-05-15T15:39:52.463540+0000","last_active":"2024-05-15T15:39:53.462381+0000","last_peered":"2024-05-15T15:39:53.462381+0000","last_clean":"2024-05-15T15:39:53.462381+0000","last_became_active":"2024-05-15T15:39:52.463162+0000","last_became_peered":"2024-05-15T15:39:52.463162+0000","last_unstale":"2024-05-15T15:39:53.462381+0000","last_undegraded":"2024-05-15T15:39:53.462381+0000","last_fullsized":"2024-05-15T15:39:53.462381+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:18:51.904529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.464627+0000","last_change":"2024-05-15T15:39:52.474224+0000","last_active":"2024-05-15T15:39:53.464627+0000","last_peered":"2024-05-15T15:39:53.464627+0000","last_clean":"2024-05-15T15:39:53.464627+0000","last_became_active":"2024-05-15T15:39:52.473890+0000","last_became_peered":"2024-05-15T15:39:52.473890+0000","last_unstale":"2024-05-15T15:39:53.464627+0000","last_undegraded":"2024-05-15T15:39:53.464627+0000","last_fullsized":"2024-05-15T15:39:53.464627+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:22:17.968105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057129+0000","last_change":"2024-05-15T15:39:52.466971+0000","last_active":"2024-05-15T15:39:54.057129+0000","last_peered":"2024-05-15T15:39:54.057129+0000","last_clean":"2024-05-15T15:39:54.057129+0000","last_became_active":"2024-05-15T15:39:52.466656+0000","last_became_peered":"2024-05-15T15:39:52.466656+0000","last_unstale":"2024-05-15T15:39:54.057129+0000","last_undegraded":"2024-05-15T15:39:54.057129+0000","last_fullsized":"2024-05-15T15:39:54.057129+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:52:27.027535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.464322+0000","last_change":"2024-05-15T15:39:52.470364+0000","last_active":"2024-05-15T15:39:53.464322+0000","last_peered":"2024-05-15T15:39:53.464322+0000","last_clean":"2024-05-15T15:39:53.464322+0000","last_became_active":"2024-05-15T15:39:52.470067+0000","last_became_peered":"2024-05-15T15:39:52.470067+0000","last_unstale":"2024-05-15T15:39:53.464322+0000","last_undegraded":"2024-05-15T15:39:53.464322+0000","last_fullsized":"2024-05-15T15:39:53.464322+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:07:28.350502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.463525+0000","last_change":"2024-05-15T15:39:52.473274+0000","last_active":"2024-05-15T15:39:53.463525+0000","last_peered":"2024-05-15T15:39:53.463525+0000","last_clean":"2024-05-15T15:39:53.463525+0000","last_became_active":"2024-05-15T15:39:52.472954+0000","last_became_peered":"2024-05-15T15:39:52.472954+0000","last_unstale":"2024-05-15T15:39:53.463525+0000","last_undegraded":"2024-05-15T15:39:53.463525+0000","last_fullsized":"2024-05-15T15:39:53.463525+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:46:06.269771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.464564+0000","last_change":"2024-05-15T15:39:52.473238+0000","last_active":"2024-05-15T15:39:53.464564+0000","last_peered":"2024-05-15T15:39:53.464564+0000","last_clean":"2024-05-15T15:39:53.464564+0000","last_became_active":"2024-05-15T15:39:52.472848+0000","last_became_peered":"2024-05-15T15:39:52.472848+0000","last_unstale":"2024-05-15T15:39:53.464564+0000","last_undegraded":"2024-05-15T15:39:53.464564+0000","last_fullsized":"2024-05-15T15:39:53.464564+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:48:53.088055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.462876+0000","last_change":"2024-05-15T15:39:52.464689+0000","last_active":"2024-05-15T15:39:53.462876+0000","last_peered":"2024-05-15T15:39:53.462876+0000","last_clean":"2024-05-15T15:39:53.462876+0000","last_became_active":"2024-05-15T15:39:52.462649+0000","last_became_peered":"2024-05-15T15:39:52.462649+0000","last_unstale":"2024-05-15T15:39:53.462876+0000","last_undegraded":"2024-05-15T15:39:53.462876+0000","last_fullsized":"2024-05-15T15:39:53.462876+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:17:05.581127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.056464+0000","last_change":"2024-05-15T15:39:52.465485+0000","last_active":"2024-05-15T15:39:54.056464+0000","last_peered":"2024-05-15T15:39:54.056464+0000","last_clean":"2024-05-15T15:39:54.056464+0000","last_became_active":"2024-05-15T15:39:52.464733+0000","last_became_peered":"2024-05-15T15:39:52.464733+0000","last_unstale":"2024-05-15T15:39:54.056464+0000","last_undegraded":"2024-05-15T15:39:54.056464+0000","last_fullsized":"2024-05-15T15:39:54.056464+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:17:34.380965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057300+0000","last_change":"2024-05-15T15:39:52.465924+0000","last_active":"2024-05-15T15:39:54.057300+0000","last_peered":"2024-05-15T15:39:54.057300+0000","last_clean":"2024-05-15T15:39:54.057300+0000","last_became_active":"2024-05-15T15:39:52.464704+0000","last_became_peered":"2024-05-15T15:39:52.464704+0000","last_unstale":"2024-05-15T15:39:54.057300+0000","last_undegraded":"2024-05-15T15:39:54.057300+0000","last_fullsized":"2024-05-15T15:39:54.057300+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:49:27.658296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.506001+0000","last_change":"2024-05-15T15:39:52.465099+0000","last_active":"2024-05-15T15:39:53.506001+0000","last_peered":"2024-05-15T15:39:53.506001+0000","last_clean":"2024-05-15T15:39:53.506001+0000","last_became_active":"2024-05-15T15:39:52.464775+0000","last_became_peered":"2024-05-15T15:39:52.464775+0000","last_unstale":"2024-05-15T15:39:53.506001+0000","last_undegraded":"2024-05-15T15:39:53.506001+0000","last_fullsized":"2024-05-15T15:39:53.506001+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:52:27.027535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.464681+0000","last_change":"2024-05-15T15:39:51.443546+0000","last_active":"2024-05-15T15:39:53.464681+0000","last_peered":"2024-05-15T15:39:53.464681+0000","last_clean":"2024-05-15T15:39:53.464681+0000","last_became_active":"2024-05-15T15:39:51.443177+0000","last_became_peered":"2024-05-15T15:39:51.443177+0000","last_unstale":"2024-05-15T15:39:53.464681+0000","last_undegraded":"2024-05-15T15:39:53.464681+0000","last_fullsized":"2024-05-15T15:39:53.464681+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:18:35.801621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-15T15:39:51.436958+0000","last_change":"2024-05-15T15:39:51.436958+0000","last_active":"2024-05-15T15:39:51.428802+0000","last_peered":"2024-05-15T15:39:51.428802+0000","last_clean":"2024-05-15T15:39:51.428802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:39:51.436958+0000","last_undegraded":"2024-05-15T15:39:51.436958+0000","last_fullsized":"2024-05-15T15:39:51.436958+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.462997+0000","last_change":"2024-05-15T15:39:51.451403+0000","last_active":"2024-05-15T15:39:53.462997+0000","last_peered":"2024-05-15T15:39:53.462997+0000","last_clean":"2024-05-15T15:39:53.462997+0000","last_became_active":"2024-05-15T15:39:51.451074+0000","last_became_peered":"2024-05-15T15:39:51.451074+0000","last_unstale":"2024-05-15T15:39:53.462997+0000","last_undegraded":"2024-05-15T15:39:53.462997+0000","last_fullsized":"2024-05-15T15:39:53.462997+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:52:26.020009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.463548+0000","last_change":"2024-05-15T15:39:51.457243+0000","last_active":"2024-05-15T15:39:53.463548+0000","last_peered":"2024-05-15T15:39:53.463548+0000","last_clean":"2024-05-15T15:39:53.463548+0000","last_became_active":"2024-05-15T15:39:51.456904+0000","last_became_peered":"2024-05-15T15:39:51.456904+0000","last_unstale":"2024-05-15T15:39:53.463548+0000","last_undegraded":"2024-05-15T15:39:53.463548+0000","last_fullsized":"2024-05-15T15:39:53.463548+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:45:30.896866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.464271+0000","last_change":"2024-05-15T15:39:52.461438+0000","last_active":"2024-05-15T15:39:53.464271+0000","last_peered":"2024-05-15T15:39:53.464271+0000","last_clean":"2024-05-15T15:39:53.464271+0000","last_became_active":"2024-05-15T15:39:52.460666+0000","last_became_peered":"2024-05-15T15:39:52.460666+0000","last_unstale":"2024-05-15T15:39:53.464271+0000","last_undegraded":"2024-05-15T15:39:53.464271+0000","last_fullsized":"2024-05-15T15:39:53.464271+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:35:07.996967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.462502+0000","last_change":"2024-05-15T15:39:51.444590+0000","last_active":"2024-05-15T15:39:53.462502+0000","last_peered":"2024-05-15T15:39:53.462502+0000","last_clean":"2024-05-15T15:39:53.462502+0000","last_became_active":"2024-05-15T15:39:51.444114+0000","last_became_peered":"2024-05-15T15:39:51.444114+0000","last_unstale":"2024-05-15T15:39:53.462502+0000","last_undegraded":"2024-05-15T15:39:53.462502+0000","last_fullsized":"2024-05-15T15:39:53.462502+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:17:33.373439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-15T15:39:51.437645+0000","last_change":"2024-05-15T15:39:51.437645+0000","last_active":"2024-05-15T15:39:51.428802+0000","last_peered":"2024-05-15T15:39:51.428802+0000","last_clean":"2024-05-15T15:39:51.428802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:39:51.437645+0000","last_undegraded":"2024-05-15T15:39:51.437645+0000","last_fullsized":"2024-05-15T15:39:51.437645+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.506255+0000","last_change":"2024-05-15T15:39:51.453203+0000","last_active":"2024-05-15T15:39:53.506255+0000","last_peered":"2024-05-15T15:39:53.506255+0000","last_clean":"2024-05-15T15:39:53.506255+0000","last_became_active":"2024-05-15T15:39:51.452835+0000","last_became_peered":"2024-05-15T15:39:51.452835+0000","last_unstale":"2024-05-15T15:39:53.506255+0000","last_undegraded":"2024-05-15T15:39:53.506255+0000","last_fullsized":"2024-05-15T15:39:53.506255+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:00:28.591473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057390+0000","last_change":"2024-05-15T15:39:52.467091+0000","last_active":"2024-05-15T15:39:54.057390+0000","last_peered":"2024-05-15T15:39:54.057390+0000","last_clean":"2024-05-15T15:39:54.057390+0000","last_became_active":"2024-05-15T15:39:52.465260+0000","last_became_peered":"2024-05-15T15:39:52.465260+0000","last_unstale":"2024-05-15T15:39:54.057390+0000","last_undegraded":"2024-05-15T15:39:54.057390+0000","last_fullsized":"2024-05-15T15:39:54.057390+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:46:06.269771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057238+0000","last_change":"2024-05-15T15:39:51.459005+0000","last_active":"2024-05-15T15:39:54.057238+0000","last_peered":"2024-05-15T15:39:54.057238+0000","last_clean":"2024-05-15T15:39:54.057238+0000","last_became_active":"2024-05-15T15:39:51.458484+0000","last_became_peered":"2024-05-15T15:39:51.458484+0000","last_unstale":"2024-05-15T15:39:54.057238+0000","last_undegraded":"2024-05-15T15:39:54.057238+0000","last_fullsized":"2024-05-15T15:39:54.057238+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:53:34.707481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.464984+0000","last_change":"2024-05-15T15:39:52.470997+0000","last_active":"2024-05-15T15:39:53.464984+0000","last_peered":"2024-05-15T15:39:53.464984+0000","last_clean":"2024-05-15T15:39:53.464984+0000","last_became_active":"2024-05-15T15:39:52.470669+0000","last_became_peered":"2024-05-15T15:39:52.470669+0000","last_unstale":"2024-05-15T15:39:53.464984+0000","last_undegraded":"2024-05-15T15:39:53.464984+0000","last_fullsized":"2024-05-15T15:39:53.464984+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:52:43.064362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.056727+0000","last_change":"2024-05-15T15:39:51.448163+0000","last_active":"2024-05-15T15:39:54.056727+0000","last_peered":"2024-05-15T15:39:54.056727+0000","last_clean":"2024-05-15T15:39:54.056727+0000","last_became_active":"2024-05-15T15:39:51.447878+0000","last_became_peered":"2024-05-15T15:39:51.447878+0000","last_unstale":"2024-05-15T15:39:54.056727+0000","last_undegraded":"2024-05-15T15:39:54.056727+0000","last_fullsized":"2024-05-15T15:39:54.056727+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:45:30.896866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.463183+0000","last_change":"2024-05-15T15:39:52.471719+0000","last_active":"2024-05-15T15:39:53.463183+0000","last_peered":"2024-05-15T15:39:53.463183+0000","last_clean":"2024-05-15T15:39:53.463183+0000","last_became_active":"2024-05-15T15:39:52.471352+0000","last_became_peered":"2024-05-15T15:39:52.471352+0000","last_unstale":"2024-05-15T15:39:53.463183+0000","last_undegraded":"2024-05-15T15:39:53.463183+0000","last_fullsized":"2024-05-15T15:39:53.463183+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:09:35.247678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"22'6","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.056826+0000","last_change":"2024-05-15T15:39:51.449551+0000","last_active":"2024-05-15T15:39:54.056826+0000","last_peered":"2024-05-15T15:39:54.056826+0000","last_clean":"2024-05-15T15:39:54.056826+0000","last_became_active":"2024-05-15T15:39:51.449185+0000","last_became_peered":"2024-05-15T15:39:51.449185+0000","last_unstale":"2024-05-15T15:39:54.056826+0000","last_undegraded":"2024-05-15T15:39:54.056826+0000","last_fullsized":"2024-05-15T15:39:54.056826+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:56:40.086761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057182+0000","last_change":"2024-05-15T15:39:52.477094+0000","last_active":"2024-05-15T15:39:54.057182+0000","last_peered":"2024-05-15T15:39:54.057182+0000","last_clean":"2024-05-15T15:39:54.057182+0000","last_became_active":"2024-05-15T15:39:52.476694+0000","last_became_peered":"2024-05-15T15:39:52.476694+0000","last_unstale":"2024-05-15T15:39:54.057182+0000","last_undegraded":"2024-05-15T15:39:54.057182+0000","last_fullsized":"2024-05-15T15:39:54.057182+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:48:53.088055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057190+0000","last_change":"2024-05-15T15:39:51.455537+0000","last_active":"2024-05-15T15:39:54.057190+0000","last_peered":"2024-05-15T15:39:54.057190+0000","last_clean":"2024-05-15T15:39:54.057190+0000","last_became_active":"2024-05-15T15:39:51.455169+0000","last_became_peered":"2024-05-15T15:39:51.455169+0000","last_unstale":"2024-05-15T15:39:54.057190+0000","last_undegraded":"2024-05-15T15:39:54.057190+0000","last_fullsized":"2024-05-15T15:39:54.057190+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:15:32.911265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.464093+0000","last_change":"2024-05-15T15:39:52.464580+0000","last_active":"2024-05-15T15:39:53.464093+0000","last_peered":"2024-05-15T15:39:53.464093+0000","last_clean":"2024-05-15T15:39:53.464093+0000","last_became_active":"2024-05-15T15:39:52.464252+0000","last_became_peered":"2024-05-15T15:39:52.464252+0000","last_unstale":"2024-05-15T15:39:53.464093+0000","last_undegraded":"2024-05-15T15:39:53.464093+0000","last_fullsized":"2024-05-15T15:39:53.464093+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:00:28.874513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.463192+0000","last_change":"2024-05-15T15:39:51.456191+0000","last_active":"2024-05-15T15:39:53.463192+0000","last_peered":"2024-05-15T15:39:53.463192+0000","last_clean":"2024-05-15T15:39:53.463192+0000","last_became_active":"2024-05-15T15:39:51.455844+0000","last_became_peered":"2024-05-15T15:39:51.455844+0000","last_unstale":"2024-05-15T15:39:53.463192+0000","last_undegraded":"2024-05-15T15:39:53.463192+0000","last_fullsized":"2024-05-15T15:39:53.463192+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:19:05.281175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.462897+0000","last_change":"2024-05-15T15:39:52.473375+0000","last_active":"2024-05-15T15:39:53.462897+0000","last_peered":"2024-05-15T15:39:53.462897+0000","last_clean":"2024-05-15T15:39:53.462897+0000","last_became_active":"2024-05-15T15:39:52.473046+0000","last_became_peered":"2024-05-15T15:39:52.473046+0000","last_unstale":"2024-05-15T15:39:53.462897+0000","last_undegraded":"2024-05-15T15:39:53.462897+0000","last_fullsized":"2024-05-15T15:39:53.462897+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:15:12.564736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.056485+0000","last_change":"2024-05-15T15:39:51.461928+0000","last_active":"2024-05-15T15:39:54.056485+0000","last_peered":"2024-05-15T15:39:54.056485+0000","last_clean":"2024-05-15T15:39:54.056485+0000","last_became_active":"2024-05-15T15:39:51.461604+0000","last_became_peered":"2024-05-15T15:39:51.461604+0000","last_unstale":"2024-05-15T15:39:54.056485+0000","last_undegraded":"2024-05-15T15:39:54.056485+0000","last_fullsized":"2024-05-15T15:39:54.056485+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:13:01.291506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.505919+0000","last_change":"2024-05-15T15:39:52.474668+0000","last_active":"2024-05-15T15:39:53.505919+0000","last_peered":"2024-05-15T15:39:53.505919+0000","last_clean":"2024-05-15T15:39:53.505919+0000","last_became_active":"2024-05-15T15:39:52.474222+0000","last_became_peered":"2024-05-15T15:39:52.474222+0000","last_unstale":"2024-05-15T15:39:53.505919+0000","last_undegraded":"2024-05-15T15:39:53.505919+0000","last_fullsized":"2024-05-15T15:39:53.505919+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:53:35.715007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T15:39:51.447890+0000","last_change":"2024-05-15T15:39:51.446711+0000","last_active":"2024-05-15T15:39:51.447890+0000","last_peered":"2024-05-15T15:39:51.447890+0000","last_clean":"2024-05-15T15:39:51.447890+0000","last_became_active":"2024-05-15T15:39:51.446392+0000","last_became_peered":"2024-05-15T15:39:51.446392+0000","last_unstale":"2024-05-15T15:39:51.447890+0000","last_undegraded":"2024-05-15T15:39:51.447890+0000","last_fullsized":"2024-05-15T15:39:51.447890+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:15:48.685660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.462447+0000","last_change":"2024-05-15T15:39:52.468710+0000","last_active":"2024-05-15T15:39:53.462447+0000","last_peered":"2024-05-15T15:39:53.462447+0000","last_clean":"2024-05-15T15:39:53.462447+0000","last_became_active":"2024-05-15T15:39:52.468364+0000","last_became_peered":"2024-05-15T15:39:52.468364+0000","last_unstale":"2024-05-15T15:39:53.462447+0000","last_undegraded":"2024-05-15T15:39:53.462447+0000","last_fullsized":"2024-05-15T15:39:53.462447+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:39:07.633570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057781+0000","last_change":"2024-05-15T15:39:51.454815+0000","last_active":"2024-05-15T15:39:54.057781+0000","last_peered":"2024-05-15T15:39:54.057781+0000","last_clean":"2024-05-15T15:39:54.057781+0000","last_became_active":"2024-05-15T15:39:51.454302+0000","last_became_peered":"2024-05-15T15:39:51.454302+0000","last_unstale":"2024-05-15T15:39:54.057781+0000","last_undegraded":"2024-05-15T15:39:54.057781+0000","last_fullsized":"2024-05-15T15:39:54.057781+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:52:26.020009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057590+0000","last_change":"2024-05-15T15:39:52.478397+0000","last_active":"2024-05-15T15:39:54.057590+0000","last_peered":"2024-05-15T15:39:54.057590+0000","last_clean":"2024-05-15T15:39:54.057590+0000","last_became_active":"2024-05-15T15:39:52.477855+0000","last_became_peered":"2024-05-15T15:39:52.477855+0000","last_unstale":"2024-05-15T15:39:54.057590+0000","last_undegraded":"2024-05-15T15:39:54.057590+0000","last_fullsized":"2024-05-15T15:39:54.057590+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:43:53.153262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T15:39:51.452447+0000","last_change":"2024-05-15T15:39:51.451802+0000","last_active":"2024-05-15T15:39:51.452447+0000","last_peered":"2024-05-15T15:39:51.452447+0000","last_clean":"2024-05-15T15:39:51.452447+0000","last_became_active":"2024-05-15T15:39:51.451413+0000","last_became_peered":"2024-05-15T15:39:51.451413+0000","last_unstale":"2024-05-15T15:39:51.452447+0000","last_undegraded":"2024-05-15T15:39:51.452447+0000","last_fullsized":"2024-05-15T15:39:51.452447+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:44:16.985300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057652+0000","last_change":"2024-05-15T15:39:52.477925+0000","last_active":"2024-05-15T15:39:54.057652+0000","last_peered":"2024-05-15T15:39:54.057652+0000","last_clean":"2024-05-15T15:39:54.057652+0000","last_became_active":"2024-05-15T15:39:52.477255+0000","last_became_peered":"2024-05-15T15:39:52.477255+0000","last_unstale":"2024-05-15T15:39:54.057652+0000","last_undegraded":"2024-05-15T15:39:54.057652+0000","last_fullsized":"2024-05-15T15:39:54.057652+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:39:07.633570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.464272+0000","last_change":"2024-05-15T15:39:51.450383+0000","last_active":"2024-05-15T15:39:53.464272+0000","last_peered":"2024-05-15T15:39:53.464272+0000","last_clean":"2024-05-15T15:39:53.464272+0000","last_became_active":"2024-05-15T15:39:51.449318+0000","last_became_peered":"2024-05-15T15:39:51.449318+0000","last_unstale":"2024-05-15T15:39:53.464272+0000","last_undegraded":"2024-05-15T15:39:53.464272+0000","last_fullsized":"2024-05-15T15:39:53.464272+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:17:33.373439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057489+0000","last_change":"2024-05-15T15:39:52.471316+0000","last_active":"2024-05-15T15:39:54.057489+0000","last_peered":"2024-05-15T15:39:54.057489+0000","last_clean":"2024-05-15T15:39:54.057489+0000","last_became_active":"2024-05-15T15:39:52.471014+0000","last_became_peered":"2024-05-15T15:39:52.471014+0000","last_unstale":"2024-05-15T15:39:54.057489+0000","last_undegraded":"2024-05-15T15:39:54.057489+0000","last_fullsized":"2024-05-15T15:39:54.057489+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:52:43.064362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.463830+0000","last_change":"2024-05-15T15:39:51.454584+0000","last_active":"2024-05-15T15:39:53.463830+0000","last_peered":"2024-05-15T15:39:53.463830+0000","last_clean":"2024-05-15T15:39:53.463830+0000","last_became_active":"2024-05-15T15:39:51.454260+0000","last_became_peered":"2024-05-15T15:39:51.454260+0000","last_unstale":"2024-05-15T15:39:53.463830+0000","last_undegraded":"2024-05-15T15:39:53.463830+0000","last_fullsized":"2024-05-15T15:39:53.463830+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:17:48.368852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.462838+0000","last_change":"2024-05-15T15:39:52.464130+0000","last_active":"2024-05-15T15:39:53.462838+0000","last_peered":"2024-05-15T15:39:53.462838+0000","last_clean":"2024-05-15T15:39:53.462838+0000","last_became_active":"2024-05-15T15:39:52.463486+0000","last_became_peered":"2024-05-15T15:39:52.463486+0000","last_unstale":"2024-05-15T15:39:53.462838+0000","last_undegraded":"2024-05-15T15:39:53.462838+0000","last_fullsized":"2024-05-15T15:39:53.462838+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:58:23.539973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":110,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.505802+0000","last_change":"2024-05-15T15:39:42.584601+0000","last_active":"2024-05-15T15:39:53.505802+0000","last_peered":"2024-05-15T15:39:53.505802+0000","last_clean":"2024-05-15T15:39:53.505802+0000","last_became_active":"2024-05-15T15:39:42.584129+0000","last_became_peered":"2024-05-15T15:39:42.584129+0000","last_unstale":"2024-05-15T15:39:53.505802+0000","last_undegraded":"2024-05-15T15:39:53.505802+0000","last_fullsized":"2024-05-15T15:39:53.505802+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:41.378107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:41.378107+0000","last_clean_scrub_stamp":"2024-05-15T15:39:41.378107+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:23:25.285669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.462726+0000","last_change":"2024-05-15T15:39:51.451749+0000","last_active":"2024-05-15T15:39:53.462726+0000","last_peered":"2024-05-15T15:39:53.462726+0000","last_clean":"2024-05-15T15:39:53.462726+0000","last_became_active":"2024-05-15T15:39:51.451438+0000","last_became_peered":"2024-05-15T15:39:51.451438+0000","last_unstale":"2024-05-15T15:39:53.462726+0000","last_undegraded":"2024-05-15T15:39:53.462726+0000","last_fullsized":"2024-05-15T15:39:53.462726+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:46:05.262245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-15T15:39:51.438340+0000","last_change":"2024-05-15T15:39:51.438340+0000","last_active":"2024-05-15T15:39:51.428802+0000","last_peered":"2024-05-15T15:39:51.428802+0000","last_clean":"2024-05-15T15:39:51.428802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:39:51.438340+0000","last_undegraded":"2024-05-15T15:39:51.438340+0000","last_fullsized":"2024-05-15T15:39:51.438340+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.462612+0000","last_change":"2024-05-15T15:39:51.457051+0000","last_active":"2024-05-15T15:39:53.462612+0000","last_peered":"2024-05-15T15:39:53.462612+0000","last_clean":"2024-05-15T15:39:53.462612+0000","last_became_active":"2024-05-15T15:39:51.456748+0000","last_became_peered":"2024-05-15T15:39:51.456748+0000","last_unstale":"2024-05-15T15:39:53.462612+0000","last_undegraded":"2024-05-15T15:39:53.462612+0000","last_fullsized":"2024-05-15T15:39:53.462612+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:53:34.707481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.463666+0000","last_change":"2024-05-15T15:39:52.467728+0000","last_active":"2024-05-15T15:39:53.463666+0000","last_peered":"2024-05-15T15:39:53.463666+0000","last_clean":"2024-05-15T15:39:53.463666+0000","last_became_active":"2024-05-15T15:39:52.467352+0000","last_became_peered":"2024-05-15T15:39:52.467352+0000","last_unstale":"2024-05-15T15:39:53.463666+0000","last_undegraded":"2024-05-15T15:39:53.463666+0000","last_fullsized":"2024-05-15T15:39:53.463666+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:19:06.288701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.056496+0000","last_change":"2024-05-15T15:39:51.454058+0000","last_active":"2024-05-15T15:39:54.056496+0000","last_peered":"2024-05-15T15:39:54.056496+0000","last_clean":"2024-05-15T15:39:54.056496+0000","last_became_active":"2024-05-15T15:39:51.453765+0000","last_became_peered":"2024-05-15T15:39:51.453765+0000","last_unstale":"2024-05-15T15:39:54.056496+0000","last_undegraded":"2024-05-15T15:39:54.056496+0000","last_fullsized":"2024-05-15T15:39:54.056496+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:17:48.368852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.464095+0000","last_change":"2024-05-15T15:39:52.474812+0000","last_active":"2024-05-15T15:39:53.464095+0000","last_peered":"2024-05-15T15:39:53.464095+0000","last_clean":"2024-05-15T15:39:53.464095+0000","last_became_active":"2024-05-15T15:39:52.472883+0000","last_became_peered":"2024-05-15T15:39:52.472883+0000","last_unstale":"2024-05-15T15:39:53.464095+0000","last_undegraded":"2024-05-15T15:39:53.464095+0000","last_fullsized":"2024-05-15T15:39:53.464095+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:00:05.496148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.463124+0000","last_change":"2024-05-15T15:39:51.449647+0000","last_active":"2024-05-15T15:39:53.463124+0000","last_peered":"2024-05-15T15:39:53.463124+0000","last_clean":"2024-05-15T15:39:53.463124+0000","last_became_active":"2024-05-15T15:39:51.449332+0000","last_became_peered":"2024-05-15T15:39:51.449332+0000","last_unstale":"2024-05-15T15:39:53.463124+0000","last_undegraded":"2024-05-15T15:39:53.463124+0000","last_fullsized":"2024-05-15T15:39:53.463124+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:43:52.145736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.056740+0000","last_change":"2024-05-15T15:39:52.479896+0000","last_active":"2024-05-15T15:39:54.056740+0000","last_peered":"2024-05-15T15:39:54.056740+0000","last_clean":"2024-05-15T15:39:54.056740+0000","last_became_active":"2024-05-15T15:39:52.479462+0000","last_became_peered":"2024-05-15T15:39:52.479462+0000","last_unstale":"2024-05-15T15:39:54.056740+0000","last_undegraded":"2024-05-15T15:39:54.056740+0000","last_fullsized":"2024-05-15T15:39:54.056740+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:00:05.496148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.463525+0000","last_change":"2024-05-15T15:39:51.450193+0000","last_active":"2024-05-15T15:39:53.463525+0000","last_peered":"2024-05-15T15:39:53.463525+0000","last_clean":"2024-05-15T15:39:53.463525+0000","last_became_active":"2024-05-15T15:39:51.449868+0000","last_became_peered":"2024-05-15T15:39:51.449868+0000","last_unstale":"2024-05-15T15:39:53.463525+0000","last_undegraded":"2024-05-15T15:39:53.463525+0000","last_fullsized":"2024-05-15T15:39:53.463525+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:13:01.291506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057411+0000","last_change":"2024-05-15T15:39:52.466700+0000","last_active":"2024-05-15T15:39:54.057411+0000","last_peered":"2024-05-15T15:39:54.057411+0000","last_clean":"2024-05-15T15:39:54.057411+0000","last_became_active":"2024-05-15T15:39:52.464696+0000","last_became_peered":"2024-05-15T15:39:52.464696+0000","last_unstale":"2024-05-15T15:39:54.057411+0000","last_undegraded":"2024-05-15T15:39:54.057411+0000","last_fullsized":"2024-05-15T15:39:54.057411+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:14:40.347641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.463133+0000","last_change":"2024-05-15T15:39:51.449690+0000","last_active":"2024-05-15T15:39:53.463133+0000","last_peered":"2024-05-15T15:39:53.463133+0000","last_clean":"2024-05-15T15:39:53.463133+0000","last_became_active":"2024-05-15T15:39:51.448404+0000","last_became_peered":"2024-05-15T15:39:51.448404+0000","last_unstale":"2024-05-15T15:39:53.463133+0000","last_undegraded":"2024-05-15T15:39:53.463133+0000","last_fullsized":"2024-05-15T15:39:53.463133+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:56:23.235022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.463699+0000","last_change":"2024-05-15T15:39:52.475321+0000","last_active":"2024-05-15T15:39:53.463699+0000","last_peered":"2024-05-15T15:39:53.463699+0000","last_clean":"2024-05-15T15:39:53.463699+0000","last_became_active":"2024-05-15T15:39:52.475018+0000","last_became_peered":"2024-05-15T15:39:52.475018+0000","last_unstale":"2024-05-15T15:39:53.463699+0000","last_undegraded":"2024-05-15T15:39:53.463699+0000","last_fullsized":"2024-05-15T15:39:53.463699+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:43:53.153262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T15:39:51.456912+0000","last_change":"2024-05-15T15:39:51.455435+0000","last_active":"2024-05-15T15:39:51.456912+0000","last_peered":"2024-05-15T15:39:51.456912+0000","last_clean":"2024-05-15T15:39:51.456912+0000","last_became_active":"2024-05-15T15:39:51.455047+0000","last_became_peered":"2024-05-15T15:39:51.455047+0000","last_unstale":"2024-05-15T15:39:51.456912+0000","last_undegraded":"2024-05-15T15:39:51.456912+0000","last_fullsized":"2024-05-15T15:39:51.456912+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:16:06.081249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-15T15:39:51.439295+0000","last_change":"2024-05-15T15:39:51.439295+0000","last_active":"2024-05-15T15:39:51.428802+0000","last_peered":"2024-05-15T15:39:51.428802+0000","last_clean":"2024-05-15T15:39:51.428802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:39:51.439295+0000","last_undegraded":"2024-05-15T15:39:51.439295+0000","last_fullsized":"2024-05-15T15:39:51.439295+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.463011+0000","last_change":"2024-05-15T15:39:51.456218+0000","last_active":"2024-05-15T15:39:53.463011+0000","last_peered":"2024-05-15T15:39:53.463011+0000","last_clean":"2024-05-15T15:39:53.463011+0000","last_became_active":"2024-05-15T15:39:51.455592+0000","last_became_peered":"2024-05-15T15:39:51.455592+0000","last_unstale":"2024-05-15T15:39:53.463011+0000","last_undegraded":"2024-05-15T15:39:53.463011+0000","last_fullsized":"2024-05-15T15:39:53.463011+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:14:39.340114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-15T15:39:51.438842+0000","last_change":"2024-05-15T15:39:51.438842+0000","last_active":"2024-05-15T15:39:51.428802+0000","last_peered":"2024-05-15T15:39:51.428802+0000","last_clean":"2024-05-15T15:39:51.428802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:39:51.438842+0000","last_undegraded":"2024-05-15T15:39:51.438842+0000","last_fullsized":"2024-05-15T15:39:51.438842+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.056270+0000","last_change":"2024-05-15T15:39:51.456266+0000","last_active":"2024-05-15T15:39:54.056270+0000","last_peered":"2024-05-15T15:39:54.056270+0000","last_clean":"2024-05-15T15:39:54.056270+0000","last_became_active":"2024-05-15T15:39:51.455914+0000","last_became_peered":"2024-05-15T15:39:51.455914+0000","last_unstale":"2024-05-15T15:39:54.056270+0000","last_undegraded":"2024-05-15T15:39:54.056270+0000","last_fullsized":"2024-05-15T15:39:54.056270+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:18:35.801621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.463115+0000","last_change":"2024-05-15T15:39:52.462843+0000","last_active":"2024-05-15T15:39:53.463115+0000","last_peered":"2024-05-15T15:39:53.463115+0000","last_clean":"2024-05-15T15:39:53.463115+0000","last_became_active":"2024-05-15T15:39:52.459592+0000","last_became_peered":"2024-05-15T15:39:52.459592+0000","last_unstale":"2024-05-15T15:39:53.463115+0000","last_undegraded":"2024-05-15T15:39:53.463115+0000","last_fullsized":"2024-05-15T15:39:53.463115+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:19:16.899508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T15:39:51.457637+0000","last_change":"2024-05-15T15:39:51.456133+0000","last_active":"2024-05-15T15:39:51.457637+0000","last_peered":"2024-05-15T15:39:51.457637+0000","last_clean":"2024-05-15T15:39:51.457637+0000","last_became_active":"2024-05-15T15:39:51.455602+0000","last_became_peered":"2024-05-15T15:39:51.455602+0000","last_unstale":"2024-05-15T15:39:51.457637+0000","last_undegraded":"2024-05-15T15:39:51.457637+0000","last_fullsized":"2024-05-15T15:39:51.457637+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:04:40.612468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-15T15:39:51.437692+0000","last_change":"2024-05-15T15:39:51.437692+0000","last_active":"2024-05-15T15:39:51.428802+0000","last_peered":"2024-05-15T15:39:51.428802+0000","last_clean":"2024-05-15T15:39:51.428802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:39:51.437692+0000","last_undegraded":"2024-05-15T15:39:51.437692+0000","last_fullsized":"2024-05-15T15:39:51.437692+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.464110+0000","last_change":"2024-05-15T15:39:51.453591+0000","last_active":"2024-05-15T15:39:53.464110+0000","last_peered":"2024-05-15T15:39:53.464110+0000","last_clean":"2024-05-15T15:39:53.464110+0000","last_became_active":"2024-05-15T15:39:51.453250+0000","last_became_peered":"2024-05-15T15:39:51.453250+0000","last_unstale":"2024-05-15T15:39:53.464110+0000","last_undegraded":"2024-05-15T15:39:53.464110+0000","last_fullsized":"2024-05-15T15:39:53.464110+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:15:32.911265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057214+0000","last_change":"2024-05-15T15:39:52.469345+0000","last_active":"2024-05-15T15:39:54.057214+0000","last_peered":"2024-05-15T15:39:54.057214+0000","last_clean":"2024-05-15T15:39:54.057214+0000","last_became_active":"2024-05-15T15:39:52.469041+0000","last_became_peered":"2024-05-15T15:39:52.469041+0000","last_unstale":"2024-05-15T15:39:54.057214+0000","last_undegraded":"2024-05-15T15:39:54.057214+0000","last_fullsized":"2024-05-15T15:39:54.057214+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:52:27.027535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.462608+0000","last_change":"2024-05-15T15:39:51.450991+0000","last_active":"2024-05-15T15:39:53.462608+0000","last_peered":"2024-05-15T15:39:53.462608+0000","last_clean":"2024-05-15T15:39:53.462608+0000","last_became_active":"2024-05-15T15:39:51.450600+0000","last_became_peered":"2024-05-15T15:39:51.450600+0000","last_unstale":"2024-05-15T15:39:53.462608+0000","last_undegraded":"2024-05-15T15:39:53.462608+0000","last_fullsized":"2024-05-15T15:39:53.462608+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:49:26.650770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.462903+0000","last_change":"2024-05-15T15:39:52.462106+0000","last_active":"2024-05-15T15:39:53.462903+0000","last_peered":"2024-05-15T15:39:53.462903+0000","last_clean":"2024-05-15T15:39:53.462903+0000","last_became_active":"2024-05-15T15:39:52.461217+0000","last_became_peered":"2024-05-15T15:39:52.461217+0000","last_unstale":"2024-05-15T15:39:53.462903+0000","last_undegraded":"2024-05-15T15:39:53.462903+0000","last_fullsized":"2024-05-15T15:39:53.462903+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:41:33.947325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.462652+0000","last_change":"2024-05-15T15:39:52.473917+0000","last_active":"2024-05-15T15:39:53.462652+0000","last_peered":"2024-05-15T15:39:53.462652+0000","last_clean":"2024-05-15T15:39:53.462652+0000","last_became_active":"2024-05-15T15:39:52.472408+0000","last_became_peered":"2024-05-15T15:39:52.472408+0000","last_unstale":"2024-05-15T15:39:53.462652+0000","last_undegraded":"2024-05-15T15:39:53.462652+0000","last_fullsized":"2024-05-15T15:39:53.462652+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:39:30.074726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057634+0000","last_change":"2024-05-15T15:39:51.458878+0000","last_active":"2024-05-15T15:39:54.057634+0000","last_peered":"2024-05-15T15:39:54.057634+0000","last_clean":"2024-05-15T15:39:54.057634+0000","last_became_active":"2024-05-15T15:39:51.458527+0000","last_became_peered":"2024-05-15T15:39:51.458527+0000","last_unstale":"2024-05-15T15:39:54.057634+0000","last_undegraded":"2024-05-15T15:39:54.057634+0000","last_fullsized":"2024-05-15T15:39:54.057634+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:14:39.340114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.506342+0000","last_change":"2024-05-15T15:39:52.479684+0000","last_active":"2024-05-15T15:39:53.506342+0000","last_peered":"2024-05-15T15:39:53.506342+0000","last_clean":"2024-05-15T15:39:53.506342+0000","last_became_active":"2024-05-15T15:39:52.479359+0000","last_became_peered":"2024-05-15T15:39:52.479359+0000","last_unstale":"2024-05-15T15:39:53.506342+0000","last_undegraded":"2024-05-15T15:39:53.506342+0000","last_fullsized":"2024-05-15T15:39:53.506342+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:14:40.347641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057324+0000","last_change":"2024-05-15T15:39:51.459312+0000","last_active":"2024-05-15T15:39:54.057324+0000","last_peered":"2024-05-15T15:39:54.057324+0000","last_clean":"2024-05-15T15:39:54.057324+0000","last_became_active":"2024-05-15T15:39:51.458739+0000","last_became_peered":"2024-05-15T15:39:51.458739+0000","last_unstale":"2024-05-15T15:39:54.057324+0000","last_undegraded":"2024-05-15T15:39:54.057324+0000","last_fullsized":"2024-05-15T15:39:54.057324+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:17:33.373439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.464791+0000","last_change":"2024-05-15T15:39:52.472300+0000","last_active":"2024-05-15T15:39:53.464791+0000","last_peered":"2024-05-15T15:39:53.464791+0000","last_clean":"2024-05-15T15:39:53.464791+0000","last_became_active":"2024-05-15T15:39:52.472005+0000","last_became_peered":"2024-05-15T15:39:52.472005+0000","last_unstale":"2024-05-15T15:39:53.464791+0000","last_undegraded":"2024-05-15T15:39:53.464791+0000","last_fullsized":"2024-05-15T15:39:53.464791+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:18:51.904529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.465122+0000","last_change":"2024-05-15T15:39:51.451702+0000","last_active":"2024-05-15T15:39:53.465122+0000","last_peered":"2024-05-15T15:39:53.465122+0000","last_clean":"2024-05-15T15:39:53.465122+0000","last_became_active":"2024-05-15T15:39:51.451387+0000","last_became_peered":"2024-05-15T15:39:51.451387+0000","last_unstale":"2024-05-15T15:39:53.465122+0000","last_undegraded":"2024-05-15T15:39:53.465122+0000","last_fullsized":"2024-05-15T15:39:53.465122+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:23:00.828647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.465209+0000","last_change":"2024-05-15T15:39:52.473199+0000","last_active":"2024-05-15T15:39:53.465209+0000","last_peered":"2024-05-15T15:39:53.465209+0000","last_clean":"2024-05-15T15:39:53.465209+0000","last_became_active":"2024-05-15T15:39:52.472848+0000","last_became_peered":"2024-05-15T15:39:52.472848+0000","last_unstale":"2024-05-15T15:39:53.465209+0000","last_undegraded":"2024-05-15T15:39:53.465209+0000","last_fullsized":"2024-05-15T15:39:53.465209+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:39:30.074726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T15:39:51.447704+0000","last_change":"2024-05-15T15:39:51.445161+0000","last_active":"2024-05-15T15:39:51.447704+0000","last_peered":"2024-05-15T15:39:51.447704+0000","last_clean":"2024-05-15T15:39:51.447704+0000","last_became_active":"2024-05-15T15:39:51.444855+0000","last_became_peered":"2024-05-15T15:39:51.444855+0000","last_unstale":"2024-05-15T15:39:51.447704+0000","last_undegraded":"2024-05-15T15:39:51.447704+0000","last_fullsized":"2024-05-15T15:39:51.447704+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:58:42.762068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1828,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24,"ondisk_log_size":24,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509445,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":241664,"data_stored":81359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509445,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":233472,"data_stored":81235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509446,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27836,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":835584,"data_stored":671695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":237568,"data_stored":81817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":233472,"data_stored":76547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509446,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":831488,"data_stored":671673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509445,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":229376,"data_stored":74991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":196608,"data_stored":61885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-15T15:39:56.906 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-15T15:39:57.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.050+0000 7fb440243640 1 Processor -- start 2024-05-15T15:39:57.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.050+0000 7fb440243640 1 -- start start 2024-05-15T15:39:57.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.051+0000 7fb440243640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb4380be4f0 0x7fb4380bfef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:57.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.051+0000 7fb440243640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb43814cce0 0x7fb4380716a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:57.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.051+0000 7fb440243640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb438071be0 0x7fb43814f980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:57.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.051+0000 7fb440243640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fb4380bfa60 con 0x7fb4380be4f0 2024-05-15T15:39:57.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.051+0000 7fb440243640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7fb438071310 con 0x7fb438071be0 2024-05-15T15:39:57.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.051+0000 7fb440243640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fb4380723b0 con 0x7fb43814cce0 2024-05-15T15:39:57.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.051+0000 7fb43dfdf640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb4380be4f0 0x7fb4380bfef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:57.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.051+0000 7fb43dfdf640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb4380be4f0 0x7fb4380bfef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59362/0 (socket says 172.21.15.12:59362) 2024-05-15T15:39:57.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.051+0000 7fb43dfdf640 1 -- 172.21.15.12:0/2809336301 learned_addr learned my addr 172.21.15.12:0/2809336301 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:39:57.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.052+0000 7fb43e7e0640 1 --2- 172.21.15.12:0/2809336301 >> v2:172.21.15.84:3300/0 conn(0x7fb438071be0 0x7fb43814f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:57.055 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.052+0000 7fb43d7de640 1 --2- 172.21.15.12:0/2809336301 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb43814cce0 0x7fb4380716a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:57.055 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.052+0000 7fb43dfdf640 1 -- 172.21.15.12:0/2809336301 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb43814cce0 msgr2=0x7fb4380716a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:39:57.055 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.052+0000 7fb43dfdf640 1 --2- 172.21.15.12:0/2809336301 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb43814cce0 0x7fb4380716a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:57.055 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.052+0000 7fb43dfdf640 1 -- 172.21.15.12:0/2809336301 >> v2:172.21.15.84:3300/0 conn(0x7fb438071be0 msgr2=0x7fb43814f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:39:57.055 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.052+0000 7fb43dfdf640 1 --2- 172.21.15.12:0/2809336301 >> v2:172.21.15.84:3300/0 conn(0x7fb438071be0 0x7fb43814f980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:57.055 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.052+0000 7fb43dfdf640 1 -- 172.21.15.12:0/2809336301 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4380720d0 con 0x7fb4380be4f0 2024-05-15T15:39:57.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.053+0000 7fb43dfdf640 1 --2- 172.21.15.12:0/2809336301 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb4380be4f0 0x7fb4380bfef0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb4380727b0 tx=0x7fb43002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0e2d25873377dd6 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:39:57.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.053+0000 7fb43cfdd640 1 -- 172.21.15.12:0/2809336301 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb430037070 con 0x7fb4380be4f0 2024-05-15T15:39:57.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.053+0000 7fb43cfdd640 1 -- 172.21.15.12:0/2809336301 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb430032440 con 0x7fb4380be4f0 2024-05-15T15:39:57.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.053+0000 7fb43cfdd640 1 -- 172.21.15.12:0/2809336301 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb430032810 con 0x7fb4380be4f0 2024-05-15T15:39:57.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.053+0000 7fb440243640 1 -- 172.21.15.12:0/2809336301 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb4380be4f0 msgr2=0x7fb4380bfef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:57.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.053+0000 7fb440243640 1 --2- 172.21.15.12:0/2809336301 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb4380be4f0 0x7fb4380bfef0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb4380727b0 tx=0x7fb43002a140 comp rx=0 tx=0).stop 2024-05-15T15:39:57.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.054+0000 7fb440243640 1 -- 172.21.15.12:0/2809336301 shutdown_connections 2024-05-15T15:39:57.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.054+0000 7fb440243640 1 --2- 172.21.15.12:0/2809336301 >> v2:172.21.15.84:3300/0 conn(0x7fb438071be0 0x7fb43814f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:57.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.054+0000 7fb440243640 1 --2- 172.21.15.12:0/2809336301 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb43814cce0 0x7fb4380716a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:57.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.054+0000 7fb440243640 1 --2- 172.21.15.12:0/2809336301 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb4380be4f0 0x7fb4380bfef0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:57.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.054+0000 7fb440243640 1 -- 172.21.15.12:0/2809336301 >> 172.21.15.12:0/2809336301 conn(0x7fb4380c17c0 msgr2=0x7fb4380c1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:39:57.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.054+0000 7fb440243640 1 -- 172.21.15.12:0/2809336301 shutdown_connections 2024-05-15T15:39:57.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.054+0000 7fb440243640 1 -- 172.21.15.12:0/2809336301 wait complete. 2024-05-15T15:39:57.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.055+0000 7fb440243640 1 Processor -- start 2024-05-15T15:39:57.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.055+0000 7fb440243640 1 -- start start 2024-05-15T15:39:57.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.056+0000 7fb440243640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb438071be0 0x7fb4380a2840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:57.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.056+0000 7fb440243640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb4380be4f0 0x7fb438142f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:57.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.056+0000 7fb440243640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb43814cce0 0x7fb4380a0190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:57.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.056+0000 7fb440243640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fb4380c0430 con 0x7fb43814cce0 2024-05-15T15:39:57.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.056+0000 7fb440243640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fb4380be900 con 0x7fb438071be0 2024-05-15T15:39:57.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.056+0000 7fb440243640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fb4380a6c90 con 0x7fb4380be4f0 2024-05-15T15:39:57.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.056+0000 7fb43e7e0640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb43814cce0 0x7fb4380a0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:57.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.056+0000 7fb43e7e0640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb43814cce0 0x7fb4380a0190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59370/0 (socket says 172.21.15.12:59370) 2024-05-15T15:39:57.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.056+0000 7fb43e7e0640 1 -- 172.21.15.12:0/1249987086 learned_addr learned my addr 172.21.15.12:0/1249987086 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:39:57.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.056+0000 7fb43d7de640 1 --2- 172.21.15.12:0/1249987086 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb4380be4f0 0x7fb438142f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:57.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.056+0000 7fb43dfdf640 1 --2- 172.21.15.12:0/1249987086 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb438071be0 0x7fb4380a2840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:57.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.057+0000 7fb43e7e0640 1 -- 172.21.15.12:0/1249987086 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb4380be4f0 msgr2=0x7fb438142f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:57.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.057+0000 7fb43e7e0640 1 --2- 172.21.15.12:0/1249987086 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb4380be4f0 0x7fb438142f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:57.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.057+0000 7fb43e7e0640 1 -- 172.21.15.12:0/1249987086 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb438071be0 msgr2=0x7fb4380a2840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:57.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.057+0000 7fb43e7e0640 1 --2- 172.21.15.12:0/1249987086 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb438071be0 0x7fb4380a2840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:57.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.057+0000 7fb43e7e0640 1 -- 172.21.15.12:0/1249987086 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4380a2d80 con 0x7fb43814cce0 2024-05-15T15:39:57.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.057+0000 7fb43e7e0640 1 --2- 172.21.15.12:0/1249987086 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb43814cce0 0x7fb4380a0190 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb428007d20 tx=0x7fb42800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:39:57.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.057+0000 7fb4367fc640 1 -- 172.21.15.12:0/1249987086 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb428014420 con 0x7fb43814cce0 2024-05-15T15:39:57.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.057+0000 7fb4367fc640 1 -- 172.21.15.12:0/1249987086 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb428019070 con 0x7fb43814cce0 2024-05-15T15:39:57.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.057+0000 7fb440243640 1 -- 172.21.15.12:0/1249987086 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4381434a0 con 0x7fb43814cce0 2024-05-15T15:39:57.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.057+0000 7fb4367fc640 1 -- 172.21.15.12:0/1249987086 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb428014820 con 0x7fb43814cce0 2024-05-15T15:39:57.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.057+0000 7fb440243640 1 -- 172.21.15.12:0/1249987086 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb438143940 con 0x7fb43814cce0 2024-05-15T15:39:57.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.058+0000 7fb440243640 1 -- 172.21.15.12:0/1249987086 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb438050940 con 0x7fb43814cce0 2024-05-15T15:39:57.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.059+0000 7fb4367fc640 1 -- 172.21.15.12:0/1249987086 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb4280149c0 con 0x7fb43814cce0 2024-05-15T15:39:57.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.059+0000 7fb4367fc640 1 --2- 172.21.15.12:0/1249987086 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fb424076300 0x7fb424078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:57.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.060+0000 7fb4367fc640 1 -- 172.21.15.12:0/1249987086 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fb428097cf0 con 0x7fb43814cce0 2024-05-15T15:39:57.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.060+0000 7fb43dfdf640 1 --2- 172.21.15.12:0/1249987086 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fb424076300 0x7fb424078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:57.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.060+0000 7fb43dfdf640 1 --2- 172.21.15.12:0/1249987086 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fb424076300 0x7fb424078810 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb430034000 tx=0x7fb43002e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:39:57.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.064+0000 7fb4367fc640 1 -- 172.21.15.12:0/1249987086 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fb42809c070 con 0x7fb43814cce0 2024-05-15T15:39:57.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.250+0000 7fb440243640 1 -- 172.21.15.12:0/1249987086 --> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb438144890 con 0x7fb424076300 2024-05-15T15:39:57.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.256+0000 7fb4367fc640 1 -- 172.21.15.12:0/1249987086 <== mgr.4106 v2:172.21.15.84:6832/4173299311 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251340 (secure 0 0 0) 0x7fb438144890 con 0x7fb424076300 2024-05-15T15:39:57.260 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-05-15T15:39:57.262 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-05-15T15:39:57.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.259+0000 7fb440243640 1 -- 172.21.15.12:0/1249987086 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fb424076300 msgr2=0x7fb424078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:57.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.259+0000 7fb440243640 1 --2- 172.21.15.12:0/1249987086 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fb424076300 0x7fb424078810 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb430034000 tx=0x7fb43002e000 comp rx=0 tx=0).stop 2024-05-15T15:39:57.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.259+0000 7fb440243640 1 -- 172.21.15.12:0/1249987086 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb43814cce0 msgr2=0x7fb4380a0190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:57.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.259+0000 7fb440243640 1 --2- 172.21.15.12:0/1249987086 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb43814cce0 0x7fb4380a0190 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb428007d20 tx=0x7fb42800e4b0 comp rx=0 tx=0).stop 2024-05-15T15:39:57.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.259+0000 7fb440243640 1 -- 172.21.15.12:0/1249987086 shutdown_connections 2024-05-15T15:39:57.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.259+0000 7fb440243640 1 --2- 172.21.15.12:0/1249987086 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fb424076300 0x7fb424078810 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:57.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.259+0000 7fb440243640 1 --2- 172.21.15.12:0/1249987086 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb43814cce0 0x7fb4380a0190 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:57.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.259+0000 7fb440243640 1 --2- 172.21.15.12:0/1249987086 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb4380be4f0 0x7fb438142f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:57.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.259+0000 7fb440243640 1 --2- 172.21.15.12:0/1249987086 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb438071be0 0x7fb4380a2840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:57.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.259+0000 7fb440243640 1 -- 172.21.15.12:0/1249987086 >> 172.21.15.12:0/1249987086 conn(0x7fb4380c17c0 msgr2=0x7fb4380bcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:39:57.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.259+0000 7fb440243640 1 -- 172.21.15.12:0/1249987086 shutdown_connections 2024-05-15T15:39:57.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.259+0000 7fb440243640 1 -- 172.21.15.12:0/1249987086 wait complete. 2024-05-15T15:39:57.272 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2024-05-15T15:39:56.701057+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592196,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":126,"num_write_kb":1641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":96,"ondisk_log_size":96,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":129,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219144,"kb_used_data":2968,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755576,"statfs":{"total":773094113280,"available":772869709824,"internally_reserved":0,"allocated":3039232,"data_stored":1801202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1828,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001482"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057108+0000","last_change":"2024-05-15T15:39:52.474245+0000","last_active":"2024-05-15T15:39:54.057108+0000","last_peered":"2024-05-15T15:39:54.057108+0000","last_clean":"2024-05-15T15:39:54.057108+0000","last_became_active":"2024-05-15T15:39:52.473919+0000","last_became_peered":"2024-05-15T15:39:52.473919+0000","last_unstale":"2024-05-15T15:39:54.057108+0000","last_undegraded":"2024-05-15T15:39:54.057108+0000","last_fullsized":"2024-05-15T15:39:54.057108+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:35:07.996967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.464974+0000","last_change":"2024-05-15T15:39:52.472587+0000","last_active":"2024-05-15T15:39:53.464974+0000","last_peered":"2024-05-15T15:39:53.464974+0000","last_clean":"2024-05-15T15:39:53.464974+0000","last_became_active":"2024-05-15T15:39:52.472268+0000","last_became_peered":"2024-05-15T15:39:52.472268+0000","last_unstale":"2024-05-15T15:39:53.464974+0000","last_undegraded":"2024-05-15T15:39:53.464974+0000","last_fullsized":"2024-05-15T15:39:53.464974+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:39:07.633570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.464154+0000","last_change":"2024-05-15T15:39:52.474404+0000","last_active":"2024-05-15T15:39:53.464154+0000","last_peered":"2024-05-15T15:39:53.464154+0000","last_clean":"2024-05-15T15:39:53.464154+0000","last_became_active":"2024-05-15T15:39:52.474102+0000","last_became_peered":"2024-05-15T15:39:52.474102+0000","last_unstale":"2024-05-15T15:39:53.464154+0000","last_undegraded":"2024-05-15T15:39:53.464154+0000","last_fullsized":"2024-05-15T15:39:53.464154+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:13:19.570085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.056856+0000","last_change":"2024-05-15T15:39:52.462504+0000","last_active":"2024-05-15T15:39:54.056856+0000","last_peered":"2024-05-15T15:39:54.056856+0000","last_clean":"2024-05-15T15:39:54.056856+0000","last_became_active":"2024-05-15T15:39:52.462135+0000","last_became_peered":"2024-05-15T15:39:52.462135+0000","last_unstale":"2024-05-15T15:39:54.056856+0000","last_undegraded":"2024-05-15T15:39:54.056856+0000","last_fullsized":"2024-05-15T15:39:54.056856+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:53:35.715007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057365+0000","last_change":"2024-05-15T15:39:52.477733+0000","last_active":"2024-05-15T15:39:54.057365+0000","last_peered":"2024-05-15T15:39:54.057365+0000","last_clean":"2024-05-15T15:39:54.057365+0000","last_became_active":"2024-05-15T15:39:52.474778+0000","last_became_peered":"2024-05-15T15:39:52.474778+0000","last_unstale":"2024-05-15T15:39:54.057365+0000","last_undegraded":"2024-05-15T15:39:54.057365+0000","last_fullsized":"2024-05-15T15:39:54.057365+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:18:51.904529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057477+0000","last_change":"2024-05-15T15:39:52.458241+0000","last_active":"2024-05-15T15:39:54.057477+0000","last_peered":"2024-05-15T15:39:54.057477+0000","last_clean":"2024-05-15T15:39:54.057477+0000","last_became_active":"2024-05-15T15:39:52.457883+0000","last_became_peered":"2024-05-15T15:39:52.457883+0000","last_unstale":"2024-05-15T15:39:54.057477+0000","last_undegraded":"2024-05-15T15:39:54.057477+0000","last_fullsized":"2024-05-15T15:39:54.057477+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:19:06.288701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.056535+0000","last_change":"2024-05-15T15:39:52.474619+0000","last_active":"2024-05-15T15:39:54.056535+0000","last_peered":"2024-05-15T15:39:54.056535+0000","last_clean":"2024-05-15T15:39:54.056535+0000","last_became_active":"2024-05-15T15:39:52.474314+0000","last_became_peered":"2024-05-15T15:39:52.474314+0000","last_unstale":"2024-05-15T15:39:54.056535+0000","last_undegraded":"2024-05-15T15:39:54.056535+0000","last_fullsized":"2024-05-15T15:39:54.056535+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:07:46.287281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.463913+0000","last_change":"2024-05-15T15:39:52.468997+0000","last_active":"2024-05-15T15:39:53.463913+0000","last_peered":"2024-05-15T15:39:53.463913+0000","last_clean":"2024-05-15T15:39:53.463913+0000","last_became_active":"2024-05-15T15:39:52.468155+0000","last_became_peered":"2024-05-15T15:39:52.468155+0000","last_unstale":"2024-05-15T15:39:53.463913+0000","last_undegraded":"2024-05-15T15:39:53.463913+0000","last_fullsized":"2024-05-15T15:39:53.463913+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:07:46.287281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.506277+0000","last_change":"2024-05-15T15:39:52.468077+0000","last_active":"2024-05-15T15:39:53.506277+0000","last_peered":"2024-05-15T15:39:53.506277+0000","last_clean":"2024-05-15T15:39:53.506277+0000","last_became_active":"2024-05-15T15:39:52.467754+0000","last_became_peered":"2024-05-15T15:39:52.467754+0000","last_unstale":"2024-05-15T15:39:53.506277+0000","last_undegraded":"2024-05-15T15:39:53.506277+0000","last_fullsized":"2024-05-15T15:39:53.506277+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:46:06.269771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057388+0000","last_change":"2024-05-15T15:39:52.480897+0000","last_active":"2024-05-15T15:39:54.057388+0000","last_peered":"2024-05-15T15:39:54.057388+0000","last_clean":"2024-05-15T15:39:54.057388+0000","last_became_active":"2024-05-15T15:39:52.479910+0000","last_became_peered":"2024-05-15T15:39:52.479910+0000","last_unstale":"2024-05-15T15:39:54.057388+0000","last_undegraded":"2024-05-15T15:39:54.057388+0000","last_fullsized":"2024-05-15T15:39:54.057388+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:13:19.570085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057782+0000","last_change":"2024-05-15T15:39:52.473167+0000","last_active":"2024-05-15T15:39:54.057782+0000","last_peered":"2024-05-15T15:39:54.057782+0000","last_clean":"2024-05-15T15:39:54.057782+0000","last_became_active":"2024-05-15T15:39:52.472835+0000","last_became_peered":"2024-05-15T15:39:52.472835+0000","last_unstale":"2024-05-15T15:39:54.057782+0000","last_undegraded":"2024-05-15T15:39:54.057782+0000","last_fullsized":"2024-05-15T15:39:54.057782+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:39:30.074726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057803+0000","last_change":"2024-05-15T15:39:52.467676+0000","last_active":"2024-05-15T15:39:54.057803+0000","last_peered":"2024-05-15T15:39:54.057803+0000","last_clean":"2024-05-15T15:39:54.057803+0000","last_became_active":"2024-05-15T15:39:52.467064+0000","last_became_peered":"2024-05-15T15:39:52.467064+0000","last_unstale":"2024-05-15T15:39:54.057803+0000","last_undegraded":"2024-05-15T15:39:54.057803+0000","last_fullsized":"2024-05-15T15:39:54.057803+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:58:23.539973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.463567+0000","last_change":"2024-05-15T15:39:52.472464+0000","last_active":"2024-05-15T15:39:53.463567+0000","last_peered":"2024-05-15T15:39:53.463567+0000","last_clean":"2024-05-15T15:39:53.463567+0000","last_became_active":"2024-05-15T15:39:52.472129+0000","last_became_peered":"2024-05-15T15:39:52.472129+0000","last_unstale":"2024-05-15T15:39:53.463567+0000","last_undegraded":"2024-05-15T15:39:53.463567+0000","last_fullsized":"2024-05-15T15:39:53.463567+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:14:40.347641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.463905+0000","last_change":"2024-05-15T15:39:52.465747+0000","last_active":"2024-05-15T15:39:53.463905+0000","last_peered":"2024-05-15T15:39:53.463905+0000","last_clean":"2024-05-15T15:39:53.463905+0000","last_became_active":"2024-05-15T15:39:52.465239+0000","last_became_peered":"2024-05-15T15:39:52.465239+0000","last_unstale":"2024-05-15T15:39:53.463905+0000","last_undegraded":"2024-05-15T15:39:53.463905+0000","last_fullsized":"2024-05-15T15:39:53.463905+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:56:24.242548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.463549+0000","last_change":"2024-05-15T15:39:52.467317+0000","last_active":"2024-05-15T15:39:53.463549+0000","last_peered":"2024-05-15T15:39:53.463549+0000","last_clean":"2024-05-15T15:39:53.463549+0000","last_became_active":"2024-05-15T15:39:52.466968+0000","last_became_peered":"2024-05-15T15:39:52.466968+0000","last_unstale":"2024-05-15T15:39:53.463549+0000","last_undegraded":"2024-05-15T15:39:53.463549+0000","last_fullsized":"2024-05-15T15:39:53.463549+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:36:37.195191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.462383+0000","last_change":"2024-05-15T15:39:52.469584+0000","last_active":"2024-05-15T15:39:53.462383+0000","last_peered":"2024-05-15T15:39:53.462383+0000","last_clean":"2024-05-15T15:39:53.462383+0000","last_became_active":"2024-05-15T15:39:52.469257+0000","last_became_peered":"2024-05-15T15:39:52.469257+0000","last_unstale":"2024-05-15T15:39:53.462383+0000","last_undegraded":"2024-05-15T15:39:53.462383+0000","last_fullsized":"2024-05-15T15:39:53.462383+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:52:43.064362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.463038+0000","last_change":"2024-05-15T15:39:52.473647+0000","last_active":"2024-05-15T15:39:53.463038+0000","last_peered":"2024-05-15T15:39:53.463038+0000","last_clean":"2024-05-15T15:39:53.463038+0000","last_became_active":"2024-05-15T15:39:52.472719+0000","last_became_peered":"2024-05-15T15:39:52.472719+0000","last_unstale":"2024-05-15T15:39:53.463038+0000","last_undegraded":"2024-05-15T15:39:53.463038+0000","last_fullsized":"2024-05-15T15:39:53.463038+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:48:23.434946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.056800+0000","last_change":"2024-05-15T15:39:52.465815+0000","last_active":"2024-05-15T15:39:54.056800+0000","last_peered":"2024-05-15T15:39:54.056800+0000","last_clean":"2024-05-15T15:39:54.056800+0000","last_became_active":"2024-05-15T15:39:52.465471+0000","last_became_peered":"2024-05-15T15:39:52.465471+0000","last_unstale":"2024-05-15T15:39:54.056800+0000","last_undegraded":"2024-05-15T15:39:54.056800+0000","last_fullsized":"2024-05-15T15:39:54.056800+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:53:35.715007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.463021+0000","last_change":"2024-05-15T15:39:52.463837+0000","last_active":"2024-05-15T15:39:53.463021+0000","last_peered":"2024-05-15T15:39:53.463021+0000","last_clean":"2024-05-15T15:39:53.463021+0000","last_became_active":"2024-05-15T15:39:52.459388+0000","last_became_peered":"2024-05-15T15:39:52.459388+0000","last_unstale":"2024-05-15T15:39:53.463021+0000","last_undegraded":"2024-05-15T15:39:53.463021+0000","last_fullsized":"2024-05-15T15:39:53.463021+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:55:50.961472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057274+0000","last_change":"2024-05-15T15:39:52.467411+0000","last_active":"2024-05-15T15:39:54.057274+0000","last_peered":"2024-05-15T15:39:54.057274+0000","last_clean":"2024-05-15T15:39:54.057274+0000","last_became_active":"2024-05-15T15:39:52.466666+0000","last_became_peered":"2024-05-15T15:39:52.466666+0000","last_unstale":"2024-05-15T15:39:54.057274+0000","last_undegraded":"2024-05-15T15:39:54.057274+0000","last_fullsized":"2024-05-15T15:39:54.057274+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:22:17.968105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-15T15:39:51.440698+0000","last_change":"2024-05-15T15:39:51.440698+0000","last_active":"2024-05-15T15:39:51.428802+0000","last_peered":"2024-05-15T15:39:51.428802+0000","last_clean":"2024-05-15T15:39:51.428802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:39:51.440698+0000","last_undegraded":"2024-05-15T15:39:51.440698+0000","last_fullsized":"2024-05-15T15:39:51.440698+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.506016+0000","last_change":"2024-05-15T15:39:52.477675+0000","last_active":"2024-05-15T15:39:53.506016+0000","last_peered":"2024-05-15T15:39:53.506016+0000","last_clean":"2024-05-15T15:39:53.506016+0000","last_became_active":"2024-05-15T15:39:52.477314+0000","last_became_peered":"2024-05-15T15:39:52.477314+0000","last_unstale":"2024-05-15T15:39:53.506016+0000","last_undegraded":"2024-05-15T15:39:53.506016+0000","last_fullsized":"2024-05-15T15:39:53.506016+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:49:27.658296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.463806+0000","last_change":"2024-05-15T15:39:52.471743+0000","last_active":"2024-05-15T15:39:53.463806+0000","last_peered":"2024-05-15T15:39:53.463806+0000","last_clean":"2024-05-15T15:39:53.463806+0000","last_became_active":"2024-05-15T15:39:52.471382+0000","last_became_peered":"2024-05-15T15:39:52.471382+0000","last_unstale":"2024-05-15T15:39:53.463806+0000","last_undegraded":"2024-05-15T15:39:53.463806+0000","last_fullsized":"2024-05-15T15:39:53.463806+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:01:48.794566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.462381+0000","last_change":"2024-05-15T15:39:52.463540+0000","last_active":"2024-05-15T15:39:53.462381+0000","last_peered":"2024-05-15T15:39:53.462381+0000","last_clean":"2024-05-15T15:39:53.462381+0000","last_became_active":"2024-05-15T15:39:52.463162+0000","last_became_peered":"2024-05-15T15:39:52.463162+0000","last_unstale":"2024-05-15T15:39:53.462381+0000","last_undegraded":"2024-05-15T15:39:53.462381+0000","last_fullsized":"2024-05-15T15:39:53.462381+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:18:51.904529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.464627+0000","last_change":"2024-05-15T15:39:52.474224+0000","last_active":"2024-05-15T15:39:53.464627+0000","last_peered":"2024-05-15T15:39:53.464627+0000","last_clean":"2024-05-15T15:39:53.464627+0000","last_became_active":"2024-05-15T15:39:52.473890+0000","last_became_peered":"2024-05-15T15:39:52.473890+0000","last_unstale":"2024-05-15T15:39:53.464627+0000","last_undegraded":"2024-05-15T15:39:53.464627+0000","last_fullsized":"2024-05-15T15:39:53.464627+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:22:17.968105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057129+0000","last_change":"2024-05-15T15:39:52.466971+0000","last_active":"2024-05-15T15:39:54.057129+0000","last_peered":"2024-05-15T15:39:54.057129+0000","last_clean":"2024-05-15T15:39:54.057129+0000","last_became_active":"2024-05-15T15:39:52.466656+0000","last_became_peered":"2024-05-15T15:39:52.466656+0000","last_unstale":"2024-05-15T15:39:54.057129+0000","last_undegraded":"2024-05-15T15:39:54.057129+0000","last_fullsized":"2024-05-15T15:39:54.057129+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:52:27.027535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.464322+0000","last_change":"2024-05-15T15:39:52.470364+0000","last_active":"2024-05-15T15:39:53.464322+0000","last_peered":"2024-05-15T15:39:53.464322+0000","last_clean":"2024-05-15T15:39:53.464322+0000","last_became_active":"2024-05-15T15:39:52.470067+0000","last_became_peered":"2024-05-15T15:39:52.470067+0000","last_unstale":"2024-05-15T15:39:53.464322+0000","last_undegraded":"2024-05-15T15:39:53.464322+0000","last_fullsized":"2024-05-15T15:39:53.464322+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:07:28.350502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.463525+0000","last_change":"2024-05-15T15:39:52.473274+0000","last_active":"2024-05-15T15:39:53.463525+0000","last_peered":"2024-05-15T15:39:53.463525+0000","last_clean":"2024-05-15T15:39:53.463525+0000","last_became_active":"2024-05-15T15:39:52.472954+0000","last_became_peered":"2024-05-15T15:39:52.472954+0000","last_unstale":"2024-05-15T15:39:53.463525+0000","last_undegraded":"2024-05-15T15:39:53.463525+0000","last_fullsized":"2024-05-15T15:39:53.463525+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:46:06.269771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.464564+0000","last_change":"2024-05-15T15:39:52.473238+0000","last_active":"2024-05-15T15:39:53.464564+0000","last_peered":"2024-05-15T15:39:53.464564+0000","last_clean":"2024-05-15T15:39:53.464564+0000","last_became_active":"2024-05-15T15:39:52.472848+0000","last_became_peered":"2024-05-15T15:39:52.472848+0000","last_unstale":"2024-05-15T15:39:53.464564+0000","last_undegraded":"2024-05-15T15:39:53.464564+0000","last_fullsized":"2024-05-15T15:39:53.464564+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:48:53.088055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.462876+0000","last_change":"2024-05-15T15:39:52.464689+0000","last_active":"2024-05-15T15:39:53.462876+0000","last_peered":"2024-05-15T15:39:53.462876+0000","last_clean":"2024-05-15T15:39:53.462876+0000","last_became_active":"2024-05-15T15:39:52.462649+0000","last_became_peered":"2024-05-15T15:39:52.462649+0000","last_unstale":"2024-05-15T15:39:53.462876+0000","last_undegraded":"2024-05-15T15:39:53.462876+0000","last_fullsized":"2024-05-15T15:39:53.462876+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:17:05.581127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.056464+0000","last_change":"2024-05-15T15:39:52.465485+0000","last_active":"2024-05-15T15:39:54.056464+0000","last_peered":"2024-05-15T15:39:54.056464+0000","last_clean":"2024-05-15T15:39:54.056464+0000","last_became_active":"2024-05-15T15:39:52.464733+0000","last_became_peered":"2024-05-15T15:39:52.464733+0000","last_unstale":"2024-05-15T15:39:54.056464+0000","last_undegraded":"2024-05-15T15:39:54.056464+0000","last_fullsized":"2024-05-15T15:39:54.056464+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:17:34.380965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057300+0000","last_change":"2024-05-15T15:39:52.465924+0000","last_active":"2024-05-15T15:39:54.057300+0000","last_peered":"2024-05-15T15:39:54.057300+0000","last_clean":"2024-05-15T15:39:54.057300+0000","last_became_active":"2024-05-15T15:39:52.464704+0000","last_became_peered":"2024-05-15T15:39:52.464704+0000","last_unstale":"2024-05-15T15:39:54.057300+0000","last_undegraded":"2024-05-15T15:39:54.057300+0000","last_fullsized":"2024-05-15T15:39:54.057300+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:49:27.658296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.506001+0000","last_change":"2024-05-15T15:39:52.465099+0000","last_active":"2024-05-15T15:39:53.506001+0000","last_peered":"2024-05-15T15:39:53.506001+0000","last_clean":"2024-05-15T15:39:53.506001+0000","last_became_active":"2024-05-15T15:39:52.464775+0000","last_became_peered":"2024-05-15T15:39:52.464775+0000","last_unstale":"2024-05-15T15:39:53.506001+0000","last_undegraded":"2024-05-15T15:39:53.506001+0000","last_fullsized":"2024-05-15T15:39:53.506001+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:52:27.027535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.464681+0000","last_change":"2024-05-15T15:39:51.443546+0000","last_active":"2024-05-15T15:39:53.464681+0000","last_peered":"2024-05-15T15:39:53.464681+0000","last_clean":"2024-05-15T15:39:53.464681+0000","last_became_active":"2024-05-15T15:39:51.443177+0000","last_became_peered":"2024-05-15T15:39:51.443177+0000","last_unstale":"2024-05-15T15:39:53.464681+0000","last_undegraded":"2024-05-15T15:39:53.464681+0000","last_fullsized":"2024-05-15T15:39:53.464681+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:18:35.801621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-15T15:39:51.436958+0000","last_change":"2024-05-15T15:39:51.436958+0000","last_active":"2024-05-15T15:39:51.428802+0000","last_peered":"2024-05-15T15:39:51.428802+0000","last_clean":"2024-05-15T15:39:51.428802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:39:51.436958+0000","last_undegraded":"2024-05-15T15:39:51.436958+0000","last_fullsized":"2024-05-15T15:39:51.436958+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.462997+0000","last_change":"2024-05-15T15:39:51.451403+0000","last_active":"2024-05-15T15:39:53.462997+0000","last_peered":"2024-05-15T15:39:53.462997+0000","last_clean":"2024-05-15T15:39:53.462997+0000","last_became_active":"2024-05-15T15:39:51.451074+0000","last_became_peered":"2024-05-15T15:39:51.451074+0000","last_unstale":"2024-05-15T15:39:53.462997+0000","last_undegraded":"2024-05-15T15:39:53.462997+0000","last_fullsized":"2024-05-15T15:39:53.462997+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:52:26.020009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.463548+0000","last_change":"2024-05-15T15:39:51.457243+0000","last_active":"2024-05-15T15:39:53.463548+0000","last_peered":"2024-05-15T15:39:53.463548+0000","last_clean":"2024-05-15T15:39:53.463548+0000","last_became_active":"2024-05-15T15:39:51.456904+0000","last_became_peered":"2024-05-15T15:39:51.456904+0000","last_unstale":"2024-05-15T15:39:53.463548+0000","last_undegraded":"2024-05-15T15:39:53.463548+0000","last_fullsized":"2024-05-15T15:39:53.463548+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:45:30.896866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.464271+0000","last_change":"2024-05-15T15:39:52.461438+0000","last_active":"2024-05-15T15:39:53.464271+0000","last_peered":"2024-05-15T15:39:53.464271+0000","last_clean":"2024-05-15T15:39:53.464271+0000","last_became_active":"2024-05-15T15:39:52.460666+0000","last_became_peered":"2024-05-15T15:39:52.460666+0000","last_unstale":"2024-05-15T15:39:53.464271+0000","last_undegraded":"2024-05-15T15:39:53.464271+0000","last_fullsized":"2024-05-15T15:39:53.464271+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:35:07.996967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.462502+0000","last_change":"2024-05-15T15:39:51.444590+0000","last_active":"2024-05-15T15:39:53.462502+0000","last_peered":"2024-05-15T15:39:53.462502+0000","last_clean":"2024-05-15T15:39:53.462502+0000","last_became_active":"2024-05-15T15:39:51.444114+0000","last_became_peered":"2024-05-15T15:39:51.444114+0000","last_unstale":"2024-05-15T15:39:53.462502+0000","last_undegraded":"2024-05-15T15:39:53.462502+0000","last_fullsized":"2024-05-15T15:39:53.462502+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:17:33.373439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-15T15:39:51.437645+0000","last_change":"2024-05-15T15:39:51.437645+0000","last_active":"2024-05-15T15:39:51.428802+0000","last_peered":"2024-05-15T15:39:51.428802+0000","last_clean":"2024-05-15T15:39:51.428802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:39:51.437645+0000","last_undegraded":"2024-05-15T15:39:51.437645+0000","last_fullsized":"2024-05-15T15:39:51.437645+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.506255+0000","last_change":"2024-05-15T15:39:51.453203+0000","last_active":"2024-05-15T15:39:53.506255+0000","last_peered":"2024-05-15T15:39:53.506255+0000","last_clean":"2024-05-15T15:39:53.506255+0000","last_became_active":"2024-05-15T15:39:51.452835+0000","last_became_peered":"2024-05-15T15:39:51.452835+0000","last_unstale":"2024-05-15T15:39:53.506255+0000","last_undegraded":"2024-05-15T15:39:53.506255+0000","last_fullsized":"2024-05-15T15:39:53.506255+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:00:28.591473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057390+0000","last_change":"2024-05-15T15:39:52.467091+0000","last_active":"2024-05-15T15:39:54.057390+0000","last_peered":"2024-05-15T15:39:54.057390+0000","last_clean":"2024-05-15T15:39:54.057390+0000","last_became_active":"2024-05-15T15:39:52.465260+0000","last_became_peered":"2024-05-15T15:39:52.465260+0000","last_unstale":"2024-05-15T15:39:54.057390+0000","last_undegraded":"2024-05-15T15:39:54.057390+0000","last_fullsized":"2024-05-15T15:39:54.057390+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:46:06.269771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057238+0000","last_change":"2024-05-15T15:39:51.459005+0000","last_active":"2024-05-15T15:39:54.057238+0000","last_peered":"2024-05-15T15:39:54.057238+0000","last_clean":"2024-05-15T15:39:54.057238+0000","last_became_active":"2024-05-15T15:39:51.458484+0000","last_became_peered":"2024-05-15T15:39:51.458484+0000","last_unstale":"2024-05-15T15:39:54.057238+0000","last_undegraded":"2024-05-15T15:39:54.057238+0000","last_fullsized":"2024-05-15T15:39:54.057238+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:53:34.707481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.464984+0000","last_change":"2024-05-15T15:39:52.470997+0000","last_active":"2024-05-15T15:39:53.464984+0000","last_peered":"2024-05-15T15:39:53.464984+0000","last_clean":"2024-05-15T15:39:53.464984+0000","last_became_active":"2024-05-15T15:39:52.470669+0000","last_became_peered":"2024-05-15T15:39:52.470669+0000","last_unstale":"2024-05-15T15:39:53.464984+0000","last_undegraded":"2024-05-15T15:39:53.464984+0000","last_fullsized":"2024-05-15T15:39:53.464984+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:52:43.064362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.056727+0000","last_change":"2024-05-15T15:39:51.448163+0000","last_active":"2024-05-15T15:39:54.056727+0000","last_peered":"2024-05-15T15:39:54.056727+0000","last_clean":"2024-05-15T15:39:54.056727+0000","last_became_active":"2024-05-15T15:39:51.447878+0000","last_became_peered":"2024-05-15T15:39:51.447878+0000","last_unstale":"2024-05-15T15:39:54.056727+0000","last_undegraded":"2024-05-15T15:39:54.056727+0000","last_fullsized":"2024-05-15T15:39:54.056727+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:45:30.896866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.463183+0000","last_change":"2024-05-15T15:39:52.471719+0000","last_active":"2024-05-15T15:39:53.463183+0000","last_peered":"2024-05-15T15:39:53.463183+0000","last_clean":"2024-05-15T15:39:53.463183+0000","last_became_active":"2024-05-15T15:39:52.471352+0000","last_became_peered":"2024-05-15T15:39:52.471352+0000","last_unstale":"2024-05-15T15:39:53.463183+0000","last_undegraded":"2024-05-15T15:39:53.463183+0000","last_fullsized":"2024-05-15T15:39:53.463183+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:09:35.247678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"22'6","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.056826+0000","last_change":"2024-05-15T15:39:51.449551+0000","last_active":"2024-05-15T15:39:54.056826+0000","last_peered":"2024-05-15T15:39:54.056826+0000","last_clean":"2024-05-15T15:39:54.056826+0000","last_became_active":"2024-05-15T15:39:51.449185+0000","last_became_peered":"2024-05-15T15:39:51.449185+0000","last_unstale":"2024-05-15T15:39:54.056826+0000","last_undegraded":"2024-05-15T15:39:54.056826+0000","last_fullsized":"2024-05-15T15:39:54.056826+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:56:40.086761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057182+0000","last_change":"2024-05-15T15:39:52.477094+0000","last_active":"2024-05-15T15:39:54.057182+0000","last_peered":"2024-05-15T15:39:54.057182+0000","last_clean":"2024-05-15T15:39:54.057182+0000","last_became_active":"2024-05-15T15:39:52.476694+0000","last_became_peered":"2024-05-15T15:39:52.476694+0000","last_unstale":"2024-05-15T15:39:54.057182+0000","last_undegraded":"2024-05-15T15:39:54.057182+0000","last_fullsized":"2024-05-15T15:39:54.057182+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:48:53.088055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057190+0000","last_change":"2024-05-15T15:39:51.455537+0000","last_active":"2024-05-15T15:39:54.057190+0000","last_peered":"2024-05-15T15:39:54.057190+0000","last_clean":"2024-05-15T15:39:54.057190+0000","last_became_active":"2024-05-15T15:39:51.455169+0000","last_became_peered":"2024-05-15T15:39:51.455169+0000","last_unstale":"2024-05-15T15:39:54.057190+0000","last_undegraded":"2024-05-15T15:39:54.057190+0000","last_fullsized":"2024-05-15T15:39:54.057190+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:15:32.911265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.464093+0000","last_change":"2024-05-15T15:39:52.464580+0000","last_active":"2024-05-15T15:39:53.464093+0000","last_peered":"2024-05-15T15:39:53.464093+0000","last_clean":"2024-05-15T15:39:53.464093+0000","last_became_active":"2024-05-15T15:39:52.464252+0000","last_became_peered":"2024-05-15T15:39:52.464252+0000","last_unstale":"2024-05-15T15:39:53.464093+0000","last_undegraded":"2024-05-15T15:39:53.464093+0000","last_fullsized":"2024-05-15T15:39:53.464093+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:00:28.874513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.463192+0000","last_change":"2024-05-15T15:39:51.456191+0000","last_active":"2024-05-15T15:39:53.463192+0000","last_peered":"2024-05-15T15:39:53.463192+0000","last_clean":"2024-05-15T15:39:53.463192+0000","last_became_active":"2024-05-15T15:39:51.455844+0000","last_became_peered":"2024-05-15T15:39:51.455844+0000","last_unstale":"2024-05-15T15:39:53.463192+0000","last_undegraded":"2024-05-15T15:39:53.463192+0000","last_fullsized":"2024-05-15T15:39:53.463192+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:19:05.281175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.462897+0000","last_change":"2024-05-15T15:39:52.473375+0000","last_active":"2024-05-15T15:39:53.462897+0000","last_peered":"2024-05-15T15:39:53.462897+0000","last_clean":"2024-05-15T15:39:53.462897+0000","last_became_active":"2024-05-15T15:39:52.473046+0000","last_became_peered":"2024-05-15T15:39:52.473046+0000","last_unstale":"2024-05-15T15:39:53.462897+0000","last_undegraded":"2024-05-15T15:39:53.462897+0000","last_fullsized":"2024-05-15T15:39:53.462897+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:15:12.564736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.056485+0000","last_change":"2024-05-15T15:39:51.461928+0000","last_active":"2024-05-15T15:39:54.056485+0000","last_peered":"2024-05-15T15:39:54.056485+0000","last_clean":"2024-05-15T15:39:54.056485+0000","last_became_active":"2024-05-15T15:39:51.461604+0000","last_became_peered":"2024-05-15T15:39:51.461604+0000","last_unstale":"2024-05-15T15:39:54.056485+0000","last_undegraded":"2024-05-15T15:39:54.056485+0000","last_fullsized":"2024-05-15T15:39:54.056485+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:13:01.291506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.505919+0000","last_change":"2024-05-15T15:39:52.474668+0000","last_active":"2024-05-15T15:39:53.505919+0000","last_peered":"2024-05-15T15:39:53.505919+0000","last_clean":"2024-05-15T15:39:53.505919+0000","last_became_active":"2024-05-15T15:39:52.474222+0000","last_became_peered":"2024-05-15T15:39:52.474222+0000","last_unstale":"2024-05-15T15:39:53.505919+0000","last_undegraded":"2024-05-15T15:39:53.505919+0000","last_fullsized":"2024-05-15T15:39:53.505919+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:53:35.715007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T15:39:51.447890+0000","last_change":"2024-05-15T15:39:51.446711+0000","last_active":"2024-05-15T15:39:51.447890+0000","last_peered":"2024-05-15T15:39:51.447890+0000","last_clean":"2024-05-15T15:39:51.447890+0000","last_became_active":"2024-05-15T15:39:51.446392+0000","last_became_peered":"2024-05-15T15:39:51.446392+0000","last_unstale":"2024-05-15T15:39:51.447890+0000","last_undegraded":"2024-05-15T15:39:51.447890+0000","last_fullsized":"2024-05-15T15:39:51.447890+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:15:48.685660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.462447+0000","last_change":"2024-05-15T15:39:52.468710+0000","last_active":"2024-05-15T15:39:53.462447+0000","last_peered":"2024-05-15T15:39:53.462447+0000","last_clean":"2024-05-15T15:39:53.462447+0000","last_became_active":"2024-05-15T15:39:52.468364+0000","last_became_peered":"2024-05-15T15:39:52.468364+0000","last_unstale":"2024-05-15T15:39:53.462447+0000","last_undegraded":"2024-05-15T15:39:53.462447+0000","last_fullsized":"2024-05-15T15:39:53.462447+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:39:07.633570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057781+0000","last_change":"2024-05-15T15:39:51.454815+0000","last_active":"2024-05-15T15:39:54.057781+0000","last_peered":"2024-05-15T15:39:54.057781+0000","last_clean":"2024-05-15T15:39:54.057781+0000","last_became_active":"2024-05-15T15:39:51.454302+0000","last_became_peered":"2024-05-15T15:39:51.454302+0000","last_unstale":"2024-05-15T15:39:54.057781+0000","last_undegraded":"2024-05-15T15:39:54.057781+0000","last_fullsized":"2024-05-15T15:39:54.057781+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:52:26.020009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057590+0000","last_change":"2024-05-15T15:39:52.478397+0000","last_active":"2024-05-15T15:39:54.057590+0000","last_peered":"2024-05-15T15:39:54.057590+0000","last_clean":"2024-05-15T15:39:54.057590+0000","last_became_active":"2024-05-15T15:39:52.477855+0000","last_became_peered":"2024-05-15T15:39:52.477855+0000","last_unstale":"2024-05-15T15:39:54.057590+0000","last_undegraded":"2024-05-15T15:39:54.057590+0000","last_fullsized":"2024-05-15T15:39:54.057590+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:43:53.153262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T15:39:51.452447+0000","last_change":"2024-05-15T15:39:51.451802+0000","last_active":"2024-05-15T15:39:51.452447+0000","last_peered":"2024-05-15T15:39:51.452447+0000","last_clean":"2024-05-15T15:39:51.452447+0000","last_became_active":"2024-05-15T15:39:51.451413+0000","last_became_peered":"2024-05-15T15:39:51.451413+0000","last_unstale":"2024-05-15T15:39:51.452447+0000","last_undegraded":"2024-05-15T15:39:51.452447+0000","last_fullsized":"2024-05-15T15:39:51.452447+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:44:16.985300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057652+0000","last_change":"2024-05-15T15:39:52.477925+0000","last_active":"2024-05-15T15:39:54.057652+0000","last_peered":"2024-05-15T15:39:54.057652+0000","last_clean":"2024-05-15T15:39:54.057652+0000","last_became_active":"2024-05-15T15:39:52.477255+0000","last_became_peered":"2024-05-15T15:39:52.477255+0000","last_unstale":"2024-05-15T15:39:54.057652+0000","last_undegraded":"2024-05-15T15:39:54.057652+0000","last_fullsized":"2024-05-15T15:39:54.057652+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:39:07.633570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.464272+0000","last_change":"2024-05-15T15:39:51.450383+0000","last_active":"2024-05-15T15:39:53.464272+0000","last_peered":"2024-05-15T15:39:53.464272+0000","last_clean":"2024-05-15T15:39:53.464272+0000","last_became_active":"2024-05-15T15:39:51.449318+0000","last_became_peered":"2024-05-15T15:39:51.449318+0000","last_unstale":"2024-05-15T15:39:53.464272+0000","last_undegraded":"2024-05-15T15:39:53.464272+0000","last_fullsized":"2024-05-15T15:39:53.464272+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:17:33.373439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057489+0000","last_change":"2024-05-15T15:39:52.471316+0000","last_active":"2024-05-15T15:39:54.057489+0000","last_peered":"2024-05-15T15:39:54.057489+0000","last_clean":"2024-05-15T15:39:54.057489+0000","last_became_active":"2024-05-15T15:39:52.471014+0000","last_became_peered":"2024-05-15T15:39:52.471014+0000","last_unstale":"2024-05-15T15:39:54.057489+0000","last_undegraded":"2024-05-15T15:39:54.057489+0000","last_fullsized":"2024-05-15T15:39:54.057489+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:52:43.064362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.463830+0000","last_change":"2024-05-15T15:39:51.454584+0000","last_active":"2024-05-15T15:39:53.463830+0000","last_peered":"2024-05-15T15:39:53.463830+0000","last_clean":"2024-05-15T15:39:53.463830+0000","last_became_active":"2024-05-15T15:39:51.454260+0000","last_became_peered":"2024-05-15T15:39:51.454260+0000","last_unstale":"2024-05-15T15:39:53.463830+0000","last_undegraded":"2024-05-15T15:39:53.463830+0000","last_fullsized":"2024-05-15T15:39:53.463830+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:17:48.368852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.462838+0000","last_change":"2024-05-15T15:39:52.464130+0000","last_active":"2024-05-15T15:39:53.462838+0000","last_peered":"2024-05-15T15:39:53.462838+0000","last_clean":"2024-05-15T15:39:53.462838+0000","last_became_active":"2024-05-15T15:39:52.463486+0000","last_became_peered":"2024-05-15T15:39:52.463486+0000","last_unstale":"2024-05-15T15:39:53.462838+0000","last_undegraded":"2024-05-15T15:39:53.462838+0000","last_fullsized":"2024-05-15T15:39:53.462838+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:58:23.539973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":110,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.505802+0000","last_change":"2024-05-15T15:39:42.584601+0000","last_active":"2024-05-15T15:39:53.505802+0000","last_peered":"2024-05-15T15:39:53.505802+0000","last_clean":"2024-05-15T15:39:53.505802+0000","last_became_active":"2024-05-15T15:39:42.584129+0000","last_became_peered":"2024-05-15T15:39:42.584129+0000","last_unstale":"2024-05-15T15:39:53.505802+0000","last_undegraded":"2024-05-15T15:39:53.505802+0000","last_fullsized":"2024-05-15T15:39:53.505802+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:41.378107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:41.378107+0000","last_clean_scrub_stamp":"2024-05-15T15:39:41.378107+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:23:25.285669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.462726+0000","last_change":"2024-05-15T15:39:51.451749+0000","last_active":"2024-05-15T15:39:53.462726+0000","last_peered":"2024-05-15T15:39:53.462726+0000","last_clean":"2024-05-15T15:39:53.462726+0000","last_became_active":"2024-05-15T15:39:51.451438+0000","last_became_peered":"2024-05-15T15:39:51.451438+0000","last_unstale":"2024-05-15T15:39:53.462726+0000","last_undegraded":"2024-05-15T15:39:53.462726+0000","last_fullsized":"2024-05-15T15:39:53.462726+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:46:05.262245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-15T15:39:51.438340+0000","last_change":"2024-05-15T15:39:51.438340+0000","last_active":"2024-05-15T15:39:51.428802+0000","last_peered":"2024-05-15T15:39:51.428802+0000","last_clean":"2024-05-15T15:39:51.428802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:39:51.438340+0000","last_undegraded":"2024-05-15T15:39:51.438340+0000","last_fullsized":"2024-05-15T15:39:51.438340+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.462612+0000","last_change":"2024-05-15T15:39:51.457051+0000","last_active":"2024-05-15T15:39:53.462612+0000","last_peered":"2024-05-15T15:39:53.462612+0000","last_clean":"2024-05-15T15:39:53.462612+0000","last_became_active":"2024-05-15T15:39:51.456748+0000","last_became_peered":"2024-05-15T15:39:51.456748+0000","last_unstale":"2024-05-15T15:39:53.462612+0000","last_undegraded":"2024-05-15T15:39:53.462612+0000","last_fullsized":"2024-05-15T15:39:53.462612+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:53:34.707481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.463666+0000","last_change":"2024-05-15T15:39:52.467728+0000","last_active":"2024-05-15T15:39:53.463666+0000","last_peered":"2024-05-15T15:39:53.463666+0000","last_clean":"2024-05-15T15:39:53.463666+0000","last_became_active":"2024-05-15T15:39:52.467352+0000","last_became_peered":"2024-05-15T15:39:52.467352+0000","last_unstale":"2024-05-15T15:39:53.463666+0000","last_undegraded":"2024-05-15T15:39:53.463666+0000","last_fullsized":"2024-05-15T15:39:53.463666+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:19:06.288701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.056496+0000","last_change":"2024-05-15T15:39:51.454058+0000","last_active":"2024-05-15T15:39:54.056496+0000","last_peered":"2024-05-15T15:39:54.056496+0000","last_clean":"2024-05-15T15:39:54.056496+0000","last_became_active":"2024-05-15T15:39:51.453765+0000","last_became_peered":"2024-05-15T15:39:51.453765+0000","last_unstale":"2024-05-15T15:39:54.056496+0000","last_undegraded":"2024-05-15T15:39:54.056496+0000","last_fullsized":"2024-05-15T15:39:54.056496+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:17:48.368852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.464095+0000","last_change":"2024-05-15T15:39:52.474812+0000","last_active":"2024-05-15T15:39:53.464095+0000","last_peered":"2024-05-15T15:39:53.464095+0000","last_clean":"2024-05-15T15:39:53.464095+0000","last_became_active":"2024-05-15T15:39:52.472883+0000","last_became_peered":"2024-05-15T15:39:52.472883+0000","last_unstale":"2024-05-15T15:39:53.464095+0000","last_undegraded":"2024-05-15T15:39:53.464095+0000","last_fullsized":"2024-05-15T15:39:53.464095+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:00:05.496148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.463124+0000","last_change":"2024-05-15T15:39:51.449647+0000","last_active":"2024-05-15T15:39:53.463124+0000","last_peered":"2024-05-15T15:39:53.463124+0000","last_clean":"2024-05-15T15:39:53.463124+0000","last_became_active":"2024-05-15T15:39:51.449332+0000","last_became_peered":"2024-05-15T15:39:51.449332+0000","last_unstale":"2024-05-15T15:39:53.463124+0000","last_undegraded":"2024-05-15T15:39:53.463124+0000","last_fullsized":"2024-05-15T15:39:53.463124+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:43:52.145736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.056740+0000","last_change":"2024-05-15T15:39:52.479896+0000","last_active":"2024-05-15T15:39:54.056740+0000","last_peered":"2024-05-15T15:39:54.056740+0000","last_clean":"2024-05-15T15:39:54.056740+0000","last_became_active":"2024-05-15T15:39:52.479462+0000","last_became_peered":"2024-05-15T15:39:52.479462+0000","last_unstale":"2024-05-15T15:39:54.056740+0000","last_undegraded":"2024-05-15T15:39:54.056740+0000","last_fullsized":"2024-05-15T15:39:54.056740+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:00:05.496148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.463525+0000","last_change":"2024-05-15T15:39:51.450193+0000","last_active":"2024-05-15T15:39:53.463525+0000","last_peered":"2024-05-15T15:39:53.463525+0000","last_clean":"2024-05-15T15:39:53.463525+0000","last_became_active":"2024-05-15T15:39:51.449868+0000","last_became_peered":"2024-05-15T15:39:51.449868+0000","last_unstale":"2024-05-15T15:39:53.463525+0000","last_undegraded":"2024-05-15T15:39:53.463525+0000","last_fullsized":"2024-05-15T15:39:53.463525+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:13:01.291506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057411+0000","last_change":"2024-05-15T15:39:52.466700+0000","last_active":"2024-05-15T15:39:54.057411+0000","last_peered":"2024-05-15T15:39:54.057411+0000","last_clean":"2024-05-15T15:39:54.057411+0000","last_became_active":"2024-05-15T15:39:52.464696+0000","last_became_peered":"2024-05-15T15:39:52.464696+0000","last_unstale":"2024-05-15T15:39:54.057411+0000","last_undegraded":"2024-05-15T15:39:54.057411+0000","last_fullsized":"2024-05-15T15:39:54.057411+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:14:40.347641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.463133+0000","last_change":"2024-05-15T15:39:51.449690+0000","last_active":"2024-05-15T15:39:53.463133+0000","last_peered":"2024-05-15T15:39:53.463133+0000","last_clean":"2024-05-15T15:39:53.463133+0000","last_became_active":"2024-05-15T15:39:51.448404+0000","last_became_peered":"2024-05-15T15:39:51.448404+0000","last_unstale":"2024-05-15T15:39:53.463133+0000","last_undegraded":"2024-05-15T15:39:53.463133+0000","last_fullsized":"2024-05-15T15:39:53.463133+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:56:23.235022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.463699+0000","last_change":"2024-05-15T15:39:52.475321+0000","last_active":"2024-05-15T15:39:53.463699+0000","last_peered":"2024-05-15T15:39:53.463699+0000","last_clean":"2024-05-15T15:39:53.463699+0000","last_became_active":"2024-05-15T15:39:52.475018+0000","last_became_peered":"2024-05-15T15:39:52.475018+0000","last_unstale":"2024-05-15T15:39:53.463699+0000","last_undegraded":"2024-05-15T15:39:53.463699+0000","last_fullsized":"2024-05-15T15:39:53.463699+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:43:53.153262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T15:39:51.456912+0000","last_change":"2024-05-15T15:39:51.455435+0000","last_active":"2024-05-15T15:39:51.456912+0000","last_peered":"2024-05-15T15:39:51.456912+0000","last_clean":"2024-05-15T15:39:51.456912+0000","last_became_active":"2024-05-15T15:39:51.455047+0000","last_became_peered":"2024-05-15T15:39:51.455047+0000","last_unstale":"2024-05-15T15:39:51.456912+0000","last_undegraded":"2024-05-15T15:39:51.456912+0000","last_fullsized":"2024-05-15T15:39:51.456912+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:16:06.081249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-15T15:39:51.439295+0000","last_change":"2024-05-15T15:39:51.439295+0000","last_active":"2024-05-15T15:39:51.428802+0000","last_peered":"2024-05-15T15:39:51.428802+0000","last_clean":"2024-05-15T15:39:51.428802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:39:51.439295+0000","last_undegraded":"2024-05-15T15:39:51.439295+0000","last_fullsized":"2024-05-15T15:39:51.439295+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.463011+0000","last_change":"2024-05-15T15:39:51.456218+0000","last_active":"2024-05-15T15:39:53.463011+0000","last_peered":"2024-05-15T15:39:53.463011+0000","last_clean":"2024-05-15T15:39:53.463011+0000","last_became_active":"2024-05-15T15:39:51.455592+0000","last_became_peered":"2024-05-15T15:39:51.455592+0000","last_unstale":"2024-05-15T15:39:53.463011+0000","last_undegraded":"2024-05-15T15:39:53.463011+0000","last_fullsized":"2024-05-15T15:39:53.463011+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:14:39.340114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-15T15:39:51.438842+0000","last_change":"2024-05-15T15:39:51.438842+0000","last_active":"2024-05-15T15:39:51.428802+0000","last_peered":"2024-05-15T15:39:51.428802+0000","last_clean":"2024-05-15T15:39:51.428802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:39:51.438842+0000","last_undegraded":"2024-05-15T15:39:51.438842+0000","last_fullsized":"2024-05-15T15:39:51.438842+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.056270+0000","last_change":"2024-05-15T15:39:51.456266+0000","last_active":"2024-05-15T15:39:54.056270+0000","last_peered":"2024-05-15T15:39:54.056270+0000","last_clean":"2024-05-15T15:39:54.056270+0000","last_became_active":"2024-05-15T15:39:51.455914+0000","last_became_peered":"2024-05-15T15:39:51.455914+0000","last_unstale":"2024-05-15T15:39:54.056270+0000","last_undegraded":"2024-05-15T15:39:54.056270+0000","last_fullsized":"2024-05-15T15:39:54.056270+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:18:35.801621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.463115+0000","last_change":"2024-05-15T15:39:52.462843+0000","last_active":"2024-05-15T15:39:53.463115+0000","last_peered":"2024-05-15T15:39:53.463115+0000","last_clean":"2024-05-15T15:39:53.463115+0000","last_became_active":"2024-05-15T15:39:52.459592+0000","last_became_peered":"2024-05-15T15:39:52.459592+0000","last_unstale":"2024-05-15T15:39:53.463115+0000","last_undegraded":"2024-05-15T15:39:53.463115+0000","last_fullsized":"2024-05-15T15:39:53.463115+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:19:16.899508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T15:39:51.457637+0000","last_change":"2024-05-15T15:39:51.456133+0000","last_active":"2024-05-15T15:39:51.457637+0000","last_peered":"2024-05-15T15:39:51.457637+0000","last_clean":"2024-05-15T15:39:51.457637+0000","last_became_active":"2024-05-15T15:39:51.455602+0000","last_became_peered":"2024-05-15T15:39:51.455602+0000","last_unstale":"2024-05-15T15:39:51.457637+0000","last_undegraded":"2024-05-15T15:39:51.457637+0000","last_fullsized":"2024-05-15T15:39:51.457637+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:04:40.612468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-15T15:39:51.437692+0000","last_change":"2024-05-15T15:39:51.437692+0000","last_active":"2024-05-15T15:39:51.428802+0000","last_peered":"2024-05-15T15:39:51.428802+0000","last_clean":"2024-05-15T15:39:51.428802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:39:51.437692+0000","last_undegraded":"2024-05-15T15:39:51.437692+0000","last_fullsized":"2024-05-15T15:39:51.437692+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.464110+0000","last_change":"2024-05-15T15:39:51.453591+0000","last_active":"2024-05-15T15:39:53.464110+0000","last_peered":"2024-05-15T15:39:53.464110+0000","last_clean":"2024-05-15T15:39:53.464110+0000","last_became_active":"2024-05-15T15:39:51.453250+0000","last_became_peered":"2024-05-15T15:39:51.453250+0000","last_unstale":"2024-05-15T15:39:53.464110+0000","last_undegraded":"2024-05-15T15:39:53.464110+0000","last_fullsized":"2024-05-15T15:39:53.464110+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:15:32.911265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057214+0000","last_change":"2024-05-15T15:39:52.469345+0000","last_active":"2024-05-15T15:39:54.057214+0000","last_peered":"2024-05-15T15:39:54.057214+0000","last_clean":"2024-05-15T15:39:54.057214+0000","last_became_active":"2024-05-15T15:39:52.469041+0000","last_became_peered":"2024-05-15T15:39:52.469041+0000","last_unstale":"2024-05-15T15:39:54.057214+0000","last_undegraded":"2024-05-15T15:39:54.057214+0000","last_fullsized":"2024-05-15T15:39:54.057214+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:52:27.027535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.462608+0000","last_change":"2024-05-15T15:39:51.450991+0000","last_active":"2024-05-15T15:39:53.462608+0000","last_peered":"2024-05-15T15:39:53.462608+0000","last_clean":"2024-05-15T15:39:53.462608+0000","last_became_active":"2024-05-15T15:39:51.450600+0000","last_became_peered":"2024-05-15T15:39:51.450600+0000","last_unstale":"2024-05-15T15:39:53.462608+0000","last_undegraded":"2024-05-15T15:39:53.462608+0000","last_fullsized":"2024-05-15T15:39:53.462608+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:49:26.650770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.462903+0000","last_change":"2024-05-15T15:39:52.462106+0000","last_active":"2024-05-15T15:39:53.462903+0000","last_peered":"2024-05-15T15:39:53.462903+0000","last_clean":"2024-05-15T15:39:53.462903+0000","last_became_active":"2024-05-15T15:39:52.461217+0000","last_became_peered":"2024-05-15T15:39:52.461217+0000","last_unstale":"2024-05-15T15:39:53.462903+0000","last_undegraded":"2024-05-15T15:39:53.462903+0000","last_fullsized":"2024-05-15T15:39:53.462903+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:41:33.947325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.462652+0000","last_change":"2024-05-15T15:39:52.473917+0000","last_active":"2024-05-15T15:39:53.462652+0000","last_peered":"2024-05-15T15:39:53.462652+0000","last_clean":"2024-05-15T15:39:53.462652+0000","last_became_active":"2024-05-15T15:39:52.472408+0000","last_became_peered":"2024-05-15T15:39:52.472408+0000","last_unstale":"2024-05-15T15:39:53.462652+0000","last_undegraded":"2024-05-15T15:39:53.462652+0000","last_fullsized":"2024-05-15T15:39:53.462652+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:39:30.074726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057634+0000","last_change":"2024-05-15T15:39:51.458878+0000","last_active":"2024-05-15T15:39:54.057634+0000","last_peered":"2024-05-15T15:39:54.057634+0000","last_clean":"2024-05-15T15:39:54.057634+0000","last_became_active":"2024-05-15T15:39:51.458527+0000","last_became_peered":"2024-05-15T15:39:51.458527+0000","last_unstale":"2024-05-15T15:39:54.057634+0000","last_undegraded":"2024-05-15T15:39:54.057634+0000","last_fullsized":"2024-05-15T15:39:54.057634+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:14:39.340114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.506342+0000","last_change":"2024-05-15T15:39:52.479684+0000","last_active":"2024-05-15T15:39:53.506342+0000","last_peered":"2024-05-15T15:39:53.506342+0000","last_clean":"2024-05-15T15:39:53.506342+0000","last_became_active":"2024-05-15T15:39:52.479359+0000","last_became_peered":"2024-05-15T15:39:52.479359+0000","last_unstale":"2024-05-15T15:39:53.506342+0000","last_undegraded":"2024-05-15T15:39:53.506342+0000","last_fullsized":"2024-05-15T15:39:53.506342+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:14:40.347641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057324+0000","last_change":"2024-05-15T15:39:51.459312+0000","last_active":"2024-05-15T15:39:54.057324+0000","last_peered":"2024-05-15T15:39:54.057324+0000","last_clean":"2024-05-15T15:39:54.057324+0000","last_became_active":"2024-05-15T15:39:51.458739+0000","last_became_peered":"2024-05-15T15:39:51.458739+0000","last_unstale":"2024-05-15T15:39:54.057324+0000","last_undegraded":"2024-05-15T15:39:54.057324+0000","last_fullsized":"2024-05-15T15:39:54.057324+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:17:33.373439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.464791+0000","last_change":"2024-05-15T15:39:52.472300+0000","last_active":"2024-05-15T15:39:53.464791+0000","last_peered":"2024-05-15T15:39:53.464791+0000","last_clean":"2024-05-15T15:39:53.464791+0000","last_became_active":"2024-05-15T15:39:52.472005+0000","last_became_peered":"2024-05-15T15:39:52.472005+0000","last_unstale":"2024-05-15T15:39:53.464791+0000","last_undegraded":"2024-05-15T15:39:53.464791+0000","last_fullsized":"2024-05-15T15:39:53.464791+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:18:51.904529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.465122+0000","last_change":"2024-05-15T15:39:51.451702+0000","last_active":"2024-05-15T15:39:53.465122+0000","last_peered":"2024-05-15T15:39:53.465122+0000","last_clean":"2024-05-15T15:39:53.465122+0000","last_became_active":"2024-05-15T15:39:51.451387+0000","last_became_peered":"2024-05-15T15:39:51.451387+0000","last_unstale":"2024-05-15T15:39:53.465122+0000","last_undegraded":"2024-05-15T15:39:53.465122+0000","last_fullsized":"2024-05-15T15:39:53.465122+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:23:00.828647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.465209+0000","last_change":"2024-05-15T15:39:52.473199+0000","last_active":"2024-05-15T15:39:53.465209+0000","last_peered":"2024-05-15T15:39:53.465209+0000","last_clean":"2024-05-15T15:39:53.465209+0000","last_became_active":"2024-05-15T15:39:52.472848+0000","last_became_peered":"2024-05-15T15:39:52.472848+0000","last_unstale":"2024-05-15T15:39:53.465209+0000","last_undegraded":"2024-05-15T15:39:53.465209+0000","last_fullsized":"2024-05-15T15:39:53.465209+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:39:30.074726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T15:39:51.447704+0000","last_change":"2024-05-15T15:39:51.445161+0000","last_active":"2024-05-15T15:39:51.447704+0000","last_peered":"2024-05-15T15:39:51.447704+0000","last_clean":"2024-05-15T15:39:51.447704+0000","last_became_active":"2024-05-15T15:39:51.444855+0000","last_became_peered":"2024-05-15T15:39:51.444855+0000","last_unstale":"2024-05-15T15:39:51.447704+0000","last_undegraded":"2024-05-15T15:39:51.447704+0000","last_fullsized":"2024-05-15T15:39:51.447704+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:58:42.762068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1828,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24,"ondisk_log_size":24,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509445,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":241664,"data_stored":81359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509445,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":233472,"data_stored":81235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509446,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27836,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":835584,"data_stored":671695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":237568,"data_stored":81817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":233472,"data_stored":76547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509446,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":831488,"data_stored":671673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509445,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":229376,"data_stored":74991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":196608,"data_stored":61885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-15T15:39:57.277 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2b is not active+clean 2024-05-15T15:39:57.277 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-05-15T15:39:51.440698+0000', 'last_change': '2024-05-15T15:39:51.440698+0000', 'last_active': '2024-05-15T15:39:51.428802+0000', 'last_peered': '2024-05-15T15:39:51.428802+0000', 'last_clean': '2024-05-15T15:39:51.428802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T15:39:51.440698+0000', 'last_undegraded': '2024-05-15T15:39:51.440698+0000', 'last_fullsized': '2024-05-15T15:39:51.440698+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T15:39:51.428802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T15:39:51.428802+0000', 'last_clean_scrub_stamp': '2024-05-15T15:39:51.428802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-15T15:39:57.277 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1b is not active+clean 2024-05-15T15:39:57.277 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-05-15T15:39:51.436958+0000', 'last_change': '2024-05-15T15:39:51.436958+0000', 'last_active': '2024-05-15T15:39:51.428802+0000', 'last_peered': '2024-05-15T15:39:51.428802+0000', 'last_clean': '2024-05-15T15:39:51.428802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T15:39:51.436958+0000', 'last_undegraded': '2024-05-15T15:39:51.436958+0000', 'last_fullsized': '2024-05-15T15:39:51.436958+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T15:39:51.428802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T15:39:51.428802+0000', 'last_clean_scrub_stamp': '2024-05-15T15:39:51.428802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-15T15:39:57.278 INFO:tasks.ceph.ceph_manager.ceph:PG 3.19 is not active+clean 2024-05-15T15:39:57.278 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-05-15T15:39:51.437645+0000', 'last_change': '2024-05-15T15:39:51.437645+0000', 'last_active': '2024-05-15T15:39:51.428802+0000', 'last_peered': '2024-05-15T15:39:51.428802+0000', 'last_clean': '2024-05-15T15:39:51.428802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T15:39:51.437645+0000', 'last_undegraded': '2024-05-15T15:39:51.437645+0000', 'last_fullsized': '2024-05-15T15:39:51.437645+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T15:39:51.428802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T15:39:51.428802+0000', 'last_clean_scrub_stamp': '2024-05-15T15:39:51.428802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-15T15:39:57.278 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2 is not active+clean 2024-05-15T15:39:57.278 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-05-15T15:39:51.438340+0000', 'last_change': '2024-05-15T15:39:51.438340+0000', 'last_active': '2024-05-15T15:39:51.428802+0000', 'last_peered': '2024-05-15T15:39:51.428802+0000', 'last_clean': '2024-05-15T15:39:51.428802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T15:39:51.438340+0000', 'last_undegraded': '2024-05-15T15:39:51.438340+0000', 'last_fullsized': '2024-05-15T15:39:51.438340+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T15:39:51.428802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T15:39:51.428802+0000', 'last_clean_scrub_stamp': '2024-05-15T15:39:51.428802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-15T15:39:57.278 INFO:tasks.ceph.ceph_manager.ceph:PG 3.7 is not active+clean 2024-05-15T15:39:57.278 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-05-15T15:39:51.439295+0000', 'last_change': '2024-05-15T15:39:51.439295+0000', 'last_active': '2024-05-15T15:39:51.428802+0000', 'last_peered': '2024-05-15T15:39:51.428802+0000', 'last_clean': '2024-05-15T15:39:51.428802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T15:39:51.439295+0000', 'last_undegraded': '2024-05-15T15:39:51.439295+0000', 'last_fullsized': '2024-05-15T15:39:51.439295+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T15:39:51.428802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T15:39:51.428802+0000', 'last_clean_scrub_stamp': '2024-05-15T15:39:51.428802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-15T15:39:57.278 INFO:tasks.ceph.ceph_manager.ceph:PG 3.6 is not active+clean 2024-05-15T15:39:57.278 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-05-15T15:39:51.438842+0000', 'last_change': '2024-05-15T15:39:51.438842+0000', 'last_active': '2024-05-15T15:39:51.428802+0000', 'last_peered': '2024-05-15T15:39:51.428802+0000', 'last_clean': '2024-05-15T15:39:51.428802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T15:39:51.438842+0000', 'last_undegraded': '2024-05-15T15:39:51.438842+0000', 'last_fullsized': '2024-05-15T15:39:51.438842+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T15:39:51.428802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T15:39:51.428802+0000', 'last_clean_scrub_stamp': '2024-05-15T15:39:51.428802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-15T15:39:57.278 INFO:tasks.ceph.ceph_manager.ceph:PG 3.8 is not active+clean 2024-05-15T15:39:57.278 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-05-15T15:39:51.437692+0000', 'last_change': '2024-05-15T15:39:51.437692+0000', 'last_active': '2024-05-15T15:39:51.428802+0000', 'last_peered': '2024-05-15T15:39:51.428802+0000', 'last_clean': '2024-05-15T15:39:51.428802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T15:39:51.437692+0000', 'last_undegraded': '2024-05-15T15:39:51.437692+0000', 'last_fullsized': '2024-05-15T15:39:51.437692+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T15:39:51.428802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T15:39:51.428802+0000', 'last_clean_scrub_stamp': '2024-05-15T15:39:51.428802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-15T15:39:57.279 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-05-15T15:39:57.280 INFO:tasks.ceph.mds.b.smithi084.stderr:2024-05-15T15:39:57.279+0000 7f7ff087a640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-15T15:39:57.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.421+0000 7f3299896640 1 Processor -- start 2024-05-15T15:39:57.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.421+0000 7f3299896640 1 -- start start 2024-05-15T15:39:57.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.422+0000 7f3299896640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f32940a0ba0 0x7f3294146380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:57.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.422+0000 7f3299896640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3294071150 con 0x7f32940bc1c0 2024-05-15T15:39:57.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.422+0000 7f3299896640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f329414c120 con 0x7f329414c8e0 2024-05-15T15:39:57.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.422+0000 7f3299896640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f329414c450 con 0x7f32940a0ba0 2024-05-15T15:39:57.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.422+0000 7f3292ffd640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f32940bc1c0 0x7f3294070a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:45168/0 (socket says 172.21.15.12:45168) 2024-05-15T15:39:57.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.422+0000 7f3292ffd640 1 -- 172.21.15.12:0/3343453965 learned_addr learned my addr 172.21.15.12:0/3343453965 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-05-15T15:39:57.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.422+0000 7f328bfff640 1 --2- 172.21.15.12:0/3343453965 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f32940a0ba0 0x7f3294146380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:57.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.422+0000 7f32927fc640 1 -- 172.21.15.12:0/3343453965 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 555477287 0 0) 0x7f3284001110 con 0x7f32940bc1c0 2024-05-15T15:39:57.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.422+0000 7f32927fc640 1 -- 172.21.15.12:0/3343453965 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3280003520 con 0x7f32940bc1c0 2024-05-15T15:39:57.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.423+0000 7f32927fc640 1 -- 172.21.15.12:0/3343453965 <== mon.1 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3042987774 0 0) 0x7f329414c120 con 0x7f329414c8e0 2024-05-15T15:39:57.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.423+0000 7f32927fc640 1 -- 172.21.15.12:0/3343453965 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3284001110 con 0x7f329414c8e0 2024-05-15T15:39:57.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.423+0000 7f32927fc640 1 -- 172.21.15.12:0/3343453965 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3107867682 0 0) 0x7f3280003520 con 0x7f32940bc1c0 2024-05-15T15:39:57.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.423+0000 7f328bfff640 1 -- 172.21.15.12:0/3343453965 >> v1:172.21.15.84:6789/0 conn(0x7f329414c8e0 legacy=0x7f3294156a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:57.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.423+0000 7f328bfff640 1 -- 172.21.15.12:0/3343453965 >> v1:172.21.15.12:6789/0 conn(0x7f32940bc1c0 legacy=0x7f3294070a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:57.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.423+0000 7f328bfff640 1 -- 172.21.15.12:0/3343453965 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3294071e40 con 0x7f32940a0ba0 2024-05-15T15:39:57.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.424+0000 7f328bfff640 1 --2- 172.21.15.12:0/3343453965 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f32940a0ba0 0x7f3294146380 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f329414c5d0 tx=0x7f327c02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a2669627f08051b0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:39:57.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.424+0000 7f32927fc640 1 -- 172.21.15.12:0/3343453965 <== mon.2 v2:172.21.15.84:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f327c037070 con 0x7f32940a0ba0 2024-05-15T15:39:57.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.424+0000 7f32927fc640 1 -- 172.21.15.12:0/3343453965 <== mon.2 v2:172.21.15.84:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f327c02ac10 con 0x7f32940a0ba0 2024-05-15T15:39:57.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.424+0000 7f32927fc640 1 -- 172.21.15.12:0/3343453965 <== mon.2 v2:172.21.15.84:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3284001840 con 0x7f32940a0ba0 2024-05-15T15:39:57.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.424+0000 7f3299896640 1 -- 172.21.15.12:0/3343453965 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f32940a0ba0 msgr2=0x7f3294146380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:57.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.424+0000 7f3299896640 1 --2- 172.21.15.12:0/3343453965 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f32940a0ba0 0x7f3294146380 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f329414c5d0 tx=0x7f327c02a180 comp rx=0 tx=0).stop 2024-05-15T15:39:57.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.424+0000 7f3299896640 1 -- 172.21.15.12:0/3343453965 shutdown_connections 2024-05-15T15:39:57.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.424+0000 7f3299896640 1 --2- 172.21.15.12:0/3343453965 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f32940a0ba0 0x7f3294146380 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:57.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.424+0000 7f3299896640 1 -- 172.21.15.12:0/3343453965 >> 172.21.15.12:0/3343453965 conn(0x7f32940c17c0 msgr2=0x7f32940c1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:39:57.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.425+0000 7f3299896640 1 -- 172.21.15.12:0/3343453965 shutdown_connections 2024-05-15T15:39:57.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.425+0000 7f3299896640 1 -- 172.21.15.12:0/3343453965 wait complete. 2024-05-15T15:39:57.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.426+0000 7f3299896640 1 Processor -- start 2024-05-15T15:39:57.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.426+0000 7f3299896640 1 -- start start 2024-05-15T15:39:57.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.427+0000 7f3299896640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f32940a0ba0 0x7f32940a4b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:57.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.427+0000 7f3299896640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f32940bc1c0 0x7f32940a55e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:57.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.427+0000 7f3299896640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f329414c8e0 0x7f32941e5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:57.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.427+0000 7f3299896640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f32940a0fb0 con 0x7f32940bc1c0 2024-05-15T15:39:57.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.427+0000 7f3299896640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f32940716b0 con 0x7f329414c8e0 2024-05-15T15:39:57.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.427+0000 7f3299896640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f32940bd5f0 con 0x7f32940a0ba0 2024-05-15T15:39:57.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.427+0000 7f328bfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f32940bc1c0 0x7f32940a55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:57.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.427+0000 7f328bfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f32940bc1c0 0x7f32940a55e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59380/0 (socket says 172.21.15.12:59380) 2024-05-15T15:39:57.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.427+0000 7f328bfff640 1 -- 172.21.15.12:0/4056751664 learned_addr learned my addr 172.21.15.12:0/4056751664 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:39:57.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.427+0000 7f3292ffd640 1 --2- 172.21.15.12:0/4056751664 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f32940a0ba0 0x7f32940a4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:57.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.427+0000 7f32937fe640 1 --2- 172.21.15.12:0/4056751664 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f329414c8e0 0x7f32941e5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:57.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.428+0000 7f328bfff640 1 -- 172.21.15.12:0/4056751664 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f32940a0ba0 msgr2=0x7f32940a4b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:57.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.428+0000 7f328bfff640 1 --2- 172.21.15.12:0/4056751664 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f32940a0ba0 0x7f32940a4b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:57.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.428+0000 7f328bfff640 1 -- 172.21.15.12:0/4056751664 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f329414c8e0 msgr2=0x7f32941e5eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:57.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.428+0000 7f328bfff640 1 --2- 172.21.15.12:0/4056751664 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f329414c8e0 0x7f32941e5eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:57.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.428+0000 7f328bfff640 1 -- 172.21.15.12:0/4056751664 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32940a5b20 con 0x7f32940bc1c0 2024-05-15T15:39:57.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.428+0000 7f32937fe640 1 --2- 172.21.15.12:0/4056751664 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f329414c8e0 0x7f32941e5eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-15T15:39:57.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.428+0000 7f328bfff640 1 --2- 172.21.15.12:0/4056751664 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f32940bc1c0 0x7f32940a55e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f327c02a770 tx=0x7f327c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:39:57.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.428+0000 7f3290ff9640 1 -- 172.21.15.12:0/4056751664 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f327c042020 con 0x7f32940bc1c0 2024-05-15T15:39:57.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.428+0000 7f3290ff9640 1 -- 172.21.15.12:0/4056751664 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f327c003a40 con 0x7f32940bc1c0 2024-05-15T15:39:57.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.428+0000 7f3299896640 1 -- 172.21.15.12:0/4056751664 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32941e63f0 con 0x7f32940bc1c0 2024-05-15T15:39:57.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.428+0000 7f3290ff9640 1 -- 172.21.15.12:0/4056751664 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f327c037040 con 0x7f32940bc1c0 2024-05-15T15:39:57.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.428+0000 7f3299896640 1 -- 172.21.15.12:0/4056751664 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32940a7220 con 0x7f32940bc1c0 2024-05-15T15:39:57.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.429+0000 7f3299896640 1 -- 172.21.15.12:0/4056751664 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32940a5100 con 0x7f32940bc1c0 2024-05-15T15:39:57.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.430+0000 7f3290ff9640 1 -- 172.21.15.12:0/4056751664 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f327c045020 con 0x7f32940bc1c0 2024-05-15T15:39:57.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.430+0000 7f3290ff9640 1 --2- 172.21.15.12:0/4056751664 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f3274076300 0x7f3274078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:57.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.431+0000 7f3290ff9640 1 -- 172.21.15.12:0/4056751664 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f327c0b7c80 con 0x7f32940bc1c0 2024-05-15T15:39:57.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.431+0000 7f3292ffd640 1 --2- 172.21.15.12:0/4056751664 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f3274076300 0x7f3274078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:57.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.431+0000 7f3292ffd640 1 --2- 172.21.15.12:0/4056751664 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f3274076300 0x7f3274078810 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3284001610 tx=0x7f3284001b20 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:39:57.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.435+0000 7f3290ff9640 1 -- 172.21.15.12:0/4056751664 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f327c04c030 con 0x7f32940bc1c0 2024-05-15T15:39:57.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.698+0000 7f3299896640 1 -- 172.21.15.12:0/4056751664 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f32940a7b50 con 0x7f32940bc1c0 2024-05-15T15:39:57.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.699+0000 7f3290ff9640 1 -- 172.21.15.12:0/4056751664 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1097 (secure 0 0 0) 0x7f327c081540 con 0x7f32940bc1c0 2024-05-15T15:39:57.703 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-05-15T15:39:57.703 INFO:teuthology.orchestra.run.smithi012.stdout:{"fsid":"3b7fc4b2-b85c-49b5-a5de-38444eeed40d","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":29,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":23,"num_osds":8,"num_up_osds":8,"osd_up_since":1715787579,"num_in_osds":8,"osd_in_since":1715787570,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":90},{"state_name":"creating+peering","count":7}],"num_pgs":97,"num_pools":3,"num_objects":16,"data_bytes":592196,"bytes_used":224403456,"bytes_avail":772869709824,"bytes_total":773094113280,"inactive_pgs_ratio":0.072164945304393768,"write_bytes_sec":2218,"read_op_per_sec":0,"write_op_per_sec":4},"fsmap":{"epoch":7,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"b","status":"up:active","gid":4288}],"up:standby":2},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2024-05-15T15:39:28.394200+0000","services":{}},"progress_events":{}} 2024-05-15T15:39:57.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.701+0000 7f3299896640 1 -- 172.21.15.12:0/4056751664 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f3274076300 msgr2=0x7f3274078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:57.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.701+0000 7f3299896640 1 --2- 172.21.15.12:0/4056751664 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f3274076300 0x7f3274078810 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3284001610 tx=0x7f3284001b20 comp rx=0 tx=0).stop 2024-05-15T15:39:57.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.701+0000 7f3299896640 1 -- 172.21.15.12:0/4056751664 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f32940bc1c0 msgr2=0x7f32940a55e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:57.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.701+0000 7f3299896640 1 --2- 172.21.15.12:0/4056751664 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f32940bc1c0 0x7f32940a55e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f327c02a770 tx=0x7f327c0046c0 comp rx=0 tx=0).stop 2024-05-15T15:39:57.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.701+0000 7f3299896640 1 -- 172.21.15.12:0/4056751664 shutdown_connections 2024-05-15T15:39:57.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.701+0000 7f3299896640 1 --2- 172.21.15.12:0/4056751664 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f329414c8e0 0x7f32941e5eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:57.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.701+0000 7f3299896640 1 --2- 172.21.15.12:0/4056751664 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f3274076300 0x7f3274078810 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:57.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.701+0000 7f3299896640 1 --2- 172.21.15.12:0/4056751664 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f32940bc1c0 0x7f32940a55e0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:57.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.701+0000 7f3299896640 1 --2- 172.21.15.12:0/4056751664 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f32940a0ba0 0x7f32940a4b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:57.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.701+0000 7f3299896640 1 -- 172.21.15.12:0/4056751664 >> 172.21.15.12:0/4056751664 conn(0x7f32940c17c0 msgr2=0x7f32941444e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:39:57.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.701+0000 7f3299896640 1 -- 172.21.15.12:0/4056751664 shutdown_connections 2024-05-15T15:39:57.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.701+0000 7f3299896640 1 -- 172.21.15.12:0/4056751664 wait complete. 2024-05-15T15:39:57.714 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-05-15T15:39:57.714 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-15T15:39:57.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.824+0000 7fee6d776640 1 Processor -- start 2024-05-15T15:39:57.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.824+0000 7fee6d776640 1 -- start start 2024-05-15T15:39:57.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.825+0000 7fee6d776640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fee6806c6e0 0x7fee68074a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:57.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.825+0000 7fee6d776640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee680bf720 con 0x7fee6814ef40 2024-05-15T15:39:57.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.825+0000 7fee6d776640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee6806cfe0 con 0x7fee681519c0 2024-05-15T15:39:57.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.825+0000 7fee6d776640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fee6806cd00 con 0x7fee6806c6e0 2024-05-15T15:39:57.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.825+0000 7fee66ffd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fee6806c6e0 0x7fee68074a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:57.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.825+0000 7fee677fe640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fee6814ef40 0x7fee68158d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:45174/0 (socket says 172.21.15.12:45174) 2024-05-15T15:39:57.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.825+0000 7fee677fe640 1 -- 172.21.15.12:0/461183018 learned_addr learned my addr 172.21.15.12:0/461183018 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-05-15T15:39:57.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.825+0000 7fee66ffd640 1 -- 172.21.15.12:0/461183018 >> v1:172.21.15.84:6789/0 conn(0x7fee681519c0 legacy=0x7fee680bf010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:39:57.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.825+0000 7fee66ffd640 1 -- 172.21.15.12:0/461183018 >> v1:172.21.15.12:6789/0 conn(0x7fee6814ef40 legacy=0x7fee68158d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:57.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.825+0000 7fee66ffd640 1 -- 172.21.15.12:0/461183018 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee68074210 con 0x7fee6806c6e0 2024-05-15T15:39:57.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.826+0000 7fee66ffd640 1 --2- 172.21.15.12:0/461183018 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fee6806c6e0 0x7fee68074a10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fee580097a0 tx=0x7fee5802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4117bbd1f5f9c86c server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:39:57.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.826+0000 7fee667fc640 1 -- 172.21.15.12:0/461183018 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee58037070 con 0x7fee6806c6e0 2024-05-15T15:39:57.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.826+0000 7fee667fc640 1 -- 172.21.15.12:0/461183018 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee58032440 con 0x7fee6806c6e0 2024-05-15T15:39:57.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.826+0000 7fee667fc640 1 -- 172.21.15.12:0/461183018 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee58032810 con 0x7fee6806c6e0 2024-05-15T15:39:57.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.827+0000 7fee6d776640 1 -- 172.21.15.12:0/461183018 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fee6806c6e0 msgr2=0x7fee68074a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:57.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.827+0000 7fee6d776640 1 --2- 172.21.15.12:0/461183018 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fee6806c6e0 0x7fee68074a10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fee580097a0 tx=0x7fee5802a210 comp rx=0 tx=0).stop 2024-05-15T15:39:57.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.827+0000 7fee6d776640 1 -- 172.21.15.12:0/461183018 shutdown_connections 2024-05-15T15:39:57.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.827+0000 7fee6d776640 1 --2- 172.21.15.12:0/461183018 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fee6806c6e0 0x7fee68074a10 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:57.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.827+0000 7fee6d776640 1 -- 172.21.15.12:0/461183018 >> 172.21.15.12:0/461183018 conn(0x7fee680bd0f0 msgr2=0x7fee680bd500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:39:57.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.827+0000 7fee6d776640 1 -- 172.21.15.12:0/461183018 shutdown_connections 2024-05-15T15:39:57.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.827+0000 7fee6d776640 1 -- 172.21.15.12:0/461183018 wait complete. 2024-05-15T15:39:57.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.828+0000 7fee6d776640 1 Processor -- start 2024-05-15T15:39:57.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.828+0000 7fee6d776640 1 -- start start 2024-05-15T15:39:57.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.829+0000 7fee6d776640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fee6806c6e0 0x7fee680b57f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:57.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.829+0000 7fee6d776640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee6814ef40 0x7fee681e44f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:57.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.829+0000 7fee6d776640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fee681519c0 0x7fee68148320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:57.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.829+0000 7fee6d776640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fee6814f350 con 0x7fee681519c0 2024-05-15T15:39:57.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.829+0000 7fee6d776640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fee68151dd0 con 0x7fee6814ef40 2024-05-15T15:39:57.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.829+0000 7fee6d776640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fee680be460 con 0x7fee6806c6e0 2024-05-15T15:39:57.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.830+0000 7fee677fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fee681519c0 0x7fee68148320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:57.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.830+0000 7fee677fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fee681519c0 0x7fee68148320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59396/0 (socket says 172.21.15.12:59396) 2024-05-15T15:39:57.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.830+0000 7fee677fe640 1 -- 172.21.15.12:0/276469625 learned_addr learned my addr 172.21.15.12:0/276469625 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:39:57.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.830+0000 7fee66ffd640 1 --2- 172.21.15.12:0/276469625 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fee6806c6e0 0x7fee680b57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:57.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.830+0000 7fee5ffff640 1 --2- 172.21.15.12:0/276469625 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee6814ef40 0x7fee681e44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:57.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.830+0000 7fee677fe640 1 -- 172.21.15.12:0/276469625 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fee6806c6e0 msgr2=0x7fee680b57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:57.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.830+0000 7fee677fe640 1 --2- 172.21.15.12:0/276469625 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fee6806c6e0 0x7fee680b57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:57.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.830+0000 7fee677fe640 1 -- 172.21.15.12:0/276469625 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee6814ef40 msgr2=0x7fee681e44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:57.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.830+0000 7fee677fe640 1 --2- 172.21.15.12:0/276469625 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee6814ef40 0x7fee681e44f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:57.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.830+0000 7fee677fe640 1 -- 172.21.15.12:0/276469625 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee680b5d30 con 0x7fee681519c0 2024-05-15T15:39:57.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.830+0000 7fee5ffff640 1 --2- 172.21.15.12:0/276469625 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee6814ef40 0x7fee681e44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-15T15:39:57.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.830+0000 7fee677fe640 1 --2- 172.21.15.12:0/276469625 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fee681519c0 0x7fee68148320 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fee6000cb10 tx=0x7fee6000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:39:57.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.830+0000 7fee5f7fe640 1 -- 172.21.15.12:0/276469625 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee60017070 con 0x7fee681519c0 2024-05-15T15:39:57.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.830+0000 7fee5f7fe640 1 -- 172.21.15.12:0/276469625 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee6000ac10 con 0x7fee681519c0 2024-05-15T15:39:57.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.830+0000 7fee5f7fe640 1 -- 172.21.15.12:0/276469625 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee60012400 con 0x7fee681519c0 2024-05-15T15:39:57.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.830+0000 7fee6d776640 1 -- 172.21.15.12:0/276469625 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee681e4a30 con 0x7fee681519c0 2024-05-15T15:39:57.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.830+0000 7fee6d776640 1 -- 172.21.15.12:0/276469625 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee681e7d20 con 0x7fee681519c0 2024-05-15T15:39:57.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.831+0000 7fee6d776640 1 -- 172.21.15.12:0/276469625 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee68069b50 con 0x7fee681519c0 2024-05-15T15:39:57.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.832+0000 7fee5f7fe640 1 -- 172.21.15.12:0/276469625 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fee6001a070 con 0x7fee681519c0 2024-05-15T15:39:57.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.833+0000 7fee5f7fe640 1 --2- 172.21.15.12:0/276469625 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fee480762d0 0x7fee480787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:39:57.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.833+0000 7fee5f7fe640 1 -- 172.21.15.12:0/276469625 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fee60097280 con 0x7fee681519c0 2024-05-15T15:39:57.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.833+0000 7fee66ffd640 1 --2- 172.21.15.12:0/276469625 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fee480762d0 0x7fee480787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:39:57.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.833+0000 7fee66ffd640 1 --2- 172.21.15.12:0/276469625 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fee480762d0 0x7fee480787e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fee58034000 tx=0x7fee5802e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:39:57.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:57.838+0000 7fee5f7fe640 1 -- 172.21.15.12:0/276469625 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fee680bf720 con 0x7fee681519c0 2024-05-15T15:39:58.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:58.022+0000 7fee6d776640 1 -- 172.21.15.12:0/276469625 --> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fee680b7220 con 0x7fee480762d0 2024-05-15T15:39:58.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:58.029+0000 7fee5f7fe640 1 -- 172.21.15.12:0/276469625 <== mgr.4106 v2:172.21.15.84:6832/4173299311 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251340 (secure 0 0 0) 0x7fee680b7220 con 0x7fee480762d0 2024-05-15T15:39:58.033 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-05-15T15:39:58.035 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-05-15T15:39:58.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:58.032+0000 7fee6d776640 1 -- 172.21.15.12:0/276469625 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fee480762d0 msgr2=0x7fee480787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:58.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:58.032+0000 7fee6d776640 1 --2- 172.21.15.12:0/276469625 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fee480762d0 0x7fee480787e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fee58034000 tx=0x7fee5802e000 comp rx=0 tx=0).stop 2024-05-15T15:39:58.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:58.032+0000 7fee6d776640 1 -- 172.21.15.12:0/276469625 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fee681519c0 msgr2=0x7fee68148320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:39:58.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:58.032+0000 7fee6d776640 1 --2- 172.21.15.12:0/276469625 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fee681519c0 0x7fee68148320 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fee6000cb10 tx=0x7fee6000a060 comp rx=0 tx=0).stop 2024-05-15T15:39:58.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:58.032+0000 7fee6d776640 1 -- 172.21.15.12:0/276469625 shutdown_connections 2024-05-15T15:39:58.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:58.032+0000 7fee6d776640 1 --2- 172.21.15.12:0/276469625 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fee480762d0 0x7fee480787e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:58.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:58.032+0000 7fee6d776640 1 --2- 172.21.15.12:0/276469625 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fee681519c0 0x7fee68148320 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:58.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:58.032+0000 7fee6d776640 1 --2- 172.21.15.12:0/276469625 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee6814ef40 0x7fee681e44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:58.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:58.032+0000 7fee6d776640 1 --2- 172.21.15.12:0/276469625 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fee6806c6e0 0x7fee680b57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:39:58.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:58.032+0000 7fee6d776640 1 -- 172.21.15.12:0/276469625 >> 172.21.15.12:0/276469625 conn(0x7fee680bd0f0 msgr2=0x7fee680bb520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:39:58.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:58.032+0000 7fee6d776640 1 -- 172.21.15.12:0/276469625 shutdown_connections 2024-05-15T15:39:58.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:39:58.032+0000 7fee6d776640 1 -- 172.21.15.12:0/276469625 wait complete. 2024-05-15T15:39:58.045 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2024-05-15T15:39:56.701057+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592196,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":126,"num_write_kb":1641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":96,"ondisk_log_size":96,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":129,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219144,"kb_used_data":2968,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755576,"statfs":{"total":773094113280,"available":772869709824,"internally_reserved":0,"allocated":3039232,"data_stored":1801202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1828,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001482"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057108+0000","last_change":"2024-05-15T15:39:52.474245+0000","last_active":"2024-05-15T15:39:54.057108+0000","last_peered":"2024-05-15T15:39:54.057108+0000","last_clean":"2024-05-15T15:39:54.057108+0000","last_became_active":"2024-05-15T15:39:52.473919+0000","last_became_peered":"2024-05-15T15:39:52.473919+0000","last_unstale":"2024-05-15T15:39:54.057108+0000","last_undegraded":"2024-05-15T15:39:54.057108+0000","last_fullsized":"2024-05-15T15:39:54.057108+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:35:07.996967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.464974+0000","last_change":"2024-05-15T15:39:52.472587+0000","last_active":"2024-05-15T15:39:53.464974+0000","last_peered":"2024-05-15T15:39:53.464974+0000","last_clean":"2024-05-15T15:39:53.464974+0000","last_became_active":"2024-05-15T15:39:52.472268+0000","last_became_peered":"2024-05-15T15:39:52.472268+0000","last_unstale":"2024-05-15T15:39:53.464974+0000","last_undegraded":"2024-05-15T15:39:53.464974+0000","last_fullsized":"2024-05-15T15:39:53.464974+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:39:07.633570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.464154+0000","last_change":"2024-05-15T15:39:52.474404+0000","last_active":"2024-05-15T15:39:53.464154+0000","last_peered":"2024-05-15T15:39:53.464154+0000","last_clean":"2024-05-15T15:39:53.464154+0000","last_became_active":"2024-05-15T15:39:52.474102+0000","last_became_peered":"2024-05-15T15:39:52.474102+0000","last_unstale":"2024-05-15T15:39:53.464154+0000","last_undegraded":"2024-05-15T15:39:53.464154+0000","last_fullsized":"2024-05-15T15:39:53.464154+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:13:19.570085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.056856+0000","last_change":"2024-05-15T15:39:52.462504+0000","last_active":"2024-05-15T15:39:54.056856+0000","last_peered":"2024-05-15T15:39:54.056856+0000","last_clean":"2024-05-15T15:39:54.056856+0000","last_became_active":"2024-05-15T15:39:52.462135+0000","last_became_peered":"2024-05-15T15:39:52.462135+0000","last_unstale":"2024-05-15T15:39:54.056856+0000","last_undegraded":"2024-05-15T15:39:54.056856+0000","last_fullsized":"2024-05-15T15:39:54.056856+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:53:35.715007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057365+0000","last_change":"2024-05-15T15:39:52.477733+0000","last_active":"2024-05-15T15:39:54.057365+0000","last_peered":"2024-05-15T15:39:54.057365+0000","last_clean":"2024-05-15T15:39:54.057365+0000","last_became_active":"2024-05-15T15:39:52.474778+0000","last_became_peered":"2024-05-15T15:39:52.474778+0000","last_unstale":"2024-05-15T15:39:54.057365+0000","last_undegraded":"2024-05-15T15:39:54.057365+0000","last_fullsized":"2024-05-15T15:39:54.057365+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:18:51.904529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057477+0000","last_change":"2024-05-15T15:39:52.458241+0000","last_active":"2024-05-15T15:39:54.057477+0000","last_peered":"2024-05-15T15:39:54.057477+0000","last_clean":"2024-05-15T15:39:54.057477+0000","last_became_active":"2024-05-15T15:39:52.457883+0000","last_became_peered":"2024-05-15T15:39:52.457883+0000","last_unstale":"2024-05-15T15:39:54.057477+0000","last_undegraded":"2024-05-15T15:39:54.057477+0000","last_fullsized":"2024-05-15T15:39:54.057477+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:19:06.288701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.056535+0000","last_change":"2024-05-15T15:39:52.474619+0000","last_active":"2024-05-15T15:39:54.056535+0000","last_peered":"2024-05-15T15:39:54.056535+0000","last_clean":"2024-05-15T15:39:54.056535+0000","last_became_active":"2024-05-15T15:39:52.474314+0000","last_became_peered":"2024-05-15T15:39:52.474314+0000","last_unstale":"2024-05-15T15:39:54.056535+0000","last_undegraded":"2024-05-15T15:39:54.056535+0000","last_fullsized":"2024-05-15T15:39:54.056535+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:07:46.287281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.463913+0000","last_change":"2024-05-15T15:39:52.468997+0000","last_active":"2024-05-15T15:39:53.463913+0000","last_peered":"2024-05-15T15:39:53.463913+0000","last_clean":"2024-05-15T15:39:53.463913+0000","last_became_active":"2024-05-15T15:39:52.468155+0000","last_became_peered":"2024-05-15T15:39:52.468155+0000","last_unstale":"2024-05-15T15:39:53.463913+0000","last_undegraded":"2024-05-15T15:39:53.463913+0000","last_fullsized":"2024-05-15T15:39:53.463913+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:07:46.287281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.506277+0000","last_change":"2024-05-15T15:39:52.468077+0000","last_active":"2024-05-15T15:39:53.506277+0000","last_peered":"2024-05-15T15:39:53.506277+0000","last_clean":"2024-05-15T15:39:53.506277+0000","last_became_active":"2024-05-15T15:39:52.467754+0000","last_became_peered":"2024-05-15T15:39:52.467754+0000","last_unstale":"2024-05-15T15:39:53.506277+0000","last_undegraded":"2024-05-15T15:39:53.506277+0000","last_fullsized":"2024-05-15T15:39:53.506277+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:46:06.269771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057388+0000","last_change":"2024-05-15T15:39:52.480897+0000","last_active":"2024-05-15T15:39:54.057388+0000","last_peered":"2024-05-15T15:39:54.057388+0000","last_clean":"2024-05-15T15:39:54.057388+0000","last_became_active":"2024-05-15T15:39:52.479910+0000","last_became_peered":"2024-05-15T15:39:52.479910+0000","last_unstale":"2024-05-15T15:39:54.057388+0000","last_undegraded":"2024-05-15T15:39:54.057388+0000","last_fullsized":"2024-05-15T15:39:54.057388+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:13:19.570085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057782+0000","last_change":"2024-05-15T15:39:52.473167+0000","last_active":"2024-05-15T15:39:54.057782+0000","last_peered":"2024-05-15T15:39:54.057782+0000","last_clean":"2024-05-15T15:39:54.057782+0000","last_became_active":"2024-05-15T15:39:52.472835+0000","last_became_peered":"2024-05-15T15:39:52.472835+0000","last_unstale":"2024-05-15T15:39:54.057782+0000","last_undegraded":"2024-05-15T15:39:54.057782+0000","last_fullsized":"2024-05-15T15:39:54.057782+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:39:30.074726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057803+0000","last_change":"2024-05-15T15:39:52.467676+0000","last_active":"2024-05-15T15:39:54.057803+0000","last_peered":"2024-05-15T15:39:54.057803+0000","last_clean":"2024-05-15T15:39:54.057803+0000","last_became_active":"2024-05-15T15:39:52.467064+0000","last_became_peered":"2024-05-15T15:39:52.467064+0000","last_unstale":"2024-05-15T15:39:54.057803+0000","last_undegraded":"2024-05-15T15:39:54.057803+0000","last_fullsized":"2024-05-15T15:39:54.057803+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:58:23.539973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.463567+0000","last_change":"2024-05-15T15:39:52.472464+0000","last_active":"2024-05-15T15:39:53.463567+0000","last_peered":"2024-05-15T15:39:53.463567+0000","last_clean":"2024-05-15T15:39:53.463567+0000","last_became_active":"2024-05-15T15:39:52.472129+0000","last_became_peered":"2024-05-15T15:39:52.472129+0000","last_unstale":"2024-05-15T15:39:53.463567+0000","last_undegraded":"2024-05-15T15:39:53.463567+0000","last_fullsized":"2024-05-15T15:39:53.463567+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:14:40.347641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.463905+0000","last_change":"2024-05-15T15:39:52.465747+0000","last_active":"2024-05-15T15:39:53.463905+0000","last_peered":"2024-05-15T15:39:53.463905+0000","last_clean":"2024-05-15T15:39:53.463905+0000","last_became_active":"2024-05-15T15:39:52.465239+0000","last_became_peered":"2024-05-15T15:39:52.465239+0000","last_unstale":"2024-05-15T15:39:53.463905+0000","last_undegraded":"2024-05-15T15:39:53.463905+0000","last_fullsized":"2024-05-15T15:39:53.463905+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:56:24.242548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.463549+0000","last_change":"2024-05-15T15:39:52.467317+0000","last_active":"2024-05-15T15:39:53.463549+0000","last_peered":"2024-05-15T15:39:53.463549+0000","last_clean":"2024-05-15T15:39:53.463549+0000","last_became_active":"2024-05-15T15:39:52.466968+0000","last_became_peered":"2024-05-15T15:39:52.466968+0000","last_unstale":"2024-05-15T15:39:53.463549+0000","last_undegraded":"2024-05-15T15:39:53.463549+0000","last_fullsized":"2024-05-15T15:39:53.463549+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:36:37.195191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.462383+0000","last_change":"2024-05-15T15:39:52.469584+0000","last_active":"2024-05-15T15:39:53.462383+0000","last_peered":"2024-05-15T15:39:53.462383+0000","last_clean":"2024-05-15T15:39:53.462383+0000","last_became_active":"2024-05-15T15:39:52.469257+0000","last_became_peered":"2024-05-15T15:39:52.469257+0000","last_unstale":"2024-05-15T15:39:53.462383+0000","last_undegraded":"2024-05-15T15:39:53.462383+0000","last_fullsized":"2024-05-15T15:39:53.462383+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:52:43.064362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.463038+0000","last_change":"2024-05-15T15:39:52.473647+0000","last_active":"2024-05-15T15:39:53.463038+0000","last_peered":"2024-05-15T15:39:53.463038+0000","last_clean":"2024-05-15T15:39:53.463038+0000","last_became_active":"2024-05-15T15:39:52.472719+0000","last_became_peered":"2024-05-15T15:39:52.472719+0000","last_unstale":"2024-05-15T15:39:53.463038+0000","last_undegraded":"2024-05-15T15:39:53.463038+0000","last_fullsized":"2024-05-15T15:39:53.463038+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:48:23.434946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.056800+0000","last_change":"2024-05-15T15:39:52.465815+0000","last_active":"2024-05-15T15:39:54.056800+0000","last_peered":"2024-05-15T15:39:54.056800+0000","last_clean":"2024-05-15T15:39:54.056800+0000","last_became_active":"2024-05-15T15:39:52.465471+0000","last_became_peered":"2024-05-15T15:39:52.465471+0000","last_unstale":"2024-05-15T15:39:54.056800+0000","last_undegraded":"2024-05-15T15:39:54.056800+0000","last_fullsized":"2024-05-15T15:39:54.056800+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:53:35.715007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.463021+0000","last_change":"2024-05-15T15:39:52.463837+0000","last_active":"2024-05-15T15:39:53.463021+0000","last_peered":"2024-05-15T15:39:53.463021+0000","last_clean":"2024-05-15T15:39:53.463021+0000","last_became_active":"2024-05-15T15:39:52.459388+0000","last_became_peered":"2024-05-15T15:39:52.459388+0000","last_unstale":"2024-05-15T15:39:53.463021+0000","last_undegraded":"2024-05-15T15:39:53.463021+0000","last_fullsized":"2024-05-15T15:39:53.463021+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:55:50.961472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057274+0000","last_change":"2024-05-15T15:39:52.467411+0000","last_active":"2024-05-15T15:39:54.057274+0000","last_peered":"2024-05-15T15:39:54.057274+0000","last_clean":"2024-05-15T15:39:54.057274+0000","last_became_active":"2024-05-15T15:39:52.466666+0000","last_became_peered":"2024-05-15T15:39:52.466666+0000","last_unstale":"2024-05-15T15:39:54.057274+0000","last_undegraded":"2024-05-15T15:39:54.057274+0000","last_fullsized":"2024-05-15T15:39:54.057274+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:22:17.968105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-15T15:39:51.440698+0000","last_change":"2024-05-15T15:39:51.440698+0000","last_active":"2024-05-15T15:39:51.428802+0000","last_peered":"2024-05-15T15:39:51.428802+0000","last_clean":"2024-05-15T15:39:51.428802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:39:51.440698+0000","last_undegraded":"2024-05-15T15:39:51.440698+0000","last_fullsized":"2024-05-15T15:39:51.440698+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.506016+0000","last_change":"2024-05-15T15:39:52.477675+0000","last_active":"2024-05-15T15:39:53.506016+0000","last_peered":"2024-05-15T15:39:53.506016+0000","last_clean":"2024-05-15T15:39:53.506016+0000","last_became_active":"2024-05-15T15:39:52.477314+0000","last_became_peered":"2024-05-15T15:39:52.477314+0000","last_unstale":"2024-05-15T15:39:53.506016+0000","last_undegraded":"2024-05-15T15:39:53.506016+0000","last_fullsized":"2024-05-15T15:39:53.506016+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:49:27.658296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.463806+0000","last_change":"2024-05-15T15:39:52.471743+0000","last_active":"2024-05-15T15:39:53.463806+0000","last_peered":"2024-05-15T15:39:53.463806+0000","last_clean":"2024-05-15T15:39:53.463806+0000","last_became_active":"2024-05-15T15:39:52.471382+0000","last_became_peered":"2024-05-15T15:39:52.471382+0000","last_unstale":"2024-05-15T15:39:53.463806+0000","last_undegraded":"2024-05-15T15:39:53.463806+0000","last_fullsized":"2024-05-15T15:39:53.463806+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:01:48.794566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.462381+0000","last_change":"2024-05-15T15:39:52.463540+0000","last_active":"2024-05-15T15:39:53.462381+0000","last_peered":"2024-05-15T15:39:53.462381+0000","last_clean":"2024-05-15T15:39:53.462381+0000","last_became_active":"2024-05-15T15:39:52.463162+0000","last_became_peered":"2024-05-15T15:39:52.463162+0000","last_unstale":"2024-05-15T15:39:53.462381+0000","last_undegraded":"2024-05-15T15:39:53.462381+0000","last_fullsized":"2024-05-15T15:39:53.462381+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:18:51.904529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.464627+0000","last_change":"2024-05-15T15:39:52.474224+0000","last_active":"2024-05-15T15:39:53.464627+0000","last_peered":"2024-05-15T15:39:53.464627+0000","last_clean":"2024-05-15T15:39:53.464627+0000","last_became_active":"2024-05-15T15:39:52.473890+0000","last_became_peered":"2024-05-15T15:39:52.473890+0000","last_unstale":"2024-05-15T15:39:53.464627+0000","last_undegraded":"2024-05-15T15:39:53.464627+0000","last_fullsized":"2024-05-15T15:39:53.464627+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:22:17.968105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057129+0000","last_change":"2024-05-15T15:39:52.466971+0000","last_active":"2024-05-15T15:39:54.057129+0000","last_peered":"2024-05-15T15:39:54.057129+0000","last_clean":"2024-05-15T15:39:54.057129+0000","last_became_active":"2024-05-15T15:39:52.466656+0000","last_became_peered":"2024-05-15T15:39:52.466656+0000","last_unstale":"2024-05-15T15:39:54.057129+0000","last_undegraded":"2024-05-15T15:39:54.057129+0000","last_fullsized":"2024-05-15T15:39:54.057129+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:52:27.027535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.464322+0000","last_change":"2024-05-15T15:39:52.470364+0000","last_active":"2024-05-15T15:39:53.464322+0000","last_peered":"2024-05-15T15:39:53.464322+0000","last_clean":"2024-05-15T15:39:53.464322+0000","last_became_active":"2024-05-15T15:39:52.470067+0000","last_became_peered":"2024-05-15T15:39:52.470067+0000","last_unstale":"2024-05-15T15:39:53.464322+0000","last_undegraded":"2024-05-15T15:39:53.464322+0000","last_fullsized":"2024-05-15T15:39:53.464322+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:07:28.350502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.463525+0000","last_change":"2024-05-15T15:39:52.473274+0000","last_active":"2024-05-15T15:39:53.463525+0000","last_peered":"2024-05-15T15:39:53.463525+0000","last_clean":"2024-05-15T15:39:53.463525+0000","last_became_active":"2024-05-15T15:39:52.472954+0000","last_became_peered":"2024-05-15T15:39:52.472954+0000","last_unstale":"2024-05-15T15:39:53.463525+0000","last_undegraded":"2024-05-15T15:39:53.463525+0000","last_fullsized":"2024-05-15T15:39:53.463525+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:46:06.269771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.464564+0000","last_change":"2024-05-15T15:39:52.473238+0000","last_active":"2024-05-15T15:39:53.464564+0000","last_peered":"2024-05-15T15:39:53.464564+0000","last_clean":"2024-05-15T15:39:53.464564+0000","last_became_active":"2024-05-15T15:39:52.472848+0000","last_became_peered":"2024-05-15T15:39:52.472848+0000","last_unstale":"2024-05-15T15:39:53.464564+0000","last_undegraded":"2024-05-15T15:39:53.464564+0000","last_fullsized":"2024-05-15T15:39:53.464564+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:48:53.088055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.462876+0000","last_change":"2024-05-15T15:39:52.464689+0000","last_active":"2024-05-15T15:39:53.462876+0000","last_peered":"2024-05-15T15:39:53.462876+0000","last_clean":"2024-05-15T15:39:53.462876+0000","last_became_active":"2024-05-15T15:39:52.462649+0000","last_became_peered":"2024-05-15T15:39:52.462649+0000","last_unstale":"2024-05-15T15:39:53.462876+0000","last_undegraded":"2024-05-15T15:39:53.462876+0000","last_fullsized":"2024-05-15T15:39:53.462876+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:17:05.581127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.056464+0000","last_change":"2024-05-15T15:39:52.465485+0000","last_active":"2024-05-15T15:39:54.056464+0000","last_peered":"2024-05-15T15:39:54.056464+0000","last_clean":"2024-05-15T15:39:54.056464+0000","last_became_active":"2024-05-15T15:39:52.464733+0000","last_became_peered":"2024-05-15T15:39:52.464733+0000","last_unstale":"2024-05-15T15:39:54.056464+0000","last_undegraded":"2024-05-15T15:39:54.056464+0000","last_fullsized":"2024-05-15T15:39:54.056464+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:17:34.380965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057300+0000","last_change":"2024-05-15T15:39:52.465924+0000","last_active":"2024-05-15T15:39:54.057300+0000","last_peered":"2024-05-15T15:39:54.057300+0000","last_clean":"2024-05-15T15:39:54.057300+0000","last_became_active":"2024-05-15T15:39:52.464704+0000","last_became_peered":"2024-05-15T15:39:52.464704+0000","last_unstale":"2024-05-15T15:39:54.057300+0000","last_undegraded":"2024-05-15T15:39:54.057300+0000","last_fullsized":"2024-05-15T15:39:54.057300+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:49:27.658296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.506001+0000","last_change":"2024-05-15T15:39:52.465099+0000","last_active":"2024-05-15T15:39:53.506001+0000","last_peered":"2024-05-15T15:39:53.506001+0000","last_clean":"2024-05-15T15:39:53.506001+0000","last_became_active":"2024-05-15T15:39:52.464775+0000","last_became_peered":"2024-05-15T15:39:52.464775+0000","last_unstale":"2024-05-15T15:39:53.506001+0000","last_undegraded":"2024-05-15T15:39:53.506001+0000","last_fullsized":"2024-05-15T15:39:53.506001+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:52:27.027535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.464681+0000","last_change":"2024-05-15T15:39:51.443546+0000","last_active":"2024-05-15T15:39:53.464681+0000","last_peered":"2024-05-15T15:39:53.464681+0000","last_clean":"2024-05-15T15:39:53.464681+0000","last_became_active":"2024-05-15T15:39:51.443177+0000","last_became_peered":"2024-05-15T15:39:51.443177+0000","last_unstale":"2024-05-15T15:39:53.464681+0000","last_undegraded":"2024-05-15T15:39:53.464681+0000","last_fullsized":"2024-05-15T15:39:53.464681+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:18:35.801621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-15T15:39:51.436958+0000","last_change":"2024-05-15T15:39:51.436958+0000","last_active":"2024-05-15T15:39:51.428802+0000","last_peered":"2024-05-15T15:39:51.428802+0000","last_clean":"2024-05-15T15:39:51.428802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:39:51.436958+0000","last_undegraded":"2024-05-15T15:39:51.436958+0000","last_fullsized":"2024-05-15T15:39:51.436958+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.462997+0000","last_change":"2024-05-15T15:39:51.451403+0000","last_active":"2024-05-15T15:39:53.462997+0000","last_peered":"2024-05-15T15:39:53.462997+0000","last_clean":"2024-05-15T15:39:53.462997+0000","last_became_active":"2024-05-15T15:39:51.451074+0000","last_became_peered":"2024-05-15T15:39:51.451074+0000","last_unstale":"2024-05-15T15:39:53.462997+0000","last_undegraded":"2024-05-15T15:39:53.462997+0000","last_fullsized":"2024-05-15T15:39:53.462997+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:52:26.020009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.463548+0000","last_change":"2024-05-15T15:39:51.457243+0000","last_active":"2024-05-15T15:39:53.463548+0000","last_peered":"2024-05-15T15:39:53.463548+0000","last_clean":"2024-05-15T15:39:53.463548+0000","last_became_active":"2024-05-15T15:39:51.456904+0000","last_became_peered":"2024-05-15T15:39:51.456904+0000","last_unstale":"2024-05-15T15:39:53.463548+0000","last_undegraded":"2024-05-15T15:39:53.463548+0000","last_fullsized":"2024-05-15T15:39:53.463548+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:45:30.896866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.464271+0000","last_change":"2024-05-15T15:39:52.461438+0000","last_active":"2024-05-15T15:39:53.464271+0000","last_peered":"2024-05-15T15:39:53.464271+0000","last_clean":"2024-05-15T15:39:53.464271+0000","last_became_active":"2024-05-15T15:39:52.460666+0000","last_became_peered":"2024-05-15T15:39:52.460666+0000","last_unstale":"2024-05-15T15:39:53.464271+0000","last_undegraded":"2024-05-15T15:39:53.464271+0000","last_fullsized":"2024-05-15T15:39:53.464271+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:35:07.996967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.462502+0000","last_change":"2024-05-15T15:39:51.444590+0000","last_active":"2024-05-15T15:39:53.462502+0000","last_peered":"2024-05-15T15:39:53.462502+0000","last_clean":"2024-05-15T15:39:53.462502+0000","last_became_active":"2024-05-15T15:39:51.444114+0000","last_became_peered":"2024-05-15T15:39:51.444114+0000","last_unstale":"2024-05-15T15:39:53.462502+0000","last_undegraded":"2024-05-15T15:39:53.462502+0000","last_fullsized":"2024-05-15T15:39:53.462502+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:17:33.373439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-15T15:39:51.437645+0000","last_change":"2024-05-15T15:39:51.437645+0000","last_active":"2024-05-15T15:39:51.428802+0000","last_peered":"2024-05-15T15:39:51.428802+0000","last_clean":"2024-05-15T15:39:51.428802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:39:51.437645+0000","last_undegraded":"2024-05-15T15:39:51.437645+0000","last_fullsized":"2024-05-15T15:39:51.437645+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.506255+0000","last_change":"2024-05-15T15:39:51.453203+0000","last_active":"2024-05-15T15:39:53.506255+0000","last_peered":"2024-05-15T15:39:53.506255+0000","last_clean":"2024-05-15T15:39:53.506255+0000","last_became_active":"2024-05-15T15:39:51.452835+0000","last_became_peered":"2024-05-15T15:39:51.452835+0000","last_unstale":"2024-05-15T15:39:53.506255+0000","last_undegraded":"2024-05-15T15:39:53.506255+0000","last_fullsized":"2024-05-15T15:39:53.506255+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:00:28.591473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057390+0000","last_change":"2024-05-15T15:39:52.467091+0000","last_active":"2024-05-15T15:39:54.057390+0000","last_peered":"2024-05-15T15:39:54.057390+0000","last_clean":"2024-05-15T15:39:54.057390+0000","last_became_active":"2024-05-15T15:39:52.465260+0000","last_became_peered":"2024-05-15T15:39:52.465260+0000","last_unstale":"2024-05-15T15:39:54.057390+0000","last_undegraded":"2024-05-15T15:39:54.057390+0000","last_fullsized":"2024-05-15T15:39:54.057390+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:46:06.269771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057238+0000","last_change":"2024-05-15T15:39:51.459005+0000","last_active":"2024-05-15T15:39:54.057238+0000","last_peered":"2024-05-15T15:39:54.057238+0000","last_clean":"2024-05-15T15:39:54.057238+0000","last_became_active":"2024-05-15T15:39:51.458484+0000","last_became_peered":"2024-05-15T15:39:51.458484+0000","last_unstale":"2024-05-15T15:39:54.057238+0000","last_undegraded":"2024-05-15T15:39:54.057238+0000","last_fullsized":"2024-05-15T15:39:54.057238+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:53:34.707481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.464984+0000","last_change":"2024-05-15T15:39:52.470997+0000","last_active":"2024-05-15T15:39:53.464984+0000","last_peered":"2024-05-15T15:39:53.464984+0000","last_clean":"2024-05-15T15:39:53.464984+0000","last_became_active":"2024-05-15T15:39:52.470669+0000","last_became_peered":"2024-05-15T15:39:52.470669+0000","last_unstale":"2024-05-15T15:39:53.464984+0000","last_undegraded":"2024-05-15T15:39:53.464984+0000","last_fullsized":"2024-05-15T15:39:53.464984+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:52:43.064362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.056727+0000","last_change":"2024-05-15T15:39:51.448163+0000","last_active":"2024-05-15T15:39:54.056727+0000","last_peered":"2024-05-15T15:39:54.056727+0000","last_clean":"2024-05-15T15:39:54.056727+0000","last_became_active":"2024-05-15T15:39:51.447878+0000","last_became_peered":"2024-05-15T15:39:51.447878+0000","last_unstale":"2024-05-15T15:39:54.056727+0000","last_undegraded":"2024-05-15T15:39:54.056727+0000","last_fullsized":"2024-05-15T15:39:54.056727+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:45:30.896866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.463183+0000","last_change":"2024-05-15T15:39:52.471719+0000","last_active":"2024-05-15T15:39:53.463183+0000","last_peered":"2024-05-15T15:39:53.463183+0000","last_clean":"2024-05-15T15:39:53.463183+0000","last_became_active":"2024-05-15T15:39:52.471352+0000","last_became_peered":"2024-05-15T15:39:52.471352+0000","last_unstale":"2024-05-15T15:39:53.463183+0000","last_undegraded":"2024-05-15T15:39:53.463183+0000","last_fullsized":"2024-05-15T15:39:53.463183+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:09:35.247678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"22'6","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.056826+0000","last_change":"2024-05-15T15:39:51.449551+0000","last_active":"2024-05-15T15:39:54.056826+0000","last_peered":"2024-05-15T15:39:54.056826+0000","last_clean":"2024-05-15T15:39:54.056826+0000","last_became_active":"2024-05-15T15:39:51.449185+0000","last_became_peered":"2024-05-15T15:39:51.449185+0000","last_unstale":"2024-05-15T15:39:54.056826+0000","last_undegraded":"2024-05-15T15:39:54.056826+0000","last_fullsized":"2024-05-15T15:39:54.056826+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:56:40.086761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057182+0000","last_change":"2024-05-15T15:39:52.477094+0000","last_active":"2024-05-15T15:39:54.057182+0000","last_peered":"2024-05-15T15:39:54.057182+0000","last_clean":"2024-05-15T15:39:54.057182+0000","last_became_active":"2024-05-15T15:39:52.476694+0000","last_became_peered":"2024-05-15T15:39:52.476694+0000","last_unstale":"2024-05-15T15:39:54.057182+0000","last_undegraded":"2024-05-15T15:39:54.057182+0000","last_fullsized":"2024-05-15T15:39:54.057182+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:48:53.088055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057190+0000","last_change":"2024-05-15T15:39:51.455537+0000","last_active":"2024-05-15T15:39:54.057190+0000","last_peered":"2024-05-15T15:39:54.057190+0000","last_clean":"2024-05-15T15:39:54.057190+0000","last_became_active":"2024-05-15T15:39:51.455169+0000","last_became_peered":"2024-05-15T15:39:51.455169+0000","last_unstale":"2024-05-15T15:39:54.057190+0000","last_undegraded":"2024-05-15T15:39:54.057190+0000","last_fullsized":"2024-05-15T15:39:54.057190+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:15:32.911265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.464093+0000","last_change":"2024-05-15T15:39:52.464580+0000","last_active":"2024-05-15T15:39:53.464093+0000","last_peered":"2024-05-15T15:39:53.464093+0000","last_clean":"2024-05-15T15:39:53.464093+0000","last_became_active":"2024-05-15T15:39:52.464252+0000","last_became_peered":"2024-05-15T15:39:52.464252+0000","last_unstale":"2024-05-15T15:39:53.464093+0000","last_undegraded":"2024-05-15T15:39:53.464093+0000","last_fullsized":"2024-05-15T15:39:53.464093+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:00:28.874513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.463192+0000","last_change":"2024-05-15T15:39:51.456191+0000","last_active":"2024-05-15T15:39:53.463192+0000","last_peered":"2024-05-15T15:39:53.463192+0000","last_clean":"2024-05-15T15:39:53.463192+0000","last_became_active":"2024-05-15T15:39:51.455844+0000","last_became_peered":"2024-05-15T15:39:51.455844+0000","last_unstale":"2024-05-15T15:39:53.463192+0000","last_undegraded":"2024-05-15T15:39:53.463192+0000","last_fullsized":"2024-05-15T15:39:53.463192+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:19:05.281175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.462897+0000","last_change":"2024-05-15T15:39:52.473375+0000","last_active":"2024-05-15T15:39:53.462897+0000","last_peered":"2024-05-15T15:39:53.462897+0000","last_clean":"2024-05-15T15:39:53.462897+0000","last_became_active":"2024-05-15T15:39:52.473046+0000","last_became_peered":"2024-05-15T15:39:52.473046+0000","last_unstale":"2024-05-15T15:39:53.462897+0000","last_undegraded":"2024-05-15T15:39:53.462897+0000","last_fullsized":"2024-05-15T15:39:53.462897+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:15:12.564736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.056485+0000","last_change":"2024-05-15T15:39:51.461928+0000","last_active":"2024-05-15T15:39:54.056485+0000","last_peered":"2024-05-15T15:39:54.056485+0000","last_clean":"2024-05-15T15:39:54.056485+0000","last_became_active":"2024-05-15T15:39:51.461604+0000","last_became_peered":"2024-05-15T15:39:51.461604+0000","last_unstale":"2024-05-15T15:39:54.056485+0000","last_undegraded":"2024-05-15T15:39:54.056485+0000","last_fullsized":"2024-05-15T15:39:54.056485+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:13:01.291506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.505919+0000","last_change":"2024-05-15T15:39:52.474668+0000","last_active":"2024-05-15T15:39:53.505919+0000","last_peered":"2024-05-15T15:39:53.505919+0000","last_clean":"2024-05-15T15:39:53.505919+0000","last_became_active":"2024-05-15T15:39:52.474222+0000","last_became_peered":"2024-05-15T15:39:52.474222+0000","last_unstale":"2024-05-15T15:39:53.505919+0000","last_undegraded":"2024-05-15T15:39:53.505919+0000","last_fullsized":"2024-05-15T15:39:53.505919+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:53:35.715007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T15:39:51.447890+0000","last_change":"2024-05-15T15:39:51.446711+0000","last_active":"2024-05-15T15:39:51.447890+0000","last_peered":"2024-05-15T15:39:51.447890+0000","last_clean":"2024-05-15T15:39:51.447890+0000","last_became_active":"2024-05-15T15:39:51.446392+0000","last_became_peered":"2024-05-15T15:39:51.446392+0000","last_unstale":"2024-05-15T15:39:51.447890+0000","last_undegraded":"2024-05-15T15:39:51.447890+0000","last_fullsized":"2024-05-15T15:39:51.447890+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:15:48.685660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.462447+0000","last_change":"2024-05-15T15:39:52.468710+0000","last_active":"2024-05-15T15:39:53.462447+0000","last_peered":"2024-05-15T15:39:53.462447+0000","last_clean":"2024-05-15T15:39:53.462447+0000","last_became_active":"2024-05-15T15:39:52.468364+0000","last_became_peered":"2024-05-15T15:39:52.468364+0000","last_unstale":"2024-05-15T15:39:53.462447+0000","last_undegraded":"2024-05-15T15:39:53.462447+0000","last_fullsized":"2024-05-15T15:39:53.462447+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:39:07.633570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057781+0000","last_change":"2024-05-15T15:39:51.454815+0000","last_active":"2024-05-15T15:39:54.057781+0000","last_peered":"2024-05-15T15:39:54.057781+0000","last_clean":"2024-05-15T15:39:54.057781+0000","last_became_active":"2024-05-15T15:39:51.454302+0000","last_became_peered":"2024-05-15T15:39:51.454302+0000","last_unstale":"2024-05-15T15:39:54.057781+0000","last_undegraded":"2024-05-15T15:39:54.057781+0000","last_fullsized":"2024-05-15T15:39:54.057781+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:52:26.020009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057590+0000","last_change":"2024-05-15T15:39:52.478397+0000","last_active":"2024-05-15T15:39:54.057590+0000","last_peered":"2024-05-15T15:39:54.057590+0000","last_clean":"2024-05-15T15:39:54.057590+0000","last_became_active":"2024-05-15T15:39:52.477855+0000","last_became_peered":"2024-05-15T15:39:52.477855+0000","last_unstale":"2024-05-15T15:39:54.057590+0000","last_undegraded":"2024-05-15T15:39:54.057590+0000","last_fullsized":"2024-05-15T15:39:54.057590+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:43:53.153262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T15:39:51.452447+0000","last_change":"2024-05-15T15:39:51.451802+0000","last_active":"2024-05-15T15:39:51.452447+0000","last_peered":"2024-05-15T15:39:51.452447+0000","last_clean":"2024-05-15T15:39:51.452447+0000","last_became_active":"2024-05-15T15:39:51.451413+0000","last_became_peered":"2024-05-15T15:39:51.451413+0000","last_unstale":"2024-05-15T15:39:51.452447+0000","last_undegraded":"2024-05-15T15:39:51.452447+0000","last_fullsized":"2024-05-15T15:39:51.452447+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:44:16.985300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057652+0000","last_change":"2024-05-15T15:39:52.477925+0000","last_active":"2024-05-15T15:39:54.057652+0000","last_peered":"2024-05-15T15:39:54.057652+0000","last_clean":"2024-05-15T15:39:54.057652+0000","last_became_active":"2024-05-15T15:39:52.477255+0000","last_became_peered":"2024-05-15T15:39:52.477255+0000","last_unstale":"2024-05-15T15:39:54.057652+0000","last_undegraded":"2024-05-15T15:39:54.057652+0000","last_fullsized":"2024-05-15T15:39:54.057652+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:39:07.633570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.464272+0000","last_change":"2024-05-15T15:39:51.450383+0000","last_active":"2024-05-15T15:39:53.464272+0000","last_peered":"2024-05-15T15:39:53.464272+0000","last_clean":"2024-05-15T15:39:53.464272+0000","last_became_active":"2024-05-15T15:39:51.449318+0000","last_became_peered":"2024-05-15T15:39:51.449318+0000","last_unstale":"2024-05-15T15:39:53.464272+0000","last_undegraded":"2024-05-15T15:39:53.464272+0000","last_fullsized":"2024-05-15T15:39:53.464272+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:17:33.373439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057489+0000","last_change":"2024-05-15T15:39:52.471316+0000","last_active":"2024-05-15T15:39:54.057489+0000","last_peered":"2024-05-15T15:39:54.057489+0000","last_clean":"2024-05-15T15:39:54.057489+0000","last_became_active":"2024-05-15T15:39:52.471014+0000","last_became_peered":"2024-05-15T15:39:52.471014+0000","last_unstale":"2024-05-15T15:39:54.057489+0000","last_undegraded":"2024-05-15T15:39:54.057489+0000","last_fullsized":"2024-05-15T15:39:54.057489+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:52:43.064362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.463830+0000","last_change":"2024-05-15T15:39:51.454584+0000","last_active":"2024-05-15T15:39:53.463830+0000","last_peered":"2024-05-15T15:39:53.463830+0000","last_clean":"2024-05-15T15:39:53.463830+0000","last_became_active":"2024-05-15T15:39:51.454260+0000","last_became_peered":"2024-05-15T15:39:51.454260+0000","last_unstale":"2024-05-15T15:39:53.463830+0000","last_undegraded":"2024-05-15T15:39:53.463830+0000","last_fullsized":"2024-05-15T15:39:53.463830+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:17:48.368852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.462838+0000","last_change":"2024-05-15T15:39:52.464130+0000","last_active":"2024-05-15T15:39:53.462838+0000","last_peered":"2024-05-15T15:39:53.462838+0000","last_clean":"2024-05-15T15:39:53.462838+0000","last_became_active":"2024-05-15T15:39:52.463486+0000","last_became_peered":"2024-05-15T15:39:52.463486+0000","last_unstale":"2024-05-15T15:39:53.462838+0000","last_undegraded":"2024-05-15T15:39:53.462838+0000","last_fullsized":"2024-05-15T15:39:53.462838+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:58:23.539973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":110,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.505802+0000","last_change":"2024-05-15T15:39:42.584601+0000","last_active":"2024-05-15T15:39:53.505802+0000","last_peered":"2024-05-15T15:39:53.505802+0000","last_clean":"2024-05-15T15:39:53.505802+0000","last_became_active":"2024-05-15T15:39:42.584129+0000","last_became_peered":"2024-05-15T15:39:42.584129+0000","last_unstale":"2024-05-15T15:39:53.505802+0000","last_undegraded":"2024-05-15T15:39:53.505802+0000","last_fullsized":"2024-05-15T15:39:53.505802+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:41.378107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:41.378107+0000","last_clean_scrub_stamp":"2024-05-15T15:39:41.378107+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:23:25.285669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.462726+0000","last_change":"2024-05-15T15:39:51.451749+0000","last_active":"2024-05-15T15:39:53.462726+0000","last_peered":"2024-05-15T15:39:53.462726+0000","last_clean":"2024-05-15T15:39:53.462726+0000","last_became_active":"2024-05-15T15:39:51.451438+0000","last_became_peered":"2024-05-15T15:39:51.451438+0000","last_unstale":"2024-05-15T15:39:53.462726+0000","last_undegraded":"2024-05-15T15:39:53.462726+0000","last_fullsized":"2024-05-15T15:39:53.462726+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:46:05.262245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-15T15:39:51.438340+0000","last_change":"2024-05-15T15:39:51.438340+0000","last_active":"2024-05-15T15:39:51.428802+0000","last_peered":"2024-05-15T15:39:51.428802+0000","last_clean":"2024-05-15T15:39:51.428802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:39:51.438340+0000","last_undegraded":"2024-05-15T15:39:51.438340+0000","last_fullsized":"2024-05-15T15:39:51.438340+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.462612+0000","last_change":"2024-05-15T15:39:51.457051+0000","last_active":"2024-05-15T15:39:53.462612+0000","last_peered":"2024-05-15T15:39:53.462612+0000","last_clean":"2024-05-15T15:39:53.462612+0000","last_became_active":"2024-05-15T15:39:51.456748+0000","last_became_peered":"2024-05-15T15:39:51.456748+0000","last_unstale":"2024-05-15T15:39:53.462612+0000","last_undegraded":"2024-05-15T15:39:53.462612+0000","last_fullsized":"2024-05-15T15:39:53.462612+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:53:34.707481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.463666+0000","last_change":"2024-05-15T15:39:52.467728+0000","last_active":"2024-05-15T15:39:53.463666+0000","last_peered":"2024-05-15T15:39:53.463666+0000","last_clean":"2024-05-15T15:39:53.463666+0000","last_became_active":"2024-05-15T15:39:52.467352+0000","last_became_peered":"2024-05-15T15:39:52.467352+0000","last_unstale":"2024-05-15T15:39:53.463666+0000","last_undegraded":"2024-05-15T15:39:53.463666+0000","last_fullsized":"2024-05-15T15:39:53.463666+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:19:06.288701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.056496+0000","last_change":"2024-05-15T15:39:51.454058+0000","last_active":"2024-05-15T15:39:54.056496+0000","last_peered":"2024-05-15T15:39:54.056496+0000","last_clean":"2024-05-15T15:39:54.056496+0000","last_became_active":"2024-05-15T15:39:51.453765+0000","last_became_peered":"2024-05-15T15:39:51.453765+0000","last_unstale":"2024-05-15T15:39:54.056496+0000","last_undegraded":"2024-05-15T15:39:54.056496+0000","last_fullsized":"2024-05-15T15:39:54.056496+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:17:48.368852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.464095+0000","last_change":"2024-05-15T15:39:52.474812+0000","last_active":"2024-05-15T15:39:53.464095+0000","last_peered":"2024-05-15T15:39:53.464095+0000","last_clean":"2024-05-15T15:39:53.464095+0000","last_became_active":"2024-05-15T15:39:52.472883+0000","last_became_peered":"2024-05-15T15:39:52.472883+0000","last_unstale":"2024-05-15T15:39:53.464095+0000","last_undegraded":"2024-05-15T15:39:53.464095+0000","last_fullsized":"2024-05-15T15:39:53.464095+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:00:05.496148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.463124+0000","last_change":"2024-05-15T15:39:51.449647+0000","last_active":"2024-05-15T15:39:53.463124+0000","last_peered":"2024-05-15T15:39:53.463124+0000","last_clean":"2024-05-15T15:39:53.463124+0000","last_became_active":"2024-05-15T15:39:51.449332+0000","last_became_peered":"2024-05-15T15:39:51.449332+0000","last_unstale":"2024-05-15T15:39:53.463124+0000","last_undegraded":"2024-05-15T15:39:53.463124+0000","last_fullsized":"2024-05-15T15:39:53.463124+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:43:52.145736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.056740+0000","last_change":"2024-05-15T15:39:52.479896+0000","last_active":"2024-05-15T15:39:54.056740+0000","last_peered":"2024-05-15T15:39:54.056740+0000","last_clean":"2024-05-15T15:39:54.056740+0000","last_became_active":"2024-05-15T15:39:52.479462+0000","last_became_peered":"2024-05-15T15:39:52.479462+0000","last_unstale":"2024-05-15T15:39:54.056740+0000","last_undegraded":"2024-05-15T15:39:54.056740+0000","last_fullsized":"2024-05-15T15:39:54.056740+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:00:05.496148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.463525+0000","last_change":"2024-05-15T15:39:51.450193+0000","last_active":"2024-05-15T15:39:53.463525+0000","last_peered":"2024-05-15T15:39:53.463525+0000","last_clean":"2024-05-15T15:39:53.463525+0000","last_became_active":"2024-05-15T15:39:51.449868+0000","last_became_peered":"2024-05-15T15:39:51.449868+0000","last_unstale":"2024-05-15T15:39:53.463525+0000","last_undegraded":"2024-05-15T15:39:53.463525+0000","last_fullsized":"2024-05-15T15:39:53.463525+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:13:01.291506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057411+0000","last_change":"2024-05-15T15:39:52.466700+0000","last_active":"2024-05-15T15:39:54.057411+0000","last_peered":"2024-05-15T15:39:54.057411+0000","last_clean":"2024-05-15T15:39:54.057411+0000","last_became_active":"2024-05-15T15:39:52.464696+0000","last_became_peered":"2024-05-15T15:39:52.464696+0000","last_unstale":"2024-05-15T15:39:54.057411+0000","last_undegraded":"2024-05-15T15:39:54.057411+0000","last_fullsized":"2024-05-15T15:39:54.057411+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:14:40.347641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.463133+0000","last_change":"2024-05-15T15:39:51.449690+0000","last_active":"2024-05-15T15:39:53.463133+0000","last_peered":"2024-05-15T15:39:53.463133+0000","last_clean":"2024-05-15T15:39:53.463133+0000","last_became_active":"2024-05-15T15:39:51.448404+0000","last_became_peered":"2024-05-15T15:39:51.448404+0000","last_unstale":"2024-05-15T15:39:53.463133+0000","last_undegraded":"2024-05-15T15:39:53.463133+0000","last_fullsized":"2024-05-15T15:39:53.463133+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:56:23.235022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.463699+0000","last_change":"2024-05-15T15:39:52.475321+0000","last_active":"2024-05-15T15:39:53.463699+0000","last_peered":"2024-05-15T15:39:53.463699+0000","last_clean":"2024-05-15T15:39:53.463699+0000","last_became_active":"2024-05-15T15:39:52.475018+0000","last_became_peered":"2024-05-15T15:39:52.475018+0000","last_unstale":"2024-05-15T15:39:53.463699+0000","last_undegraded":"2024-05-15T15:39:53.463699+0000","last_fullsized":"2024-05-15T15:39:53.463699+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:43:53.153262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T15:39:51.456912+0000","last_change":"2024-05-15T15:39:51.455435+0000","last_active":"2024-05-15T15:39:51.456912+0000","last_peered":"2024-05-15T15:39:51.456912+0000","last_clean":"2024-05-15T15:39:51.456912+0000","last_became_active":"2024-05-15T15:39:51.455047+0000","last_became_peered":"2024-05-15T15:39:51.455047+0000","last_unstale":"2024-05-15T15:39:51.456912+0000","last_undegraded":"2024-05-15T15:39:51.456912+0000","last_fullsized":"2024-05-15T15:39:51.456912+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:16:06.081249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-15T15:39:51.439295+0000","last_change":"2024-05-15T15:39:51.439295+0000","last_active":"2024-05-15T15:39:51.428802+0000","last_peered":"2024-05-15T15:39:51.428802+0000","last_clean":"2024-05-15T15:39:51.428802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:39:51.439295+0000","last_undegraded":"2024-05-15T15:39:51.439295+0000","last_fullsized":"2024-05-15T15:39:51.439295+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.463011+0000","last_change":"2024-05-15T15:39:51.456218+0000","last_active":"2024-05-15T15:39:53.463011+0000","last_peered":"2024-05-15T15:39:53.463011+0000","last_clean":"2024-05-15T15:39:53.463011+0000","last_became_active":"2024-05-15T15:39:51.455592+0000","last_became_peered":"2024-05-15T15:39:51.455592+0000","last_unstale":"2024-05-15T15:39:53.463011+0000","last_undegraded":"2024-05-15T15:39:53.463011+0000","last_fullsized":"2024-05-15T15:39:53.463011+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:14:39.340114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-15T15:39:51.438842+0000","last_change":"2024-05-15T15:39:51.438842+0000","last_active":"2024-05-15T15:39:51.428802+0000","last_peered":"2024-05-15T15:39:51.428802+0000","last_clean":"2024-05-15T15:39:51.428802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:39:51.438842+0000","last_undegraded":"2024-05-15T15:39:51.438842+0000","last_fullsized":"2024-05-15T15:39:51.438842+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.056270+0000","last_change":"2024-05-15T15:39:51.456266+0000","last_active":"2024-05-15T15:39:54.056270+0000","last_peered":"2024-05-15T15:39:54.056270+0000","last_clean":"2024-05-15T15:39:54.056270+0000","last_became_active":"2024-05-15T15:39:51.455914+0000","last_became_peered":"2024-05-15T15:39:51.455914+0000","last_unstale":"2024-05-15T15:39:54.056270+0000","last_undegraded":"2024-05-15T15:39:54.056270+0000","last_fullsized":"2024-05-15T15:39:54.056270+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:18:35.801621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.463115+0000","last_change":"2024-05-15T15:39:52.462843+0000","last_active":"2024-05-15T15:39:53.463115+0000","last_peered":"2024-05-15T15:39:53.463115+0000","last_clean":"2024-05-15T15:39:53.463115+0000","last_became_active":"2024-05-15T15:39:52.459592+0000","last_became_peered":"2024-05-15T15:39:52.459592+0000","last_unstale":"2024-05-15T15:39:53.463115+0000","last_undegraded":"2024-05-15T15:39:53.463115+0000","last_fullsized":"2024-05-15T15:39:53.463115+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:19:16.899508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T15:39:51.457637+0000","last_change":"2024-05-15T15:39:51.456133+0000","last_active":"2024-05-15T15:39:51.457637+0000","last_peered":"2024-05-15T15:39:51.457637+0000","last_clean":"2024-05-15T15:39:51.457637+0000","last_became_active":"2024-05-15T15:39:51.455602+0000","last_became_peered":"2024-05-15T15:39:51.455602+0000","last_unstale":"2024-05-15T15:39:51.457637+0000","last_undegraded":"2024-05-15T15:39:51.457637+0000","last_fullsized":"2024-05-15T15:39:51.457637+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:04:40.612468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-15T15:39:51.437692+0000","last_change":"2024-05-15T15:39:51.437692+0000","last_active":"2024-05-15T15:39:51.428802+0000","last_peered":"2024-05-15T15:39:51.428802+0000","last_clean":"2024-05-15T15:39:51.428802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:39:51.437692+0000","last_undegraded":"2024-05-15T15:39:51.437692+0000","last_fullsized":"2024-05-15T15:39:51.437692+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.464110+0000","last_change":"2024-05-15T15:39:51.453591+0000","last_active":"2024-05-15T15:39:53.464110+0000","last_peered":"2024-05-15T15:39:53.464110+0000","last_clean":"2024-05-15T15:39:53.464110+0000","last_became_active":"2024-05-15T15:39:51.453250+0000","last_became_peered":"2024-05-15T15:39:51.453250+0000","last_unstale":"2024-05-15T15:39:53.464110+0000","last_undegraded":"2024-05-15T15:39:53.464110+0000","last_fullsized":"2024-05-15T15:39:53.464110+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:15:32.911265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057214+0000","last_change":"2024-05-15T15:39:52.469345+0000","last_active":"2024-05-15T15:39:54.057214+0000","last_peered":"2024-05-15T15:39:54.057214+0000","last_clean":"2024-05-15T15:39:54.057214+0000","last_became_active":"2024-05-15T15:39:52.469041+0000","last_became_peered":"2024-05-15T15:39:52.469041+0000","last_unstale":"2024-05-15T15:39:54.057214+0000","last_undegraded":"2024-05-15T15:39:54.057214+0000","last_fullsized":"2024-05-15T15:39:54.057214+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:52:27.027535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.462608+0000","last_change":"2024-05-15T15:39:51.450991+0000","last_active":"2024-05-15T15:39:53.462608+0000","last_peered":"2024-05-15T15:39:53.462608+0000","last_clean":"2024-05-15T15:39:53.462608+0000","last_became_active":"2024-05-15T15:39:51.450600+0000","last_became_peered":"2024-05-15T15:39:51.450600+0000","last_unstale":"2024-05-15T15:39:53.462608+0000","last_undegraded":"2024-05-15T15:39:53.462608+0000","last_fullsized":"2024-05-15T15:39:53.462608+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:49:26.650770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.462903+0000","last_change":"2024-05-15T15:39:52.462106+0000","last_active":"2024-05-15T15:39:53.462903+0000","last_peered":"2024-05-15T15:39:53.462903+0000","last_clean":"2024-05-15T15:39:53.462903+0000","last_became_active":"2024-05-15T15:39:52.461217+0000","last_became_peered":"2024-05-15T15:39:52.461217+0000","last_unstale":"2024-05-15T15:39:53.462903+0000","last_undegraded":"2024-05-15T15:39:53.462903+0000","last_fullsized":"2024-05-15T15:39:53.462903+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:41:33.947325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.462652+0000","last_change":"2024-05-15T15:39:52.473917+0000","last_active":"2024-05-15T15:39:53.462652+0000","last_peered":"2024-05-15T15:39:53.462652+0000","last_clean":"2024-05-15T15:39:53.462652+0000","last_became_active":"2024-05-15T15:39:52.472408+0000","last_became_peered":"2024-05-15T15:39:52.472408+0000","last_unstale":"2024-05-15T15:39:53.462652+0000","last_undegraded":"2024-05-15T15:39:53.462652+0000","last_fullsized":"2024-05-15T15:39:53.462652+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:39:30.074726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057634+0000","last_change":"2024-05-15T15:39:51.458878+0000","last_active":"2024-05-15T15:39:54.057634+0000","last_peered":"2024-05-15T15:39:54.057634+0000","last_clean":"2024-05-15T15:39:54.057634+0000","last_became_active":"2024-05-15T15:39:51.458527+0000","last_became_peered":"2024-05-15T15:39:51.458527+0000","last_unstale":"2024-05-15T15:39:54.057634+0000","last_undegraded":"2024-05-15T15:39:54.057634+0000","last_fullsized":"2024-05-15T15:39:54.057634+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:14:39.340114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.506342+0000","last_change":"2024-05-15T15:39:52.479684+0000","last_active":"2024-05-15T15:39:53.506342+0000","last_peered":"2024-05-15T15:39:53.506342+0000","last_clean":"2024-05-15T15:39:53.506342+0000","last_became_active":"2024-05-15T15:39:52.479359+0000","last_became_peered":"2024-05-15T15:39:52.479359+0000","last_unstale":"2024-05-15T15:39:53.506342+0000","last_undegraded":"2024-05-15T15:39:53.506342+0000","last_fullsized":"2024-05-15T15:39:53.506342+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:14:40.347641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057324+0000","last_change":"2024-05-15T15:39:51.459312+0000","last_active":"2024-05-15T15:39:54.057324+0000","last_peered":"2024-05-15T15:39:54.057324+0000","last_clean":"2024-05-15T15:39:54.057324+0000","last_became_active":"2024-05-15T15:39:51.458739+0000","last_became_peered":"2024-05-15T15:39:51.458739+0000","last_unstale":"2024-05-15T15:39:54.057324+0000","last_undegraded":"2024-05-15T15:39:54.057324+0000","last_fullsized":"2024-05-15T15:39:54.057324+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:17:33.373439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.464791+0000","last_change":"2024-05-15T15:39:52.472300+0000","last_active":"2024-05-15T15:39:53.464791+0000","last_peered":"2024-05-15T15:39:53.464791+0000","last_clean":"2024-05-15T15:39:53.464791+0000","last_became_active":"2024-05-15T15:39:52.472005+0000","last_became_peered":"2024-05-15T15:39:52.472005+0000","last_unstale":"2024-05-15T15:39:53.464791+0000","last_undegraded":"2024-05-15T15:39:53.464791+0000","last_fullsized":"2024-05-15T15:39:53.464791+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:18:51.904529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.465122+0000","last_change":"2024-05-15T15:39:51.451702+0000","last_active":"2024-05-15T15:39:53.465122+0000","last_peered":"2024-05-15T15:39:53.465122+0000","last_clean":"2024-05-15T15:39:53.465122+0000","last_became_active":"2024-05-15T15:39:51.451387+0000","last_became_peered":"2024-05-15T15:39:51.451387+0000","last_unstale":"2024-05-15T15:39:53.465122+0000","last_undegraded":"2024-05-15T15:39:53.465122+0000","last_fullsized":"2024-05-15T15:39:53.465122+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:23:00.828647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.465209+0000","last_change":"2024-05-15T15:39:52.473199+0000","last_active":"2024-05-15T15:39:53.465209+0000","last_peered":"2024-05-15T15:39:53.465209+0000","last_clean":"2024-05-15T15:39:53.465209+0000","last_became_active":"2024-05-15T15:39:52.472848+0000","last_became_peered":"2024-05-15T15:39:52.472848+0000","last_unstale":"2024-05-15T15:39:53.465209+0000","last_undegraded":"2024-05-15T15:39:53.465209+0000","last_fullsized":"2024-05-15T15:39:53.465209+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:39:30.074726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T15:39:51.447704+0000","last_change":"2024-05-15T15:39:51.445161+0000","last_active":"2024-05-15T15:39:51.447704+0000","last_peered":"2024-05-15T15:39:51.447704+0000","last_clean":"2024-05-15T15:39:51.447704+0000","last_became_active":"2024-05-15T15:39:51.444855+0000","last_became_peered":"2024-05-15T15:39:51.444855+0000","last_unstale":"2024-05-15T15:39:51.447704+0000","last_undegraded":"2024-05-15T15:39:51.447704+0000","last_fullsized":"2024-05-15T15:39:51.447704+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:58:42.762068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1828,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24,"ondisk_log_size":24,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509445,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":241664,"data_stored":81359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509445,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":233472,"data_stored":81235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509446,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27836,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":835584,"data_stored":671695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":237568,"data_stored":81817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":233472,"data_stored":76547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509446,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":831488,"data_stored":671673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509445,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":229376,"data_stored":74991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":196608,"data_stored":61885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-15T15:40:01.050 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-15T15:40:01.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.176+0000 7efc77572640 1 Processor -- start 2024-05-15T15:40:01.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.176+0000 7efc77572640 1 -- start start 2024-05-15T15:40:01.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.177+0000 7efc77572640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7efc7014fad0 0x7efc7014fee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:01.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.177+0000 7efc77572640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc7014d230 con 0x7efc700be3f0 2024-05-15T15:40:01.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.177+0000 7efc77572640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc700bb890 con 0x7efc70074b00 2024-05-15T15:40:01.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.177+0000 7efc77572640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7efc700bb470 con 0x7efc7014fad0 2024-05-15T15:40:01.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.178+0000 7efc74b0d640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7efc700be3f0 0x7efc7014cb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:45182/0 (socket says 172.21.15.12:45182) 2024-05-15T15:40:01.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.178+0000 7efc74b0d640 1 -- 172.21.15.12:0/4024269312 learned_addr learned my addr 172.21.15.12:0/4024269312 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-05-15T15:40:01.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.178+0000 7efc67fff640 1 -- 172.21.15.12:0/4024269312 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 96238718 0 0) 0x7efc7014d230 con 0x7efc700be3f0 2024-05-15T15:40:01.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.178+0000 7efc67fff640 1 -- 172.21.15.12:0/4024269312 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efc5c003520 con 0x7efc700be3f0 2024-05-15T15:40:01.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.178+0000 7efc75b0f640 1 --2- 172.21.15.12:0/4024269312 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7efc7014fad0 0x7efc7014fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:01.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.178+0000 7efc67fff640 1 -- 172.21.15.12:0/4024269312 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3102977308 0 0) 0x7efc5c003520 con 0x7efc700be3f0 2024-05-15T15:40:01.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.178+0000 7efc67fff640 1 -- 172.21.15.12:0/4024269312 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7efc7014fad0 msgr2=0x7efc7014fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:40:01.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.178+0000 7efc67fff640 1 --2- 172.21.15.12:0/4024269312 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7efc7014fad0 0x7efc7014fee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:01.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.178+0000 7efc67fff640 1 -- 172.21.15.12:0/4024269312 >> v1:172.21.15.84:6789/0 conn(0x7efc70074b00 legacy=0x7efc7006c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:01.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.178+0000 7efc67fff640 1 -- 172.21.15.12:0/4024269312 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc700bbb30 con 0x7efc700be3f0 2024-05-15T15:40:01.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.178+0000 7efc67fff640 1 -- 172.21.15.12:0/4024269312 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 38171736 0 0) 0x7efc600016f0 con 0x7efc700be3f0 2024-05-15T15:40:01.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.178+0000 7efc67fff640 1 -- 172.21.15.12:0/4024269312 >> v1:172.21.15.12:6789/0 conn(0x7efc700be3f0 legacy=0x7efc7014cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:01.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.178+0000 7efc67fff640 1 --2- 172.21.15.12:0/4024269312 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efc5c0039e0 0x7efc5c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:01.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.178+0000 7efc67fff640 1 --2- 172.21.15.12:0/4024269312 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7efc7014fad0 0x7efc5c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:01.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.178+0000 7efc67fff640 1 --2- 172.21.15.12:0/4024269312 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc5c004d40 0x7efc5c005170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:01.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.178+0000 7efc67fff640 1 -- 172.21.15.12:0/4024269312 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7efc700bb470 con 0x7efc5c004d40 2024-05-15T15:40:01.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.178+0000 7efc67fff640 1 -- 172.21.15.12:0/4024269312 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7efc5c00bba0 con 0x7efc5c0039e0 2024-05-15T15:40:01.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.178+0000 7efc67fff640 1 -- 172.21.15.12:0/4024269312 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7efc5c00bda0 con 0x7efc7014fad0 2024-05-15T15:40:01.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.178+0000 7efc75b0f640 1 --2- 172.21.15.12:0/4024269312 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc5c004d40 0x7efc5c005170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:01.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.178+0000 7efc7530e640 1 --2- 172.21.15.12:0/4024269312 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efc5c0039e0 0x7efc5c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:01.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.178+0000 7efc74b0d640 1 --2- 172.21.15.12:0/4024269312 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7efc7014fad0 0x7efc5c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:01.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.179+0000 7efc75b0f640 1 -- 172.21.15.12:0/4024269312 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7efc7014fad0 msgr2=0x7efc5c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:40:01.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.179+0000 7efc75b0f640 1 --2- 172.21.15.12:0/4024269312 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7efc7014fad0 0x7efc5c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:01.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.179+0000 7efc75b0f640 1 -- 172.21.15.12:0/4024269312 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efc5c0039e0 msgr2=0x7efc5c003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:40:01.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.179+0000 7efc75b0f640 1 --2- 172.21.15.12:0/4024269312 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efc5c0039e0 0x7efc5c003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:01.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.179+0000 7efc75b0f640 1 -- 172.21.15.12:0/4024269312 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc5c003520 con 0x7efc5c004d40 2024-05-15T15:40:01.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.179+0000 7efc75b0f640 1 --2- 172.21.15.12:0/4024269312 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc5c004d40 0x7efc5c005170 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7efc700bd0a0 tx=0x7efc5c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b25af474196af14 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:01.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.179+0000 7efc67fff640 1 -- 172.21.15.12:0/4024269312 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc68009c10 con 0x7efc5c004d40 2024-05-15T15:40:01.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.180+0000 7efc67fff640 1 -- 172.21.15.12:0/4024269312 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc68036070 con 0x7efc5c004d40 2024-05-15T15:40:01.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.180+0000 7efc67fff640 1 -- 172.21.15.12:0/4024269312 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc68031830 con 0x7efc5c004d40 2024-05-15T15:40:01.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.180+0000 7efc77572640 1 -- 172.21.15.12:0/4024269312 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc5c004d40 msgr2=0x7efc5c005170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:01.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.180+0000 7efc77572640 1 --2- 172.21.15.12:0/4024269312 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc5c004d40 0x7efc5c005170 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7efc700bd0a0 tx=0x7efc5c005830 comp rx=0 tx=0).stop 2024-05-15T15:40:01.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.180+0000 7efc75b0f640 1 -- 172.21.15.12:0/4024269312 reap_dead start 2024-05-15T15:40:01.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.180+0000 7efc77572640 1 -- 172.21.15.12:0/4024269312 shutdown_connections 2024-05-15T15:40:01.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.180+0000 7efc77572640 1 -- 172.21.15.12:0/4024269312 >> 172.21.15.12:0/4024269312 conn(0x7efc700bd0f0 msgr2=0x7efc700bd500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:01.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.180+0000 7efc77572640 1 -- 172.21.15.12:0/4024269312 shutdown_connections 2024-05-15T15:40:01.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.180+0000 7efc77572640 1 -- 172.21.15.12:0/4024269312 wait complete. 2024-05-15T15:40:01.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.182+0000 7efc77572640 1 Processor -- start 2024-05-15T15:40:01.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.182+0000 7efc77572640 1 -- start start 2024-05-15T15:40:01.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.183+0000 7efc77572640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7efc5c004d40 0x7efc700711a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:01.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.183+0000 7efc77572640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efc7014c300 0x7efc701e0680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:01.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.183+0000 7efc77572640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc701e3a20 0x7efc701e3e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:01.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.183+0000 7efc77572640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7efc700bc3d0 con 0x7efc701e3a20 2024-05-15T15:40:01.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.183+0000 7efc77572640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7efc700bc0f0 con 0x7efc7014c300 2024-05-15T15:40:01.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.183+0000 7efc77572640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7efc7014fee0 con 0x7efc5c004d40 2024-05-15T15:40:01.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.183+0000 7efc75b0f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc701e3a20 0x7efc701e3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:01.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.183+0000 7efc75b0f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc701e3a20 0x7efc701e3e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59412/0 (socket says 172.21.15.12:59412) 2024-05-15T15:40:01.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.183+0000 7efc75b0f640 1 -- 172.21.15.12:0/7858812 learned_addr learned my addr 172.21.15.12:0/7858812 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:01.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.183+0000 7efc7530e640 1 --2- 172.21.15.12:0/7858812 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7efc5c004d40 0x7efc700711a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:01.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.183+0000 7efc74b0d640 1 --2- 172.21.15.12:0/7858812 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efc7014c300 0x7efc701e0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:01.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.184+0000 7efc75b0f640 1 -- 172.21.15.12:0/7858812 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7efc5c004d40 msgr2=0x7efc700711a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:01.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.184+0000 7efc75b0f640 1 --2- 172.21.15.12:0/7858812 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7efc5c004d40 0x7efc700711a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:01.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.184+0000 7efc75b0f640 1 -- 172.21.15.12:0/7858812 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efc7014c300 msgr2=0x7efc701e0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:01.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.184+0000 7efc75b0f640 1 --2- 172.21.15.12:0/7858812 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efc7014c300 0x7efc701e0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:01.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.184+0000 7efc75b0f640 1 -- 172.21.15.12:0/7858812 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc700709d0 con 0x7efc701e3a20 2024-05-15T15:40:01.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.184+0000 7efc75b0f640 1 --2- 172.21.15.12:0/7858812 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc701e3a20 0x7efc701e3e30 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7efc6800e230 tx=0x7efc68009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:01.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.184+0000 7efc65ffb640 1 -- 172.21.15.12:0/7858812 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc68009c10 con 0x7efc701e3a20 2024-05-15T15:40:01.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.184+0000 7efc65ffb640 1 -- 172.21.15.12:0/7858812 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc68003990 con 0x7efc701e3a20 2024-05-15T15:40:01.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.184+0000 7efc77572640 1 -- 172.21.15.12:0/7858812 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc701e0bc0 con 0x7efc701e3a20 2024-05-15T15:40:01.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.184+0000 7efc65ffb640 1 -- 172.21.15.12:0/7858812 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc68003d80 con 0x7efc701e3a20 2024-05-15T15:40:01.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.184+0000 7efc77572640 1 -- 172.21.15.12:0/7858812 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc700706f0 con 0x7efc701e3a20 2024-05-15T15:40:01.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.185+0000 7efc77572640 1 -- 172.21.15.12:0/7858812 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc70050940 con 0x7efc701e3a20 2024-05-15T15:40:01.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.186+0000 7efc65ffb640 1 -- 172.21.15.12:0/7858812 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7efc68005d10 con 0x7efc701e3a20 2024-05-15T15:40:01.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.186+0000 7efc65ffb640 1 --2- 172.21.15.12:0/7858812 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7efc540762d0 0x7efc540787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:01.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.186+0000 7efc65ffb640 1 -- 172.21.15.12:0/7858812 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7efc680b8b60 con 0x7efc701e3a20 2024-05-15T15:40:01.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.187+0000 7efc7530e640 1 --2- 172.21.15.12:0/7858812 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7efc540762d0 0x7efc540787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:01.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.187+0000 7efc7530e640 1 --2- 172.21.15.12:0/7858812 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7efc540762d0 0x7efc540787e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7efc6c0011a0 tx=0x7efc6c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:01.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.191+0000 7efc65ffb640 1 -- 172.21.15.12:0/7858812 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7efc6804a060 con 0x7efc701e3a20 2024-05-15T15:40:01.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.377+0000 7efc77572640 1 -- 172.21.15.12:0/7858812 --> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7efc700742e0 con 0x7efc540762d0 2024-05-15T15:40:01.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.384+0000 7efc65ffb640 1 -- 172.21.15.12:0/7858812 <== mgr.4106 v2:172.21.15.84:6832/4173299311 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251845 (secure 0 0 0) 0x7efc700742e0 con 0x7efc540762d0 2024-05-15T15:40:01.389 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-05-15T15:40:01.391 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-05-15T15:40:01.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.387+0000 7efc77572640 1 -- 172.21.15.12:0/7858812 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7efc540762d0 msgr2=0x7efc540787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:01.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.387+0000 7efc77572640 1 --2- 172.21.15.12:0/7858812 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7efc540762d0 0x7efc540787e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7efc6c0011a0 tx=0x7efc6c009040 comp rx=0 tx=0).stop 2024-05-15T15:40:01.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.387+0000 7efc77572640 1 -- 172.21.15.12:0/7858812 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc701e3a20 msgr2=0x7efc701e3e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:01.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.387+0000 7efc77572640 1 --2- 172.21.15.12:0/7858812 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc701e3a20 0x7efc701e3e30 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7efc6800e230 tx=0x7efc68009750 comp rx=0 tx=0).stop 2024-05-15T15:40:01.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.387+0000 7efc77572640 1 -- 172.21.15.12:0/7858812 shutdown_connections 2024-05-15T15:40:01.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.387+0000 7efc77572640 1 --2- 172.21.15.12:0/7858812 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7efc540762d0 0x7efc540787e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:01.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.387+0000 7efc77572640 1 --2- 172.21.15.12:0/7858812 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc701e3a20 0x7efc701e3e30 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:01.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.387+0000 7efc77572640 1 --2- 172.21.15.12:0/7858812 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efc7014c300 0x7efc701e0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:01.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.387+0000 7efc77572640 1 --2- 172.21.15.12:0/7858812 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7efc5c004d40 0x7efc700711a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:01.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.387+0000 7efc77572640 1 -- 172.21.15.12:0/7858812 >> 172.21.15.12:0/7858812 conn(0x7efc700bd0f0 msgr2=0x7efc7006d600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:01.394 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.387+0000 7efc77572640 1 -- 172.21.15.12:0/7858812 shutdown_connections 2024-05-15T15:40:01.394 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.387+0000 7efc77572640 1 -- 172.21.15.12:0/7858812 wait complete. 2024-05-15T15:40:01.400 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2024-05-15T15:40:00.702149+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":188,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219212,"kb_used_data":3048,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755508,"statfs":{"total":773094113280,"available":772869640192,"internally_reserved":0,"allocated":3121152,"data_stored":1835436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.257534"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057108+0000","last_change":"2024-05-15T15:39:52.474245+0000","last_active":"2024-05-15T15:39:54.057108+0000","last_peered":"2024-05-15T15:39:54.057108+0000","last_clean":"2024-05-15T15:39:54.057108+0000","last_became_active":"2024-05-15T15:39:52.473919+0000","last_became_peered":"2024-05-15T15:39:52.473919+0000","last_unstale":"2024-05-15T15:39:54.057108+0000","last_undegraded":"2024-05-15T15:39:54.057108+0000","last_fullsized":"2024-05-15T15:39:54.057108+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:35:07.996967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.464974+0000","last_change":"2024-05-15T15:39:52.472587+0000","last_active":"2024-05-15T15:39:53.464974+0000","last_peered":"2024-05-15T15:39:53.464974+0000","last_clean":"2024-05-15T15:39:53.464974+0000","last_became_active":"2024-05-15T15:39:52.472268+0000","last_became_peered":"2024-05-15T15:39:52.472268+0000","last_unstale":"2024-05-15T15:39:53.464974+0000","last_undegraded":"2024-05-15T15:39:53.464974+0000","last_fullsized":"2024-05-15T15:39:53.464974+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:39:07.633570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.464154+0000","last_change":"2024-05-15T15:39:52.474404+0000","last_active":"2024-05-15T15:39:53.464154+0000","last_peered":"2024-05-15T15:39:53.464154+0000","last_clean":"2024-05-15T15:39:53.464154+0000","last_became_active":"2024-05-15T15:39:52.474102+0000","last_became_peered":"2024-05-15T15:39:52.474102+0000","last_unstale":"2024-05-15T15:39:53.464154+0000","last_undegraded":"2024-05-15T15:39:53.464154+0000","last_fullsized":"2024-05-15T15:39:53.464154+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:13:19.570085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.056856+0000","last_change":"2024-05-15T15:39:52.462504+0000","last_active":"2024-05-15T15:39:54.056856+0000","last_peered":"2024-05-15T15:39:54.056856+0000","last_clean":"2024-05-15T15:39:54.056856+0000","last_became_active":"2024-05-15T15:39:52.462135+0000","last_became_peered":"2024-05-15T15:39:52.462135+0000","last_unstale":"2024-05-15T15:39:54.056856+0000","last_undegraded":"2024-05-15T15:39:54.056856+0000","last_fullsized":"2024-05-15T15:39:54.056856+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:53:35.715007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057365+0000","last_change":"2024-05-15T15:39:52.477733+0000","last_active":"2024-05-15T15:39:54.057365+0000","last_peered":"2024-05-15T15:39:54.057365+0000","last_clean":"2024-05-15T15:39:54.057365+0000","last_became_active":"2024-05-15T15:39:52.474778+0000","last_became_peered":"2024-05-15T15:39:52.474778+0000","last_unstale":"2024-05-15T15:39:54.057365+0000","last_undegraded":"2024-05-15T15:39:54.057365+0000","last_fullsized":"2024-05-15T15:39:54.057365+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:18:51.904529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057477+0000","last_change":"2024-05-15T15:39:52.458241+0000","last_active":"2024-05-15T15:39:54.057477+0000","last_peered":"2024-05-15T15:39:54.057477+0000","last_clean":"2024-05-15T15:39:54.057477+0000","last_became_active":"2024-05-15T15:39:52.457883+0000","last_became_peered":"2024-05-15T15:39:52.457883+0000","last_unstale":"2024-05-15T15:39:54.057477+0000","last_undegraded":"2024-05-15T15:39:54.057477+0000","last_fullsized":"2024-05-15T15:39:54.057477+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:19:06.288701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.056535+0000","last_change":"2024-05-15T15:39:52.474619+0000","last_active":"2024-05-15T15:39:54.056535+0000","last_peered":"2024-05-15T15:39:54.056535+0000","last_clean":"2024-05-15T15:39:54.056535+0000","last_became_active":"2024-05-15T15:39:52.474314+0000","last_became_peered":"2024-05-15T15:39:52.474314+0000","last_unstale":"2024-05-15T15:39:54.056535+0000","last_undegraded":"2024-05-15T15:39:54.056535+0000","last_fullsized":"2024-05-15T15:39:54.056535+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:07:46.287281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.463913+0000","last_change":"2024-05-15T15:39:52.468997+0000","last_active":"2024-05-15T15:39:53.463913+0000","last_peered":"2024-05-15T15:39:53.463913+0000","last_clean":"2024-05-15T15:39:53.463913+0000","last_became_active":"2024-05-15T15:39:52.468155+0000","last_became_peered":"2024-05-15T15:39:52.468155+0000","last_unstale":"2024-05-15T15:39:53.463913+0000","last_undegraded":"2024-05-15T15:39:53.463913+0000","last_fullsized":"2024-05-15T15:39:53.463913+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:07:46.287281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.506277+0000","last_change":"2024-05-15T15:39:52.468077+0000","last_active":"2024-05-15T15:39:53.506277+0000","last_peered":"2024-05-15T15:39:53.506277+0000","last_clean":"2024-05-15T15:39:53.506277+0000","last_became_active":"2024-05-15T15:39:52.467754+0000","last_became_peered":"2024-05-15T15:39:52.467754+0000","last_unstale":"2024-05-15T15:39:53.506277+0000","last_undegraded":"2024-05-15T15:39:53.506277+0000","last_fullsized":"2024-05-15T15:39:53.506277+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:46:06.269771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057388+0000","last_change":"2024-05-15T15:39:52.480897+0000","last_active":"2024-05-15T15:39:54.057388+0000","last_peered":"2024-05-15T15:39:54.057388+0000","last_clean":"2024-05-15T15:39:54.057388+0000","last_became_active":"2024-05-15T15:39:52.479910+0000","last_became_peered":"2024-05-15T15:39:52.479910+0000","last_unstale":"2024-05-15T15:39:54.057388+0000","last_undegraded":"2024-05-15T15:39:54.057388+0000","last_fullsized":"2024-05-15T15:39:54.057388+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:13:19.570085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057782+0000","last_change":"2024-05-15T15:39:52.473167+0000","last_active":"2024-05-15T15:39:54.057782+0000","last_peered":"2024-05-15T15:39:54.057782+0000","last_clean":"2024-05-15T15:39:54.057782+0000","last_became_active":"2024-05-15T15:39:52.472835+0000","last_became_peered":"2024-05-15T15:39:52.472835+0000","last_unstale":"2024-05-15T15:39:54.057782+0000","last_undegraded":"2024-05-15T15:39:54.057782+0000","last_fullsized":"2024-05-15T15:39:54.057782+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:39:30.074726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057803+0000","last_change":"2024-05-15T15:39:52.467676+0000","last_active":"2024-05-15T15:39:54.057803+0000","last_peered":"2024-05-15T15:39:54.057803+0000","last_clean":"2024-05-15T15:39:54.057803+0000","last_became_active":"2024-05-15T15:39:52.467064+0000","last_became_peered":"2024-05-15T15:39:52.467064+0000","last_unstale":"2024-05-15T15:39:54.057803+0000","last_undegraded":"2024-05-15T15:39:54.057803+0000","last_fullsized":"2024-05-15T15:39:54.057803+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:58:23.539973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.463567+0000","last_change":"2024-05-15T15:39:52.472464+0000","last_active":"2024-05-15T15:39:53.463567+0000","last_peered":"2024-05-15T15:39:53.463567+0000","last_clean":"2024-05-15T15:39:53.463567+0000","last_became_active":"2024-05-15T15:39:52.472129+0000","last_became_peered":"2024-05-15T15:39:52.472129+0000","last_unstale":"2024-05-15T15:39:53.463567+0000","last_undegraded":"2024-05-15T15:39:53.463567+0000","last_fullsized":"2024-05-15T15:39:53.463567+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:14:40.347641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.463905+0000","last_change":"2024-05-15T15:39:52.465747+0000","last_active":"2024-05-15T15:39:53.463905+0000","last_peered":"2024-05-15T15:39:53.463905+0000","last_clean":"2024-05-15T15:39:53.463905+0000","last_became_active":"2024-05-15T15:39:52.465239+0000","last_became_peered":"2024-05-15T15:39:52.465239+0000","last_unstale":"2024-05-15T15:39:53.463905+0000","last_undegraded":"2024-05-15T15:39:53.463905+0000","last_fullsized":"2024-05-15T15:39:53.463905+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:56:24.242548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.463549+0000","last_change":"2024-05-15T15:39:52.467317+0000","last_active":"2024-05-15T15:39:53.463549+0000","last_peered":"2024-05-15T15:39:53.463549+0000","last_clean":"2024-05-15T15:39:53.463549+0000","last_became_active":"2024-05-15T15:39:52.466968+0000","last_became_peered":"2024-05-15T15:39:52.466968+0000","last_unstale":"2024-05-15T15:39:53.463549+0000","last_undegraded":"2024-05-15T15:39:53.463549+0000","last_fullsized":"2024-05-15T15:39:53.463549+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:36:37.195191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.462383+0000","last_change":"2024-05-15T15:39:52.469584+0000","last_active":"2024-05-15T15:39:53.462383+0000","last_peered":"2024-05-15T15:39:53.462383+0000","last_clean":"2024-05-15T15:39:53.462383+0000","last_became_active":"2024-05-15T15:39:52.469257+0000","last_became_peered":"2024-05-15T15:39:52.469257+0000","last_unstale":"2024-05-15T15:39:53.462383+0000","last_undegraded":"2024-05-15T15:39:53.462383+0000","last_fullsized":"2024-05-15T15:39:53.462383+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:52:43.064362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.463038+0000","last_change":"2024-05-15T15:39:52.473647+0000","last_active":"2024-05-15T15:39:53.463038+0000","last_peered":"2024-05-15T15:39:53.463038+0000","last_clean":"2024-05-15T15:39:53.463038+0000","last_became_active":"2024-05-15T15:39:52.472719+0000","last_became_peered":"2024-05-15T15:39:52.472719+0000","last_unstale":"2024-05-15T15:39:53.463038+0000","last_undegraded":"2024-05-15T15:39:53.463038+0000","last_fullsized":"2024-05-15T15:39:53.463038+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:48:23.434946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.056800+0000","last_change":"2024-05-15T15:39:52.465815+0000","last_active":"2024-05-15T15:39:54.056800+0000","last_peered":"2024-05-15T15:39:54.056800+0000","last_clean":"2024-05-15T15:39:54.056800+0000","last_became_active":"2024-05-15T15:39:52.465471+0000","last_became_peered":"2024-05-15T15:39:52.465471+0000","last_unstale":"2024-05-15T15:39:54.056800+0000","last_undegraded":"2024-05-15T15:39:54.056800+0000","last_fullsized":"2024-05-15T15:39:54.056800+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:53:35.715007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.463021+0000","last_change":"2024-05-15T15:39:52.463837+0000","last_active":"2024-05-15T15:39:53.463021+0000","last_peered":"2024-05-15T15:39:53.463021+0000","last_clean":"2024-05-15T15:39:53.463021+0000","last_became_active":"2024-05-15T15:39:52.459388+0000","last_became_peered":"2024-05-15T15:39:52.459388+0000","last_unstale":"2024-05-15T15:39:53.463021+0000","last_undegraded":"2024-05-15T15:39:53.463021+0000","last_fullsized":"2024-05-15T15:39:53.463021+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:55:50.961472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057274+0000","last_change":"2024-05-15T15:39:52.467411+0000","last_active":"2024-05-15T15:39:54.057274+0000","last_peered":"2024-05-15T15:39:54.057274+0000","last_clean":"2024-05-15T15:39:54.057274+0000","last_became_active":"2024-05-15T15:39:52.466666+0000","last_became_peered":"2024-05-15T15:39:52.466666+0000","last_unstale":"2024-05-15T15:39:54.057274+0000","last_undegraded":"2024-05-15T15:39:54.057274+0000","last_fullsized":"2024-05-15T15:39:54.057274+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:22:17.968105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.056682+0000","last_change":"2024-05-15T15:39:52.459193+0000","last_active":"2024-05-15T15:39:54.056682+0000","last_peered":"2024-05-15T15:39:54.056682+0000","last_clean":"2024-05-15T15:39:54.056682+0000","last_became_active":"2024-05-15T15:39:52.458872+0000","last_became_peered":"2024-05-15T15:39:52.458872+0000","last_unstale":"2024-05-15T15:39:54.056682+0000","last_undegraded":"2024-05-15T15:39:54.056682+0000","last_fullsized":"2024-05-15T15:39:54.056682+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:57:04.417030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.506016+0000","last_change":"2024-05-15T15:39:52.477675+0000","last_active":"2024-05-15T15:39:53.506016+0000","last_peered":"2024-05-15T15:39:53.506016+0000","last_clean":"2024-05-15T15:39:53.506016+0000","last_became_active":"2024-05-15T15:39:52.477314+0000","last_became_peered":"2024-05-15T15:39:52.477314+0000","last_unstale":"2024-05-15T15:39:53.506016+0000","last_undegraded":"2024-05-15T15:39:53.506016+0000","last_fullsized":"2024-05-15T15:39:53.506016+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:49:27.658296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.463806+0000","last_change":"2024-05-15T15:39:52.471743+0000","last_active":"2024-05-15T15:39:53.463806+0000","last_peered":"2024-05-15T15:39:53.463806+0000","last_clean":"2024-05-15T15:39:53.463806+0000","last_became_active":"2024-05-15T15:39:52.471382+0000","last_became_peered":"2024-05-15T15:39:52.471382+0000","last_unstale":"2024-05-15T15:39:53.463806+0000","last_undegraded":"2024-05-15T15:39:53.463806+0000","last_fullsized":"2024-05-15T15:39:53.463806+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:01:48.794566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.462381+0000","last_change":"2024-05-15T15:39:52.463540+0000","last_active":"2024-05-15T15:39:53.462381+0000","last_peered":"2024-05-15T15:39:53.462381+0000","last_clean":"2024-05-15T15:39:53.462381+0000","last_became_active":"2024-05-15T15:39:52.463162+0000","last_became_peered":"2024-05-15T15:39:52.463162+0000","last_unstale":"2024-05-15T15:39:53.462381+0000","last_undegraded":"2024-05-15T15:39:53.462381+0000","last_fullsized":"2024-05-15T15:39:53.462381+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:18:51.904529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.464627+0000","last_change":"2024-05-15T15:39:52.474224+0000","last_active":"2024-05-15T15:39:53.464627+0000","last_peered":"2024-05-15T15:39:53.464627+0000","last_clean":"2024-05-15T15:39:53.464627+0000","last_became_active":"2024-05-15T15:39:52.473890+0000","last_became_peered":"2024-05-15T15:39:52.473890+0000","last_unstale":"2024-05-15T15:39:53.464627+0000","last_undegraded":"2024-05-15T15:39:53.464627+0000","last_fullsized":"2024-05-15T15:39:53.464627+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:22:17.968105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057129+0000","last_change":"2024-05-15T15:39:52.466971+0000","last_active":"2024-05-15T15:39:54.057129+0000","last_peered":"2024-05-15T15:39:54.057129+0000","last_clean":"2024-05-15T15:39:54.057129+0000","last_became_active":"2024-05-15T15:39:52.466656+0000","last_became_peered":"2024-05-15T15:39:52.466656+0000","last_unstale":"2024-05-15T15:39:54.057129+0000","last_undegraded":"2024-05-15T15:39:54.057129+0000","last_fullsized":"2024-05-15T15:39:54.057129+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:52:27.027535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.464322+0000","last_change":"2024-05-15T15:39:52.470364+0000","last_active":"2024-05-15T15:39:53.464322+0000","last_peered":"2024-05-15T15:39:53.464322+0000","last_clean":"2024-05-15T15:39:53.464322+0000","last_became_active":"2024-05-15T15:39:52.470067+0000","last_became_peered":"2024-05-15T15:39:52.470067+0000","last_unstale":"2024-05-15T15:39:53.464322+0000","last_undegraded":"2024-05-15T15:39:53.464322+0000","last_fullsized":"2024-05-15T15:39:53.464322+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:07:28.350502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.463525+0000","last_change":"2024-05-15T15:39:52.473274+0000","last_active":"2024-05-15T15:39:53.463525+0000","last_peered":"2024-05-15T15:39:53.463525+0000","last_clean":"2024-05-15T15:39:53.463525+0000","last_became_active":"2024-05-15T15:39:52.472954+0000","last_became_peered":"2024-05-15T15:39:52.472954+0000","last_unstale":"2024-05-15T15:39:53.463525+0000","last_undegraded":"2024-05-15T15:39:53.463525+0000","last_fullsized":"2024-05-15T15:39:53.463525+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:46:06.269771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.464564+0000","last_change":"2024-05-15T15:39:52.473238+0000","last_active":"2024-05-15T15:39:53.464564+0000","last_peered":"2024-05-15T15:39:53.464564+0000","last_clean":"2024-05-15T15:39:53.464564+0000","last_became_active":"2024-05-15T15:39:52.472848+0000","last_became_peered":"2024-05-15T15:39:52.472848+0000","last_unstale":"2024-05-15T15:39:53.464564+0000","last_undegraded":"2024-05-15T15:39:53.464564+0000","last_fullsized":"2024-05-15T15:39:53.464564+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:48:53.088055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.462876+0000","last_change":"2024-05-15T15:39:52.464689+0000","last_active":"2024-05-15T15:39:53.462876+0000","last_peered":"2024-05-15T15:39:53.462876+0000","last_clean":"2024-05-15T15:39:53.462876+0000","last_became_active":"2024-05-15T15:39:52.462649+0000","last_became_peered":"2024-05-15T15:39:52.462649+0000","last_unstale":"2024-05-15T15:39:53.462876+0000","last_undegraded":"2024-05-15T15:39:53.462876+0000","last_fullsized":"2024-05-15T15:39:53.462876+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:17:05.581127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.056464+0000","last_change":"2024-05-15T15:39:52.465485+0000","last_active":"2024-05-15T15:39:54.056464+0000","last_peered":"2024-05-15T15:39:54.056464+0000","last_clean":"2024-05-15T15:39:54.056464+0000","last_became_active":"2024-05-15T15:39:52.464733+0000","last_became_peered":"2024-05-15T15:39:52.464733+0000","last_unstale":"2024-05-15T15:39:54.056464+0000","last_undegraded":"2024-05-15T15:39:54.056464+0000","last_fullsized":"2024-05-15T15:39:54.056464+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:17:34.380965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057300+0000","last_change":"2024-05-15T15:39:52.465924+0000","last_active":"2024-05-15T15:39:54.057300+0000","last_peered":"2024-05-15T15:39:54.057300+0000","last_clean":"2024-05-15T15:39:54.057300+0000","last_became_active":"2024-05-15T15:39:52.464704+0000","last_became_peered":"2024-05-15T15:39:52.464704+0000","last_unstale":"2024-05-15T15:39:54.057300+0000","last_undegraded":"2024-05-15T15:39:54.057300+0000","last_fullsized":"2024-05-15T15:39:54.057300+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:49:27.658296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.506001+0000","last_change":"2024-05-15T15:39:52.465099+0000","last_active":"2024-05-15T15:39:53.506001+0000","last_peered":"2024-05-15T15:39:53.506001+0000","last_clean":"2024-05-15T15:39:53.506001+0000","last_became_active":"2024-05-15T15:39:52.464775+0000","last_became_peered":"2024-05-15T15:39:52.464775+0000","last_unstale":"2024-05-15T15:39:53.506001+0000","last_undegraded":"2024-05-15T15:39:53.506001+0000","last_fullsized":"2024-05-15T15:39:53.506001+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:52:27.027535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.464681+0000","last_change":"2024-05-15T15:39:51.443546+0000","last_active":"2024-05-15T15:39:53.464681+0000","last_peered":"2024-05-15T15:39:53.464681+0000","last_clean":"2024-05-15T15:39:53.464681+0000","last_became_active":"2024-05-15T15:39:51.443177+0000","last_became_peered":"2024-05-15T15:39:51.443177+0000","last_unstale":"2024-05-15T15:39:53.464681+0000","last_undegraded":"2024-05-15T15:39:53.464681+0000","last_fullsized":"2024-05-15T15:39:53.464681+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:18:35.801621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.056878+0000","last_change":"2024-05-15T15:39:52.470469+0000","last_active":"2024-05-15T15:39:54.056878+0000","last_peered":"2024-05-15T15:39:54.056878+0000","last_clean":"2024-05-15T15:39:54.056878+0000","last_became_active":"2024-05-15T15:39:52.468716+0000","last_became_peered":"2024-05-15T15:39:52.468716+0000","last_unstale":"2024-05-15T15:39:54.056878+0000","last_undegraded":"2024-05-15T15:39:54.056878+0000","last_fullsized":"2024-05-15T15:39:54.056878+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:58:08.602086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.462997+0000","last_change":"2024-05-15T15:39:51.451403+0000","last_active":"2024-05-15T15:39:53.462997+0000","last_peered":"2024-05-15T15:39:53.462997+0000","last_clean":"2024-05-15T15:39:53.462997+0000","last_became_active":"2024-05-15T15:39:51.451074+0000","last_became_peered":"2024-05-15T15:39:51.451074+0000","last_unstale":"2024-05-15T15:39:53.462997+0000","last_undegraded":"2024-05-15T15:39:53.462997+0000","last_fullsized":"2024-05-15T15:39:53.462997+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:52:26.020009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.463548+0000","last_change":"2024-05-15T15:39:51.457243+0000","last_active":"2024-05-15T15:39:53.463548+0000","last_peered":"2024-05-15T15:39:53.463548+0000","last_clean":"2024-05-15T15:39:53.463548+0000","last_became_active":"2024-05-15T15:39:51.456904+0000","last_became_peered":"2024-05-15T15:39:51.456904+0000","last_unstale":"2024-05-15T15:39:53.463548+0000","last_undegraded":"2024-05-15T15:39:53.463548+0000","last_fullsized":"2024-05-15T15:39:53.463548+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:45:30.896866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.464271+0000","last_change":"2024-05-15T15:39:52.461438+0000","last_active":"2024-05-15T15:39:53.464271+0000","last_peered":"2024-05-15T15:39:53.464271+0000","last_clean":"2024-05-15T15:39:53.464271+0000","last_became_active":"2024-05-15T15:39:52.460666+0000","last_became_peered":"2024-05-15T15:39:52.460666+0000","last_unstale":"2024-05-15T15:39:53.464271+0000","last_undegraded":"2024-05-15T15:39:53.464271+0000","last_fullsized":"2024-05-15T15:39:53.464271+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:35:07.996967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.462502+0000","last_change":"2024-05-15T15:39:51.444590+0000","last_active":"2024-05-15T15:39:53.462502+0000","last_peered":"2024-05-15T15:39:53.462502+0000","last_clean":"2024-05-15T15:39:53.462502+0000","last_became_active":"2024-05-15T15:39:51.444114+0000","last_became_peered":"2024-05-15T15:39:51.444114+0000","last_unstale":"2024-05-15T15:39:53.462502+0000","last_undegraded":"2024-05-15T15:39:53.462502+0000","last_fullsized":"2024-05-15T15:39:53.462502+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:17:33.373439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.056759+0000","last_change":"2024-05-15T15:39:52.463132+0000","last_active":"2024-05-15T15:39:54.056759+0000","last_peered":"2024-05-15T15:39:54.056759+0000","last_clean":"2024-05-15T15:39:54.056759+0000","last_became_active":"2024-05-15T15:39:52.462785+0000","last_became_peered":"2024-05-15T15:39:52.462785+0000","last_unstale":"2024-05-15T15:39:54.056759+0000","last_undegraded":"2024-05-15T15:39:54.056759+0000","last_fullsized":"2024-05-15T15:39:54.056759+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:08:58.790860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.506255+0000","last_change":"2024-05-15T15:39:51.453203+0000","last_active":"2024-05-15T15:39:53.506255+0000","last_peered":"2024-05-15T15:39:53.506255+0000","last_clean":"2024-05-15T15:39:53.506255+0000","last_became_active":"2024-05-15T15:39:51.452835+0000","last_became_peered":"2024-05-15T15:39:51.452835+0000","last_unstale":"2024-05-15T15:39:53.506255+0000","last_undegraded":"2024-05-15T15:39:53.506255+0000","last_fullsized":"2024-05-15T15:39:53.506255+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:00:28.591473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057390+0000","last_change":"2024-05-15T15:39:52.467091+0000","last_active":"2024-05-15T15:39:54.057390+0000","last_peered":"2024-05-15T15:39:54.057390+0000","last_clean":"2024-05-15T15:39:54.057390+0000","last_became_active":"2024-05-15T15:39:52.465260+0000","last_became_peered":"2024-05-15T15:39:52.465260+0000","last_unstale":"2024-05-15T15:39:54.057390+0000","last_undegraded":"2024-05-15T15:39:54.057390+0000","last_fullsized":"2024-05-15T15:39:54.057390+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:46:06.269771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057238+0000","last_change":"2024-05-15T15:39:51.459005+0000","last_active":"2024-05-15T15:39:54.057238+0000","last_peered":"2024-05-15T15:39:54.057238+0000","last_clean":"2024-05-15T15:39:54.057238+0000","last_became_active":"2024-05-15T15:39:51.458484+0000","last_became_peered":"2024-05-15T15:39:51.458484+0000","last_unstale":"2024-05-15T15:39:54.057238+0000","last_undegraded":"2024-05-15T15:39:54.057238+0000","last_fullsized":"2024-05-15T15:39:54.057238+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:53:34.707481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.464984+0000","last_change":"2024-05-15T15:39:52.470997+0000","last_active":"2024-05-15T15:39:53.464984+0000","last_peered":"2024-05-15T15:39:53.464984+0000","last_clean":"2024-05-15T15:39:53.464984+0000","last_became_active":"2024-05-15T15:39:52.470669+0000","last_became_peered":"2024-05-15T15:39:52.470669+0000","last_unstale":"2024-05-15T15:39:53.464984+0000","last_undegraded":"2024-05-15T15:39:53.464984+0000","last_fullsized":"2024-05-15T15:39:53.464984+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:52:43.064362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.056727+0000","last_change":"2024-05-15T15:39:51.448163+0000","last_active":"2024-05-15T15:39:54.056727+0000","last_peered":"2024-05-15T15:39:54.056727+0000","last_clean":"2024-05-15T15:39:54.056727+0000","last_became_active":"2024-05-15T15:39:51.447878+0000","last_became_peered":"2024-05-15T15:39:51.447878+0000","last_unstale":"2024-05-15T15:39:54.056727+0000","last_undegraded":"2024-05-15T15:39:54.056727+0000","last_fullsized":"2024-05-15T15:39:54.056727+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:45:30.896866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.463183+0000","last_change":"2024-05-15T15:39:52.471719+0000","last_active":"2024-05-15T15:39:53.463183+0000","last_peered":"2024-05-15T15:39:53.463183+0000","last_clean":"2024-05-15T15:39:53.463183+0000","last_became_active":"2024-05-15T15:39:52.471352+0000","last_became_peered":"2024-05-15T15:39:52.471352+0000","last_unstale":"2024-05-15T15:39:53.463183+0000","last_undegraded":"2024-05-15T15:39:53.463183+0000","last_fullsized":"2024-05-15T15:39:53.463183+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:09:35.247678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"22'6","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.056826+0000","last_change":"2024-05-15T15:39:51.449551+0000","last_active":"2024-05-15T15:39:54.056826+0000","last_peered":"2024-05-15T15:39:54.056826+0000","last_clean":"2024-05-15T15:39:54.056826+0000","last_became_active":"2024-05-15T15:39:51.449185+0000","last_became_peered":"2024-05-15T15:39:51.449185+0000","last_unstale":"2024-05-15T15:39:54.056826+0000","last_undegraded":"2024-05-15T15:39:54.056826+0000","last_fullsized":"2024-05-15T15:39:54.056826+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:56:40.086761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057182+0000","last_change":"2024-05-15T15:39:52.477094+0000","last_active":"2024-05-15T15:39:54.057182+0000","last_peered":"2024-05-15T15:39:54.057182+0000","last_clean":"2024-05-15T15:39:54.057182+0000","last_became_active":"2024-05-15T15:39:52.476694+0000","last_became_peered":"2024-05-15T15:39:52.476694+0000","last_unstale":"2024-05-15T15:39:54.057182+0000","last_undegraded":"2024-05-15T15:39:54.057182+0000","last_fullsized":"2024-05-15T15:39:54.057182+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:48:53.088055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057190+0000","last_change":"2024-05-15T15:39:51.455537+0000","last_active":"2024-05-15T15:39:54.057190+0000","last_peered":"2024-05-15T15:39:54.057190+0000","last_clean":"2024-05-15T15:39:54.057190+0000","last_became_active":"2024-05-15T15:39:51.455169+0000","last_became_peered":"2024-05-15T15:39:51.455169+0000","last_unstale":"2024-05-15T15:39:54.057190+0000","last_undegraded":"2024-05-15T15:39:54.057190+0000","last_fullsized":"2024-05-15T15:39:54.057190+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:15:32.911265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.464093+0000","last_change":"2024-05-15T15:39:52.464580+0000","last_active":"2024-05-15T15:39:53.464093+0000","last_peered":"2024-05-15T15:39:53.464093+0000","last_clean":"2024-05-15T15:39:53.464093+0000","last_became_active":"2024-05-15T15:39:52.464252+0000","last_became_peered":"2024-05-15T15:39:52.464252+0000","last_unstale":"2024-05-15T15:39:53.464093+0000","last_undegraded":"2024-05-15T15:39:53.464093+0000","last_fullsized":"2024-05-15T15:39:53.464093+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:00:28.874513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.463192+0000","last_change":"2024-05-15T15:39:51.456191+0000","last_active":"2024-05-15T15:39:53.463192+0000","last_peered":"2024-05-15T15:39:53.463192+0000","last_clean":"2024-05-15T15:39:53.463192+0000","last_became_active":"2024-05-15T15:39:51.455844+0000","last_became_peered":"2024-05-15T15:39:51.455844+0000","last_unstale":"2024-05-15T15:39:53.463192+0000","last_undegraded":"2024-05-15T15:39:53.463192+0000","last_fullsized":"2024-05-15T15:39:53.463192+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:19:05.281175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.462897+0000","last_change":"2024-05-15T15:39:52.473375+0000","last_active":"2024-05-15T15:39:53.462897+0000","last_peered":"2024-05-15T15:39:53.462897+0000","last_clean":"2024-05-15T15:39:53.462897+0000","last_became_active":"2024-05-15T15:39:52.473046+0000","last_became_peered":"2024-05-15T15:39:52.473046+0000","last_unstale":"2024-05-15T15:39:53.462897+0000","last_undegraded":"2024-05-15T15:39:53.462897+0000","last_fullsized":"2024-05-15T15:39:53.462897+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:15:12.564736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.056485+0000","last_change":"2024-05-15T15:39:51.461928+0000","last_active":"2024-05-15T15:39:54.056485+0000","last_peered":"2024-05-15T15:39:54.056485+0000","last_clean":"2024-05-15T15:39:54.056485+0000","last_became_active":"2024-05-15T15:39:51.461604+0000","last_became_peered":"2024-05-15T15:39:51.461604+0000","last_unstale":"2024-05-15T15:39:54.056485+0000","last_undegraded":"2024-05-15T15:39:54.056485+0000","last_fullsized":"2024-05-15T15:39:54.056485+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:13:01.291506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.505919+0000","last_change":"2024-05-15T15:39:52.474668+0000","last_active":"2024-05-15T15:39:53.505919+0000","last_peered":"2024-05-15T15:39:53.505919+0000","last_clean":"2024-05-15T15:39:53.505919+0000","last_became_active":"2024-05-15T15:39:52.474222+0000","last_became_peered":"2024-05-15T15:39:52.474222+0000","last_unstale":"2024-05-15T15:39:53.505919+0000","last_undegraded":"2024-05-15T15:39:53.505919+0000","last_fullsized":"2024-05-15T15:39:53.505919+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:53:35.715007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.056855+0000","last_change":"2024-05-15T15:39:51.446711+0000","last_active":"2024-05-15T15:39:54.056855+0000","last_peered":"2024-05-15T15:39:54.056855+0000","last_clean":"2024-05-15T15:39:54.056855+0000","last_became_active":"2024-05-15T15:39:51.446392+0000","last_became_peered":"2024-05-15T15:39:51.446392+0000","last_unstale":"2024-05-15T15:39:54.056855+0000","last_undegraded":"2024-05-15T15:39:54.056855+0000","last_fullsized":"2024-05-15T15:39:54.056855+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:02:03.970482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.462447+0000","last_change":"2024-05-15T15:39:52.468710+0000","last_active":"2024-05-15T15:39:53.462447+0000","last_peered":"2024-05-15T15:39:53.462447+0000","last_clean":"2024-05-15T15:39:53.462447+0000","last_became_active":"2024-05-15T15:39:52.468364+0000","last_became_peered":"2024-05-15T15:39:52.468364+0000","last_unstale":"2024-05-15T15:39:53.462447+0000","last_undegraded":"2024-05-15T15:39:53.462447+0000","last_fullsized":"2024-05-15T15:39:53.462447+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:39:07.633570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057781+0000","last_change":"2024-05-15T15:39:51.454815+0000","last_active":"2024-05-15T15:39:54.057781+0000","last_peered":"2024-05-15T15:39:54.057781+0000","last_clean":"2024-05-15T15:39:54.057781+0000","last_became_active":"2024-05-15T15:39:51.454302+0000","last_became_peered":"2024-05-15T15:39:51.454302+0000","last_unstale":"2024-05-15T15:39:54.057781+0000","last_undegraded":"2024-05-15T15:39:54.057781+0000","last_fullsized":"2024-05-15T15:39:54.057781+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:52:26.020009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057590+0000","last_change":"2024-05-15T15:39:52.478397+0000","last_active":"2024-05-15T15:39:54.057590+0000","last_peered":"2024-05-15T15:39:54.057590+0000","last_clean":"2024-05-15T15:39:54.057590+0000","last_became_active":"2024-05-15T15:39:52.477855+0000","last_became_peered":"2024-05-15T15:39:52.477855+0000","last_unstale":"2024-05-15T15:39:54.057590+0000","last_undegraded":"2024-05-15T15:39:54.057590+0000","last_fullsized":"2024-05-15T15:39:54.057590+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:43:53.153262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057138+0000","last_change":"2024-05-15T15:39:51.451802+0000","last_active":"2024-05-15T15:39:54.057138+0000","last_peered":"2024-05-15T15:39:54.057138+0000","last_clean":"2024-05-15T15:39:54.057138+0000","last_became_active":"2024-05-15T15:39:51.451413+0000","last_became_peered":"2024-05-15T15:39:51.451413+0000","last_unstale":"2024-05-15T15:39:54.057138+0000","last_undegraded":"2024-05-15T15:39:54.057138+0000","last_fullsized":"2024-05-15T15:39:54.057138+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:13:11.699438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057652+0000","last_change":"2024-05-15T15:39:52.477925+0000","last_active":"2024-05-15T15:39:54.057652+0000","last_peered":"2024-05-15T15:39:54.057652+0000","last_clean":"2024-05-15T15:39:54.057652+0000","last_became_active":"2024-05-15T15:39:52.477255+0000","last_became_peered":"2024-05-15T15:39:52.477255+0000","last_unstale":"2024-05-15T15:39:54.057652+0000","last_undegraded":"2024-05-15T15:39:54.057652+0000","last_fullsized":"2024-05-15T15:39:54.057652+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:39:07.633570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.464272+0000","last_change":"2024-05-15T15:39:51.450383+0000","last_active":"2024-05-15T15:39:53.464272+0000","last_peered":"2024-05-15T15:39:53.464272+0000","last_clean":"2024-05-15T15:39:53.464272+0000","last_became_active":"2024-05-15T15:39:51.449318+0000","last_became_peered":"2024-05-15T15:39:51.449318+0000","last_unstale":"2024-05-15T15:39:53.464272+0000","last_undegraded":"2024-05-15T15:39:53.464272+0000","last_fullsized":"2024-05-15T15:39:53.464272+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:17:33.373439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057489+0000","last_change":"2024-05-15T15:39:52.471316+0000","last_active":"2024-05-15T15:39:54.057489+0000","last_peered":"2024-05-15T15:39:54.057489+0000","last_clean":"2024-05-15T15:39:54.057489+0000","last_became_active":"2024-05-15T15:39:52.471014+0000","last_became_peered":"2024-05-15T15:39:52.471014+0000","last_unstale":"2024-05-15T15:39:54.057489+0000","last_undegraded":"2024-05-15T15:39:54.057489+0000","last_fullsized":"2024-05-15T15:39:54.057489+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:52:43.064362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.463830+0000","last_change":"2024-05-15T15:39:51.454584+0000","last_active":"2024-05-15T15:39:53.463830+0000","last_peered":"2024-05-15T15:39:53.463830+0000","last_clean":"2024-05-15T15:39:53.463830+0000","last_became_active":"2024-05-15T15:39:51.454260+0000","last_became_peered":"2024-05-15T15:39:51.454260+0000","last_unstale":"2024-05-15T15:39:53.463830+0000","last_undegraded":"2024-05-15T15:39:53.463830+0000","last_fullsized":"2024-05-15T15:39:53.463830+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:17:48.368852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.462838+0000","last_change":"2024-05-15T15:39:52.464130+0000","last_active":"2024-05-15T15:39:53.462838+0000","last_peered":"2024-05-15T15:39:53.462838+0000","last_clean":"2024-05-15T15:39:53.462838+0000","last_became_active":"2024-05-15T15:39:52.463486+0000","last_became_peered":"2024-05-15T15:39:52.463486+0000","last_unstale":"2024-05-15T15:39:53.462838+0000","last_undegraded":"2024-05-15T15:39:53.462838+0000","last_fullsized":"2024-05-15T15:39:53.462838+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:58:23.539973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":110,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.505802+0000","last_change":"2024-05-15T15:39:42.584601+0000","last_active":"2024-05-15T15:39:53.505802+0000","last_peered":"2024-05-15T15:39:53.505802+0000","last_clean":"2024-05-15T15:39:53.505802+0000","last_became_active":"2024-05-15T15:39:42.584129+0000","last_became_peered":"2024-05-15T15:39:42.584129+0000","last_unstale":"2024-05-15T15:39:53.505802+0000","last_undegraded":"2024-05-15T15:39:53.505802+0000","last_fullsized":"2024-05-15T15:39:53.505802+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:41.378107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:41.378107+0000","last_clean_scrub_stamp":"2024-05-15T15:39:41.378107+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:23:25.285669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.462726+0000","last_change":"2024-05-15T15:39:51.451749+0000","last_active":"2024-05-15T15:39:53.462726+0000","last_peered":"2024-05-15T15:39:53.462726+0000","last_clean":"2024-05-15T15:39:53.462726+0000","last_became_active":"2024-05-15T15:39:51.451438+0000","last_became_peered":"2024-05-15T15:39:51.451438+0000","last_unstale":"2024-05-15T15:39:53.462726+0000","last_undegraded":"2024-05-15T15:39:53.462726+0000","last_fullsized":"2024-05-15T15:39:53.462726+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:46:05.262245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057001+0000","last_change":"2024-05-15T15:39:52.462888+0000","last_active":"2024-05-15T15:39:54.057001+0000","last_peered":"2024-05-15T15:39:54.057001+0000","last_clean":"2024-05-15T15:39:54.057001+0000","last_became_active":"2024-05-15T15:39:52.462435+0000","last_became_peered":"2024-05-15T15:39:52.462435+0000","last_unstale":"2024-05-15T15:39:54.057001+0000","last_undegraded":"2024-05-15T15:39:54.057001+0000","last_fullsized":"2024-05-15T15:39:54.057001+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:49:18.132410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.462612+0000","last_change":"2024-05-15T15:39:51.457051+0000","last_active":"2024-05-15T15:39:53.462612+0000","last_peered":"2024-05-15T15:39:53.462612+0000","last_clean":"2024-05-15T15:39:53.462612+0000","last_became_active":"2024-05-15T15:39:51.456748+0000","last_became_peered":"2024-05-15T15:39:51.456748+0000","last_unstale":"2024-05-15T15:39:53.462612+0000","last_undegraded":"2024-05-15T15:39:53.462612+0000","last_fullsized":"2024-05-15T15:39:53.462612+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:53:34.707481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.463666+0000","last_change":"2024-05-15T15:39:52.467728+0000","last_active":"2024-05-15T15:39:53.463666+0000","last_peered":"2024-05-15T15:39:53.463666+0000","last_clean":"2024-05-15T15:39:53.463666+0000","last_became_active":"2024-05-15T15:39:52.467352+0000","last_became_peered":"2024-05-15T15:39:52.467352+0000","last_unstale":"2024-05-15T15:39:53.463666+0000","last_undegraded":"2024-05-15T15:39:53.463666+0000","last_fullsized":"2024-05-15T15:39:53.463666+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:19:06.288701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.056496+0000","last_change":"2024-05-15T15:39:51.454058+0000","last_active":"2024-05-15T15:39:54.056496+0000","last_peered":"2024-05-15T15:39:54.056496+0000","last_clean":"2024-05-15T15:39:54.056496+0000","last_became_active":"2024-05-15T15:39:51.453765+0000","last_became_peered":"2024-05-15T15:39:51.453765+0000","last_unstale":"2024-05-15T15:39:54.056496+0000","last_undegraded":"2024-05-15T15:39:54.056496+0000","last_fullsized":"2024-05-15T15:39:54.056496+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:17:48.368852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.464095+0000","last_change":"2024-05-15T15:39:52.474812+0000","last_active":"2024-05-15T15:39:53.464095+0000","last_peered":"2024-05-15T15:39:53.464095+0000","last_clean":"2024-05-15T15:39:53.464095+0000","last_became_active":"2024-05-15T15:39:52.472883+0000","last_became_peered":"2024-05-15T15:39:52.472883+0000","last_unstale":"2024-05-15T15:39:53.464095+0000","last_undegraded":"2024-05-15T15:39:53.464095+0000","last_fullsized":"2024-05-15T15:39:53.464095+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:00:05.496148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.463124+0000","last_change":"2024-05-15T15:39:51.449647+0000","last_active":"2024-05-15T15:39:53.463124+0000","last_peered":"2024-05-15T15:39:53.463124+0000","last_clean":"2024-05-15T15:39:53.463124+0000","last_became_active":"2024-05-15T15:39:51.449332+0000","last_became_peered":"2024-05-15T15:39:51.449332+0000","last_unstale":"2024-05-15T15:39:53.463124+0000","last_undegraded":"2024-05-15T15:39:53.463124+0000","last_fullsized":"2024-05-15T15:39:53.463124+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:43:52.145736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.056740+0000","last_change":"2024-05-15T15:39:52.479896+0000","last_active":"2024-05-15T15:39:54.056740+0000","last_peered":"2024-05-15T15:39:54.056740+0000","last_clean":"2024-05-15T15:39:54.056740+0000","last_became_active":"2024-05-15T15:39:52.479462+0000","last_became_peered":"2024-05-15T15:39:52.479462+0000","last_unstale":"2024-05-15T15:39:54.056740+0000","last_undegraded":"2024-05-15T15:39:54.056740+0000","last_fullsized":"2024-05-15T15:39:54.056740+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:00:05.496148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.463525+0000","last_change":"2024-05-15T15:39:51.450193+0000","last_active":"2024-05-15T15:39:53.463525+0000","last_peered":"2024-05-15T15:39:53.463525+0000","last_clean":"2024-05-15T15:39:53.463525+0000","last_became_active":"2024-05-15T15:39:51.449868+0000","last_became_peered":"2024-05-15T15:39:51.449868+0000","last_unstale":"2024-05-15T15:39:53.463525+0000","last_undegraded":"2024-05-15T15:39:53.463525+0000","last_fullsized":"2024-05-15T15:39:53.463525+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:13:01.291506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057411+0000","last_change":"2024-05-15T15:39:52.466700+0000","last_active":"2024-05-15T15:39:54.057411+0000","last_peered":"2024-05-15T15:39:54.057411+0000","last_clean":"2024-05-15T15:39:54.057411+0000","last_became_active":"2024-05-15T15:39:52.464696+0000","last_became_peered":"2024-05-15T15:39:52.464696+0000","last_unstale":"2024-05-15T15:39:54.057411+0000","last_undegraded":"2024-05-15T15:39:54.057411+0000","last_fullsized":"2024-05-15T15:39:54.057411+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:14:40.347641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.463133+0000","last_change":"2024-05-15T15:39:51.449690+0000","last_active":"2024-05-15T15:39:53.463133+0000","last_peered":"2024-05-15T15:39:53.463133+0000","last_clean":"2024-05-15T15:39:53.463133+0000","last_became_active":"2024-05-15T15:39:51.448404+0000","last_became_peered":"2024-05-15T15:39:51.448404+0000","last_unstale":"2024-05-15T15:39:53.463133+0000","last_undegraded":"2024-05-15T15:39:53.463133+0000","last_fullsized":"2024-05-15T15:39:53.463133+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:56:23.235022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.463699+0000","last_change":"2024-05-15T15:39:52.475321+0000","last_active":"2024-05-15T15:39:53.463699+0000","last_peered":"2024-05-15T15:39:53.463699+0000","last_clean":"2024-05-15T15:39:53.463699+0000","last_became_active":"2024-05-15T15:39:52.475018+0000","last_became_peered":"2024-05-15T15:39:52.475018+0000","last_unstale":"2024-05-15T15:39:53.463699+0000","last_undegraded":"2024-05-15T15:39:53.463699+0000","last_fullsized":"2024-05-15T15:39:53.463699+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:43:53.153262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057301+0000","last_change":"2024-05-15T15:39:51.455435+0000","last_active":"2024-05-15T15:39:54.057301+0000","last_peered":"2024-05-15T15:39:54.057301+0000","last_clean":"2024-05-15T15:39:54.057301+0000","last_became_active":"2024-05-15T15:39:51.455047+0000","last_became_peered":"2024-05-15T15:39:51.455047+0000","last_unstale":"2024-05-15T15:39:54.057301+0000","last_undegraded":"2024-05-15T15:39:54.057301+0000","last_fullsized":"2024-05-15T15:39:54.057301+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:49:40.863334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057303+0000","last_change":"2024-05-15T15:39:52.459873+0000","last_active":"2024-05-15T15:39:54.057303+0000","last_peered":"2024-05-15T15:39:54.057303+0000","last_clean":"2024-05-15T15:39:54.057303+0000","last_became_active":"2024-05-15T15:39:52.459582+0000","last_became_peered":"2024-05-15T15:39:52.459582+0000","last_unstale":"2024-05-15T15:39:54.057303+0000","last_undegraded":"2024-05-15T15:39:54.057303+0000","last_fullsized":"2024-05-15T15:39:54.057303+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:54:18.294364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.463011+0000","last_change":"2024-05-15T15:39:51.456218+0000","last_active":"2024-05-15T15:39:53.463011+0000","last_peered":"2024-05-15T15:39:53.463011+0000","last_clean":"2024-05-15T15:39:53.463011+0000","last_became_active":"2024-05-15T15:39:51.455592+0000","last_became_peered":"2024-05-15T15:39:51.455592+0000","last_unstale":"2024-05-15T15:39:53.463011+0000","last_undegraded":"2024-05-15T15:39:53.463011+0000","last_fullsized":"2024-05-15T15:39:53.463011+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:14:39.340114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057249+0000","last_change":"2024-05-15T15:39:52.464074+0000","last_active":"2024-05-15T15:39:54.057249+0000","last_peered":"2024-05-15T15:39:54.057249+0000","last_clean":"2024-05-15T15:39:54.057249+0000","last_became_active":"2024-05-15T15:39:52.463738+0000","last_became_peered":"2024-05-15T15:39:52.463738+0000","last_unstale":"2024-05-15T15:39:54.057249+0000","last_undegraded":"2024-05-15T15:39:54.057249+0000","last_fullsized":"2024-05-15T15:39:54.057249+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:29:47.569993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.056270+0000","last_change":"2024-05-15T15:39:51.456266+0000","last_active":"2024-05-15T15:39:54.056270+0000","last_peered":"2024-05-15T15:39:54.056270+0000","last_clean":"2024-05-15T15:39:54.056270+0000","last_became_active":"2024-05-15T15:39:51.455914+0000","last_became_peered":"2024-05-15T15:39:51.455914+0000","last_unstale":"2024-05-15T15:39:54.056270+0000","last_undegraded":"2024-05-15T15:39:54.056270+0000","last_fullsized":"2024-05-15T15:39:54.056270+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:18:35.801621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.463115+0000","last_change":"2024-05-15T15:39:52.462843+0000","last_active":"2024-05-15T15:39:53.463115+0000","last_peered":"2024-05-15T15:39:53.463115+0000","last_clean":"2024-05-15T15:39:53.463115+0000","last_became_active":"2024-05-15T15:39:52.459592+0000","last_became_peered":"2024-05-15T15:39:52.459592+0000","last_unstale":"2024-05-15T15:39:53.463115+0000","last_undegraded":"2024-05-15T15:39:53.463115+0000","last_fullsized":"2024-05-15T15:39:53.463115+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:19:16.899508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.056705+0000","last_change":"2024-05-15T15:39:51.456133+0000","last_active":"2024-05-15T15:39:54.056705+0000","last_peered":"2024-05-15T15:39:54.056705+0000","last_clean":"2024-05-15T15:39:54.056705+0000","last_became_active":"2024-05-15T15:39:51.455602+0000","last_became_peered":"2024-05-15T15:39:51.455602+0000","last_unstale":"2024-05-15T15:39:54.056705+0000","last_undegraded":"2024-05-15T15:39:54.056705+0000","last_fullsized":"2024-05-15T15:39:54.056705+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:17:38.370348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.056952+0000","last_change":"2024-05-15T15:39:52.462939+0000","last_active":"2024-05-15T15:39:54.056952+0000","last_peered":"2024-05-15T15:39:54.056952+0000","last_clean":"2024-05-15T15:39:54.056952+0000","last_became_active":"2024-05-15T15:39:52.462611+0000","last_became_peered":"2024-05-15T15:39:52.462611+0000","last_unstale":"2024-05-15T15:39:54.056952+0000","last_undegraded":"2024-05-15T15:39:54.056952+0000","last_fullsized":"2024-05-15T15:39:54.056952+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:03:58.144604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.464110+0000","last_change":"2024-05-15T15:39:51.453591+0000","last_active":"2024-05-15T15:39:53.464110+0000","last_peered":"2024-05-15T15:39:53.464110+0000","last_clean":"2024-05-15T15:39:53.464110+0000","last_became_active":"2024-05-15T15:39:51.453250+0000","last_became_peered":"2024-05-15T15:39:51.453250+0000","last_unstale":"2024-05-15T15:39:53.464110+0000","last_undegraded":"2024-05-15T15:39:53.464110+0000","last_fullsized":"2024-05-15T15:39:53.464110+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:15:32.911265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057214+0000","last_change":"2024-05-15T15:39:52.469345+0000","last_active":"2024-05-15T15:39:54.057214+0000","last_peered":"2024-05-15T15:39:54.057214+0000","last_clean":"2024-05-15T15:39:54.057214+0000","last_became_active":"2024-05-15T15:39:52.469041+0000","last_became_peered":"2024-05-15T15:39:52.469041+0000","last_unstale":"2024-05-15T15:39:54.057214+0000","last_undegraded":"2024-05-15T15:39:54.057214+0000","last_fullsized":"2024-05-15T15:39:54.057214+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:52:27.027535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.462608+0000","last_change":"2024-05-15T15:39:51.450991+0000","last_active":"2024-05-15T15:39:53.462608+0000","last_peered":"2024-05-15T15:39:53.462608+0000","last_clean":"2024-05-15T15:39:53.462608+0000","last_became_active":"2024-05-15T15:39:51.450600+0000","last_became_peered":"2024-05-15T15:39:51.450600+0000","last_unstale":"2024-05-15T15:39:53.462608+0000","last_undegraded":"2024-05-15T15:39:53.462608+0000","last_fullsized":"2024-05-15T15:39:53.462608+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:49:26.650770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.462903+0000","last_change":"2024-05-15T15:39:52.462106+0000","last_active":"2024-05-15T15:39:53.462903+0000","last_peered":"2024-05-15T15:39:53.462903+0000","last_clean":"2024-05-15T15:39:53.462903+0000","last_became_active":"2024-05-15T15:39:52.461217+0000","last_became_peered":"2024-05-15T15:39:52.461217+0000","last_unstale":"2024-05-15T15:39:53.462903+0000","last_undegraded":"2024-05-15T15:39:53.462903+0000","last_fullsized":"2024-05-15T15:39:53.462903+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:41:33.947325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.462652+0000","last_change":"2024-05-15T15:39:52.473917+0000","last_active":"2024-05-15T15:39:53.462652+0000","last_peered":"2024-05-15T15:39:53.462652+0000","last_clean":"2024-05-15T15:39:53.462652+0000","last_became_active":"2024-05-15T15:39:52.472408+0000","last_became_peered":"2024-05-15T15:39:52.472408+0000","last_unstale":"2024-05-15T15:39:53.462652+0000","last_undegraded":"2024-05-15T15:39:53.462652+0000","last_fullsized":"2024-05-15T15:39:53.462652+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:39:30.074726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057634+0000","last_change":"2024-05-15T15:39:51.458878+0000","last_active":"2024-05-15T15:39:54.057634+0000","last_peered":"2024-05-15T15:39:54.057634+0000","last_clean":"2024-05-15T15:39:54.057634+0000","last_became_active":"2024-05-15T15:39:51.458527+0000","last_became_peered":"2024-05-15T15:39:51.458527+0000","last_unstale":"2024-05-15T15:39:54.057634+0000","last_undegraded":"2024-05-15T15:39:54.057634+0000","last_fullsized":"2024-05-15T15:39:54.057634+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:14:39.340114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.506342+0000","last_change":"2024-05-15T15:39:52.479684+0000","last_active":"2024-05-15T15:39:53.506342+0000","last_peered":"2024-05-15T15:39:53.506342+0000","last_clean":"2024-05-15T15:39:53.506342+0000","last_became_active":"2024-05-15T15:39:52.479359+0000","last_became_peered":"2024-05-15T15:39:52.479359+0000","last_unstale":"2024-05-15T15:39:53.506342+0000","last_undegraded":"2024-05-15T15:39:53.506342+0000","last_fullsized":"2024-05-15T15:39:53.506342+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:14:40.347641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057324+0000","last_change":"2024-05-15T15:39:51.459312+0000","last_active":"2024-05-15T15:39:54.057324+0000","last_peered":"2024-05-15T15:39:54.057324+0000","last_clean":"2024-05-15T15:39:54.057324+0000","last_became_active":"2024-05-15T15:39:51.458739+0000","last_became_peered":"2024-05-15T15:39:51.458739+0000","last_unstale":"2024-05-15T15:39:54.057324+0000","last_undegraded":"2024-05-15T15:39:54.057324+0000","last_fullsized":"2024-05-15T15:39:54.057324+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:17:33.373439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.464791+0000","last_change":"2024-05-15T15:39:52.472300+0000","last_active":"2024-05-15T15:39:53.464791+0000","last_peered":"2024-05-15T15:39:53.464791+0000","last_clean":"2024-05-15T15:39:53.464791+0000","last_became_active":"2024-05-15T15:39:52.472005+0000","last_became_peered":"2024-05-15T15:39:52.472005+0000","last_unstale":"2024-05-15T15:39:53.464791+0000","last_undegraded":"2024-05-15T15:39:53.464791+0000","last_fullsized":"2024-05-15T15:39:53.464791+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:18:51.904529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.465122+0000","last_change":"2024-05-15T15:39:51.451702+0000","last_active":"2024-05-15T15:39:53.465122+0000","last_peered":"2024-05-15T15:39:53.465122+0000","last_clean":"2024-05-15T15:39:53.465122+0000","last_became_active":"2024-05-15T15:39:51.451387+0000","last_became_peered":"2024-05-15T15:39:51.451387+0000","last_unstale":"2024-05-15T15:39:53.465122+0000","last_undegraded":"2024-05-15T15:39:53.465122+0000","last_fullsized":"2024-05-15T15:39:53.465122+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:23:00.828647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.465209+0000","last_change":"2024-05-15T15:39:52.473199+0000","last_active":"2024-05-15T15:39:53.465209+0000","last_peered":"2024-05-15T15:39:53.465209+0000","last_clean":"2024-05-15T15:39:53.465209+0000","last_became_active":"2024-05-15T15:39:52.472848+0000","last_became_peered":"2024-05-15T15:39:52.472848+0000","last_unstale":"2024-05-15T15:39:53.465209+0000","last_undegraded":"2024-05-15T15:39:53.465209+0000","last_fullsized":"2024-05-15T15:39:53.465209+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:39:30.074726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"22'4","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057222+0000","last_change":"2024-05-15T15:39:51.445161+0000","last_active":"2024-05-15T15:39:54.057222+0000","last_peered":"2024-05-15T15:39:54.057222+0000","last_clean":"2024-05-15T15:39:54.057222+0000","last_became_active":"2024-05-15T15:39:51.444855+0000","last_became_peered":"2024-05-15T15:39:51.444855+0000","last_unstale":"2024-05-15T15:39:54.057222+0000","last_undegraded":"2024-05-15T15:39:54.057222+0000","last_fullsized":"2024-05-15T15:39:54.057222+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:36:50.322584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509446,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":241664,"data_stored":81359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509446,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":233472,"data_stored":81235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509447,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27836,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":835584,"data_stored":671695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509446,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":237568,"data_stored":81817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509446,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":245760,"data_stored":82847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509447,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":831488,"data_stored":671673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509446,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":241664,"data_stored":81291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":253952,"data_stored":83519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-15T15:40:01.405 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-15T15:40:01.405 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-05-15T15:40:01.405 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-05-15T15:40:01.405 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-05-15T15:40:01.406 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-05-15T15:40:01.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.551+0000 7f3c9c80c640 1 Processor -- start 2024-05-15T15:40:01.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.552+0000 7f3c9c80c640 1 -- start start 2024-05-15T15:40:01.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.553+0000 7f3c9c80c640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f3c980a0ba0 0x7f3c98146380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:01.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.553+0000 7f3c9c80c640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c98071150 con 0x7f3c980bc1c0 2024-05-15T15:40:01.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.553+0000 7f3c9c80c640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c9814c120 con 0x7f3c9814c8e0 2024-05-15T15:40:01.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.553+0000 7f3c9c80c640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f3c9814c450 con 0x7f3c980a0ba0 2024-05-15T15:40:01.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.553+0000 7f3c95d9b640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f3c980a0ba0 0x7f3c98146380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:01.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.553+0000 7f3c95d9b640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f3c980a0ba0 0x7f3c98146380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59428/0 (socket says 172.21.15.12:59428) 2024-05-15T15:40:01.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.553+0000 7f3c95d9b640 1 -- 172.21.15.12:0/723627635 learned_addr learned my addr 172.21.15.12:0/723627635 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:01.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.553+0000 7f3c95d9b640 1 -- 172.21.15.12:0/723627635 >> v1:172.21.15.84:6789/0 conn(0x7f3c9814c8e0 legacy=0x7f3c98156a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:01.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.553+0000 7f3c95d9b640 1 -- 172.21.15.12:0/723627635 >> v1:172.21.15.12:6789/0 conn(0x7f3c980bc1c0 legacy=0x7f3c98070a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:01.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.553+0000 7f3c95d9b640 1 -- 172.21.15.12:0/723627635 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c98071e40 con 0x7f3c980a0ba0 2024-05-15T15:40:01.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.554+0000 7f3c95d9b640 1 --2- 172.21.15.12:0/723627635 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c980a0ba0 0x7f3c98146380 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3c80009870 tx=0x7f3c8002a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5844c774b625a7d server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:01.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.554+0000 7f3c9559a640 1 -- 172.21.15.12:0/723627635 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c80037070 con 0x7f3c980a0ba0 2024-05-15T15:40:01.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.554+0000 7f3c9559a640 1 -- 172.21.15.12:0/723627635 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c8002ae50 con 0x7f3c980a0ba0 2024-05-15T15:40:01.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.554+0000 7f3c9559a640 1 -- 172.21.15.12:0/723627635 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c80032860 con 0x7f3c980a0ba0 2024-05-15T15:40:01.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.555+0000 7f3c9c80c640 1 -- 172.21.15.12:0/723627635 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c980a0ba0 msgr2=0x7f3c98146380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:01.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.555+0000 7f3c9c80c640 1 --2- 172.21.15.12:0/723627635 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c980a0ba0 0x7f3c98146380 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3c80009870 tx=0x7f3c8002a300 comp rx=0 tx=0).stop 2024-05-15T15:40:01.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.555+0000 7f3c9c80c640 1 -- 172.21.15.12:0/723627635 shutdown_connections 2024-05-15T15:40:01.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.555+0000 7f3c9c80c640 1 --2- 172.21.15.12:0/723627635 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c980a0ba0 0x7f3c98146380 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:01.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.555+0000 7f3c9c80c640 1 -- 172.21.15.12:0/723627635 >> 172.21.15.12:0/723627635 conn(0x7f3c980c17c0 msgr2=0x7f3c980c1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:01.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.555+0000 7f3c9c80c640 1 -- 172.21.15.12:0/723627635 shutdown_connections 2024-05-15T15:40:01.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.555+0000 7f3c9c80c640 1 -- 172.21.15.12:0/723627635 wait complete. 2024-05-15T15:40:01.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.557+0000 7f3c9c80c640 1 Processor -- start 2024-05-15T15:40:01.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.557+0000 7f3c9c80c640 1 -- start start 2024-05-15T15:40:01.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.558+0000 7f3c9c80c640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f3c980a0ba0 0x7f3c98147bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:01.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.558+0000 7f3c9c80c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c980bc1c0 0x7f3c980a6db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:01.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.558+0000 7f3c9c80c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3c9814c8e0 0x7f3c981e5df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:01.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.558+0000 7f3c9c80c640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f3c980a0fb0 con 0x7f3c980bc1c0 2024-05-15T15:40:01.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.558+0000 7f3c9c80c640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f3c980716b0 con 0x7f3c9814c8e0 2024-05-15T15:40:01.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.558+0000 7f3c9c80c640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f3c980bd5f0 con 0x7f3c980a0ba0 2024-05-15T15:40:01.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.558+0000 7f3c95d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c980bc1c0 0x7f3c980a6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:01.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.558+0000 7f3c95d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c980bc1c0 0x7f3c980a6db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59444/0 (socket says 172.21.15.12:59444) 2024-05-15T15:40:01.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.558+0000 7f3c95d9b640 1 -- 172.21.15.12:0/3827233042 learned_addr learned my addr 172.21.15.12:0/3827233042 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:01.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.558+0000 7f3c96d9d640 1 --2- 172.21.15.12:0/3827233042 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3c9814c8e0 0x7f3c981e5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:01.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.558+0000 7f3c9659c640 1 --2- 172.21.15.12:0/3827233042 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f3c980a0ba0 0x7f3c98147bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:01.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.558+0000 7f3c95d9b640 1 -- 172.21.15.12:0/3827233042 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f3c980a0ba0 msgr2=0x7f3c98147bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:01.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.558+0000 7f3c95d9b640 1 --2- 172.21.15.12:0/3827233042 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f3c980a0ba0 0x7f3c98147bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:01.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.558+0000 7f3c95d9b640 1 -- 172.21.15.12:0/3827233042 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3c9814c8e0 msgr2=0x7f3c981e5df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:01.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.558+0000 7f3c95d9b640 1 --2- 172.21.15.12:0/3827233042 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3c9814c8e0 0x7f3c981e5df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:01.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.558+0000 7f3c95d9b640 1 -- 172.21.15.12:0/3827233042 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c980a72f0 con 0x7f3c980bc1c0 2024-05-15T15:40:01.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.558+0000 7f3c9659c640 1 --2- 172.21.15.12:0/3827233042 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f3c980a0ba0 0x7f3c98147bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-15T15:40:01.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.558+0000 7f3c95d9b640 1 --2- 172.21.15.12:0/3827233042 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c980bc1c0 0x7f3c980a6db0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3c80000c00 tx=0x7f3c800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:01.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.559+0000 7f3c8effd640 1 -- 172.21.15.12:0/3827233042 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c80041070 con 0x7f3c980bc1c0 2024-05-15T15:40:01.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.559+0000 7f3c8effd640 1 -- 172.21.15.12:0/3827233042 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c8003c890 con 0x7f3c980bc1c0 2024-05-15T15:40:01.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.559+0000 7f3c9c80c640 1 -- 172.21.15.12:0/3827233042 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c981e6330 con 0x7f3c980bc1c0 2024-05-15T15:40:01.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.559+0000 7f3c8effd640 1 -- 172.21.15.12:0/3827233042 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c80037040 con 0x7f3c980bc1c0 2024-05-15T15:40:01.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.559+0000 7f3c9c80c640 1 -- 172.21.15.12:0/3827233042 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c981471c0 con 0x7f3c980bc1c0 2024-05-15T15:40:01.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.560+0000 7f3c9c80c640 1 -- 172.21.15.12:0/3827233042 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c981432a0 con 0x7f3c980bc1c0 2024-05-15T15:40:01.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.560+0000 7f3c8effd640 1 -- 172.21.15.12:0/3827233042 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f3c80044070 con 0x7f3c980bc1c0 2024-05-15T15:40:01.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.561+0000 7f3c8effd640 1 --2- 172.21.15.12:0/3827233042 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f3c78076300 0x7f3c78078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:01.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.561+0000 7f3c8effd640 1 -- 172.21.15.12:0/3827233042 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f3c800b7fa0 con 0x7f3c980bc1c0 2024-05-15T15:40:01.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.561+0000 7f3c9659c640 1 --2- 172.21.15.12:0/3827233042 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f3c78076300 0x7f3c78078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:01.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.562+0000 7f3c9659c640 1 --2- 172.21.15.12:0/3827233042 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f3c78076300 0x7f3c78078810 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3c90007fd0 tx=0x7f3c90009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:01.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.565+0000 7f3c8effd640 1 -- 172.21.15.12:0/3827233042 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f3c80081230 con 0x7f3c980bc1c0 2024-05-15T15:40:01.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.805+0000 7f3c9c80c640 1 -- 172.21.15.12:0/3827233042 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f3c98149b20 con 0x7f3c980bc1c0 2024-05-15T15:40:01.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.808+0000 7f3c8effd640 1 -- 172.21.15.12:0/3827233042 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+189521 (secure 0 0 0) 0x7f3c80085530 con 0x7f3c980bc1c0 2024-05-15T15:40:01.812 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-05-15T15:40:01.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.811+0000 7f3c9c80c640 1 -- 172.21.15.12:0/3827233042 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f3c78076300 msgr2=0x7f3c78078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:01.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.811+0000 7f3c9c80c640 1 --2- 172.21.15.12:0/3827233042 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f3c78076300 0x7f3c78078810 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3c90007fd0 tx=0x7f3c90009040 comp rx=0 tx=0).stop 2024-05-15T15:40:01.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.811+0000 7f3c9c80c640 1 -- 172.21.15.12:0/3827233042 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c980bc1c0 msgr2=0x7f3c980a6db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:01.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.811+0000 7f3c9c80c640 1 --2- 172.21.15.12:0/3827233042 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c980bc1c0 0x7f3c980a6db0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3c80000c00 tx=0x7f3c800046c0 comp rx=0 tx=0).stop 2024-05-15T15:40:01.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.811+0000 7f3c9c80c640 1 -- 172.21.15.12:0/3827233042 shutdown_connections 2024-05-15T15:40:01.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.811+0000 7f3c9c80c640 1 --2- 172.21.15.12:0/3827233042 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3c9814c8e0 0x7f3c981e5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:01.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.811+0000 7f3c9c80c640 1 --2- 172.21.15.12:0/3827233042 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f3c78076300 0x7f3c78078810 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:01.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.811+0000 7f3c9c80c640 1 --2- 172.21.15.12:0/3827233042 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c980bc1c0 0x7f3c980a6db0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:01.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.811+0000 7f3c9c80c640 1 --2- 172.21.15.12:0/3827233042 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f3c980a0ba0 0x7f3c98147bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:01.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.811+0000 7f3c9c80c640 1 -- 172.21.15.12:0/3827233042 >> 172.21.15.12:0/3827233042 conn(0x7f3c980c17c0 msgr2=0x7f3c9814ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:01.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.811+0000 7f3c9c80c640 1 -- 172.21.15.12:0/3827233042 shutdown_connections 2024-05-15T15:40:01.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.811+0000 7f3c9c80c640 1 -- 172.21.15.12:0/3827233042 wait complete. 2024-05-15T15:40:01.824 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":5,"flags":0,"active_gid":4106,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":4173299311},{"type":"v1","addr":"172.21.15.84:6833","nonce":4173299311}]},"active_addr":"172.21.15.84:6833/4173299311","active_change":"2024-05-15T15:39:32.685994+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4107,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.84:0","nonce":1886011545}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.84:0","nonce":3892592936}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.84:0","nonce":3093059278}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.84:0","nonce":2402074380}]}]} 2024-05-15T15:40:01.828 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-05-15T15:40:01.829 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-05-15T15:40:01.829 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-15T15:40:01.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.938+0000 7f5a2d4b6640 1 Processor -- start 2024-05-15T15:40:01.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.938+0000 7f5a2d4b6640 1 -- start start 2024-05-15T15:40:01.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.939+0000 7f5a2d4b6640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5a28074b00 0x7f5a2806c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:01.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.939+0000 7f5a2d4b6640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f5a280be3f0 0x7f5a2814cb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:01.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.939+0000 7f5a2d4b6640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a2806ce00 con 0x7f5a2814fad0 2024-05-15T15:40:01.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.939+0000 7f5a2d4b6640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f5a280bb470 con 0x7f5a28074b00 2024-05-15T15:40:01.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.939+0000 7f5a2d4b6640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f5a280bb890 con 0x7f5a280be3f0 2024-05-15T15:40:01.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.940+0000 7f5a26ffd640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5a28074b00 0x7f5a2806c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:01.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.940+0000 7f5a267fc640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f5a280be3f0 0x7f5a2814cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:01.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.940+0000 7f5a26ffd640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5a28074b00 0x7f5a2806c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.12:35796/0 (socket says 172.21.15.12:35796) 2024-05-15T15:40:01.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.940+0000 7f5a267fc640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f5a280be3f0 0x7f5a2814cb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3301/0 says I am v2:172.21.15.12:37610/0 (socket says 172.21.15.12:37610) 2024-05-15T15:40:01.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.940+0000 7f5a26ffd640 1 -- 172.21.15.12:0/296292996 learned_addr learned my addr 172.21.15.12:0/296292996 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:01.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.940+0000 7f5a277fe640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f5a2814fad0 0x7f5a2814fee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.12:53698/0 (socket says 172.21.15.12:53698) 2024-05-15T15:40:01.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.940+0000 7f5a26ffd640 1 -- 172.21.15.12:0/296292996 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f5a280be3f0 msgr2=0x7f5a2814cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:40:01.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.940+0000 7f5a26ffd640 1 --2- 172.21.15.12:0/296292996 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f5a280be3f0 0x7f5a2814cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:01.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.940+0000 7f5a26ffd640 1 -- 172.21.15.12:0/296292996 >> v1:172.21.15.84:6789/0 conn(0x7f5a2814fad0 legacy=0x7f5a2814fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:01.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.940+0000 7f5a26ffd640 1 -- 172.21.15.12:0/296292996 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a280bbb30 con 0x7f5a28074b00 2024-05-15T15:40:01.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.940+0000 7f5a267fc640 1 --2- 172.21.15.12:0/296292996 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f5a280be3f0 0x7f5a2814cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-15T15:40:01.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.941+0000 7f5a26ffd640 1 --2- 172.21.15.12:0/296292996 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a28074b00 0x7f5a2806c8c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5a280bba60 tx=0x7f5a1802a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=63f4fdf142c56970 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:01.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.941+0000 7f5a25ffb640 1 -- 172.21.15.12:0/296292996 <== mon.1 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a18037070 con 0x7f5a28074b00 2024-05-15T15:40:01.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.941+0000 7f5a25ffb640 1 -- 172.21.15.12:0/296292996 <== mon.1 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a18032440 con 0x7f5a28074b00 2024-05-15T15:40:01.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.941+0000 7f5a25ffb640 1 -- 172.21.15.12:0/296292996 <== mon.1 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a18032810 con 0x7f5a28074b00 2024-05-15T15:40:01.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.942+0000 7f5a2d4b6640 1 -- 172.21.15.12:0/296292996 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a28074b00 msgr2=0x7f5a2806c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:01.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.942+0000 7f5a2d4b6640 1 --2- 172.21.15.12:0/296292996 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a28074b00 0x7f5a2806c8c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5a280bba60 tx=0x7f5a1802a1c0 comp rx=0 tx=0).stop 2024-05-15T15:40:01.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.942+0000 7f5a2d4b6640 1 -- 172.21.15.12:0/296292996 shutdown_connections 2024-05-15T15:40:01.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.942+0000 7f5a2d4b6640 1 --2- 172.21.15.12:0/296292996 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f5a280be3f0 0x7f5a2814cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:01.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.942+0000 7f5a2d4b6640 1 --2- 172.21.15.12:0/296292996 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a28074b00 0x7f5a2806c8c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:01.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.942+0000 7f5a2d4b6640 1 -- 172.21.15.12:0/296292996 >> 172.21.15.12:0/296292996 conn(0x7f5a280bd0f0 msgr2=0x7f5a280bd500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:01.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.942+0000 7f5a2d4b6640 1 -- 172.21.15.12:0/296292996 shutdown_connections 2024-05-15T15:40:01.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.942+0000 7f5a2d4b6640 1 -- 172.21.15.12:0/296292996 wait complete. 2024-05-15T15:40:01.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.943+0000 7f5a2d4b6640 1 Processor -- start 2024-05-15T15:40:01.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.943+0000 7f5a2d4b6640 1 -- start start 2024-05-15T15:40:01.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.944+0000 7f5a2d4b6640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a28074b00 0x7f5a280becd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:01.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.944+0000 7f5a2d4b6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a280be3f0 0x7f5a280a06f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:01.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.944+0000 7f5a2d4b6640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f5a2814fad0 0x7f5a2813d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:01.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.944+0000 7f5a2d4b6640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f5a280bc3d0 con 0x7f5a280be3f0 2024-05-15T15:40:01.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.944+0000 7f5a2d4b6640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f5a280bc0f0 con 0x7f5a28074b00 2024-05-15T15:40:01.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.944+0000 7f5a2d4b6640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f5a2814d060 con 0x7f5a2814fad0 2024-05-15T15:40:01.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.945+0000 7f5a267fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a280be3f0 0x7f5a280a06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:01.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.945+0000 7f5a267fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a280be3f0 0x7f5a280a06f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59450/0 (socket says 172.21.15.12:59450) 2024-05-15T15:40:01.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.945+0000 7f5a267fc640 1 -- 172.21.15.12:0/1994336029 learned_addr learned my addr 172.21.15.12:0/1994336029 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:01.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.945+0000 7f5a26ffd640 1 --2- 172.21.15.12:0/1994336029 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a28074b00 0x7f5a280becd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:01.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.945+0000 7f5a277fe640 1 --2- 172.21.15.12:0/1994336029 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f5a2814fad0 0x7f5a2813d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:01.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.945+0000 7f5a267fc640 1 -- 172.21.15.12:0/1994336029 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f5a2814fad0 msgr2=0x7f5a2813d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:01.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.945+0000 7f5a267fc640 1 --2- 172.21.15.12:0/1994336029 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f5a2814fad0 0x7f5a2813d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:01.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.945+0000 7f5a267fc640 1 -- 172.21.15.12:0/1994336029 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a28074b00 msgr2=0x7f5a280becd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:01.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.945+0000 7f5a267fc640 1 --2- 172.21.15.12:0/1994336029 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a28074b00 0x7f5a280becd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:01.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.945+0000 7f5a267fc640 1 -- 172.21.15.12:0/1994336029 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a280bf210 con 0x7f5a280be3f0 2024-05-15T15:40:01.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.945+0000 7f5a267fc640 1 --2- 172.21.15.12:0/1994336029 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a280be3f0 0x7f5a280a06f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5a1c00e900 tx=0x7f5a1c00edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:01.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.945+0000 7f5a0f7fe640 1 -- 172.21.15.12:0/1994336029 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a1c017070 con 0x7f5a280be3f0 2024-05-15T15:40:01.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.945+0000 7f5a0f7fe640 1 -- 172.21.15.12:0/1994336029 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a1c00ca00 con 0x7f5a280be3f0 2024-05-15T15:40:01.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.945+0000 7f5a2d4b6640 1 -- 172.21.15.12:0/1994336029 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a280a0c30 con 0x7f5a280be3f0 2024-05-15T15:40:01.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.945+0000 7f5a0f7fe640 1 -- 172.21.15.12:0/1994336029 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a1c00cdf0 con 0x7f5a280be3f0 2024-05-15T15:40:01.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.945+0000 7f5a2d4b6640 1 -- 172.21.15.12:0/1994336029 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a2814ee80 con 0x7f5a280be3f0 2024-05-15T15:40:01.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.946+0000 7f5a2d4b6640 1 -- 172.21.15.12:0/1994336029 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a2814f660 con 0x7f5a280be3f0 2024-05-15T15:40:01.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.947+0000 7f5a0f7fe640 1 -- 172.21.15.12:0/1994336029 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f5a1c01a070 con 0x7f5a280be3f0 2024-05-15T15:40:01.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.947+0000 7f5a0f7fe640 1 --2- 172.21.15.12:0/1994336029 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f5a140762d0 0x7f5a140787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:01.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.948+0000 7f5a0f7fe640 1 -- 172.21.15.12:0/1994336029 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f5a1c097160 con 0x7f5a280be3f0 2024-05-15T15:40:01.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.948+0000 7f5a26ffd640 1 --2- 172.21.15.12:0/1994336029 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f5a140762d0 0x7f5a140787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:01.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.948+0000 7f5a26ffd640 1 --2- 172.21.15.12:0/1994336029 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f5a140762d0 0x7f5a140787e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5a18034000 tx=0x7f5a1802e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:01.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:01.952+0000 7f5a0f7fe640 1 -- 172.21.15.12:0/1994336029 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f5a1c060360 con 0x7f5a280be3f0 2024-05-15T15:40:02.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.148+0000 7f5a2d4b6640 1 -- 172.21.15.12:0/1994336029 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5a280bb100 con 0x7f5a280be3f0 2024-05-15T15:40:02.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.150+0000 7f5a0f7fe640 1 -- 172.21.15.12:0/1994336029 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16573 (secure 0 0 0) 0x7f5a1c064660 con 0x7f5a280be3f0 2024-05-15T15:40:02.152 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-05-15T15:40:02.152 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":23,"fsid":"3b7fc4b2-b85c-49b5-a5de-38444eeed40d","created":"2024-05-15T15:39:28.392476+0000","modified":"2024-05-15T15:39:53.451332+0000","last_up_change":"2024-05-15T15:39:39.363983+0000","last_in_change":"2024-05-15T15:39:30.591216+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-15T15:39:40.715999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-15T15:39:49.598723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-15T15:39:50.783054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0d06a12a-866a-418e-9776-704d74354579","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":3943681952},{"type":"v1","addr":"172.21.15.12:6809","nonce":3943681952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":3943681952},{"type":"v1","addr":"172.21.15.12:6812","nonce":3943681952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":3943681952},{"type":"v1","addr":"172.21.15.12:6821","nonce":3943681952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":3943681952},{"type":"v1","addr":"172.21.15.12:6816","nonce":3943681952}]},"public_addr":"172.21.15.12:6809/3943681952","cluster_addr":"172.21.15.12:6812/3943681952","heartbeat_back_addr":"172.21.15.12:6821/3943681952","heartbeat_front_addr":"172.21.15.12:6816/3943681952","state":["exists","up"]},{"osd":1,"uuid":"09d0fa19-9ef8-4f35-bf99-6e86658c6f10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6811","nonce":1763752148},{"type":"v1","addr":"172.21.15.12:6813","nonce":1763752148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":1763752148},{"type":"v1","addr":"172.21.15.12:6817","nonce":1763752148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":1763752148},{"type":"v1","addr":"172.21.15.12:6827","nonce":1763752148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6819","nonce":1763752148},{"type":"v1","addr":"172.21.15.12:6822","nonce":1763752148}]},"public_addr":"172.21.15.12:6813/1763752148","cluster_addr":"172.21.15.12:6817/1763752148","heartbeat_back_addr":"172.21.15.12:6827/1763752148","heartbeat_front_addr":"172.21.15.12:6822/1763752148","state":["exists","up"]},{"osd":2,"uuid":"b204c6ad-f431-40a5-ba27-9844294f0ece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":2173702802},{"type":"v1","addr":"172.21.15.12:6823","nonce":2173702802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":2173702802},{"type":"v1","addr":"172.21.15.12:6826","nonce":2173702802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":2173702802},{"type":"v1","addr":"172.21.15.12:6831","nonce":2173702802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":2173702802},{"type":"v1","addr":"172.21.15.12:6829","nonce":2173702802}]},"public_addr":"172.21.15.12:6823/2173702802","cluster_addr":"172.21.15.12:6826/2173702802","heartbeat_back_addr":"172.21.15.12:6831/2173702802","heartbeat_front_addr":"172.21.15.12:6829/2173702802","state":["exists","up"]},{"osd":3,"uuid":"660a9ccb-2ee5-42d8-8481-0835047a8260","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":3956443113},{"type":"v1","addr":"172.21.15.12:6801","nonce":3956443113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":3956443113},{"type":"v1","addr":"172.21.15.12:6803","nonce":3956443113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":3956443113},{"type":"v1","addr":"172.21.15.12:6807","nonce":3956443113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":3956443113},{"type":"v1","addr":"172.21.15.12:6805","nonce":3956443113}]},"public_addr":"172.21.15.12:6801/3956443113","cluster_addr":"172.21.15.12:6803/3956443113","heartbeat_back_addr":"172.21.15.12:6807/3956443113","heartbeat_front_addr":"172.21.15.12:6805/3956443113","state":["exists","up"]},{"osd":4,"uuid":"9eef1461-a961-457c-9a78-43b5098a46a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":1021092792},{"type":"v1","addr":"172.21.15.84:6809","nonce":1021092792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":1021092792},{"type":"v1","addr":"172.21.15.84:6811","nonce":1021092792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":1021092792},{"type":"v1","addr":"172.21.15.84:6815","nonce":1021092792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":1021092792},{"type":"v1","addr":"172.21.15.84:6813","nonce":1021092792}]},"public_addr":"172.21.15.84:6809/1021092792","cluster_addr":"172.21.15.84:6811/1021092792","heartbeat_back_addr":"172.21.15.84:6815/1021092792","heartbeat_front_addr":"172.21.15.84:6813/1021092792","state":["exists","up"]},{"osd":5,"uuid":"5f924e2f-6c71-4741-a727-d3710c438431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":3173527851},{"type":"v1","addr":"172.21.15.84:6801","nonce":3173527851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":3173527851},{"type":"v1","addr":"172.21.15.84:6803","nonce":3173527851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":3173527851},{"type":"v1","addr":"172.21.15.84:6807","nonce":3173527851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":3173527851},{"type":"v1","addr":"172.21.15.84:6805","nonce":3173527851}]},"public_addr":"172.21.15.84:6801/3173527851","cluster_addr":"172.21.15.84:6803/3173527851","heartbeat_back_addr":"172.21.15.84:6807/3173527851","heartbeat_front_addr":"172.21.15.84:6805/3173527851","state":["exists","up"]},{"osd":6,"uuid":"efae9975-8c16-4ad3-892f-71f3c59718d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3029180670},{"type":"v1","addr":"172.21.15.84:6817","nonce":3029180670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3029180670},{"type":"v1","addr":"172.21.15.84:6819","nonce":3029180670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3029180670},{"type":"v1","addr":"172.21.15.84:6823","nonce":3029180670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3029180670},{"type":"v1","addr":"172.21.15.84:6821","nonce":3029180670}]},"public_addr":"172.21.15.84:6817/3029180670","cluster_addr":"172.21.15.84:6819/3029180670","heartbeat_back_addr":"172.21.15.84:6823/3029180670","heartbeat_front_addr":"172.21.15.84:6821/3029180670","state":["exists","up"]},{"osd":7,"uuid":"6426efba-ee4d-4e44-83d1-c76c75aec30c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3067620602},{"type":"v1","addr":"172.21.15.84:6825","nonce":3067620602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3067620602},{"type":"v1","addr":"172.21.15.84:6827","nonce":3067620602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":3067620602},{"type":"v1","addr":"172.21.15.84:6831","nonce":3067620602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":3067620602},{"type":"v1","addr":"172.21.15.84:6829","nonce":3067620602}]},"public_addr":"172.21.15.84:6825/3067620602","cluster_addr":"172.21.15.84:6827/3067620602","heartbeat_back_addr":"172.21.15.84:6831/3067620602","heartbeat_front_addr":"172.21.15.84:6829/3067620602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.809514+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.845364+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.762733+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.688597+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.699228+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.747865+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.712415+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.820683+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-15T15:40:02.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.152+0000 7f5a2d4b6640 1 -- 172.21.15.12:0/1994336029 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f5a140762d0 msgr2=0x7f5a140787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:02.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.152+0000 7f5a2d4b6640 1 --2- 172.21.15.12:0/1994336029 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f5a140762d0 0x7f5a140787e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5a18034000 tx=0x7f5a1802e000 comp rx=0 tx=0).stop 2024-05-15T15:40:02.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.152+0000 7f5a2d4b6640 1 -- 172.21.15.12:0/1994336029 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a280be3f0 msgr2=0x7f5a280a06f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:02.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.152+0000 7f5a2d4b6640 1 --2- 172.21.15.12:0/1994336029 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a280be3f0 0x7f5a280a06f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5a1c00e900 tx=0x7f5a1c00edc0 comp rx=0 tx=0).stop 2024-05-15T15:40:02.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.152+0000 7f5a2d4b6640 1 -- 172.21.15.12:0/1994336029 shutdown_connections 2024-05-15T15:40:02.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.152+0000 7f5a2d4b6640 1 --2- 172.21.15.12:0/1994336029 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f5a2814fad0 0x7f5a2813d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:02.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.152+0000 7f5a2d4b6640 1 --2- 172.21.15.12:0/1994336029 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f5a140762d0 0x7f5a140787e0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:02.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.152+0000 7f5a2d4b6640 1 --2- 172.21.15.12:0/1994336029 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a280be3f0 0x7f5a280a06f0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:02.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.152+0000 7f5a2d4b6640 1 --2- 172.21.15.12:0/1994336029 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a28074b00 0x7f5a280becd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:02.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.152+0000 7f5a2d4b6640 1 -- 172.21.15.12:0/1994336029 >> 172.21.15.12:0/1994336029 conn(0x7f5a280bd0f0 msgr2=0x7f5a28148ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:02.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.152+0000 7f5a2d4b6640 1 -- 172.21.15.12:0/1994336029 shutdown_connections 2024-05-15T15:40:02.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.152+0000 7f5a2d4b6640 1 -- 172.21.15.12:0/1994336029 wait complete. 2024-05-15T15:40:02.165 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-05-15T15:40:02.165 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-15T15:40:02.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.275+0000 7fe9db2c8640 1 Processor -- start 2024-05-15T15:40:02.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.275+0000 7fe9db2c8640 1 -- start start 2024-05-15T15:40:02.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.276+0000 7fe9db2c8640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe9d4151fc0 0x7fe9d40bd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:02.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.276+0000 7fe9db2c8640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe9d406da30 0x7fe9d40be940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:02.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.276+0000 7fe9db2c8640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9d40c36f0 con 0x7fe9d406de40 2024-05-15T15:40:02.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.276+0000 7fe9db2c8640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fe9d40bdc10 con 0x7fe9d406da30 2024-05-15T15:40:02.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.276+0000 7fe9db2c8640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7fe9d4152530 con 0x7fe9d4151fc0 2024-05-15T15:40:02.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.276+0000 7fe9d8863640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe9d406da30 0x7fe9d40be940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:02.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.276+0000 7fe9d8863640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe9d406da30 0x7fe9d40be940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59452/0 (socket says 172.21.15.12:59452) 2024-05-15T15:40:02.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.276+0000 7fe9d8863640 1 -- 172.21.15.12:0/778615830 learned_addr learned my addr 172.21.15.12:0/778615830 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:02.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.276+0000 7fe9d9865640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fe9d406de40 0x7fe9d414e570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:45200/0 (socket says 172.21.15.12:45200) 2024-05-15T15:40:02.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.276+0000 7fe9d9064640 1 --2- 172.21.15.12:0/778615830 >> v2:172.21.15.84:3300/0 conn(0x7fe9d4151fc0 0x7fe9d40bd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:02.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.276+0000 7fe9d8863640 1 -- 172.21.15.12:0/778615830 >> v2:172.21.15.84:3300/0 conn(0x7fe9d4151fc0 msgr2=0x7fe9d40bd6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:40:02.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.277+0000 7fe9d8863640 1 --2- 172.21.15.12:0/778615830 >> v2:172.21.15.84:3300/0 conn(0x7fe9d4151fc0 0x7fe9d40bd6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:02.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.277+0000 7fe9d8863640 1 -- 172.21.15.12:0/778615830 >> v1:172.21.15.12:6789/0 conn(0x7fe9d406de40 legacy=0x7fe9d414e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:02.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.277+0000 7fe9d8863640 1 -- 172.21.15.12:0/778615830 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9d4152810 con 0x7fe9d406da30 2024-05-15T15:40:02.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.277+0000 7fe9d8863640 1 --2- 172.21.15.12:0/778615830 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9d406da30 0x7fe9d40be940 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe9d408d300 tx=0x7fe9c402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86b0b5d15c20d71d server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:02.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.277+0000 7fe9cbfff640 1 -- 172.21.15.12:0/778615830 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9c4037070 con 0x7fe9d406da30 2024-05-15T15:40:02.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.277+0000 7fe9cbfff640 1 -- 172.21.15.12:0/778615830 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9c4032440 con 0x7fe9d406da30 2024-05-15T15:40:02.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.277+0000 7fe9cbfff640 1 -- 172.21.15.12:0/778615830 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9c4032810 con 0x7fe9d406da30 2024-05-15T15:40:02.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.278+0000 7fe9db2c8640 1 -- 172.21.15.12:0/778615830 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9d406da30 msgr2=0x7fe9d40be940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:02.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.278+0000 7fe9db2c8640 1 --2- 172.21.15.12:0/778615830 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9d406da30 0x7fe9d40be940 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe9d408d300 tx=0x7fe9c402a1e0 comp rx=0 tx=0).stop 2024-05-15T15:40:02.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.278+0000 7fe9db2c8640 1 -- 172.21.15.12:0/778615830 shutdown_connections 2024-05-15T15:40:02.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.278+0000 7fe9db2c8640 1 --2- 172.21.15.12:0/778615830 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9d406da30 0x7fe9d40be940 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:02.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.278+0000 7fe9db2c8640 1 --2- 172.21.15.12:0/778615830 >> v2:172.21.15.84:3300/0 conn(0x7fe9d4151fc0 0x7fe9d40bd6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:02.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.278+0000 7fe9db2c8640 1 -- 172.21.15.12:0/778615830 >> 172.21.15.12:0/778615830 conn(0x7fe9d40c3d20 msgr2=0x7fe9d40c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:02.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.278+0000 7fe9db2c8640 1 -- 172.21.15.12:0/778615830 shutdown_connections 2024-05-15T15:40:02.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.278+0000 7fe9db2c8640 1 -- 172.21.15.12:0/778615830 wait complete. 2024-05-15T15:40:02.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.280+0000 7fe9db2c8640 1 Processor -- start 2024-05-15T15:40:02.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.280+0000 7fe9db2c8640 1 -- start start 2024-05-15T15:40:02.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.281+0000 7fe9db2c8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9d406da30 0x7fe9d4148330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:02.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.281+0000 7fe9db2c8640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe9d406de40 0x7fe9d4147370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:02.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.281+0000 7fe9db2c8640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe9d4151fc0 0x7fe9d414e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:02.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.281+0000 7fe9db2c8640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fe9d40a3050 con 0x7fe9d406da30 2024-05-15T15:40:02.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.281+0000 7fe9db2c8640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fe9d40a2ed0 con 0x7fe9d4151fc0 2024-05-15T15:40:02.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.281+0000 7fe9db2c8640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fe9d40bee80 con 0x7fe9d406de40 2024-05-15T15:40:02.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.281+0000 7fe9d9064640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9d406da30 0x7fe9d4148330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:02.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.281+0000 7fe9d9064640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9d406da30 0x7fe9d4148330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59464/0 (socket says 172.21.15.12:59464) 2024-05-15T15:40:02.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.281+0000 7fe9d9064640 1 -- 172.21.15.12:0/3397517932 learned_addr learned my addr 172.21.15.12:0/3397517932 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:02.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.281+0000 7fe9d9865640 1 --2- 172.21.15.12:0/3397517932 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe9d4151fc0 0x7fe9d414e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:02.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.281+0000 7fe9d9064640 1 -- 172.21.15.12:0/3397517932 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe9d406de40 msgr2=0x7fe9d4147370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:02.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.281+0000 7fe9d9064640 1 --2- 172.21.15.12:0/3397517932 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe9d406de40 0x7fe9d4147370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:02.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.281+0000 7fe9d9064640 1 -- 172.21.15.12:0/3397517932 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe9d4151fc0 msgr2=0x7fe9d414e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:02.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.281+0000 7fe9d9064640 1 --2- 172.21.15.12:0/3397517932 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe9d4151fc0 0x7fe9d414e4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:02.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.281+0000 7fe9d9064640 1 -- 172.21.15.12:0/3397517932 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9d41478b0 con 0x7fe9d406da30 2024-05-15T15:40:02.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.281+0000 7fe9d9064640 1 --2- 172.21.15.12:0/3397517932 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9d406da30 0x7fe9d4148330 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe9d000c820 tx=0x7fe9d000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:02.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.281+0000 7fe9c9ffb640 1 -- 172.21.15.12:0/3397517932 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9d0015070 con 0x7fe9d406da30 2024-05-15T15:40:02.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.281+0000 7fe9c9ffb640 1 -- 172.21.15.12:0/3397517932 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9d0004020 con 0x7fe9d406da30 2024-05-15T15:40:02.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.281+0000 7fe9c9ffb640 1 -- 172.21.15.12:0/3397517932 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9d00043f0 con 0x7fe9d406da30 2024-05-15T15:40:02.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.281+0000 7fe9db2c8640 1 -- 172.21.15.12:0/3397517932 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9d41e77d0 con 0x7fe9d406da30 2024-05-15T15:40:02.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.282+0000 7fe9db2c8640 1 -- 172.21.15.12:0/3397517932 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9d41e7d90 con 0x7fe9d406da30 2024-05-15T15:40:02.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.283+0000 7fe9db2c8640 1 -- 172.21.15.12:0/3397517932 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9d4050940 con 0x7fe9d406da30 2024-05-15T15:40:02.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.283+0000 7fe9c9ffb640 1 -- 172.21.15.12:0/3397517932 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe9d0007830 con 0x7fe9d406da30 2024-05-15T15:40:02.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.284+0000 7fe9c9ffb640 1 --2- 172.21.15.12:0/3397517932 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fe9b8076300 0x7fe9b8078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:02.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.284+0000 7fe9c9ffb640 1 -- 172.21.15.12:0/3397517932 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fe9d0097480 con 0x7fe9d406da30 2024-05-15T15:40:02.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.284+0000 7fe9d8863640 1 --2- 172.21.15.12:0/3397517932 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fe9b8076300 0x7fe9b8078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:02.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.284+0000 7fe9d8863640 1 --2- 172.21.15.12:0/3397517932 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fe9b8076300 0x7fe9b8078810 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe9c4034000 tx=0x7fe9c402c000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:02.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.288+0000 7fe9c9ffb640 1 -- 172.21.15.12:0/3397517932 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fe9d0060cb0 con 0x7fe9d406da30 2024-05-15T15:40:02.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.479+0000 7fe9db2c8640 1 -- 172.21.15.12:0/3397517932 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe9d406eb40 con 0x7fe9d406da30 2024-05-15T15:40:02.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.480+0000 7fe9c9ffb640 1 -- 172.21.15.12:0/3397517932 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16573 (secure 0 0 0) 0x7fe9d00605b0 con 0x7fe9d406da30 2024-05-15T15:40:02.482 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-05-15T15:40:02.482 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":23,"fsid":"3b7fc4b2-b85c-49b5-a5de-38444eeed40d","created":"2024-05-15T15:39:28.392476+0000","modified":"2024-05-15T15:39:53.451332+0000","last_up_change":"2024-05-15T15:39:39.363983+0000","last_in_change":"2024-05-15T15:39:30.591216+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-15T15:39:40.715999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-15T15:39:49.598723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-15T15:39:50.783054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0d06a12a-866a-418e-9776-704d74354579","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":3943681952},{"type":"v1","addr":"172.21.15.12:6809","nonce":3943681952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":3943681952},{"type":"v1","addr":"172.21.15.12:6812","nonce":3943681952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":3943681952},{"type":"v1","addr":"172.21.15.12:6821","nonce":3943681952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":3943681952},{"type":"v1","addr":"172.21.15.12:6816","nonce":3943681952}]},"public_addr":"172.21.15.12:6809/3943681952","cluster_addr":"172.21.15.12:6812/3943681952","heartbeat_back_addr":"172.21.15.12:6821/3943681952","heartbeat_front_addr":"172.21.15.12:6816/3943681952","state":["exists","up"]},{"osd":1,"uuid":"09d0fa19-9ef8-4f35-bf99-6e86658c6f10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6811","nonce":1763752148},{"type":"v1","addr":"172.21.15.12:6813","nonce":1763752148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":1763752148},{"type":"v1","addr":"172.21.15.12:6817","nonce":1763752148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":1763752148},{"type":"v1","addr":"172.21.15.12:6827","nonce":1763752148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6819","nonce":1763752148},{"type":"v1","addr":"172.21.15.12:6822","nonce":1763752148}]},"public_addr":"172.21.15.12:6813/1763752148","cluster_addr":"172.21.15.12:6817/1763752148","heartbeat_back_addr":"172.21.15.12:6827/1763752148","heartbeat_front_addr":"172.21.15.12:6822/1763752148","state":["exists","up"]},{"osd":2,"uuid":"b204c6ad-f431-40a5-ba27-9844294f0ece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":2173702802},{"type":"v1","addr":"172.21.15.12:6823","nonce":2173702802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":2173702802},{"type":"v1","addr":"172.21.15.12:6826","nonce":2173702802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":2173702802},{"type":"v1","addr":"172.21.15.12:6831","nonce":2173702802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":2173702802},{"type":"v1","addr":"172.21.15.12:6829","nonce":2173702802}]},"public_addr":"172.21.15.12:6823/2173702802","cluster_addr":"172.21.15.12:6826/2173702802","heartbeat_back_addr":"172.21.15.12:6831/2173702802","heartbeat_front_addr":"172.21.15.12:6829/2173702802","state":["exists","up"]},{"osd":3,"uuid":"660a9ccb-2ee5-42d8-8481-0835047a8260","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":3956443113},{"type":"v1","addr":"172.21.15.12:6801","nonce":3956443113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":3956443113},{"type":"v1","addr":"172.21.15.12:6803","nonce":3956443113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":3956443113},{"type":"v1","addr":"172.21.15.12:6807","nonce":3956443113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":3956443113},{"type":"v1","addr":"172.21.15.12:6805","nonce":3956443113}]},"public_addr":"172.21.15.12:6801/3956443113","cluster_addr":"172.21.15.12:6803/3956443113","heartbeat_back_addr":"172.21.15.12:6807/3956443113","heartbeat_front_addr":"172.21.15.12:6805/3956443113","state":["exists","up"]},{"osd":4,"uuid":"9eef1461-a961-457c-9a78-43b5098a46a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":1021092792},{"type":"v1","addr":"172.21.15.84:6809","nonce":1021092792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":1021092792},{"type":"v1","addr":"172.21.15.84:6811","nonce":1021092792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":1021092792},{"type":"v1","addr":"172.21.15.84:6815","nonce":1021092792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":1021092792},{"type":"v1","addr":"172.21.15.84:6813","nonce":1021092792}]},"public_addr":"172.21.15.84:6809/1021092792","cluster_addr":"172.21.15.84:6811/1021092792","heartbeat_back_addr":"172.21.15.84:6815/1021092792","heartbeat_front_addr":"172.21.15.84:6813/1021092792","state":["exists","up"]},{"osd":5,"uuid":"5f924e2f-6c71-4741-a727-d3710c438431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":3173527851},{"type":"v1","addr":"172.21.15.84:6801","nonce":3173527851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":3173527851},{"type":"v1","addr":"172.21.15.84:6803","nonce":3173527851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":3173527851},{"type":"v1","addr":"172.21.15.84:6807","nonce":3173527851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":3173527851},{"type":"v1","addr":"172.21.15.84:6805","nonce":3173527851}]},"public_addr":"172.21.15.84:6801/3173527851","cluster_addr":"172.21.15.84:6803/3173527851","heartbeat_back_addr":"172.21.15.84:6807/3173527851","heartbeat_front_addr":"172.21.15.84:6805/3173527851","state":["exists","up"]},{"osd":6,"uuid":"efae9975-8c16-4ad3-892f-71f3c59718d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3029180670},{"type":"v1","addr":"172.21.15.84:6817","nonce":3029180670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3029180670},{"type":"v1","addr":"172.21.15.84:6819","nonce":3029180670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3029180670},{"type":"v1","addr":"172.21.15.84:6823","nonce":3029180670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3029180670},{"type":"v1","addr":"172.21.15.84:6821","nonce":3029180670}]},"public_addr":"172.21.15.84:6817/3029180670","cluster_addr":"172.21.15.84:6819/3029180670","heartbeat_back_addr":"172.21.15.84:6823/3029180670","heartbeat_front_addr":"172.21.15.84:6821/3029180670","state":["exists","up"]},{"osd":7,"uuid":"6426efba-ee4d-4e44-83d1-c76c75aec30c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3067620602},{"type":"v1","addr":"172.21.15.84:6825","nonce":3067620602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3067620602},{"type":"v1","addr":"172.21.15.84:6827","nonce":3067620602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":3067620602},{"type":"v1","addr":"172.21.15.84:6831","nonce":3067620602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":3067620602},{"type":"v1","addr":"172.21.15.84:6829","nonce":3067620602}]},"public_addr":"172.21.15.84:6825/3067620602","cluster_addr":"172.21.15.84:6827/3067620602","heartbeat_back_addr":"172.21.15.84:6831/3067620602","heartbeat_front_addr":"172.21.15.84:6829/3067620602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.809514+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.845364+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.762733+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.688597+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.699228+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.747865+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.712415+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.820683+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-15T15:40:02.484 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.482+0000 7fe9db2c8640 1 -- 172.21.15.12:0/3397517932 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fe9b8076300 msgr2=0x7fe9b8078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:02.484 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.482+0000 7fe9db2c8640 1 --2- 172.21.15.12:0/3397517932 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fe9b8076300 0x7fe9b8078810 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe9c4034000 tx=0x7fe9c402c000 comp rx=0 tx=0).stop 2024-05-15T15:40:02.484 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.482+0000 7fe9db2c8640 1 -- 172.21.15.12:0/3397517932 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9d406da30 msgr2=0x7fe9d4148330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:02.484 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.482+0000 7fe9db2c8640 1 --2- 172.21.15.12:0/3397517932 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9d406da30 0x7fe9d4148330 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe9d000c820 tx=0x7fe9d000cce0 comp rx=0 tx=0).stop 2024-05-15T15:40:02.484 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.482+0000 7fe9db2c8640 1 -- 172.21.15.12:0/3397517932 shutdown_connections 2024-05-15T15:40:02.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.482+0000 7fe9db2c8640 1 --2- 172.21.15.12:0/3397517932 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe9d4151fc0 0x7fe9d414e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:02.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.482+0000 7fe9db2c8640 1 --2- 172.21.15.12:0/3397517932 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe9d406de40 0x7fe9d4147370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:02.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.482+0000 7fe9db2c8640 1 --2- 172.21.15.12:0/3397517932 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fe9b8076300 0x7fe9b8078810 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:02.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.482+0000 7fe9db2c8640 1 --2- 172.21.15.12:0/3397517932 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9d406da30 0x7fe9d4148330 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:02.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.482+0000 7fe9db2c8640 1 -- 172.21.15.12:0/3397517932 >> 172.21.15.12:0/3397517932 conn(0x7fe9d40c3d20 msgr2=0x7fe9d40c09d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:02.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.482+0000 7fe9db2c8640 1 -- 172.21.15.12:0/3397517932 shutdown_connections 2024-05-15T15:40:02.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.482+0000 7fe9db2c8640 1 -- 172.21.15.12:0/3397517932 wait complete. 2024-05-15T15:40:02.496 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-05-15T15:40:02.496 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-05-15T15:40:02.497 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-05-15T15:40:02.497 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-05-15T15:40:02.498 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-05-15T15:40:02.498 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-05-15T15:40:02.498 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-05-15T15:40:02.499 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-05-15T15:40:02.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.724+0000 7fb00c63b640 1 Processor -- start 2024-05-15T15:40:02.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.724+0000 7fb00c63b640 1 -- start start 2024-05-15T15:40:02.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.726+0000 7fc403fe3640 1 Processor -- start 2024-05-15T15:40:02.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.726+0000 7fa49d94d640 1 Processor -- start 2024-05-15T15:40:02.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.726+0000 7f7a7bfff640 1 Processor -- start 2024-05-15T15:40:02.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.726+0000 7f7a7bfff640 1 -- start start 2024-05-15T15:40:02.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.726+0000 7f360083d640 1 Processor -- start 2024-05-15T15:40:02.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.726+0000 7f360083d640 1 -- start start 2024-05-15T15:40:02.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.726+0000 7fa49d94d640 1 -- start start 2024-05-15T15:40:02.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.726+0000 7fdf5d2aa640 1 Processor -- start 2024-05-15T15:40:02.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.726+0000 7fb00c63b640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb004153680 0x7fb00406c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:02.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.726+0000 7fb00c63b640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb004073a50 0x7fb004073e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:02.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.726+0000 7fb00c63b640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb0040bb940 0x7fb0040bbd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:02.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.726+0000 7fb00c63b640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fb004153a90 con 0x7fb0040bb940 2024-05-15T15:40:02.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.726+0000 7fb00c63b640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7fb00406d210 con 0x7fb004073a50 2024-05-15T15:40:02.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.726+0000 7fb00c63b640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fb0040bc580 con 0x7fb004153680 2024-05-15T15:40:02.731 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.727+0000 7fdf5d2aa640 1 -- start start 2024-05-15T15:40:02.731 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.727+0000 7f1f2f59e640 1 Processor -- start 2024-05-15T15:40:02.731 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.727+0000 7f5062422640 1 Processor -- start 2024-05-15T15:40:02.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.726+0000 7fc403fe3640 1 -- start start 2024-05-15T15:40:02.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.727+0000 7f5062422640 1 -- start start 2024-05-15T15:40:02.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.727+0000 7f1f2f59e640 1 -- start start 2024-05-15T15:40:02.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.727+0000 7fa49d94d640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa4980be230 0x7fa49806dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:02.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.727+0000 7fa49d94d640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa49814f2e0 0x7fa4980bd920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:02.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.728+0000 7fa49d94d640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4980bea40 con 0x7fa4980bd510 2024-05-15T15:40:02.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.728+0000 7fdf5d2aa640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fdf58151fc0 0x7fdf580bd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:02.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.728+0000 7fdf5d2aa640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fdf5806da30 0x7fdf580be940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:02.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.728+0000 7f7a7bfff640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7a740427b0 0x7f7a740cb950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:02.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.728+0000 7f7a7bfff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f7a74040b80 0x7f7a74006f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:02.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.728+0000 7f7a7bfff640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f7a7403f670 0x7f7a7403fa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:02.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.728+0000 7f7a7bfff640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f7a7403d8d0 con 0x7f7a74040b80 2024-05-15T15:40:02.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.728+0000 7f7a7bfff640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f7a7403e530 con 0x7f7a740427b0 2024-05-15T15:40:02.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.728+0000 7f7a7bfff640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f7a7403ffc0 con 0x7f7a7403f670 2024-05-15T15:40:02.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.728+0000 7fdf5d2aa640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf580c36f0 con 0x7fdf5806de40 2024-05-15T15:40:02.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.728+0000 7f7a7affd640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7a740427b0 0x7f7a740cb950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:02.735 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.728+0000 7fdf5d2aa640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fdf580bdc10 con 0x7fdf5806da30 2024-05-15T15:40:02.735 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.728+0000 7fdf5d2aa640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fdf58152530 con 0x7fdf58151fc0 2024-05-15T15:40:02.735 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.728+0000 7f7a7affd640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7a740427b0 0x7f7a740cb950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.12:35862/0 (socket says 172.21.15.12:35862) 2024-05-15T15:40:02.735 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.728+0000 7f7a7affd640 1 -- 172.21.15.12:0/3196743051 learned_addr learned my addr 172.21.15.12:0/3196743051 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:02.736 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.728+0000 7fdf56ffd640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fdf58151fc0 0x7fdf580bd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:02.736 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.728+0000 7fdf56ffd640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fdf58151fc0 0x7fdf580bd6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3301/0 says I am v2:172.21.15.12:37664/0 (socket says 172.21.15.12:37664) 2024-05-15T15:40:02.736 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.728+0000 7fdf56ffd640 1 -- 172.21.15.12:0/545063470 learned_addr learned my addr 172.21.15.12:0/545063470 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:02.736 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.729+0000 7f7a7b7fe640 1 --2- 172.21.15.12:0/3196743051 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f7a7403f670 0x7f7a7403fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:02.736 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.729+0000 7f360083d640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f35f403a140 0x7f35f40cd810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:02.737 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.729+0000 7f35fb7fe640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f35f4038050 0x7f35f4038cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.12:53708/0 (socket says 172.21.15.12:53708) 2024-05-15T15:40:02.737 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.729+0000 7f5062422640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f505c14cb00 0x7f505c0bcd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:02.737 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.729+0000 7f7a7a7fc640 1 --2- 172.21.15.12:0/3196743051 >> v2:172.21.15.12:3300/0 conn(0x7f7a74040b80 0x7f7a74006f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:02.737 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.729+0000 7f35fb7fe640 1 -- 172.21.15.12:0/3099931364 learned_addr learned my addr 172.21.15.12:0/3099931364 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-05-15T15:40:02.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.728+0000 7fa49d94d640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fa49814c230 con 0x7fa49814f2e0 2024-05-15T15:40:02.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.728+0000 7fa49d94d640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7fa4980becb0 con 0x7fa4980be230 2024-05-15T15:40:02.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.728+0000 7fa4977fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa49814f2e0 0x7fa4980bd920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:02.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.728+0000 7fa4977fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa49814f2e0 0x7fa4980bd920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59476/0 (socket says 172.21.15.12:59476) 2024-05-15T15:40:02.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.728+0000 7fa4977fe640 1 -- 172.21.15.12:0/946392540 learned_addr learned my addr 172.21.15.12:0/946392540 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:02.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.728+0000 7fa496ffd640 1 --2- 172.21.15.12:0/946392540 >> v2:172.21.15.84:3300/0 conn(0x7fa4980be230 0x7fa49806dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:02.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.729+0000 7fa4977fe640 1 -- 172.21.15.12:0/946392540 >> v2:172.21.15.84:3300/0 conn(0x7fa4980be230 msgr2=0x7fa49806dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:40:02.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.729+0000 7fa4977fe640 1 --2- 172.21.15.12:0/946392540 >> v2:172.21.15.84:3300/0 conn(0x7fa4980be230 0x7fa49806dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:02.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.729+0000 7fa4977fe640 1 -- 172.21.15.12:0/946392540 >> v1:172.21.15.12:6789/0 conn(0x7fa4980bd510 legacy=0x7fa49814ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:40:02.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.729+0000 7fa4977fe640 1 -- 172.21.15.12:0/946392540 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa49806e0f0 con 0x7fa49814f2e0 2024-05-15T15:40:02.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.729+0000 7f5062422640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f505c0be850 con 0x7f505c153580 2024-05-15T15:40:02.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.729+0000 7f5062422640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f505c0beb30 con 0x7f505c0c4f00 2024-05-15T15:40:02.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.729+0000 7f5062422640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f505c1529e0 con 0x7f505c14cb00 2024-05-15T15:40:02.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.729+0000 7fdf567fc640 1 --2- 172.21.15.12:0/545063470 >> v2:172.21.15.12:3300/0 conn(0x7fdf5806da30 0x7fdf580be940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:02.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.729+0000 7f35faffd640 1 --2- 172.21.15.12:0/3099931364 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f35f403a140 0x7f35f40cd810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:02.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.727+0000 7fb00a3d7640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb004153680 0x7fb00406c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:02.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.727+0000 7fb009bd6640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb004073a50 0x7fb004073e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:02.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.728+0000 7fb00a3d7640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb004153680 0x7fb00406c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3301/0 says I am v2:172.21.15.12:37640/0 (socket says 172.21.15.12:37640) 2024-05-15T15:40:02.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.728+0000 7fb00a3d7640 1 -- 172.21.15.12:0/2774434250 learned_addr learned my addr 172.21.15.12:0/2774434250 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:02.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.728+0000 7fb00abd8640 1 --2- 172.21.15.12:0/2774434250 >> v2:172.21.15.12:3300/0 conn(0x7fb0040bb940 0x7fb0040bbd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:02.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.729+0000 7fb00a3d7640 1 -- 172.21.15.12:0/2774434250 >> v2:172.21.15.84:3300/0 conn(0x7fb004073a50 msgr2=0x7fb004073e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:40:02.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.729+0000 7fb00a3d7640 1 --2- 172.21.15.12:0/2774434250 >> v2:172.21.15.84:3300/0 conn(0x7fb004073a50 0x7fb004073e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:02.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.729+0000 7fb00a3d7640 1 -- 172.21.15.12:0/2774434250 >> v2:172.21.15.12:3300/0 conn(0x7fb0040bb940 msgr2=0x7fb0040bbd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:40:02.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.729+0000 7fb00a3d7640 1 --2- 172.21.15.12:0/2774434250 >> v2:172.21.15.12:3300/0 conn(0x7fb0040bb940 0x7fb0040bbd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:02.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.729+0000 7fb00a3d7640 1 -- 172.21.15.12:0/2774434250 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb004073250 con 0x7fb004153680 2024-05-15T15:40:02.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.729+0000 7f505b7fe640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f505c0c4f00 0x7f505c152e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.12:53724/0 (socket says 172.21.15.12:53724) 2024-05-15T15:40:02.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.729+0000 7f505b7fe640 1 -- 172.21.15.12:0/3436473538 learned_addr learned my addr 172.21.15.12:0/3436473538 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-05-15T15:40:02.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.729+0000 7f360083d640 1 -- 172.21.15.12:0/3099931364 --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35f403c310 con 0x7f35f400b190 2024-05-15T15:40:02.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.729+0000 7f360083d640 1 -- 172.21.15.12:0/3099931364 --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35f40393c0 con 0x7f35f4038050 2024-05-15T15:40:02.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.729+0000 7fc403fe3640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc3fc1530f0 0x7fc3fc15e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:02.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.729+0000 7fc403fe3640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3fc06de00 con 0x7fc3fc0735d0 2024-05-15T15:40:02.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.729+0000 7fc403fe3640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3fc0bc000 con 0x7fc3fc14caf0 2024-05-15T15:40:02.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.729+0000 7fc403fe3640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7fc3fc14cf00 con 0x7fc3fc1530f0 2024-05-15T15:40:02.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.729+0000 7f360083d640 1 -- 172.21.15.12:0/3099931364 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f35f403be80 con 0x7f35f403a140 2024-05-15T15:40:02.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.730+0000 7f35fa7fc640 1 -- 172.21.15.12:0/3099931364 <== mon.1 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4034228190 0 0) 0x7f35f0001160 con 0x7f35f4038050 2024-05-15T15:40:02.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.730+0000 7f1f2f59e640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1f2803b720 0x7f1f28038f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:02.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.730+0000 7f1f2f59e640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1f280cee10 0x7f1f280c8630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:02.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.730+0000 7f1f2f59e640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f280cf220 con 0x7f1f2803c350 2024-05-15T15:40:02.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.730+0000 7f1f2f59e640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f1f280ce980 con 0x7f1f280cee10 2024-05-15T15:40:02.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.730+0000 7f1f2f59e640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f1f2803d7d0 con 0x7f1f2803b720 2024-05-15T15:40:02.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.729+0000 7f7a7b7fe640 1 -- 172.21.15.12:0/3196743051 >> v2:172.21.15.84:3300/0 conn(0x7f7a740427b0 msgr2=0x7f7a740cb950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:40:02.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.729+0000 7f7a7b7fe640 1 --2- 172.21.15.12:0/3196743051 >> v2:172.21.15.84:3300/0 conn(0x7f7a740427b0 0x7f7a740cb950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:02.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.729+0000 7f7a7b7fe640 1 -- 172.21.15.12:0/3196743051 >> v2:172.21.15.12:3300/0 conn(0x7f7a74040b80 msgr2=0x7f7a74006f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:40:02.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.729+0000 7f7a7b7fe640 1 --2- 172.21.15.12:0/3196743051 >> v2:172.21.15.12:3300/0 conn(0x7f7a74040b80 0x7f7a74006f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:02.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.729+0000 7f7a7b7fe640 1 -- 172.21.15.12:0/3196743051 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a7403df70 con 0x7f7a7403f670 2024-05-15T15:40:02.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.730+0000 7fc401d7f640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fc3fc14caf0 0x7fc3fc06d6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.12:53728/0 (socket says 172.21.15.12:53728) 2024-05-15T15:40:02.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.730+0000 7fc401d7f640 1 -- 172.21.15.12:0/2944410678 learned_addr learned my addr 172.21.15.12:0/2944410678 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-05-15T15:40:02.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.729+0000 7fdf56ffd640 1 -- 172.21.15.12:0/545063470 >> v2:172.21.15.12:3300/0 conn(0x7fdf5806da30 msgr2=0x7fdf580be940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:40:02.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.729+0000 7fdf56ffd640 1 --2- 172.21.15.12:0/545063470 >> v2:172.21.15.12:3300/0 conn(0x7fdf5806da30 0x7fdf580be940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:02.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.729+0000 7fdf56ffd640 1 -- 172.21.15.12:0/545063470 >> v1:172.21.15.84:6789/0 conn(0x7fdf5806de40 legacy=0x7fdf5814e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:40:02.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.730+0000 7f505affd640 1 -- 172.21.15.12:0/3436473538 <== mon.1 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1440273004 0 0) 0x7f505c0beb30 con 0x7f505c0c4f00 2024-05-15T15:40:02.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.730+0000 7f505affd640 1 -- 172.21.15.12:0/3436473538 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5044003520 con 0x7f505c0c4f00 2024-05-15T15:40:02.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.730+0000 7fc402580640 1 --2- 172.21.15.12:0/2944410678 >> v2:172.21.15.84:3300/0 conn(0x7fc3fc1530f0 0x7fc3fc15e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:02.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.729+0000 7fdf56ffd640 1 -- 172.21.15.12:0/545063470 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf58152810 con 0x7fdf58151fc0 2024-05-15T15:40:02.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.730+0000 7f1f2ed9d640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f1f2803c350 0x7f1f2803c760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.12:53734/0 (socket says 172.21.15.12:53734) 2024-05-15T15:40:02.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.730+0000 7f1f2ed9d640 1 -- 172.21.15.12:0/2732469821 learned_addr learned my addr 172.21.15.12:0/2732469821 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-05-15T15:40:02.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.730+0000 7f1f2e59c640 1 --2- 172.21.15.12:0/2732469821 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1f2803b720 0x7f1f28038f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:02.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.730+0000 7f1f2dd9b640 1 --2- 172.21.15.12:0/2732469821 >> v2:172.21.15.12:3300/0 conn(0x7f1f280cee10 0x7f1f280c8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:02.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.730+0000 7f35fa7fc640 1 -- 172.21.15.12:0/3099931364 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f35ec005730 con 0x7f35f4038050 2024-05-15T15:40:02.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.730+0000 7f35faffd640 1 -- 172.21.15.12:0/3099931364 >> v1:172.21.15.84:6789/0 conn(0x7f35f4038050 legacy=0x7f35f4038cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:02.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.730+0000 7f35faffd640 1 -- 172.21.15.12:0/3099931364 >> v1:172.21.15.12:6789/0 conn(0x7f35f400b190 legacy=0x7f35f40d8070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:40:02.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.730+0000 7f35faffd640 1 -- 172.21.15.12:0/3099931364 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35f403b120 con 0x7f35f403a140 2024-05-15T15:40:02.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.730+0000 7fb00a3d7640 1 --2- 172.21.15.12:0/2774434250 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb004153680 0x7fb00406c6e0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fb00406f200 tx=0x7faffc02a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2426acbe3d93d14d server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:02.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.730+0000 7f505bfff640 1 --2- 172.21.15.12:0/3436473538 >> v2:172.21.15.12:3300/0 conn(0x7f505c14cb00 0x7f505c0bcd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:02.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.731+0000 7f7a7b7fe640 1 --2- 172.21.15.12:0/3196743051 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f7a7403f670 0x7f7a7403fa80 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f7a7c000b60 tx=0x7f7a7c0a7290 comp rx=0 tx=0).ready entity=mon.2 client_cookie=63e045642257e999 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:02.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.731+0000 7fc400d7d640 1 -- 172.21.15.12:0/2944410678 <== mon.1 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 16818543 0 0) 0x7fc3fc0bc000 con 0x7fc3fc14caf0 2024-05-15T15:40:02.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.731+0000 7fc400d7d640 1 -- 172.21.15.12:0/2944410678 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc3e8003520 con 0x7fc3fc14caf0 2024-05-15T15:40:02.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.731+0000 7fdf56ffd640 1 --2- 172.21.15.12:0/545063470 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fdf58151fc0 0x7fdf580bd6d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fdf4c009870 tx=0x7fdf4c02a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f229f8977a5b2cd4 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:02.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.731+0000 7fb0093d5640 1 -- 172.21.15.12:0/2774434250 <== mon.2 v2:172.21.15.84:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faffc037070 con 0x7fb004153680 2024-05-15T15:40:02.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.731+0000 7fa4977fe640 1 --2- 172.21.15.12:0/946392540 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa49814f2e0 0x7fa4980bd920 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa49808d400 tx=0x7fa490032ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9826427d8f4370a server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:02.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.731+0000 7f505affd640 1 -- 172.21.15.12:0/3436473538 <== mon.1 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 51718768 0 0) 0x7f5044003520 con 0x7f505c0c4f00 2024-05-15T15:40:02.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.731+0000 7f505affd640 1 -- 172.21.15.12:0/3436473538 >> v2:172.21.15.12:3300/0 conn(0x7f505c14cb00 msgr2=0x7f505c0bcd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:40:02.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.731+0000 7f505affd640 1 --2- 172.21.15.12:0/3436473538 >> v2:172.21.15.12:3300/0 conn(0x7f505c14cb00 0x7f505c0bcd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:02.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.731+0000 7f505affd640 1 -- 172.21.15.12:0/3436473538 >> v1:172.21.15.12:6789/0 conn(0x7f505c153580 legacy=0x7f505c15d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:02.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.731+0000 7f1f2dd9b640 1 -- 172.21.15.12:0/2732469821 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1f2803b720 msgr2=0x7f1f28038f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:40:02.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.731+0000 7f505affd640 1 -- 172.21.15.12:0/3436473538 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f505c0bee10 con 0x7f505c0c4f00 2024-05-15T15:40:02.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.731+0000 7f505affd640 1 -- 172.21.15.12:0/3436473538 <== mon.1 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 38171736 0 0) 0x7f504c0016d0 con 0x7f505c0c4f00 2024-05-15T15:40:02.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.731+0000 7f505affd640 1 -- 172.21.15.12:0/3436473538 >> v1:172.21.15.84:6789/0 conn(0x7f505c0c4f00 legacy=0x7f505c152e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:02.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.731+0000 7f505affd640 1 --2- 172.21.15.12:0/3436473538 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f5044003a00 0x7f5044003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:02.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.731+0000 7f1f2dd9b640 1 --2- 172.21.15.12:0/2732469821 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1f2803b720 0x7f1f28038f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:02.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.731+0000 7f505affd640 1 --2- 172.21.15.12:0/3436473538 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5044004800 0x7f5044004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:02.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.731+0000 7f505affd640 1 --2- 172.21.15.12:0/3436473538 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f50440051a0 0x7f504400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:02.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.731+0000 7f505affd640 1 -- 172.21.15.12:0/3436473538 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f505c1529e0 con 0x7f50440051a0 2024-05-15T15:40:02.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.731+0000 7f505affd640 1 -- 172.21.15.12:0/3436473538 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f504400c140 con 0x7f5044004800 2024-05-15T15:40:02.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.731+0000 7f1f2dd9b640 1 -- 172.21.15.12:0/2732469821 >> v1:172.21.15.84:6789/0 conn(0x7f1f2803c350 legacy=0x7f1f2803c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:02.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.731+0000 7f505affd640 1 -- 172.21.15.12:0/3436473538 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f504400c340 con 0x7f5044003a00 2024-05-15T15:40:02.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.731+0000 7f1f2dd9b640 1 -- 172.21.15.12:0/2732469821 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f280ce610 con 0x7f1f280cee10 2024-05-15T15:40:02.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.731+0000 7f505bfff640 1 --2- 172.21.15.12:0/3436473538 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f5044003a00 0x7f5044003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:02.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.731+0000 7fc400d7d640 1 -- 172.21.15.12:0/2944410678 <== mon.1 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1274319704 0 0) 0x7fc3e8003520 con 0x7fc3fc14caf0 2024-05-15T15:40:02.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.731+0000 7fc400d7d640 1 -- 172.21.15.12:0/2944410678 >> v2:172.21.15.84:3300/0 conn(0x7fc3fc1530f0 msgr2=0x7fc3fc15e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:40:02.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.731+0000 7fc400d7d640 1 --2- 172.21.15.12:0/2944410678 >> v2:172.21.15.84:3300/0 conn(0x7fc3fc1530f0 0x7fc3fc15e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:02.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.731+0000 7fc400d7d640 1 -- 172.21.15.12:0/2944410678 >> v1:172.21.15.12:6789/0 conn(0x7fc3fc0735d0 legacy=0x7fc3fc1529e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:02.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.731+0000 7fc400d7d640 1 -- 172.21.15.12:0/2944410678 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3fc0bc2e0 con 0x7fc3fc14caf0 2024-05-15T15:40:02.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.731+0000 7fdf55ffb640 1 -- 172.21.15.12:0/545063470 <== mon.2 v2:172.21.15.84:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf4c037070 con 0x7fdf58151fc0 2024-05-15T15:40:02.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.731+0000 7fdf55ffb640 1 -- 172.21.15.12:0/545063470 <== mon.2 v2:172.21.15.84:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf4c032440 con 0x7fdf58151fc0 2024-05-15T15:40:02.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.731+0000 7fb0093d5640 1 -- 172.21.15.12:0/2774434250 <== mon.2 v2:172.21.15.84:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faffc032440 con 0x7fb004153680 2024-05-15T15:40:02.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.731+0000 7fc400d7d640 1 -- 172.21.15.12:0/2944410678 <== mon.1 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 38171736 0 0) 0x7fc3f80016d0 con 0x7fc3fc14caf0 2024-05-15T15:40:02.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.731+0000 7fc400d7d640 1 -- 172.21.15.12:0/2944410678 >> v1:172.21.15.84:6789/0 conn(0x7fc3fc14caf0 legacy=0x7fc3fc06d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:02.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.731+0000 7fdf55ffb640 1 -- 172.21.15.12:0/545063470 <== mon.2 v2:172.21.15.84:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf4c032810 con 0x7fdf58151fc0 2024-05-15T15:40:02.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.731+0000 7fb0093d5640 1 -- 172.21.15.12:0/2774434250 <== mon.2 v2:172.21.15.84:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faffc032810 con 0x7fb004153680 2024-05-15T15:40:02.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.731+0000 7fc400d7d640 1 --2- 172.21.15.12:0/2944410678 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc3e8003a40 0x7fc3e8003ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:02.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.731+0000 7fc400d7d640 1 --2- 172.21.15.12:0/2944410678 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc3e8004800 0x7fc3e8004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:02.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.731+0000 7fc400d7d640 1 --2- 172.21.15.12:0/2944410678 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc3e8005270 0x7fc3e800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:02.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.731+0000 7fc400d7d640 1 -- 172.21.15.12:0/2944410678 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fc3fc14cf00 con 0x7fc3e8005270 2024-05-15T15:40:02.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.731+0000 7fc400d7d640 1 -- 172.21.15.12:0/2944410678 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fc3e800c240 con 0x7fc3e8004800 2024-05-15T15:40:02.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.731+0000 7fc400d7d640 1 -- 172.21.15.12:0/2944410678 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fc3e800c440 con 0x7fc3e8003a40 2024-05-15T15:40:02.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.732+0000 7fc40157e640 1 --2- 172.21.15.12:0/2944410678 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc3e8004800 0x7fc3e8004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:02.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.732+0000 7fc402580640 1 --2- 172.21.15.12:0/2944410678 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc3e8005270 0x7fc3e800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:02.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.731+0000 7f7a79ffb640 1 -- 172.21.15.12:0/3196743051 <== mon.2 v2:172.21.15.84:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a7c0b4070 con 0x7f7a7403f670 2024-05-15T15:40:02.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.731+0000 7f7a79ffb640 1 -- 172.21.15.12:0/3196743051 <== mon.2 v2:172.21.15.84:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a7c0af440 con 0x7f7a7403f670 2024-05-15T15:40:02.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.731+0000 7f7a79ffb640 1 -- 172.21.15.12:0/3196743051 <== mon.2 v2:172.21.15.84:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a7c0af830 con 0x7f7a7403f670 2024-05-15T15:40:02.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.731+0000 7f50609bf640 1 --2- 172.21.15.12:0/3436473538 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f50440051a0 0x7f504400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:02.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.731+0000 7f505b7fe640 1 --2- 172.21.15.12:0/3436473538 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5044004800 0x7f5044004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:02.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.732+0000 7f50609bf640 1 -- 172.21.15.12:0/3436473538 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f5044003a00 msgr2=0x7f5044003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:40:02.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.732+0000 7f50609bf640 1 --2- 172.21.15.12:0/3436473538 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f5044003a00 0x7f5044003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:02.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.732+0000 7f50609bf640 1 -- 172.21.15.12:0/3436473538 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5044004800 msgr2=0x7f5044004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:40:02.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.732+0000 7f50609bf640 1 --2- 172.21.15.12:0/3436473538 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5044004800 0x7f5044004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:02.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.732+0000 7f50609bf640 1 -- 172.21.15.12:0/3436473538 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f505c0bee10 con 0x7f50440051a0 2024-05-15T15:40:02.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.732+0000 7f35faffd640 1 --2- 172.21.15.12:0/3099931364 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f35f403a140 0x7f35f40cd810 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f35e80097d0 tx=0x7f35e802a280 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b4bf66ec31018c75 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:02.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.732+0000 7f35fa7fc640 1 -- 172.21.15.12:0/3099931364 <== mon.2 v2:172.21.15.84:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35e8037070 con 0x7f35f403a140 2024-05-15T15:40:02.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.731+0000 7fa495ffb640 1 -- 172.21.15.12:0/946392540 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa490033a10 con 0x7fa49814f2e0 2024-05-15T15:40:02.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.731+0000 7fa495ffb640 1 -- 172.21.15.12:0/946392540 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa490033bb0 con 0x7fa49814f2e0 2024-05-15T15:40:02.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.731+0000 7fa495ffb640 1 -- 172.21.15.12:0/946392540 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa49003b3f0 con 0x7fa49814f2e0 2024-05-15T15:40:02.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.732+0000 7f35fa7fc640 1 -- 172.21.15.12:0/3099931364 <== mon.2 v2:172.21.15.84:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35e8032440 con 0x7f35f403a140 2024-05-15T15:40:02.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.732+0000 7f35fa7fc640 1 -- 172.21.15.12:0/3099931364 <== mon.2 v2:172.21.15.84:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35e8032810 con 0x7f35f403a140 2024-05-15T15:40:02.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.732+0000 7f1f2dd9b640 1 --2- 172.21.15.12:0/2732469821 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1f280cee10 0x7f1f280c8630 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1f200097d0 tx=0x7f1f2002a160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aae795ff68b5d6da server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:02.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.732+0000 7fc401d7f640 1 --2- 172.21.15.12:0/2944410678 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc3e8003a40 0x7fc3e8003ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:02.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.732+0000 7fdf5d2aa640 1 -- 172.21.15.12:0/545063470 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fdf58151fc0 msgr2=0x7fdf580bd6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:02.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.732+0000 7fdf5d2aa640 1 --2- 172.21.15.12:0/545063470 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fdf58151fc0 0x7fdf580bd6d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fdf4c009870 tx=0x7fdf4c02a1c0 comp rx=0 tx=0).stop 2024-05-15T15:40:02.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.733+0000 7fc402580640 1 -- 172.21.15.12:0/2944410678 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc3e8003a40 msgr2=0x7fc3e8003ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:40:02.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.733+0000 7fc402580640 1 --2- 172.21.15.12:0/2944410678 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc3e8003a40 0x7fc3e8003ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:02.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.733+0000 7fc402580640 1 -- 172.21.15.12:0/2944410678 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc3e8004800 msgr2=0x7fc3e8004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:40:02.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.733+0000 7fc402580640 1 --2- 172.21.15.12:0/2944410678 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc3e8004800 0x7fc3e8004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:02.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.733+0000 7fc402580640 1 -- 172.21.15.12:0/2944410678 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3fc0bc2e0 con 0x7fc3e8005270 2024-05-15T15:40:02.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.733+0000 7f1f2d59a640 1 -- 172.21.15.12:0/2732469821 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f20037070 con 0x7f1f280cee10 2024-05-15T15:40:02.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.733+0000 7f1f2d59a640 1 -- 172.21.15.12:0/2732469821 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f20032440 con 0x7f1f280cee10 2024-05-15T15:40:02.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.733+0000 7fdf5d2aa640 1 -- 172.21.15.12:0/545063470 shutdown_connections 2024-05-15T15:40:02.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.733+0000 7fdf5d2aa640 1 --2- 172.21.15.12:0/545063470 >> v2:172.21.15.12:3300/0 conn(0x7fdf5806da30 0x7fdf580be940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:02.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.733+0000 7fdf5d2aa640 1 --2- 172.21.15.12:0/545063470 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fdf58151fc0 0x7fdf580bd6d0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:02.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.733+0000 7fdf5d2aa640 1 -- 172.21.15.12:0/545063470 >> 172.21.15.12:0/545063470 conn(0x7fdf580c3d20 msgr2=0x7fdf580c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:02.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.733+0000 7fdf5d2aa640 1 -- 172.21.15.12:0/545063470 shutdown_connections 2024-05-15T15:40:02.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.733+0000 7fdf5d2aa640 1 -- 172.21.15.12:0/545063470 wait complete. 2024-05-15T15:40:02.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.733+0000 7f7a7bfff640 1 -- 172.21.15.12:0/3196743051 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f7a7403f670 msgr2=0x7f7a7403fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:02.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.733+0000 7f7a7bfff640 1 --2- 172.21.15.12:0/3196743051 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f7a7403f670 0x7f7a7403fa80 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f7a7c000b60 tx=0x7f7a7c0a7290 comp rx=0 tx=0).stop 2024-05-15T15:40:02.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.733+0000 7f7a7bfff640 1 -- 172.21.15.12:0/3196743051 shutdown_connections 2024-05-15T15:40:02.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.733+0000 7f7a7bfff640 1 --2- 172.21.15.12:0/3196743051 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f7a7403f670 0x7f7a7403fa80 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:02.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.733+0000 7f7a7bfff640 1 --2- 172.21.15.12:0/3196743051 >> v2:172.21.15.12:3300/0 conn(0x7f7a74040b80 0x7f7a74006f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:02.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.733+0000 7f7a7bfff640 1 --2- 172.21.15.12:0/3196743051 >> v2:172.21.15.84:3300/0 conn(0x7f7a740427b0 0x7f7a740cb950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:02.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.733+0000 7f7a7bfff640 1 -- 172.21.15.12:0/3196743051 >> 172.21.15.12:0/3196743051 conn(0x7f7a740063f0 msgr2=0x7f7a74006800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:02.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.733+0000 7fb00c63b640 1 -- 172.21.15.12:0/2774434250 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb004153680 msgr2=0x7fb00406c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:02.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.733+0000 7fb00c63b640 1 --2- 172.21.15.12:0/2774434250 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb004153680 0x7fb00406c6e0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fb00406f200 tx=0x7faffc02a210 comp rx=0 tx=0).stop 2024-05-15T15:40:02.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.733+0000 7fb00c63b640 1 -- 172.21.15.12:0/2774434250 shutdown_connections 2024-05-15T15:40:02.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.733+0000 7fb00c63b640 1 --2- 172.21.15.12:0/2774434250 >> v2:172.21.15.12:3300/0 conn(0x7fb0040bb940 0x7fb0040bbd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:02.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.733+0000 7fb00c63b640 1 --2- 172.21.15.12:0/2774434250 >> v2:172.21.15.84:3300/0 conn(0x7fb004073a50 0x7fb004073e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:02.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.733+0000 7fb00c63b640 1 --2- 172.21.15.12:0/2774434250 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb004153680 0x7fb00406c6e0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:02.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.733+0000 7fb00c63b640 1 -- 172.21.15.12:0/2774434250 >> 172.21.15.12:0/2774434250 conn(0x7fb0040bd0f0 msgr2=0x7fb0040bd500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:02.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.733+0000 7f50609bf640 1 -- 172.21.15.12:0/3436473538 reap_dead start 2024-05-15T15:40:02.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.733+0000 7f50609bf640 1 --2- 172.21.15.12:0/3436473538 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f50440051a0 0x7f504400b9c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f50440057e0 tx=0x7f5044005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=435f7524d28ad5c1 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:02.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.733+0000 7fa49d94d640 1 -- 172.21.15.12:0/946392540 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa49814f2e0 msgr2=0x7fa4980bd920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:02.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.733+0000 7fa49d94d640 1 --2- 172.21.15.12:0/946392540 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa49814f2e0 0x7fa4980bd920 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa49808d400 tx=0x7fa490032ed0 comp rx=0 tx=0).stop 2024-05-15T15:40:02.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.733+0000 7fa49d94d640 1 -- 172.21.15.12:0/946392540 shutdown_connections 2024-05-15T15:40:02.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.733+0000 7fa49d94d640 1 --2- 172.21.15.12:0/946392540 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa49814f2e0 0x7fa4980bd920 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:02.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.733+0000 7fa49d94d640 1 --2- 172.21.15.12:0/946392540 >> v2:172.21.15.84:3300/0 conn(0x7fa4980be230 0x7fa49806dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:02.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.733+0000 7fa49d94d640 1 -- 172.21.15.12:0/946392540 >> 172.21.15.12:0/946392540 conn(0x7fa4980c3cd0 msgr2=0x7fa4980c40e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:02.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.733+0000 7fa49d94d640 1 -- 172.21.15.12:0/946392540 shutdown_connections 2024-05-15T15:40:02.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.733+0000 7fa49d94d640 1 -- 172.21.15.12:0/946392540 wait complete. 2024-05-15T15:40:02.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.734+0000 7f505affd640 1 -- 172.21.15.12:0/3436473538 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5054001b10 con 0x7f50440051a0 2024-05-15T15:40:02.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.734+0000 7f505affd640 1 -- 172.21.15.12:0/3436473538 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5054006b50 con 0x7f50440051a0 2024-05-15T15:40:02.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.733+0000 7f360083d640 1 -- 172.21.15.12:0/3099931364 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f35f403a140 msgr2=0x7f35f40cd810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:02.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.733+0000 7f360083d640 1 --2- 172.21.15.12:0/3099931364 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f35f403a140 0x7f35f40cd810 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f35e80097d0 tx=0x7f35e802a280 comp rx=0 tx=0).stop 2024-05-15T15:40:02.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.734+0000 7f505affd640 1 -- 172.21.15.12:0/3436473538 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5054001b10 con 0x7f50440051a0 2024-05-15T15:40:02.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.734+0000 7f7a7bfff640 1 -- 172.21.15.12:0/3196743051 shutdown_connections 2024-05-15T15:40:02.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.734+0000 7f7a7bfff640 1 -- 172.21.15.12:0/3196743051 wait complete. 2024-05-15T15:40:02.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.734+0000 7fb00c63b640 1 -- 172.21.15.12:0/2774434250 shutdown_connections 2024-05-15T15:40:02.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.734+0000 7f1f2d59a640 1 -- 172.21.15.12:0/2732469821 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f20032850 con 0x7f1f280cee10 2024-05-15T15:40:02.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.734+0000 7fc402580640 1 --2- 172.21.15.12:0/2944410678 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc3e8005270 0x7fc3e800b9c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc3f4009fa0 tx=0x7fc3e8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f296a0a333e7557 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:02.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.734+0000 7fc402580640 1 -- 172.21.15.12:0/2944410678 reap_dead start 2024-05-15T15:40:02.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.734+0000 7f1f2f59e640 1 -- 172.21.15.12:0/2732469821 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1f280cee10 msgr2=0x7f1f280c8630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:02.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.734+0000 7f1f2f59e640 1 --2- 172.21.15.12:0/2732469821 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1f280cee10 0x7f1f280c8630 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1f200097d0 tx=0x7f1f2002a160 comp rx=0 tx=0).stop 2024-05-15T15:40:02.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.734+0000 7fc400d7d640 1 -- 172.21.15.12:0/2944410678 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3f4009bf0 con 0x7fc3e8005270 2024-05-15T15:40:02.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.734+0000 7fc400d7d640 1 -- 172.21.15.12:0/2944410678 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3f4030490 con 0x7fc3e8005270 2024-05-15T15:40:02.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.734+0000 7f1f2f59e640 1 -- 172.21.15.12:0/2732469821 shutdown_connections 2024-05-15T15:40:02.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.734+0000 7f1f2f59e640 1 --2- 172.21.15.12:0/2732469821 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1f280cee10 0x7f1f280c8630 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:02.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.734+0000 7f1f2f59e640 1 --2- 172.21.15.12:0/2732469821 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1f2803b720 0x7f1f28038f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:02.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.734+0000 7f1f2f59e640 1 -- 172.21.15.12:0/2732469821 >> 172.21.15.12:0/2732469821 conn(0x7f1f280407a0 msgr2=0x7f1f28040bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:02.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.735+0000 7f1f2f59e640 1 -- 172.21.15.12:0/2732469821 shutdown_connections 2024-05-15T15:40:02.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.735+0000 7fc400d7d640 1 -- 172.21.15.12:0/2944410678 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3f402d070 con 0x7fc3e8005270 2024-05-15T15:40:02.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.735+0000 7f1f2f59e640 1 -- 172.21.15.12:0/2732469821 wait complete. 2024-05-15T15:40:02.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.735+0000 7f5062422640 1 -- 172.21.15.12:0/3436473538 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f50440051a0 msgr2=0x7f504400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:02.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.735+0000 7f5062422640 1 --2- 172.21.15.12:0/3436473538 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f50440051a0 0x7f504400b9c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f50440057e0 tx=0x7f5044005830 comp rx=0 tx=0).stop 2024-05-15T15:40:02.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.735+0000 7f360083d640 1 -- 172.21.15.12:0/3099931364 shutdown_connections 2024-05-15T15:40:02.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.735+0000 7f360083d640 1 --2- 172.21.15.12:0/3099931364 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f35f403a140 0x7f35f40cd810 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:02.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.735+0000 7f360083d640 1 -- 172.21.15.12:0/3099931364 >> 172.21.15.12:0/3099931364 conn(0x7f35f403f680 msgr2=0x7f35f40060e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:02.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.735+0000 7fb00c63b640 1 -- 172.21.15.12:0/2774434250 wait complete. 2024-05-15T15:40:02.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.735+0000 7f5062422640 1 -- 172.21.15.12:0/3436473538 shutdown_connections 2024-05-15T15:40:02.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.735+0000 7f360083d640 1 -- 172.21.15.12:0/3099931364 shutdown_connections 2024-05-15T15:40:02.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.735+0000 7f360083d640 1 -- 172.21.15.12:0/3099931364 wait complete. 2024-05-15T15:40:02.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.735+0000 7f5062422640 1 --2- 172.21.15.12:0/3436473538 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f50440051a0 0x7f504400b9c0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:02.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.735+0000 7fa49d94d640 1 Processor -- start 2024-05-15T15:40:02.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.735+0000 7fc403fe3640 1 -- 172.21.15.12:0/2944410678 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc3e8005270 msgr2=0x7fc3e800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:02.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.735+0000 7fc403fe3640 1 --2- 172.21.15.12:0/2944410678 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc3e8005270 0x7fc3e800b9c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc3f4009fa0 tx=0x7fc3e8005830 comp rx=0 tx=0).stop 2024-05-15T15:40:02.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.736+0000 7f5062422640 1 -- 172.21.15.12:0/3436473538 >> 172.21.15.12:0/3436473538 conn(0x7f505c06cd10 msgr2=0x7f505c0c47f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:02.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.736+0000 7fa49d94d640 1 -- start start 2024-05-15T15:40:02.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.736+0000 7fc403fe3640 1 -- 172.21.15.12:0/2944410678 shutdown_connections 2024-05-15T15:40:02.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.736+0000 7f5062422640 1 -- 172.21.15.12:0/3436473538 shutdown_connections 2024-05-15T15:40:02.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.736+0000 7fdf5d2aa640 1 Processor -- start 2024-05-15T15:40:02.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.736+0000 7f5062422640 1 -- 172.21.15.12:0/3436473538 wait complete. 2024-05-15T15:40:02.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.736+0000 7fdf5d2aa640 1 -- start start 2024-05-15T15:40:02.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.737+0000 7f7a7bfff640 1 Processor -- start 2024-05-15T15:40:02.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.737+0000 7f7a7bfff640 1 -- start start 2024-05-15T15:40:02.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.737+0000 7f1f2f59e640 1 Processor -- start 2024-05-15T15:40:02.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.737+0000 7fa49d94d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4980bd510 0x7fa4980a8d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:02.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.738+0000 7fa49d94d640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa4980be230 0x7fa498150530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:02.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.738+0000 7fb00c63b640 1 Processor -- start 2024-05-15T15:40:02.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.738+0000 7fb00c63b640 1 -- start start 2024-05-15T15:40:02.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.738+0000 7fa496ffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4980bd510 0x7fa4980a8d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:02.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.738+0000 7fa496ffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4980bd510 0x7fa4980a8d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.12:35878/0 (socket says 172.21.15.12:35878) 2024-05-15T15:40:02.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.738+0000 7fa496ffd640 1 -- 172.21.15.12:0/1818236690 learned_addr learned my addr 172.21.15.12:0/1818236690 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:02.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.738+0000 7fa4967fc640 1 --2- 172.21.15.12:0/1818236690 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa4980be230 0x7fa498150530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:02.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.738+0000 7f360083d640 1 Processor -- start 2024-05-15T15:40:02.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.738+0000 7fa49d94d640 1 --2- 172.21.15.12:0/1818236690 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa49814f2e0 0x7fa498150a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:02.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.738+0000 7fdf5d2aa640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdf5806da30 0x7fdf580ba010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:02.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.739+0000 7fdf5d2aa640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fdf5806de40 0x7fdf581e81e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:02.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.739+0000 7f360083d640 1 -- start start 2024-05-15T15:40:02.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.739+0000 7fdf5d2aa640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdf58151fc0 0x7fdf580a1de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:02.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.739+0000 7f5062422640 1 Processor -- start 2024-05-15T15:40:02.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.739+0000 7fa4977fe640 1 --2- 172.21.15.12:0/1818236690 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa49814f2e0 0x7fa498150a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:02.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.739+0000 7f7a7bfff640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f7a7403f670 0x7f7a740c6c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:02.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.739+0000 7f5062422640 1 -- start start 2024-05-15T15:40:02.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.737+0000 7f1f2f59e640 1 -- start start 2024-05-15T15:40:02.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.739+0000 7fdf5d2aa640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fdf580a3050 con 0x7fdf58151fc0 2024-05-15T15:40:02.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.739+0000 7fdf5d2aa640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fdf580a2ed0 con 0x7fdf5806da30 2024-05-15T15:40:02.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.739+0000 7fdf5d2aa640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fdf580bee80 con 0x7fdf5806de40 2024-05-15T15:40:02.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.739+0000 7fdf567fc640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fdf5806de40 0x7fdf581e81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:02.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.739+0000 7fdf577fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdf58151fc0 0x7fdf580a1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:02.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.739+0000 7fdf567fc640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fdf5806de40 0x7fdf581e81e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3301/0 says I am v2:172.21.15.12:37716/0 (socket says 172.21.15.12:37716) 2024-05-15T15:40:02.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.739+0000 7fdf567fc640 1 -- 172.21.15.12:0/2384753760 learned_addr learned my addr 172.21.15.12:0/2384753760 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:02.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.739+0000 7fdf56ffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdf5806da30 0x7fdf580ba010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:02.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.739+0000 7f7a7bfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7a74040b80 0x7f7a740c5e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:02.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.739+0000 7f1f2f59e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f2803b720 0x7f1f280cd720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:02.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.739+0000 7f7a7bfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a740427b0 0x7f7a7415c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:02.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.739+0000 7f1f2f59e640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1f2803c350 0x7f1f280b7b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:02.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.739+0000 7f1f2f59e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1f280cee10 0x7f1f280251a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:02.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.740+0000 7f7a7affd640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f7a7403f670 0x7f7a740c6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:02.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.740+0000 7f7a7affd640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f7a7403f670 0x7f7a740c6c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3301/0 says I am v2:172.21.15.12:37730/0 (socket says 172.21.15.12:37730) 2024-05-15T15:40:02.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.740+0000 7fb00c63b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb004073a50 0x7fb004151a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:02.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.740+0000 7f1f2ed9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1f280cee10 0x7f1f280251a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:02.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.740+0000 7f7a7affd640 1 -- 172.21.15.12:0/6801613 learned_addr learned my addr 172.21.15.12:0/6801613 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:02.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.740+0000 7f7a7a7fc640 1 --2- 172.21.15.12:0/6801613 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7a74040b80 0x7f7a740c5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:02.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.740+0000 7f7a7b7fe640 1 --2- 172.21.15.12:0/6801613 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a740427b0 0x7f7a7415c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:02.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.740+0000 7f7a7bfff640 1 -- 172.21.15.12:0/6801613 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f7a74042e60 con 0x7f7a74040b80 2024-05-15T15:40:02.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.740+0000 7f7a7bfff640 1 -- 172.21.15.12:0/6801613 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f7a7403d3b0 con 0x7f7a740427b0 2024-05-15T15:40:02.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.740+0000 7f7a7bfff640 1 -- 172.21.15.12:0/6801613 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f7a74007450 con 0x7f7a7403f670 2024-05-15T15:40:02.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.740+0000 7fb00c63b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb0040bb940 0x7fb00414a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:02.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.740+0000 7f1f2ed9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1f280cee10 0x7f1f280251a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59562/0 (socket says 172.21.15.12:59562) 2024-05-15T15:40:02.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.740+0000 7fb00c63b640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb004153680 0x7fb004147000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:02.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.740+0000 7fb00a3d7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb004073a50 0x7fb004151a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:02.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.740+0000 7fb00a3d7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb004073a50 0x7fb004151a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59578/0 (socket says 172.21.15.12:59578) 2024-05-15T15:40:02.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.740+0000 7fb00a3d7640 1 -- 172.21.15.12:0/374227676 learned_addr learned my addr 172.21.15.12:0/374227676 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:02.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.740+0000 7fb00c63b640 1 -- 172.21.15.12:0/374227676 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fb0040bc290 con 0x7fb004073a50 2024-05-15T15:40:02.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.740+0000 7f1f2ed9d640 1 -- 172.21.15.12:0/2398575760 learned_addr learned my addr 172.21.15.12:0/2398575760 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:02.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.740+0000 7fdf577fe640 1 -- 172.21.15.12:0/2384753760 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fdf5806de40 msgr2=0x7fdf581e81e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:02.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.740+0000 7fdf577fe640 1 --2- 172.21.15.12:0/2384753760 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fdf5806de40 0x7fdf581e81e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:02.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.740+0000 7f1f2f59e640 1 -- 172.21.15.12:0/2398575760 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f1f2803afb0 con 0x7f1f280cee10 2024-05-15T15:40:02.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.740+0000 7fdf577fe640 1 -- 172.21.15.12:0/2384753760 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdf5806da30 msgr2=0x7fdf580ba010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:02.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.740+0000 7fdf577fe640 1 --2- 172.21.15.12:0/2384753760 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdf5806da30 0x7fdf580ba010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:02.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.740+0000 7fdf577fe640 1 -- 172.21.15.12:0/2384753760 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf580ba550 con 0x7fdf58151fc0 2024-05-15T15:40:02.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.740+0000 7f1f2f59e640 1 -- 172.21.15.12:0/2398575760 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f1f2803bbb0 con 0x7f1f2803b720 2024-05-15T15:40:02.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.740+0000 7f1f2f59e640 1 -- 172.21.15.12:0/2398575760 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f1f2803b130 con 0x7f1f2803c350 2024-05-15T15:40:02.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.740+0000 7fb009bd6640 1 --2- 172.21.15.12:0/374227676 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb0040bb940 0x7fb00414a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:02.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.740+0000 7fb00c63b640 1 -- 172.21.15.12:0/374227676 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fb0040be700 con 0x7fb0040bb940 2024-05-15T15:40:02.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.741+0000 7f1f2dd9b640 1 --2- 172.21.15.12:0/2398575760 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1f2803c350 0x7f1f280b7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:02.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.740+0000 7fdf567fc640 1 --2- 172.21.15.12:0/2384753760 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fdf5806de40 0x7fdf581e81e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-15T15:40:02.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.741+0000 7fdf577fe640 1 --2- 172.21.15.12:0/2384753760 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdf58151fc0 0x7fdf580a1de0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fdf5000bf70 tx=0x7fdf5000c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:02.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.741+0000 7fdf56ffd640 1 --2- 172.21.15.12:0/2384753760 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdf5806da30 0x7fdf580ba010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-15T15:40:02.789 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.740+0000 7f7a7affd640 1 -- 172.21.15.12:0/6801613 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a740427b0 msgr2=0x7f7a7415c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:02.789 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.740+0000 7f7a7affd640 1 --2- 172.21.15.12:0/6801613 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a740427b0 0x7f7a7415c750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:02.789 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.740+0000 7f7a7affd640 1 -- 172.21.15.12:0/6801613 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7a74040b80 msgr2=0x7f7a740c5e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:02.789 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.740+0000 7f7a7affd640 1 --2- 172.21.15.12:0/6801613 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7a74040b80 0x7f7a740c5e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:02.789 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.740+0000 7f7a7affd640 1 -- 172.21.15.12:0/6801613 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a740c7150 con 0x7f7a7403f670 2024-05-15T15:40:02.789 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.741+0000 7fb00c63b640 1 -- 172.21.15.12:0/374227676 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fb00406cc20 con 0x7fb004153680 2024-05-15T15:40:02.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.741+0000 7f360083d640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f35f400b190 0x7f35f4041c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:02.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.736+0000 7fc403fe3640 1 --2- 172.21.15.12:0/2944410678 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc3e8005270 0x7fc3e800b9c0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:02.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.736+0000 7fc403fe3640 1 -- 172.21.15.12:0/2944410678 >> 172.21.15.12:0/2944410678 conn(0x7fc3fc06f390 msgr2=0x7fc3fc06f7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:02.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.736+0000 7fc403fe3640 1 -- 172.21.15.12:0/2944410678 shutdown_connections 2024-05-15T15:40:02.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.736+0000 7fc403fe3640 1 -- 172.21.15.12:0/2944410678 wait complete. 2024-05-15T15:40:02.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.739+0000 7fc403fe3640 1 Processor -- start 2024-05-15T15:40:02.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.739+0000 7fc403fe3640 1 -- start start 2024-05-15T15:40:02.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.741+0000 7fc403fe3640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc3e8005270 0x7fc3fc0b95e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:02.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.741+0000 7fc403fe3640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc3fc13cab0 0x7fc3fc0b8610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:02.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.741+0000 7fc403fe3640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc3fc13fab0 0x7fc3fc13fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:02.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.741+0000 7fc403fe3640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fc3fc072940 con 0x7fc3fc13fab0 2024-05-15T15:40:02.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.741+0000 7fc403fe3640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fc3fc073f80 con 0x7fc3fc13cab0 2024-05-15T15:40:02.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.741+0000 7fc403fe3640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fc3fc072ac0 con 0x7fc3e8005270 2024-05-15T15:40:02.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.741+0000 7fc402580640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc3fc13fab0 0x7fc3fc13fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:02.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.741+0000 7f360083d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f35f4038050 0x7f35f4167720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:02.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.739+0000 7fa49d94d640 1 -- 172.21.15.12:0/1818236690 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa4980be640 con 0x7fa49814f2e0 2024-05-15T15:40:02.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.739+0000 7fa49d94d640 1 -- 172.21.15.12:0/1818236690 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa49806ea70 con 0x7fa4980bd510 2024-05-15T15:40:02.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.739+0000 7fa49d94d640 1 -- 172.21.15.12:0/1818236690 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fa49808d850 con 0x7fa4980be230 2024-05-15T15:40:02.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.741+0000 7fc402580640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc3fc13fab0 0x7fc3fc13fec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59588/0 (socket says 172.21.15.12:59588) 2024-05-15T15:40:02.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.741+0000 7fc402580640 1 -- 172.21.15.12:0/1483065961 learned_addr learned my addr 172.21.15.12:0/1483065961 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:02.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.741+0000 7f7a7affd640 1 --2- 172.21.15.12:0/6801613 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f7a7403f670 0x7f7a740c6c10 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7a6c00e870 tx=0x7f7a6c00ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:02.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.741+0000 7fb00abd8640 1 --2- 172.21.15.12:0/374227676 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb004153680 0x7fb004147000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:02.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.741+0000 7f35fb7fe640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f35f400b190 0x7f35f4041c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:02.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.741+0000 7f35faffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f35f4038050 0x7f35f4167720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:02.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.741+0000 7f35fb7fe640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f35f400b190 0x7f35f4041c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3301/0 says I am v2:172.21.15.12:37756/0 (socket says 172.21.15.12:37756) 2024-05-15T15:40:02.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.741+0000 7f35faffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f35f4038050 0x7f35f4167720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59592/0 (socket says 172.21.15.12:59592) 2024-05-15T15:40:02.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.741+0000 7fa4977fe640 1 -- 172.21.15.12:0/1818236690 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa4980be230 msgr2=0x7fa498150530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:02.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.741+0000 7fa4977fe640 1 --2- 172.21.15.12:0/1818236690 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa4980be230 0x7fa498150530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:02.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.741+0000 7fa4977fe640 1 -- 172.21.15.12:0/1818236690 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4980bd510 msgr2=0x7fa4980a8d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:02.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.741+0000 7fa4977fe640 1 --2- 172.21.15.12:0/1818236690 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4980bd510 0x7fa4980a8d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:02.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.741+0000 7fa4977fe640 1 -- 172.21.15.12:0/1818236690 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa498151bc0 con 0x7fa49814f2e0 2024-05-15T15:40:02.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.741+0000 7f360083d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f35f403a140 0x7f35f4163f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:02.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.741+0000 7f5062422640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f50440051a0 0x7f505c0bf230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:02.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.741+0000 7f5062422640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f505c1e8a50 0x7f505c14afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:02.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.741+0000 7f360083d640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f35f4038460 con 0x7f35f4038050 2024-05-15T15:40:02.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.741+0000 7f5062422640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f505c14b500 0x7f505c1ebd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:02.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.741+0000 7f360083d640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f35f403bb10 con 0x7f35f403a140 2024-05-15T15:40:02.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.741+0000 7f360083d640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f35f403a550 con 0x7f35f400b190 2024-05-15T15:40:02.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.741+0000 7f5062422640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f505c0a98e0 con 0x7f505c1e8a50 2024-05-15T15:40:02.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.742+0000 7f5062422640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f505c0a9760 con 0x7f505c14b500 2024-05-15T15:40:02.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.742+0000 7f5062422640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f505c14cf10 con 0x7f50440051a0 2024-05-15T15:40:02.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.741+0000 7fa4977fe640 1 --2- 172.21.15.12:0/1818236690 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa49814f2e0 0x7fa498150a70 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa490039000 tx=0x7fa490004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:02.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.742+0000 7fc401d7f640 1 --2- 172.21.15.12:0/1483065961 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc3e8005270 0x7fc3fc0b95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:02.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.741+0000 7fb00a3d7640 1 -- 172.21.15.12:0/374227676 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb004153680 msgr2=0x7fb004147000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:02.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.741+0000 7fb00a3d7640 1 --2- 172.21.15.12:0/374227676 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb004153680 0x7fb004147000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:02.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.741+0000 7fb00a3d7640 1 -- 172.21.15.12:0/374227676 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb0040bb940 msgr2=0x7fb00414a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:02.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.741+0000 7fb00a3d7640 1 --2- 172.21.15.12:0/374227676 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb0040bb940 0x7fb00414a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:02.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.741+0000 7fb00a3d7640 1 -- 172.21.15.12:0/374227676 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb004151f70 con 0x7fb004073a50 2024-05-15T15:40:02.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.742+0000 7fb00a3d7640 1 --2- 172.21.15.12:0/374227676 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb004073a50 0x7fb004151a30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7faffc0097f0 tx=0x7faffc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:02.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.742+0000 7f50609bf640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f505c14b500 0x7f505c1ebd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:02.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.742+0000 7f7a637fe640 1 -- 172.21.15.12:0/6801613 <== mon.2 v2:172.21.15.84:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a6c017070 con 0x7f7a7403f670 2024-05-15T15:40:02.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.742+0000 7f505bfff640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f50440051a0 0x7f505c0bf230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:02.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.742+0000 7f505bfff640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f50440051a0 0x7f505c0bf230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3301/0 says I am v2:172.21.15.12:37758/0 (socket says 172.21.15.12:37758) 2024-05-15T15:40:02.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.742+0000 7f505bfff640 1 -- 172.21.15.12:0/1253136635 learned_addr learned my addr 172.21.15.12:0/1253136635 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:02.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.742+0000 7fc402580640 1 -- 172.21.15.12:0/1483065961 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc3e8005270 msgr2=0x7fc3fc0b95e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:02.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.742+0000 7fc402580640 1 --2- 172.21.15.12:0/1483065961 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc3e8005270 0x7fc3fc0b95e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:02.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.742+0000 7fc402580640 1 -- 172.21.15.12:0/1483065961 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc3fc13cab0 msgr2=0x7fc3fc0b8610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:02.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.742+0000 7fc402580640 1 --2- 172.21.15.12:0/1483065961 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc3fc13cab0 0x7fc3fc0b8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:02.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.742+0000 7fc402580640 1 -- 172.21.15.12:0/1483065961 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3fc13c5d0 con 0x7fc3fc13fab0 2024-05-15T15:40:02.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.742+0000 7fc401d7f640 1 --2- 172.21.15.12:0/1483065961 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc3e8005270 0x7fc3fc0b95e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-15T15:40:02.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.742+0000 7f7a7bfff640 1 -- 172.21.15.12:0/6801613 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a740c8b40 con 0x7f7a7403f670 2024-05-15T15:40:02.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.742+0000 7f7a7bfff640 1 -- 172.21.15.12:0/6801613 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a74167d70 con 0x7f7a7403f670 2024-05-15T15:40:02.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.741+0000 7fdf3f7fe640 1 -- 172.21.15.12:0/2384753760 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf50019070 con 0x7fdf58151fc0 2024-05-15T15:40:02.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.741+0000 7fdf3f7fe640 1 -- 172.21.15.12:0/2384753760 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf50014440 con 0x7fdf58151fc0 2024-05-15T15:40:02.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.741+0000 7fdf3f7fe640 1 -- 172.21.15.12:0/2384753760 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf50014830 con 0x7fdf58151fc0 2024-05-15T15:40:02.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.741+0000 7fdf5d2aa640 1 -- 172.21.15.12:0/2384753760 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf581e8720 con 0x7fdf58151fc0 2024-05-15T15:40:02.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.741+0000 7fdf5d2aa640 1 -- 172.21.15.12:0/2384753760 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf5814f210 con 0x7fdf58151fc0 2024-05-15T15:40:02.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.742+0000 7fc402580640 1 --2- 172.21.15.12:0/1483065961 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc3fc13fab0 0x7fc3fc13fec0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc3f402af30 tx=0x7fc3f4009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:02.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.742+0000 7f7a637fe640 1 -- 172.21.15.12:0/6801613 <== mon.2 v2:172.21.15.84:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a6c00c8e0 con 0x7f7a7403f670 2024-05-15T15:40:02.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.742+0000 7f505bfff640 1 -- 172.21.15.12:0/1253136635 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f505c14b500 msgr2=0x7f505c1ebd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:02.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.742+0000 7f505bfff640 1 --2- 172.21.15.12:0/1253136635 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f505c14b500 0x7f505c1ebd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:02.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.742+0000 7f7a637fe640 1 -- 172.21.15.12:0/6801613 <== mon.2 v2:172.21.15.84:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a6c00cc90 con 0x7f7a7403f670 2024-05-15T15:40:02.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.742+0000 7f505bfff640 1 -- 172.21.15.12:0/1253136635 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f505c1e8a50 msgr2=0x7f505c14afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:02.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.742+0000 7f505bfff640 1 --2- 172.21.15.12:0/1253136635 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f505c1e8a50 0x7f505c14afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:02.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.742+0000 7f1f2e59c640 1 --2- 172.21.15.12:0/2398575760 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f2803b720 0x7f1f280cd720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:02.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.742+0000 7f505bfff640 1 -- 172.21.15.12:0/1253136635 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f505c0bf770 con 0x7f50440051a0 2024-05-15T15:40:02.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.742+0000 7f35fbfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f35f403a140 0x7f35f4163f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:02.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.742+0000 7f35fbfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f35f403a140 0x7f35f4163f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.12:35934/0 (socket says 172.21.15.12:35934) 2024-05-15T15:40:02.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.742+0000 7f35fbfff640 1 -- 172.21.15.12:0/3744414757 learned_addr learned my addr 172.21.15.12:0/3744414757 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:02.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.742+0000 7f35fbfff640 1 -- 172.21.15.12:0/3744414757 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f35f400b190 msgr2=0x7f35f4041c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:02.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.742+0000 7f35fbfff640 1 --2- 172.21.15.12:0/3744414757 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f35f400b190 0x7f35f4041c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:02.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.742+0000 7f35fbfff640 1 -- 172.21.15.12:0/3744414757 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f35f4038050 msgr2=0x7f35f4167720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:02.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.742+0000 7f35fbfff640 1 --2- 172.21.15.12:0/3744414757 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f35f4038050 0x7f35f4167720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:02.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.742+0000 7f35fbfff640 1 -- 172.21.15.12:0/3744414757 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35f4042160 con 0x7f35f403a140 2024-05-15T15:40:02.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.743+0000 7fdf5d2aa640 1 -- 172.21.15.12:0/2384753760 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fdf58050940 con 0x7fdf58151fc0 2024-05-15T15:40:02.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.743+0000 7f35fbfff640 1 --2- 172.21.15.12:0/3744414757 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f35f403a140 0x7f35f4163f60 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f35fc0770f0 tx=0x7f35fc06ec40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:02.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.743+0000 7fb002ffd640 1 -- 172.21.15.12:0/374227676 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faffc041020 con 0x7fb004073a50 2024-05-15T15:40:02.805 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.743+0000 7fb00c63b640 1 -- 172.21.15.12:0/374227676 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb00414aae0 con 0x7fb004073a50 2024-05-15T15:40:02.805 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.743+0000 7fb00c63b640 1 -- 172.21.15.12:0/374227676 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb004071030 con 0x7fb004073a50 2024-05-15T15:40:02.805 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.743+0000 7f35e7fff640 1 -- 172.21.15.12:0/3744414757 <== mon.1 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35fc076820 con 0x7f35f403a140 2024-05-15T15:40:02.805 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.743+0000 7f35e7fff640 1 -- 172.21.15.12:0/3744414757 <== mon.1 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35fc090070 con 0x7f35f403a140 2024-05-15T15:40:02.805 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.743+0000 7fc3f27fc640 1 -- 172.21.15.12:0/1483065961 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3f402d070 con 0x7fc3fc13fab0 2024-05-15T15:40:02.805 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.743+0000 7fc3f27fc640 1 -- 172.21.15.12:0/1483065961 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3f4041070 con 0x7fc3fc13fab0 2024-05-15T15:40:02.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.743+0000 7fc3f27fc640 1 -- 172.21.15.12:0/1483065961 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3f4009bf0 con 0x7fc3fc13fab0 2024-05-15T15:40:02.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.743+0000 7f1f2ed9d640 1 -- 172.21.15.12:0/2398575760 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1f2803c350 msgr2=0x7f1f280b7b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:02.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.743+0000 7f1f2ed9d640 1 --2- 172.21.15.12:0/2398575760 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1f2803c350 0x7f1f280b7b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:02.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.743+0000 7f1f2ed9d640 1 -- 172.21.15.12:0/2398575760 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f2803b720 msgr2=0x7f1f280cd720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:02.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.743+0000 7f1f2ed9d640 1 --2- 172.21.15.12:0/2398575760 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f2803b720 0x7f1f280cd720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:02.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.743+0000 7f1f2ed9d640 1 -- 172.21.15.12:0/2398575760 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f280b8080 con 0x7f1f280cee10 2024-05-15T15:40:02.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.743+0000 7fc403fe3640 1 -- 172.21.15.12:0/1483065961 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3fc0b8b50 con 0x7fc3fc13fab0 2024-05-15T15:40:02.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.743+0000 7fc403fe3640 1 -- 172.21.15.12:0/1483065961 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3fc0b79c0 con 0x7fc3fc13fab0 2024-05-15T15:40:02.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.743+0000 7f35e7fff640 1 -- 172.21.15.12:0/3744414757 <== mon.1 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35fc0956b0 con 0x7f35f403a140 2024-05-15T15:40:02.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.744+0000 7f1f2ed9d640 1 --2- 172.21.15.12:0/2398575760 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1f280cee10 0x7f1f280251a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1f2400c3c0 tx=0x7f1f2400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:02.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.744+0000 7f360083d640 1 -- 172.21.15.12:0/3744414757 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35f4167c60 con 0x7f35f403a140 2024-05-15T15:40:02.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.743+0000 7fa47ffff640 1 -- 172.21.15.12:0/1818236690 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa49004a020 con 0x7fa49814f2e0 2024-05-15T15:40:02.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.744+0000 7f360083d640 1 -- 172.21.15.12:0/3744414757 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35f40caf40 con 0x7f35f403a140 2024-05-15T15:40:02.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.743+0000 7fa47ffff640 1 -- 172.21.15.12:0/1818236690 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa490045450 con 0x7fa49814f2e0 2024-05-15T15:40:02.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.743+0000 7fa47ffff640 1 -- 172.21.15.12:0/1818236690 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa490045820 con 0x7fa49814f2e0 2024-05-15T15:40:02.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.743+0000 7fa49d94d640 1 -- 172.21.15.12:0/1818236690 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa498151e30 con 0x7fa49814f2e0 2024-05-15T15:40:02.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.743+0000 7f7a7bfff640 1 -- 172.21.15.12:0/6801613 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7a5c001030 con 0x7f7a7403f670 2024-05-15T15:40:02.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.743+0000 7fa49d94d640 1 -- 172.21.15.12:0/1818236690 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4981e0ed0 con 0x7fa49814f2e0 2024-05-15T15:40:02.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.744+0000 7fb002ffd640 1 -- 172.21.15.12:0/374227676 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faffc03d6e0 con 0x7fb004073a50 2024-05-15T15:40:02.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.744+0000 7fa47dffb640 1 -- 172.21.15.12:0/1818236690 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa4981e12b0 con 0x7fa49814f2e0 2024-05-15T15:40:02.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.744+0000 7f505bfff640 1 --2- 172.21.15.12:0/1253136635 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f50440051a0 0x7f505c0bf230 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f5050011570 tx=0x7f5050011a30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:02.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.745+0000 7f1f1effd640 1 -- 172.21.15.12:0/2398575760 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f24017070 con 0x7f1f280cee10 2024-05-15T15:40:02.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.745+0000 7f5058ff9640 1 -- 172.21.15.12:0/1253136635 <== mon.2 v2:172.21.15.84:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5050015930 con 0x7f50440051a0 2024-05-15T15:40:02.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.745+0000 7fc403fe3640 1 -- 172.21.15.12:0/1483065961 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc3fc069b50 con 0x7fc3fc13fab0 2024-05-15T15:40:02.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.745+0000 7f1f2f59e640 1 -- 172.21.15.12:0/2398575760 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f280256e0 con 0x7f1f280cee10 2024-05-15T15:40:02.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.745+0000 7f1f2f59e640 1 -- 172.21.15.12:0/2398575760 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f280ccb20 con 0x7f1f280cee10 2024-05-15T15:40:02.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.745+0000 7f1f1effd640 1 -- 172.21.15.12:0/2398575760 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f24005ce0 con 0x7f1f280cee10 2024-05-15T15:40:02.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.744+0000 7fb00c63b640 1 -- 172.21.15.12:0/374227676 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb00414cbb0 con 0x7fb004073a50 2024-05-15T15:40:02.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.745+0000 7f5062422640 1 -- 172.21.15.12:0/1253136635 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f505c0c8420 con 0x7f50440051a0 2024-05-15T15:40:02.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.745+0000 7f5062422640 1 -- 172.21.15.12:0/1253136635 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f505c0c0700 con 0x7f50440051a0 2024-05-15T15:40:02.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.745+0000 7f5058ff9640 1 -- 172.21.15.12:0/1253136635 <== mon.2 v2:172.21.15.84:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5050015ad0 con 0x7f50440051a0 2024-05-15T15:40:02.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.745+0000 7f5058ff9640 1 -- 172.21.15.12:0/1253136635 <== mon.2 v2:172.21.15.84:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f505000f460 con 0x7f50440051a0 2024-05-15T15:40:02.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.746+0000 7f1f1effd640 1 -- 172.21.15.12:0/2398575760 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f240072d0 con 0x7f1f280cee10 2024-05-15T15:40:02.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.746+0000 7f35e7fff640 1 -- 172.21.15.12:0/3744414757 <== mon.1 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f35fc095850 con 0x7f35f403a140 2024-05-15T15:40:02.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.746+0000 7fa47ffff640 1 -- 172.21.15.12:0/1818236690 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa49004d020 con 0x7fa49814f2e0 2024-05-15T15:40:02.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.747+0000 7fa47ffff640 1 --2- 172.21.15.12:0/1818236690 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fa4840763a0 0x7fa4840788b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:02.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.747+0000 7f5062422640 1 -- 172.21.15.12:0/1253136635 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f503c001030 con 0x7f50440051a0 2024-05-15T15:40:02.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.747+0000 7fa47ffff640 1 -- 172.21.15.12:0/1818236690 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fa4900c13a0 con 0x7fa49814f2e0 2024-05-15T15:40:02.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.747+0000 7f35e7fff640 1 --2- 172.21.15.12:0/3744414757 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f35e00762d0 0x7f35e00787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:02.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.748+0000 7f360083d640 1 -- 172.21.15.12:0/3744414757 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f35dc001030 con 0x7f35f403a140 2024-05-15T15:40:02.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.747+0000 7fa496ffd640 1 --2- 172.21.15.12:0/1818236690 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fa4840763a0 0x7fa4840788b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:02.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.747+0000 7fa47ffff640 1 --2- 172.21.15.12:0/1818236690 >> [v2:172.21.15.84:6824/3067620602,v1:172.21.15.84:6825/3067620602] conn(0x7fa48407e670 0x7fa484080ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:02.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.747+0000 7fa47ffff640 1 -- 172.21.15.12:0/1818236690 --> [v2:172.21.15.84:6824/3067620602,v1:172.21.15.84:6825/3067620602] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa4900020b0 con 0x7fa48407e670 2024-05-15T15:40:02.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.747+0000 7fa47ffff640 1 -- 172.21.15.12:0/1818236690 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fa4900c1790 con 0x7fa49814f2e0 2024-05-15T15:40:02.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.748+0000 7f35e7fff640 1 -- 172.21.15.12:0/3744414757 <== mon.1 v2:172.21.15.84:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f35fc113ae0 con 0x7f35f403a140 2024-05-15T15:40:02.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.748+0000 7f35fb7fe640 1 --2- 172.21.15.12:0/3744414757 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f35e00762d0 0x7f35e00787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:02.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.748+0000 7f35e7fff640 1 --2- 172.21.15.12:0/3744414757 >> [v2:172.21.15.84:6816/3029180670,v1:172.21.15.84:6817/3029180670] conn(0x7f35e007e520 0x7f35e0080970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:02.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.748+0000 7f35e7fff640 1 -- 172.21.15.12:0/3744414757 --> [v2:172.21.15.84:6816/3029180670,v1:172.21.15.84:6817/3029180670] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f35fc099e50 con 0x7f35e007e520 2024-05-15T15:40:02.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.748+0000 7f35e7fff640 1 -- 172.21.15.12:0/3744414757 <== mon.1 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f35fc0d93c0 con 0x7f35f403a140 2024-05-15T15:40:02.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.748+0000 7f1f2f59e640 1 -- 172.21.15.12:0/2398575760 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1f14001030 con 0x7f1f280cee10 2024-05-15T15:40:02.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.748+0000 7fc3f27fc640 1 -- 172.21.15.12:0/1483065961 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc3f4005d10 con 0x7fc3fc13fab0 2024-05-15T15:40:02.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.748+0000 7f35faffd640 1 --2- 172.21.15.12:0/3744414757 >> [v2:172.21.15.84:6816/3029180670,v1:172.21.15.84:6817/3029180670] conn(0x7f35e007e520 0x7f35e0080970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:02.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.748+0000 7fa4967fc640 1 --2- 172.21.15.12:0/1818236690 >> [v2:172.21.15.84:6824/3067620602,v1:172.21.15.84:6825/3067620602] conn(0x7fa48407e670 0x7fa484080ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:02.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.748+0000 7fc3f27fc640 1 --2- 172.21.15.12:0/1483065961 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fc3e0076320 0x7fc3e0078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:02.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.749+0000 7f35fb7fe640 1 --2- 172.21.15.12:0/3744414757 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f35e00762d0 0x7f35e00787e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f35f000d320 tx=0x7f35f000d2b0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:02.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.749+0000 7fa496ffd640 1 --2- 172.21.15.12:0/1818236690 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fa4840763a0 0x7fa4840788b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa48c007a60 tx=0x7fa48c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:02.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.749+0000 7fc3f27fc640 1 -- 172.21.15.12:0/1483065961 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fc3f40b8720 con 0x7fc3fc13fab0 2024-05-15T15:40:02.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.749+0000 7fc401d7f640 1 --2- 172.21.15.12:0/1483065961 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fc3e0076320 0x7fc3e0078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:02.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.749+0000 7fc3f27fc640 1 --2- 172.21.15.12:0/1483065961 >> [v2:172.21.15.12:6808/3943681952,v1:172.21.15.12:6809/3943681952] conn(0x7fc3e007e5f0 0x7fc3e0080a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:02.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.749+0000 7fc3f27fc640 1 -- 172.21.15.12:0/1483065961 --> [v2:172.21.15.12:6808/3943681952,v1:172.21.15.12:6809/3943681952] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc3f4033e80 con 0x7fc3e007e5f0 2024-05-15T15:40:02.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.749+0000 7fc3f27fc640 1 -- 172.21.15.12:0/1483065961 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fc3f40b8ad0 con 0x7fc3fc13fab0 2024-05-15T15:40:02.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.748+0000 7fdf3f7fe640 1 -- 172.21.15.12:0/2384753760 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fdf5001c070 con 0x7fdf58151fc0 2024-05-15T15:40:02.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.749+0000 7fb002ffd640 1 -- 172.21.15.12:0/374227676 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faffc037040 con 0x7fb004073a50 2024-05-15T15:40:02.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.749+0000 7fb002ffd640 1 -- 172.21.15.12:0/374227676 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7faffc044020 con 0x7fb004073a50 2024-05-15T15:40:02.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.749+0000 7fdf3f7fe640 1 --2- 172.21.15.12:0/2384753760 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fdf440763a0 0x7fdf440788b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:02.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.749+0000 7f35faffd640 1 --2- 172.21.15.12:0/3744414757 >> [v2:172.21.15.84:6816/3029180670,v1:172.21.15.84:6817/3029180670] conn(0x7f35e007e520 0x7f35e0080970 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:02.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.749+0000 7f5058ff9640 1 -- 172.21.15.12:0/1253136635 <== mon.2 v2:172.21.15.84:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f505000f600 con 0x7f50440051a0 2024-05-15T15:40:02.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.749+0000 7f7a637fe640 1 -- 172.21.15.12:0/6801613 <== mon.2 v2:172.21.15.84:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7a6c01a070 con 0x7f7a7403f670 2024-05-15T15:40:02.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.749+0000 7fdf3f7fe640 1 -- 172.21.15.12:0/2384753760 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fdf50097560 con 0x7fdf58151fc0 2024-05-15T15:40:02.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.749+0000 7f1f1effd640 1 -- 172.21.15.12:0/2398575760 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1f2401a070 con 0x7f1f280cee10 2024-05-15T15:40:02.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.749+0000 7fa4967fc640 1 --2- 172.21.15.12:0/1818236690 >> [v2:172.21.15.84:6824/3067620602,v1:172.21.15.84:6825/3067620602] conn(0x7fa48407e670 0x7fa484080ac0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:02.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.749+0000 7fdf3f7fe640 1 --2- 172.21.15.12:0/2384753760 >> [v2:172.21.15.12:6820/2173702802,v1:172.21.15.12:6823/2173702802] conn(0x7fdf4407e670 0x7fdf44080ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:02.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.749+0000 7fdf3f7fe640 1 -- 172.21.15.12:0/2384753760 --> [v2:172.21.15.12:6820/2173702802,v1:172.21.15.12:6823/2173702802] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdf50018ec0 con 0x7fdf4407e670 2024-05-15T15:40:02.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.749+0000 7fdf3f7fe640 1 -- 172.21.15.12:0/2384753760 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fdf5009e050 con 0x7fdf58151fc0 2024-05-15T15:40:02.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.750+0000 7fdf56ffd640 1 --2- 172.21.15.12:0/2384753760 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fdf440763a0 0x7fdf440788b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:02.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.750+0000 7fdf567fc640 1 --2- 172.21.15.12:0/2384753760 >> [v2:172.21.15.12:6820/2173702802,v1:172.21.15.12:6823/2173702802] conn(0x7fdf4407e670 0x7fdf44080ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:02.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.749+0000 7fc40157e640 1 --2- 172.21.15.12:0/1483065961 >> [v2:172.21.15.12:6808/3943681952,v1:172.21.15.12:6809/3943681952] conn(0x7fc3e007e5f0 0x7fc3e0080a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:02.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.750+0000 7fc401d7f640 1 --2- 172.21.15.12:0/1483065961 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fc3e0076320 0x7fc3e0078830 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc3f8001220 tx=0x7fc3f8001150 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:02.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.750+0000 7f7a637fe640 1 --2- 172.21.15.12:0/6801613 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f7a68076350 0x7f7a68078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:02.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.750+0000 7fb002ffd640 1 --2- 172.21.15.12:0/374227676 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7faff0076400 0x7faff0078910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:02.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.750+0000 7f7a637fe640 1 -- 172.21.15.12:0/6801613 <== mon.2 v2:172.21.15.84:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f7a6c097a70 con 0x7f7a7403f670 2024-05-15T15:40:02.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.750+0000 7fc40157e640 1 --2- 172.21.15.12:0/1483065961 >> [v2:172.21.15.12:6808/3943681952,v1:172.21.15.12:6809/3943681952] conn(0x7fc3e007e5f0 0x7fc3e0080a40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:02.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.750+0000 7f7a7a7fc640 1 --2- 172.21.15.12:0/6801613 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f7a68076350 0x7f7a68078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:02.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.750+0000 7f7a637fe640 1 --2- 172.21.15.12:0/6801613 >> [v2:172.21.15.12:6800/3956443113,v1:172.21.15.12:6801/3956443113] conn(0x7f7a6807e620 0x7f7a68080a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:02.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.750+0000 7f7a637fe640 1 -- 172.21.15.12:0/6801613 --> [v2:172.21.15.12:6800/3956443113,v1:172.21.15.12:6801/3956443113] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7a6c017e70 con 0x7f7a6807e620 2024-05-15T15:40:02.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.750+0000 7f7a637fe640 1 -- 172.21.15.12:0/6801613 <== mon.2 v2:172.21.15.84:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f7a6c097f50 con 0x7f7a7403f670 2024-05-15T15:40:02.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.750+0000 7fb002ffd640 1 -- 172.21.15.12:0/374227676 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7faffc0b7e80 con 0x7fb004073a50 2024-05-15T15:40:02.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.750+0000 7fb002ffd640 1 --2- 172.21.15.12:0/374227676 >> [v2:172.21.15.84:6808/1021092792,v1:172.21.15.84:6809/1021092792] conn(0x7faff007e6d0 0x7faff0080b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:02.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.750+0000 7fb002ffd640 1 -- 172.21.15.12:0/374227676 --> [v2:172.21.15.84:6808/1021092792,v1:172.21.15.84:6809/1021092792] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7faffc03fe50 con 0x7faff007e6d0 2024-05-15T15:40:02.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.750+0000 7fb009bd6640 1 --2- 172.21.15.12:0/374227676 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7faff0076400 0x7faff0078910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:02.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.750+0000 7fb002ffd640 1 -- 172.21.15.12:0/374227676 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7faffc0ba490 con 0x7fb004073a50 2024-05-15T15:40:02.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.750+0000 7f35e7fff640 1 -- 172.21.15.12:0/3744414757 <== osd.6 v2:172.21.15.84:6816/3029180670 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f35fc099e50 con 0x7f35e007e520 2024-05-15T15:40:02.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.750+0000 7fa47ffff640 1 -- 172.21.15.12:0/1818236690 <== osd.7 v2:172.21.15.84:6824/3067620602 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa4900020b0 con 0x7fa48407e670 2024-05-15T15:40:02.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.750+0000 7f5058ff9640 1 --2- 172.21.15.12:0/1253136635 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f50480762d0 0x7f50480787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:02.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.751+0000 7f7a7b7fe640 1 --2- 172.21.15.12:0/6801613 >> [v2:172.21.15.12:6800/3956443113,v1:172.21.15.12:6801/3956443113] conn(0x7f7a6807e620 0x7f7a68080a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:02.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.751+0000 7fb00abd8640 1 --2- 172.21.15.12:0/374227676 >> [v2:172.21.15.84:6808/1021092792,v1:172.21.15.84:6809/1021092792] conn(0x7faff007e6d0 0x7faff0080b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:02.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.751+0000 7f5058ff9640 1 -- 172.21.15.12:0/1253136635 <== mon.2 v2:172.21.15.84:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f5050097fd0 con 0x7f50440051a0 2024-05-15T15:40:02.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.751+0000 7f1f1effd640 1 --2- 172.21.15.12:0/2398575760 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f1f100762d0 0x7f1f100787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:02.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.751+0000 7f7a7a7fc640 1 --2- 172.21.15.12:0/6801613 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f7a68076350 0x7f7a68078860 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7a740ca230 tx=0x7f7a70008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:02.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.751+0000 7f5058ff9640 1 --2- 172.21.15.12:0/1253136635 >> [v2:172.21.15.84:6800/3173527851,v1:172.21.15.84:6801/3173527851] conn(0x7f504807e5a0 0x7f50480809f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:02.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.751+0000 7f5058ff9640 1 -- 172.21.15.12:0/1253136635 --> [v2:172.21.15.84:6800/3173527851,v1:172.21.15.84:6801/3173527851] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f505001cec0 con 0x7f504807e5a0 2024-05-15T15:40:02.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.751+0000 7f5058ff9640 1 -- 172.21.15.12:0/1253136635 <== mon.2 v2:172.21.15.84:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f505009a5d0 con 0x7f50440051a0 2024-05-15T15:40:02.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.751+0000 7f50609bf640 1 --2- 172.21.15.12:0/1253136635 >> [v2:172.21.15.84:6800/3173527851,v1:172.21.15.84:6801/3173527851] conn(0x7f504807e5a0 0x7f50480809f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:02.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.751+0000 7f7a7b7fe640 1 --2- 172.21.15.12:0/6801613 >> [v2:172.21.15.12:6800/3956443113,v1:172.21.15.12:6801/3956443113] conn(0x7f7a6807e620 0x7f7a68080a70 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:02.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.751+0000 7f505b7fe640 1 --2- 172.21.15.12:0/1253136635 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f50480762d0 0x7f50480787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:02.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.751+0000 7fb00abd8640 1 --2- 172.21.15.12:0/374227676 >> [v2:172.21.15.84:6808/1021092792,v1:172.21.15.84:6809/1021092792] conn(0x7faff007e6d0 0x7faff0080b20 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:02.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.751+0000 7fc3f27fc640 1 -- 172.21.15.12:0/1483065961 <== osd.0 v2:172.21.15.12:6808/3943681952 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc3f4033e80 con 0x7fc3e007e5f0 2024-05-15T15:40:02.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.750+0000 7fdf567fc640 1 --2- 172.21.15.12:0/2384753760 >> [v2:172.21.15.12:6820/2173702802,v1:172.21.15.12:6823/2173702802] conn(0x7fdf4407e670 0x7fdf44080ac0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:02.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.751+0000 7fb009bd6640 1 --2- 172.21.15.12:0/374227676 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7faff0076400 0x7faff0078910 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb0040a56f0 tx=0x7faff400b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:02.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.751+0000 7f1f1effd640 1 -- 172.21.15.12:0/2398575760 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f1f24096800 con 0x7f1f280cee10 2024-05-15T15:40:02.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.752+0000 7f1f2e59c640 1 --2- 172.21.15.12:0/2398575760 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f1f100762d0 0x7f1f100787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:02.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.752+0000 7f50609bf640 1 --2- 172.21.15.12:0/1253136635 >> [v2:172.21.15.84:6800/3173527851,v1:172.21.15.84:6801/3173527851] conn(0x7f504807e5a0 0x7f50480809f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:02.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.752+0000 7f505b7fe640 1 --2- 172.21.15.12:0/1253136635 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f50480762d0 0x7f50480787e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f505c1518b0 tx=0x7f504c001110 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:02.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.751+0000 7fdf3f7fe640 1 -- 172.21.15.12:0/2384753760 <== osd.2 v2:172.21.15.12:6820/2173702802 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fdf50018ec0 con 0x7fdf4407e670 2024-05-15T15:40:02.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.752+0000 7fdf56ffd640 1 --2- 172.21.15.12:0/2384753760 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fdf440763a0 0x7fdf440788b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fdf4c034000 tx=0x7fdf4c02e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:02.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.752+0000 7f1f1effd640 1 --2- 172.21.15.12:0/2398575760 >> [v2:172.21.15.12:6811/1763752148,v1:172.21.15.12:6813/1763752148] conn(0x7f1f1007e5a0 0x7f1f100809f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:02.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.752+0000 7f1f1effd640 1 -- 172.21.15.12:0/2398575760 --> [v2:172.21.15.12:6811/1763752148,v1:172.21.15.12:6813/1763752148] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1f2401be50 con 0x7f1f1007e5a0 2024-05-15T15:40:02.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.752+0000 7f1f2e59c640 1 --2- 172.21.15.12:0/2398575760 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f1f100762d0 0x7f1f100787e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1f30066130 tx=0x7f1f3008e040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:02.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.753+0000 7f1f2dd9b640 1 --2- 172.21.15.12:0/2398575760 >> [v2:172.21.15.12:6811/1763752148,v1:172.21.15.12:6813/1763752148] conn(0x7f1f1007e5a0 0x7f1f100809f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:02.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.753+0000 7f7a637fe640 1 -- 172.21.15.12:0/6801613 <== osd.3 v2:172.21.15.12:6800/3956443113 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7a6c017e70 con 0x7f7a6807e620 2024-05-15T15:40:02.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.753+0000 7f5058ff9640 1 -- 172.21.15.12:0/1253136635 <== osd.5 v2:172.21.15.84:6800/3173527851 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f505001cec0 con 0x7f504807e5a0 2024-05-15T15:40:02.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.753+0000 7f1f2dd9b640 1 --2- 172.21.15.12:0/2398575760 >> [v2:172.21.15.12:6811/1763752148,v1:172.21.15.12:6813/1763752148] conn(0x7f1f1007e5a0 0x7f1f100809f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:02.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.753+0000 7f1f1effd640 1 -- 172.21.15.12:0/2398575760 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f1f2409d050 con 0x7f1f280cee10 2024-05-15T15:40:02.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.755+0000 7fb002ffd640 1 -- 172.21.15.12:0/374227676 <== osd.4 v2:172.21.15.84:6808/1021092792 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7faffc03fe50 con 0x7faff007e6d0 2024-05-15T15:40:02.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.755+0000 7f1f1effd640 1 -- 172.21.15.12:0/2398575760 <== osd.1 v2:172.21.15.12:6811/1763752148 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1f2401be50 con 0x7f1f1007e5a0 2024-05-15T15:40:02.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.782+0000 7fc403fe3640 1 -- 172.21.15.12:0/1483065961 --> [v2:172.21.15.12:6808/3943681952,v1:172.21.15.12:6809/3943681952] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc3fc1501e0 con 0x7fc3e007e5f0 2024-05-15T15:40:02.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.782+0000 7fc3f27fc640 1 -- 172.21.15.12:0/1483065961 <== osd.0 v2:172.21.15.12:6808/3943681952 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fc3fc1501e0 con 0x7fc3e007e5f0 2024-05-15T15:40:02.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.783+0000 7fc3dffff640 1 -- 172.21.15.12:0/1483065961 >> [v2:172.21.15.12:6808/3943681952,v1:172.21.15.12:6809/3943681952] conn(0x7fc3e007e5f0 msgr2=0x7fc3e0080a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:02.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.783+0000 7fc3dffff640 1 --2- 172.21.15.12:0/1483065961 >> [v2:172.21.15.12:6808/3943681952,v1:172.21.15.12:6809/3943681952] conn(0x7fc3e007e5f0 0x7fc3e0080a40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:02.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.783+0000 7fa47dffb640 1 -- 172.21.15.12:0/1818236690 --> [v2:172.21.15.84:6824/3067620602,v1:172.21.15.84:6825/3067620602] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa4981e0a00 con 0x7fa48407e670 2024-05-15T15:40:02.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.783+0000 7fc3dffff640 1 -- 172.21.15.12:0/1483065961 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fc3e0076320 msgr2=0x7fc3e0078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:02.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.783+0000 7fc3dffff640 1 --2- 172.21.15.12:0/1483065961 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fc3e0076320 0x7fc3e0078830 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc3f8001220 tx=0x7fc3f8001150 comp rx=0 tx=0).stop 2024-05-15T15:40:02.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.783+0000 7fc3dffff640 1 -- 172.21.15.12:0/1483065961 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc3fc13fab0 msgr2=0x7fc3fc13fec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:02.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.783+0000 7fc3dffff640 1 --2- 172.21.15.12:0/1483065961 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc3fc13fab0 0x7fc3fc13fec0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc3f402af30 tx=0x7fc3f4009750 comp rx=0 tx=0).stop 2024-05-15T15:40:02.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.784+0000 7fc402580640 1 -- 172.21.15.12:0/1483065961 reap_dead start 2024-05-15T15:40:02.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.784+0000 7fc3dffff640 1 -- 172.21.15.12:0/1483065961 shutdown_connections 2024-05-15T15:40:02.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.784+0000 7fc3dffff640 1 -- 172.21.15.12:0/1483065961 >> 172.21.15.12:0/1483065961 conn(0x7fc3fc06f390 msgr2=0x7fc3fc148090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:02.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.784+0000 7fc3dffff640 1 -- 172.21.15.12:0/1483065961 shutdown_connections 2024-05-15T15:40:02.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.784+0000 7fc3dffff640 1 -- 172.21.15.12:0/1483065961 wait complete. 2024-05-15T15:40:02.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.785+0000 7fa47ffff640 1 -- 172.21.15.12:0/1818236690 <== osd.7 v2:172.21.15.84:6824/3067620602 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fa4981e0a00 con 0x7fa48407e670 2024-05-15T15:40:02.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.785+0000 7fa47dffb640 1 -- 172.21.15.12:0/1818236690 >> [v2:172.21.15.84:6824/3067620602,v1:172.21.15.84:6825/3067620602] conn(0x7fa48407e670 msgr2=0x7fa484080ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:02.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.785+0000 7fa47dffb640 1 --2- 172.21.15.12:0/1818236690 >> [v2:172.21.15.84:6824/3067620602,v1:172.21.15.84:6825/3067620602] conn(0x7fa48407e670 0x7fa484080ac0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:02.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.785+0000 7f360083d640 1 -- 172.21.15.12:0/3744414757 --> [v2:172.21.15.84:6816/3029180670,v1:172.21.15.84:6817/3029180670] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f35dc002dd0 con 0x7f35e007e520 2024-05-15T15:40:02.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.785+0000 7fdf5d2aa640 1 -- 172.21.15.12:0/2384753760 --> [v2:172.21.15.12:6820/2173702802,v1:172.21.15.12:6823/2173702802] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fdf5814dec0 con 0x7fdf4407e670 2024-05-15T15:40:02.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.785+0000 7fa47dffb640 1 -- 172.21.15.12:0/1818236690 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fa4840763a0 msgr2=0x7fa4840788b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:02.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.785+0000 7fa47dffb640 1 --2- 172.21.15.12:0/1818236690 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fa4840763a0 0x7fa4840788b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa48c007a60 tx=0x7fa48c008040 comp rx=0 tx=0).stop 2024-05-15T15:40:02.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.785+0000 7fa47dffb640 1 -- 172.21.15.12:0/1818236690 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa49814f2e0 msgr2=0x7fa498150a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:02.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.785+0000 7fa47dffb640 1 --2- 172.21.15.12:0/1818236690 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa49814f2e0 0x7fa498150a70 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa490039000 tx=0x7fa490004a40 comp rx=0 tx=0).stop 2024-05-15T15:40:02.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.785+0000 7fa4977fe640 1 -- 172.21.15.12:0/1818236690 reap_dead start 2024-05-15T15:40:02.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.786+0000 7fa47dffb640 1 -- 172.21.15.12:0/1818236690 shutdown_connections 2024-05-15T15:40:02.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.786+0000 7fa47dffb640 1 -- 172.21.15.12:0/1818236690 >> 172.21.15.12:0/1818236690 conn(0x7fa4980c3cd0 msgr2=0x7fa49814a750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:02.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.786+0000 7fdf3f7fe640 1 -- 172.21.15.12:0/2384753760 <== osd.2 v2:172.21.15.12:6820/2173702802 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fdf5814dec0 con 0x7fdf4407e670 2024-05-15T15:40:02.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.786+0000 7f5062422640 1 -- 172.21.15.12:0/1253136635 --> [v2:172.21.15.84:6800/3173527851,v1:172.21.15.84:6801/3173527851] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f503c002dd0 con 0x7f504807e5a0 2024-05-15T15:40:02.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.786+0000 7fa47dffb640 1 -- 172.21.15.12:0/1818236690 shutdown_connections 2024-05-15T15:40:02.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.786+0000 7f35e7fff640 1 -- 172.21.15.12:0/3744414757 <== osd.6 v2:172.21.15.84:6816/3029180670 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f35dc002dd0 con 0x7f35e007e520 2024-05-15T15:40:02.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.786+0000 7fa47dffb640 1 -- 172.21.15.12:0/1818236690 wait complete. 2024-05-15T15:40:02.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.786+0000 7fdf5d2aa640 1 -- 172.21.15.12:0/2384753760 >> [v2:172.21.15.12:6820/2173702802,v1:172.21.15.12:6823/2173702802] conn(0x7fdf4407e670 msgr2=0x7fdf44080ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:02.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.786+0000 7fdf5d2aa640 1 --2- 172.21.15.12:0/2384753760 >> [v2:172.21.15.12:6820/2173702802,v1:172.21.15.12:6823/2173702802] conn(0x7fdf4407e670 0x7fdf44080ac0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:02.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.787+0000 7f7a7bfff640 1 -- 172.21.15.12:0/6801613 --> [v2:172.21.15.12:6800/3956443113,v1:172.21.15.12:6801/3956443113] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7a5c002dd0 con 0x7f7a6807e620 2024-05-15T15:40:02.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.787+0000 7f5058ff9640 1 -- 172.21.15.12:0/1253136635 <== osd.5 v2:172.21.15.84:6800/3173527851 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f503c002dd0 con 0x7f504807e5a0 2024-05-15T15:40:02.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.787+0000 7fdf5d2aa640 1 -- 172.21.15.12:0/2384753760 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fdf440763a0 msgr2=0x7fdf440788b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:02.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.787+0000 7fdf5d2aa640 1 --2- 172.21.15.12:0/2384753760 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fdf440763a0 0x7fdf440788b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fdf4c034000 tx=0x7fdf4c02e000 comp rx=0 tx=0).stop 2024-05-15T15:40:02.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.787+0000 7fdf5d2aa640 1 -- 172.21.15.12:0/2384753760 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdf58151fc0 msgr2=0x7fdf580a1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:02.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.787+0000 7fdf5d2aa640 1 --2- 172.21.15.12:0/2384753760 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdf58151fc0 0x7fdf580a1de0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fdf5000bf70 tx=0x7fdf5000c4d0 comp rx=0 tx=0).stop 2024-05-15T15:40:02.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.787+0000 7f5062422640 1 -- 172.21.15.12:0/1253136635 >> [v2:172.21.15.84:6800/3173527851,v1:172.21.15.84:6801/3173527851] conn(0x7f504807e5a0 msgr2=0x7f50480809f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:02.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.787+0000 7f5062422640 1 --2- 172.21.15.12:0/1253136635 >> [v2:172.21.15.84:6800/3173527851,v1:172.21.15.84:6801/3173527851] conn(0x7f504807e5a0 0x7f50480809f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:02.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.787+0000 7f360083d640 1 -- 172.21.15.12:0/3744414757 >> [v2:172.21.15.84:6816/3029180670,v1:172.21.15.84:6817/3029180670] conn(0x7f35e007e520 msgr2=0x7f35e0080970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:02.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.787+0000 7f360083d640 1 --2- 172.21.15.12:0/3744414757 >> [v2:172.21.15.84:6816/3029180670,v1:172.21.15.84:6817/3029180670] conn(0x7f35e007e520 0x7f35e0080970 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:02.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.787+0000 7fdf577fe640 1 -- 172.21.15.12:0/2384753760 reap_dead start 2024-05-15T15:40:02.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.787+0000 7f1f2f59e640 1 -- 172.21.15.12:0/2398575760 --> [v2:172.21.15.12:6811/1763752148,v1:172.21.15.12:6813/1763752148] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1f14002dd0 con 0x7f1f1007e5a0 2024-05-15T15:40:02.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.787+0000 7fdf5d2aa640 1 -- 172.21.15.12:0/2384753760 shutdown_connections 2024-05-15T15:40:02.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.787+0000 7fdf5d2aa640 1 -- 172.21.15.12:0/2384753760 >> 172.21.15.12:0/2384753760 conn(0x7fdf580c3d20 msgr2=0x7fdf580c0aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:02.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.787+0000 7f5062422640 1 -- 172.21.15.12:0/1253136635 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f50480762d0 msgr2=0x7f50480787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:02.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.787+0000 7f5062422640 1 --2- 172.21.15.12:0/1253136635 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f50480762d0 0x7f50480787e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f505c1518b0 tx=0x7f504c001110 comp rx=0 tx=0).stop 2024-05-15T15:40:02.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.787+0000 7f5062422640 1 -- 172.21.15.12:0/1253136635 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f50440051a0 msgr2=0x7f505c0bf230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:02.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.787+0000 7f5062422640 1 --2- 172.21.15.12:0/1253136635 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f50440051a0 0x7f505c0bf230 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f5050011570 tx=0x7f5050011a30 comp rx=0 tx=0).stop 2024-05-15T15:40:02.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.787+0000 7f50609bf640 1 -- 172.21.15.12:0/1253136635 reap_dead start 2024-05-15T15:40:02.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.788+0000 7fdf5d2aa640 1 -- 172.21.15.12:0/2384753760 shutdown_connections 2024-05-15T15:40:02.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.788+0000 7fdf5d2aa640 1 -- 172.21.15.12:0/2384753760 wait complete. 2024-05-15T15:40:02.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.787+0000 7f7a637fe640 1 -- 172.21.15.12:0/6801613 <== osd.3 v2:172.21.15.12:6800/3956443113 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f7a5c002dd0 con 0x7f7a6807e620 2024-05-15T15:40:02.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.788+0000 7f5062422640 1 -- 172.21.15.12:0/1253136635 shutdown_connections 2024-05-15T15:40:02.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.788+0000 7f5062422640 1 -- 172.21.15.12:0/1253136635 >> 172.21.15.12:0/1253136635 conn(0x7f505c06cd10 msgr2=0x7f505c068600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:02.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.787+0000 7f360083d640 1 -- 172.21.15.12:0/3744414757 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f35e00762d0 msgr2=0x7f35e00787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:02.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.787+0000 7f360083d640 1 --2- 172.21.15.12:0/3744414757 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f35e00762d0 0x7f35e00787e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f35f000d320 tx=0x7f35f000d2b0 comp rx=0 tx=0).stop 2024-05-15T15:40:02.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.788+0000 7f360083d640 1 -- 172.21.15.12:0/3744414757 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f35f403a140 msgr2=0x7f35f4163f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:02.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.788+0000 7f360083d640 1 --2- 172.21.15.12:0/3744414757 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f35f403a140 0x7f35f4163f60 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f35fc0770f0 tx=0x7f35fc06ec40 comp rx=0 tx=0).stop 2024-05-15T15:40:02.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.788+0000 7f1f1effd640 1 -- 172.21.15.12:0/2398575760 <== osd.1 v2:172.21.15.12:6811/1763752148 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f1f14002dd0 con 0x7f1f1007e5a0 2024-05-15T15:40:02.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.788+0000 7f35fbfff640 1 -- 172.21.15.12:0/3744414757 reap_dead start 2024-05-15T15:40:02.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.788+0000 7f5062422640 1 -- 172.21.15.12:0/1253136635 shutdown_connections 2024-05-15T15:40:02.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.788+0000 7f360083d640 1 -- 172.21.15.12:0/3744414757 shutdown_connections 2024-05-15T15:40:02.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.788+0000 7f360083d640 1 -- 172.21.15.12:0/3744414757 >> 172.21.15.12:0/3744414757 conn(0x7f35f403f680 msgr2=0x7f35f4038aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:02.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.788+0000 7f5062422640 1 -- 172.21.15.12:0/1253136635 wait complete. 2024-05-15T15:40:02.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.788+0000 7f7a7bfff640 1 -- 172.21.15.12:0/6801613 >> [v2:172.21.15.12:6800/3956443113,v1:172.21.15.12:6801/3956443113] conn(0x7f7a6807e620 msgr2=0x7f7a68080a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:02.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.788+0000 7f7a7bfff640 1 --2- 172.21.15.12:0/6801613 >> [v2:172.21.15.12:6800/3956443113,v1:172.21.15.12:6801/3956443113] conn(0x7f7a6807e620 0x7f7a68080a70 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:02.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.788+0000 7f360083d640 1 -- 172.21.15.12:0/3744414757 shutdown_connections 2024-05-15T15:40:02.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.788+0000 7f360083d640 1 -- 172.21.15.12:0/3744414757 wait complete. 2024-05-15T15:40:02.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.788+0000 7fb00c63b640 1 -- 172.21.15.12:0/374227676 --> [v2:172.21.15.84:6808/1021092792,v1:172.21.15.84:6809/1021092792] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb004069b50 con 0x7faff007e6d0 2024-05-15T15:40:02.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.788+0000 7f7a7bfff640 1 -- 172.21.15.12:0/6801613 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f7a68076350 msgr2=0x7f7a68078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:02.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.788+0000 7f7a7bfff640 1 --2- 172.21.15.12:0/6801613 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f7a68076350 0x7f7a68078860 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7a740ca230 tx=0x7f7a70008040 comp rx=0 tx=0).stop 2024-05-15T15:40:02.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.789+0000 7f1f1cff9640 1 -- 172.21.15.12:0/2398575760 >> [v2:172.21.15.12:6811/1763752148,v1:172.21.15.12:6813/1763752148] conn(0x7f1f1007e5a0 msgr2=0x7f1f100809f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:02.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.789+0000 7f1f1cff9640 1 --2- 172.21.15.12:0/2398575760 >> [v2:172.21.15.12:6811/1763752148,v1:172.21.15.12:6813/1763752148] conn(0x7f1f1007e5a0 0x7f1f100809f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:02.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.788+0000 7f7a7bfff640 1 -- 172.21.15.12:0/6801613 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f7a7403f670 msgr2=0x7f7a740c6c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:02.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.789+0000 7f7a7bfff640 1 --2- 172.21.15.12:0/6801613 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f7a7403f670 0x7f7a740c6c10 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7a6c00e870 tx=0x7f7a6c00ed30 comp rx=0 tx=0).stop 2024-05-15T15:40:02.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.789+0000 7f7a7b7fe640 1 -- 172.21.15.12:0/6801613 reap_dead start 2024-05-15T15:40:02.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.789+0000 7f1f1cff9640 1 -- 172.21.15.12:0/2398575760 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f1f100762d0 msgr2=0x7f1f100787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:02.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.789+0000 7f1f1cff9640 1 --2- 172.21.15.12:0/2398575760 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f1f100762d0 0x7f1f100787e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1f30066130 tx=0x7f1f3008e040 comp rx=0 tx=0).stop 2024-05-15T15:40:02.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.789+0000 7fb002ffd640 1 -- 172.21.15.12:0/374227676 <== osd.4 v2:172.21.15.84:6808/1021092792 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fb004069b50 con 0x7faff007e6d0 2024-05-15T15:40:02.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.789+0000 7f1f1cff9640 1 -- 172.21.15.12:0/2398575760 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1f280cee10 msgr2=0x7f1f280251a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:02.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.789+0000 7f1f1cff9640 1 --2- 172.21.15.12:0/2398575760 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1f280cee10 0x7f1f280251a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1f2400c3c0 tx=0x7f1f2400c880 comp rx=0 tx=0).stop 2024-05-15T15:40:02.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.789+0000 7f1f2ed9d640 1 -- 172.21.15.12:0/2398575760 reap_dead start 2024-05-15T15:40:02.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.789+0000 7f1f1cff9640 1 -- 172.21.15.12:0/2398575760 shutdown_connections 2024-05-15T15:40:02.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.789+0000 7f1f1cff9640 1 -- 172.21.15.12:0/2398575760 >> 172.21.15.12:0/2398575760 conn(0x7f1f280407a0 msgr2=0x7f1f280b65e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:02.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.789+0000 7f1f1cff9640 1 -- 172.21.15.12:0/2398575760 shutdown_connections 2024-05-15T15:40:02.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.789+0000 7f1f1cff9640 1 -- 172.21.15.12:0/2398575760 wait complete. 2024-05-15T15:40:02.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.790+0000 7f7a7bfff640 1 -- 172.21.15.12:0/6801613 shutdown_connections 2024-05-15T15:40:02.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.790+0000 7f7a7bfff640 1 -- 172.21.15.12:0/6801613 >> 172.21.15.12:0/6801613 conn(0x7f7a740063f0 msgr2=0x7f7a740c1140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:02.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.790+0000 7f7a7bfff640 1 -- 172.21.15.12:0/6801613 shutdown_connections 2024-05-15T15:40:02.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.790+0000 7f7a7bfff640 1 -- 172.21.15.12:0/6801613 wait complete. 2024-05-15T15:40:02.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.790+0000 7fb00c63b640 1 -- 172.21.15.12:0/374227676 >> [v2:172.21.15.84:6808/1021092792,v1:172.21.15.84:6809/1021092792] conn(0x7faff007e6d0 msgr2=0x7faff0080b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:02.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.790+0000 7fb00c63b640 1 --2- 172.21.15.12:0/374227676 >> [v2:172.21.15.84:6808/1021092792,v1:172.21.15.84:6809/1021092792] conn(0x7faff007e6d0 0x7faff0080b20 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:02.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.791+0000 7fb00c63b640 1 -- 172.21.15.12:0/374227676 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7faff0076400 msgr2=0x7faff0078910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:02.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.791+0000 7fb00c63b640 1 --2- 172.21.15.12:0/374227676 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7faff0076400 0x7faff0078910 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb0040a56f0 tx=0x7faff400b040 comp rx=0 tx=0).stop 2024-05-15T15:40:02.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.791+0000 7fb00c63b640 1 -- 172.21.15.12:0/374227676 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb004073a50 msgr2=0x7fb004151a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:02.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.791+0000 7fb00c63b640 1 --2- 172.21.15.12:0/374227676 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb004073a50 0x7fb004151a30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7faffc0097f0 tx=0x7faffc0046c0 comp rx=0 tx=0).stop 2024-05-15T15:40:02.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.791+0000 7fb00abd8640 1 -- 172.21.15.12:0/374227676 reap_dead start 2024-05-15T15:40:02.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.794+0000 7fb00c63b640 1 -- 172.21.15.12:0/374227676 shutdown_connections 2024-05-15T15:40:02.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.794+0000 7fb00c63b640 1 -- 172.21.15.12:0/374227676 >> 172.21.15.12:0/374227676 conn(0x7fb0040bd0f0 msgr2=0x7fb0040bac40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:02.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.794+0000 7fb00c63b640 1 -- 172.21.15.12:0/374227676 shutdown_connections 2024-05-15T15:40:02.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:02.794+0000 7fb00c63b640 1 -- 172.21.15.12:0/374227676 wait complete. 2024-05-15T15:40:02.856 INFO:teuthology.orchestra.run.smithi012.stdout:64424509447 2024-05-15T15:40:02.857 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-15T15:40:02.858 INFO:teuthology.orchestra.run.smithi012.stdout:64424509448 2024-05-15T15:40:02.858 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-05-15T15:40:02.859 INFO:teuthology.orchestra.run.smithi012.stdout:64424509447 2024-05-15T15:40:02.859 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-05-15T15:40:02.860 INFO:teuthology.orchestra.run.smithi012.stdout:64424509447 2024-05-15T15:40:02.860 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-05-15T15:40:02.860 INFO:teuthology.orchestra.run.smithi012.stdout:64424509447 2024-05-15T15:40:02.861 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-15T15:40:02.861 INFO:teuthology.orchestra.run.smithi012.stdout:64424509448 2024-05-15T15:40:02.862 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-15T15:40:02.862 INFO:teuthology.orchestra.run.smithi012.stdout:55834574856 2024-05-15T15:40:02.863 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-05-15T15:40:02.864 INFO:teuthology.orchestra.run.smithi012.stdout:64424509447 2024-05-15T15:40:02.864 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-15T15:40:03.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.115+0000 7fa1425c9640 1 Processor -- start 2024-05-15T15:40:03.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.115+0000 7fa1425c9640 1 -- start start 2024-05-15T15:40:03.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.118+0000 7fcc3983d640 1 Processor -- start 2024-05-15T15:40:03.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.118+0000 7fd4e1a42640 1 Processor -- start 2024-05-15T15:40:03.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.118+0000 7fd4e1a42640 1 -- start start 2024-05-15T15:40:03.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.118+0000 7fcc3983d640 1 -- start start 2024-05-15T15:40:03.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.118+0000 7f8d893ff640 1 Processor -- start 2024-05-15T15:40:03.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.119+0000 7f8d893ff640 1 -- start start 2024-05-15T15:40:03.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.117+0000 7fa1425c9640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa13403d360 0x7fa1340ef930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:03.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.117+0000 7fa1425c9640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa1340efe70 0x7fa1340f9b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:03.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.117+0000 7fa1425c9640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa13403a1b0 con 0x7fa13403cf50 2024-05-15T15:40:03.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.117+0000 7fa1425c9640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fa134039f60 con 0x7fa1340efe70 2024-05-15T15:40:03.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.117+0000 7fa1425c9640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fa13403a490 con 0x7fa13403d360 2024-05-15T15:40:03.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.118+0000 7fa1415c7640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fa13403cf50 0x7fa1340ef220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.12:53738/0 (socket says 172.21.15.12:53738) 2024-05-15T15:40:03.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.118+0000 7fa1415c7640 1 -- 172.21.15.12:0/3368966814 learned_addr learned my addr 172.21.15.12:0/3368966814 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-05-15T15:40:03.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.118+0000 7fa141dc8640 1 --2- 172.21.15.12:0/3368966814 >> v2:172.21.15.12:3300/0 conn(0x7fa1340efe70 0x7fa1340f9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:03.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.118+0000 7fa140dc6640 1 --2- 172.21.15.12:0/3368966814 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa13403d360 0x7fa1340ef930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:03.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.118+0000 7fa133fff640 1 -- 172.21.15.12:0/3368966814 <== mon.1 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 57132167 0 0) 0x7fa13403a1b0 con 0x7fa13403cf50 2024-05-15T15:40:03.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.118+0000 7fa133fff640 1 -- 172.21.15.12:0/3368966814 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa128003520 con 0x7fa13403cf50 2024-05-15T15:40:03.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.119+0000 7fdd29bea640 1 Processor -- start 2024-05-15T15:40:03.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.119+0000 7fdd29bea640 1 -- start start 2024-05-15T15:40:03.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.119+0000 7fcc3983d640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fcc340b6f30 0x7fcc34155ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:03.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.119+0000 7fecd2957640 1 Processor -- start 2024-05-15T15:40:03.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.119+0000 7fecd2957640 1 -- start start 2024-05-15T15:40:03.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.119+0000 7fa141dc8640 1 -- 172.21.15.12:0/3368966814 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa13403d360 msgr2=0x7fa1340ef930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:40:03.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.120+0000 7fcc3983d640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fcc34070b40 0x7fcc3415ced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:03.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.120+0000 7fcc3983d640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc34073d80 con 0x7fcc34070730 2024-05-15T15:40:03.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.120+0000 7fcc33fff640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fcc34070730 0x7fcc340732f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.12:53742/0 (socket says 172.21.15.12:53742) 2024-05-15T15:40:03.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.120+0000 7fcc33fff640 1 -- 172.21.15.12:0/3930792774 learned_addr learned my addr 172.21.15.12:0/3930792774 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-05-15T15:40:03.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.120+0000 7fcc3983d640 1 -- 172.21.15.12:0/3930792774 --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fcc340bbe10 con 0x7fcc34070b40 2024-05-15T15:40:03.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.120+0000 7fcc3983d640 1 -- 172.21.15.12:0/3930792774 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fcc340bc060 con 0x7fcc340b6f30 2024-05-15T15:40:03.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.120+0000 7fcc337fe640 1 -- 172.21.15.12:0/3930792774 <== mon.1 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3704227537 0 0) 0x7fcc34073d80 con 0x7fcc34070730 2024-05-15T15:40:03.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.120+0000 7fcc337fe640 1 -- 172.21.15.12:0/3930792774 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcc20003520 con 0x7fcc34070730 2024-05-15T15:40:03.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.120+0000 7fcc3903c640 1 --2- 172.21.15.12:0/3930792774 >> v2:172.21.15.12:3300/0 conn(0x7fcc34070b40 0x7fcc3415ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:03.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.119+0000 7fa141dc8640 1 --2- 172.21.15.12:0/3368966814 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa13403d360 0x7fa1340ef930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:03.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.119+0000 7fa141dc8640 1 -- 172.21.15.12:0/3368966814 >> v1:172.21.15.84:6789/0 conn(0x7fa13403cf50 legacy=0x7fa1340ef220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:03.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.119+0000 7fa141dc8640 1 -- 172.21.15.12:0/3368966814 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa13403a770 con 0x7fa1340efe70 2024-05-15T15:40:03.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.120+0000 7fa140dc6640 1 --2- 172.21.15.12:0/3368966814 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa13403d360 0x7fa1340ef930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-15T15:40:03.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.120+0000 7fa141dc8640 1 --2- 172.21.15.12:0/3368966814 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa1340efe70 0x7fa1340f9b80 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa13c051610 tx=0x7fa13c0985b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25f7cc48c72ad0b3 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:03.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.120+0000 7fd4e1a42640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fd4d403a850 0x7fd4d4039eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:03.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.120+0000 7fd4e1a42640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd4d403c810 0x7fd4d40ce5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:03.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.120+0000 7fd4e1a42640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4d40d1e20 con 0x7fd4d403cc20 2024-05-15T15:40:03.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.120+0000 7fd4e1a42640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fd4d40c8c20 con 0x7fd4d403c810 2024-05-15T15:40:03.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.120+0000 7fd4e1a42640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fd4d40d2750 con 0x7fd4d403a850 2024-05-15T15:40:03.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.120+0000 7fd4daffd640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fd4d403a850 0x7fd4d4039eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:03.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.121+0000 7fcc3883b640 1 --2- 172.21.15.12:0/3930792774 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fcc340b6f30 0x7fcc34155ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:03.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.120+0000 7fecd2957640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fecc403cf40 0x7fecc403ad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:03.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.120+0000 7fecd2957640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fecc40399c0 0x7fecc40e03b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:03.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.120+0000 7fecd2957640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fecc403b530 con 0x7fecc40cfc40 2024-05-15T15:40:03.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.120+0000 7fecd2957640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7fecc403c580 con 0x7fecc403cf40 2024-05-15T15:40:03.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.120+0000 7fecd2957640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fecc40d5c40 con 0x7fecc40399c0 2024-05-15T15:40:03.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.121+0000 7f8d893ff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8d7c043040 0x7f8d7c0078d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:03.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.121+0000 7fdd29bea640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fdd240742a0 0x7fdd240bbe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:03.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.121+0000 7fd4da7fc640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd4d403c810 0x7fd4d40ce5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:03.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.121+0000 7fa133fff640 1 -- 172.21.15.12:0/3368966814 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa13c0a0650 con 0x7fa1340efe70 2024-05-15T15:40:03.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.121+0000 7fa133fff640 1 -- 172.21.15.12:0/3368966814 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa13c0a0810 con 0x7fa1340efe70 2024-05-15T15:40:03.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.121+0000 7fa133fff640 1 -- 172.21.15.12:0/3368966814 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa13c0a0c80 con 0x7fa1340efe70 2024-05-15T15:40:03.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.121+0000 7fd4da7fc640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd4d403c810 0x7fd4d40ce5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59618/0 (socket says 172.21.15.12:59618) 2024-05-15T15:40:03.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.121+0000 7fd4da7fc640 1 -- 172.21.15.12:0/1909622165 learned_addr learned my addr 172.21.15.12:0/1909622165 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:03.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.121+0000 7feccbfff640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fecc403cf40 0x7fecc403ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:03.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.121+0000 7feccbfff640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fecc403cf40 0x7fecc403ad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.12:35956/0 (socket says 172.21.15.12:35956) 2024-05-15T15:40:03.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.121+0000 7feccbfff640 1 -- 172.21.15.12:0/3822723237 learned_addr learned my addr 172.21.15.12:0/3822723237 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:03.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.121+0000 7fecd0ef4640 1 --2- 172.21.15.12:0/3822723237 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fecc40399c0 0x7fecc40e03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:03.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.121+0000 7f8d893ff640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8d7c0408e0 0x7f8d7c0cb4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:03.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.119+0000 7f89b2822640 1 Processor -- start 2024-05-15T15:40:03.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.120+0000 7f89b2822640 1 -- start start 2024-05-15T15:40:03.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.121+0000 7fcc337fe640 1 -- 172.21.15.12:0/3930792774 <== mon.1 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3200541610 0 0) 0x7fcc20003520 con 0x7fcc34070730 2024-05-15T15:40:03.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.121+0000 7fcc337fe640 1 -- 172.21.15.12:0/3930792774 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fcc340b6f30 msgr2=0x7fcc34155ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:40:03.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.121+0000 7fcc337fe640 1 --2- 172.21.15.12:0/3930792774 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fcc340b6f30 0x7fcc34155ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:03.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.121+0000 7fcc337fe640 1 -- 172.21.15.12:0/3930792774 >> v2:172.21.15.12:3300/0 conn(0x7fcc34070b40 msgr2=0x7fcc3415ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:40:03.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.121+0000 7fcc337fe640 1 --2- 172.21.15.12:0/3930792774 >> v2:172.21.15.12:3300/0 conn(0x7fcc34070b40 0x7fcc3415ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:03.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.121+0000 7fcc337fe640 1 -- 172.21.15.12:0/3930792774 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc340bc340 con 0x7fcc34070730 2024-05-15T15:40:03.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.121+0000 7fcc337fe640 1 -- 172.21.15.12:0/3930792774 <== mon.1 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 38171736 0 0) 0x7fcc2c001a70 con 0x7fcc34070730 2024-05-15T15:40:03.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.121+0000 7fcc337fe640 1 -- 172.21.15.12:0/3930792774 >> v1:172.21.15.84:6789/0 conn(0x7fcc34070730 legacy=0x7fcc340732f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:03.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.121+0000 7f8d893ff640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8d7c0cb9e0 0x7f8d7c0d4e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:03.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.121+0000 7fcc337fe640 1 --2- 172.21.15.12:0/3930792774 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcc20003a50 0x7fcc20003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:03.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.121+0000 7fcc337fe640 1 --2- 172.21.15.12:0/3930792774 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fcc20004800 0x7fcc20004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:03.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.121+0000 7fdd29bea640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fdd24152db0 0x7fdd2415cf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:03.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.121+0000 7fdd22ffd640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fdd2414c960 0x7fdd241526a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:45262/0 (socket says 172.21.15.12:45262) 2024-05-15T15:40:03.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.121+0000 7fdd237fe640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fdd240742a0 0x7fdd240bbe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:03.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.121+0000 7fdd237fe640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fdd240742a0 0x7fdd240bbe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3301/0 says I am v2:172.21.15.12:37810/0 (socket says 172.21.15.12:37810) 2024-05-15T15:40:03.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.122+0000 7f89b2822640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f89a400b180 0x7f89a4038040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:03.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.121+0000 7fcc337fe640 1 --2- 172.21.15.12:0/3930792774 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcc20005150 0x7fcc2000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:03.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.121+0000 7fcc337fe640 1 -- 172.21.15.12:0/3930792774 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fcc340bbe10 con 0x7fcc20005150 2024-05-15T15:40:03.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.121+0000 7fcc337fe640 1 -- 172.21.15.12:0/3930792774 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fcc340bc060 con 0x7fcc20003a50 2024-05-15T15:40:03.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.121+0000 7fcc337fe640 1 -- 172.21.15.12:0/3930792774 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fcc2000c060 con 0x7fcc20004800 2024-05-15T15:40:03.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.122+0000 7fcc3903c640 1 --2- 172.21.15.12:0/3930792774 >> v2:172.21.15.12:3300/0 conn(0x7fcc34070b40 0x7fcc3415ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-15T15:40:03.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.122+0000 7feccbfff640 1 -- 172.21.15.12:0/3822723237 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fecc40399c0 msgr2=0x7fecc40e03b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:40:03.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.122+0000 7feccbfff640 1 --2- 172.21.15.12:0/3822723237 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fecc40399c0 0x7fecc40e03b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:03.134 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.121+0000 7f8d827fc640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8d7c0408e0 0x7f8d7c0cb4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:03.134 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.122+0000 7f8d827fc640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8d7c0408e0 0x7f8d7c0cb4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3301/0 says I am v2:172.21.15.12:37800/0 (socket says 172.21.15.12:37800) 2024-05-15T15:40:03.134 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.122+0000 7f8d827fc640 1 -- 172.21.15.12:0/514638819 learned_addr learned my addr 172.21.15.12:0/514638819 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:03.134 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.122+0000 7feccbfff640 1 -- 172.21.15.12:0/3822723237 >> v1:172.21.15.84:6789/0 conn(0x7fecc40cfc40 legacy=0x7fecc40d6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:03.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.122+0000 7fdd22ffd640 1 -- 172.21.15.12:0/3374472529 learned_addr learned my addr 172.21.15.12:0/3374472529 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-05-15T15:40:03.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.122+0000 7fdd23fff640 1 --2- 172.21.15.12:0/3374472529 >> v2:172.21.15.84:3300/0 conn(0x7fdd24152db0 0x7fdd2415cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:03.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.122+0000 7f8d82ffd640 1 --2- 172.21.15.12:0/514638819 >> v2:172.21.15.12:3300/0 conn(0x7f8d7c043040 0x7f8d7c0078d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:03.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.122+0000 7f89b2822640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f89a403a130 0x7f89a4038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:03.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.122+0000 7f89b2822640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89a403c300 con 0x7f89a40cd800 2024-05-15T15:40:03.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.122+0000 7f89b2822640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f89a403be70 con 0x7f89a400b180 2024-05-15T15:40:03.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.122+0000 7f89b2822640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f89a403b110 con 0x7f89a403a130 2024-05-15T15:40:03.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.122+0000 7f89b1820640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f89a400b180 0x7f89a4038040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:03.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.122+0000 7f89b1820640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f89a400b180 0x7f89a4038040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.12:35988/0 (socket says 172.21.15.12:35988) 2024-05-15T15:40:03.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.122+0000 7f89b1820640 1 -- 172.21.15.12:0/974422061 learned_addr learned my addr 172.21.15.12:0/974422061 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:03.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.122+0000 7f8d83fff640 1 --2- 172.21.15.12:0/514638819 >> v2:172.21.15.84:3300/0 conn(0x7f8d7c0cb9e0 0x7f8d7c0d4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:03.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.122+0000 7f8d893ff640 1 -- 172.21.15.12:0/514638819 --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f8d7c043450 con 0x7f8d7c043040 2024-05-15T15:40:03.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.122+0000 7f8d893ff640 1 -- 172.21.15.12:0/514638819 --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f8d7c03f810 con 0x7f8d7c0cb9e0 2024-05-15T15:40:03.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.122+0000 7f8d893ff640 1 -- 172.21.15.12:0/514638819 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f8d7c040100 con 0x7f8d7c0408e0 2024-05-15T15:40:03.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.122+0000 7fdd29bea640 1 -- 172.21.15.12:0/3374472529 --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd2406ef60 con 0x7fdd2414c960 2024-05-15T15:40:03.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.122+0000 7fdd29bea640 1 -- 172.21.15.12:0/3374472529 --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7fdd2406f240 con 0x7fdd24152db0 2024-05-15T15:40:03.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.122+0000 7fdd29bea640 1 -- 172.21.15.12:0/3374472529 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fdd2406fd90 con 0x7fdd240742a0 2024-05-15T15:40:03.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.122+0000 7fcc3903c640 1 --2- 172.21.15.12:0/3930792774 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcc20005150 0x7fcc2000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:03.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.122+0000 7f89b1820640 1 -- 172.21.15.12:0/974422061 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f89a403a130 msgr2=0x7f89a4038ca0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-15T15:40:03.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.122+0000 7f89b1820640 1 --2- 172.21.15.12:0/974422061 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f89a403a130 0x7f89a4038ca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:03.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.122+0000 7f89b1820640 1 -- 172.21.15.12:0/974422061 >> v1:172.21.15.84:6789/0 conn(0x7f89a40cd800 legacy=0x7f89a40d0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:40:03.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.122+0000 7fa1425c9640 1 -- 172.21.15.12:0/3368966814 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa1340efe70 msgr2=0x7fa1340f9b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:03.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.122+0000 7fa1425c9640 1 --2- 172.21.15.12:0/3368966814 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa1340efe70 0x7fa1340f9b80 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa13c051610 tx=0x7fa13c0985b0 comp rx=0 tx=0).stop 2024-05-15T15:40:03.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.122+0000 7fa1425c9640 1 -- 172.21.15.12:0/3368966814 shutdown_connections 2024-05-15T15:40:03.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.122+0000 7fa1425c9640 1 --2- 172.21.15.12:0/3368966814 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa1340efe70 0x7fa1340f9b80 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:03.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.122+0000 7fa1425c9640 1 --2- 172.21.15.12:0/3368966814 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa13403d360 0x7fa1340ef930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:03.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.122+0000 7f89b1820640 1 -- 172.21.15.12:0/974422061 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89a403b3f0 con 0x7f89a400b180 2024-05-15T15:40:03.139 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.122+0000 7fa1425c9640 1 -- 172.21.15.12:0/3368966814 >> 172.21.15.12:0/3368966814 conn(0x7fa13403f230 msgr2=0x7fa13403f640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:03.139 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.122+0000 7fd4d9ffb640 1 -- 172.21.15.12:0/1909622165 <== mon.1 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2310934114 0 0) 0x7fd4d40d1e20 con 0x7fd4d403cc20 2024-05-15T15:40:03.139 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.122+0000 7fd4d9ffb640 1 -- 172.21.15.12:0/1909622165 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd4c4003520 con 0x7fd4d403cc20 2024-05-15T15:40:03.139 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.122+0000 7fd4da7fc640 1 -- 172.21.15.12:0/1909622165 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fd4d403a850 msgr2=0x7fd4d4039eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:40:03.139 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.122+0000 7fd4d9ffb640 1 -- 172.21.15.12:0/1909622165 <== mon.1 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 219835189 0 0) 0x7fd4c4003520 con 0x7fd4d403cc20 2024-05-15T15:40:03.139 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.122+0000 7fd4da7fc640 1 --2- 172.21.15.12:0/1909622165 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fd4d403a850 0x7fd4d4039eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:03.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.122+0000 7fd4da7fc640 1 -- 172.21.15.12:0/1909622165 >> v1:172.21.15.84:6789/0 conn(0x7fd4d403cc20 legacy=0x7fd4d403b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:03.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.122+0000 7fd4da7fc640 1 -- 172.21.15.12:0/1909622165 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4d40d2100 con 0x7fd4d403c810 2024-05-15T15:40:03.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.123+0000 7f8d83fff640 1 -- 172.21.15.12:0/514638819 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8d7c0408e0 msgr2=0x7f8d7c0cb4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:40:03.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.123+0000 7f8d83fff640 1 --2- 172.21.15.12:0/514638819 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8d7c0408e0 0x7f8d7c0cb4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:03.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.123+0000 7f8d83fff640 1 -- 172.21.15.12:0/514638819 >> v2:172.21.15.12:3300/0 conn(0x7f8d7c043040 msgr2=0x7f8d7c0078d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:40:03.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.123+0000 7f8d83fff640 1 --2- 172.21.15.12:0/514638819 >> v2:172.21.15.12:3300/0 conn(0x7f8d7c043040 0x7f8d7c0078d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:03.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.123+0000 7f8d83fff640 1 -- 172.21.15.12:0/514638819 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d7c03fab0 con 0x7f8d7c0cb9e0 2024-05-15T15:40:03.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.122+0000 7feccbfff640 1 -- 172.21.15.12:0/3822723237 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecc40d5f20 con 0x7fecc403cf40 2024-05-15T15:40:03.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.123+0000 7fcc33fff640 1 --2- 172.21.15.12:0/3930792774 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fcc20004800 0x7fcc20004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:03.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.123+0000 7fa1425c9640 1 -- 172.21.15.12:0/3368966814 shutdown_connections 2024-05-15T15:40:03.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.123+0000 7fa1425c9640 1 -- 172.21.15.12:0/3368966814 wait complete. 2024-05-15T15:40:03.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.123+0000 7fa2d9cc6640 1 Processor -- start 2024-05-15T15:40:03.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.123+0000 7fdd237fe640 1 -- 172.21.15.12:0/3374472529 >> v2:172.21.15.84:3300/0 conn(0x7fdd24152db0 msgr2=0x7fdd2415cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:40:03.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.123+0000 7fdd237fe640 1 --2- 172.21.15.12:0/3374472529 >> v2:172.21.15.84:3300/0 conn(0x7fdd24152db0 0x7fdd2415cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:03.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.123+0000 7fdd237fe640 1 -- 172.21.15.12:0/3374472529 >> v1:172.21.15.12:6789/0 conn(0x7fdd2414c960 legacy=0x7fdd241526a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:03.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.123+0000 7fdd237fe640 1 -- 172.21.15.12:0/3374472529 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd24070070 con 0x7fdd240742a0 2024-05-15T15:40:03.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.123+0000 7fcc3883b640 1 --2- 172.21.15.12:0/3930792774 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcc20003a50 0x7fcc20003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:03.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.123+0000 7fcc33fff640 1 -- 172.21.15.12:0/3930792774 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcc20003a50 msgr2=0x7fcc20003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:40:03.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.123+0000 7fcc33fff640 1 --2- 172.21.15.12:0/3930792774 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcc20003a50 0x7fcc20003ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:03.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.123+0000 7fcc33fff640 1 -- 172.21.15.12:0/3930792774 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcc20005150 msgr2=0x7fcc2000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:40:03.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.123+0000 7fcc33fff640 1 --2- 172.21.15.12:0/3930792774 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcc20005150 0x7fcc2000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:03.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.123+0000 7fcc33fff640 1 -- 172.21.15.12:0/3930792774 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc20003520 con 0x7fcc20004800 2024-05-15T15:40:03.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.123+0000 7feccbfff640 1 --2- 172.21.15.12:0/3822723237 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fecc403cf40 0x7fecc403ad10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fecb8009860 tx=0x7fecb802a1e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=429d8b805fee1ded server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:03.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.123+0000 7feccaffd640 1 -- 172.21.15.12:0/3822723237 <== mon.1 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecb8037070 con 0x7fecc403cf40 2024-05-15T15:40:03.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.124+0000 7feccaffd640 1 -- 172.21.15.12:0/3822723237 <== mon.1 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecb8032440 con 0x7fecc403cf40 2024-05-15T15:40:03.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.124+0000 7feccaffd640 1 -- 172.21.15.12:0/3822723237 <== mon.1 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecb8032810 con 0x7fecc403cf40 2024-05-15T15:40:03.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.124+0000 7f89b1820640 1 --2- 172.21.15.12:0/974422061 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89a400b180 0x7f89a4038040 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f89a8009850 tx=0x7f89a802c3d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba6f2634c4b0f6bf server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:03.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.124+0000 7f8d83fff640 1 --2- 172.21.15.12:0/514638819 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8d7c0cb9e0 0x7f8d7c0d4e30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8d8406a9d0 tx=0x7f8d840a7420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=772ee1c7f1185e4f server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:03.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.123+0000 7fa2d9cc6640 1 -- start start 2024-05-15T15:40:03.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.124+0000 7f8d81ffb640 1 -- 172.21.15.12:0/514638819 <== mon.1 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d840b3070 con 0x7f8d7c0cb9e0 2024-05-15T15:40:03.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.124+0000 7fdd237fe640 1 --2- 172.21.15.12:0/3374472529 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fdd240742a0 0x7fdd240bbe50 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fdd140097a0 tx=0x7fdd1402a250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ae1302520bb16173 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:03.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.124+0000 7f8d81ffb640 1 -- 172.21.15.12:0/514638819 <== mon.1 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d840ae600 con 0x7f8d7c0cb9e0 2024-05-15T15:40:03.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.124+0000 7f8d81ffb640 1 -- 172.21.15.12:0/514638819 <== mon.1 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d840aea30 con 0x7f8d7c0cb9e0 2024-05-15T15:40:03.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.124+0000 7fd4da7fc640 1 --2- 172.21.15.12:0/1909622165 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd4d403c810 0x7fd4d40ce5b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd4d000bb10 tx=0x7fd4d002c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58c50a277d288792 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:03.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.124+0000 7fdd227fc640 1 -- 172.21.15.12:0/3374472529 <== mon.2 v2:172.21.15.84:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd14037070 con 0x7fdd240742a0 2024-05-15T15:40:03.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.124+0000 7fdd227fc640 1 -- 172.21.15.12:0/3374472529 <== mon.2 v2:172.21.15.84:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd14032440 con 0x7fdd240742a0 2024-05-15T15:40:03.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.124+0000 7fdd227fc640 1 -- 172.21.15.12:0/3374472529 <== mon.2 v2:172.21.15.84:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd14032810 con 0x7fdd240742a0 2024-05-15T15:40:03.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.124+0000 7fcc33fff640 1 --2- 172.21.15.12:0/3930792774 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fcc20004800 0x7fcc20004c10 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fcc34074f60 tx=0x7fcc20005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e792187ab2d5ec2 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:03.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.125+0000 7fd4d9ffb640 1 -- 172.21.15.12:0/1909622165 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4d003a070 con 0x7fd4d403c810 2024-05-15T15:40:03.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.125+0000 7fd4d9ffb640 1 -- 172.21.15.12:0/1909622165 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4d00324f0 con 0x7fd4d403c810 2024-05-15T15:40:03.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.125+0000 7fcc337fe640 1 -- 172.21.15.12:0/3930792774 <== mon.2 v2:172.21.15.84:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc2c00a480 con 0x7fcc20004800 2024-05-15T15:40:03.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.125+0000 7fd4d9ffb640 1 -- 172.21.15.12:0/1909622165 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4dc050860 con 0x7fd4d403c810 2024-05-15T15:40:03.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.125+0000 7f89b081e640 1 -- 172.21.15.12:0/974422061 <== mon.1 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89a8038070 con 0x7f89a400b180 2024-05-15T15:40:03.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.125+0000 7fdd29bea640 1 -- 172.21.15.12:0/3374472529 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fdd240742a0 msgr2=0x7fdd240bbe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:03.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.125+0000 7fdd29bea640 1 --2- 172.21.15.12:0/3374472529 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fdd240742a0 0x7fdd240bbe50 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fdd140097a0 tx=0x7fdd1402a250 comp rx=0 tx=0).stop 2024-05-15T15:40:03.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.126+0000 7fdd29bea640 1 -- 172.21.15.12:0/3374472529 shutdown_connections 2024-05-15T15:40:03.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.126+0000 7fdd29bea640 1 --2- 172.21.15.12:0/3374472529 >> v2:172.21.15.84:3300/0 conn(0x7fdd24152db0 0x7fdd2415cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:03.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.126+0000 7fdd29bea640 1 --2- 172.21.15.12:0/3374472529 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fdd240742a0 0x7fdd240bbe50 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:03.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.126+0000 7fdd29bea640 1 -- 172.21.15.12:0/3374472529 >> 172.21.15.12:0/3374472529 conn(0x7fdd2406d700 msgr2=0x7fdd240ba730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:03.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.126+0000 7fd4e1a42640 1 -- 172.21.15.12:0/1909622165 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd4d403c810 msgr2=0x7fd4d40ce5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:03.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.126+0000 7fd4e1a42640 1 --2- 172.21.15.12:0/1909622165 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd4d403c810 0x7fd4d40ce5b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd4d000bb10 tx=0x7fd4d002c8d0 comp rx=0 tx=0).stop 2024-05-15T15:40:03.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.125+0000 7fa2d9cc6640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa2d40bd510 0x7fa2d40bd920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:03.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.125+0000 7fa2d9cc6640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa2d414ebd0 0x7fa2d414efe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:03.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.125+0000 7fa2d9cc6640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2d40bea40 con 0x7fa2d40be230 2024-05-15T15:40:03.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.125+0000 7fa2d9cc6640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fa2d414c230 con 0x7fa2d40bd510 2024-05-15T15:40:03.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.125+0000 7fa2d9cc6640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7fa2d40becb0 con 0x7fa2d414ebd0 2024-05-15T15:40:03.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.126+0000 7fa2d3fff640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa2d414ebd0 0x7fa2d414efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:03.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.126+0000 7fa2d3fff640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa2d414ebd0 0x7fa2d414efe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.12:36010/0 (socket says 172.21.15.12:36010) 2024-05-15T15:40:03.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.126+0000 7fa2d3fff640 1 -- 172.21.15.12:0/2676914542 learned_addr learned my addr 172.21.15.12:0/2676914542 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:03.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.125+0000 7f89b081e640 1 -- 172.21.15.12:0/974422061 <== mon.1 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89a8004230 con 0x7f89a400b180 2024-05-15T15:40:03.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.125+0000 7f89b081e640 1 -- 172.21.15.12:0/974422061 <== mon.1 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89a8003610 con 0x7f89a400b180 2024-05-15T15:40:03.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.125+0000 7fcc337fe640 1 -- 172.21.15.12:0/3930792774 <== mon.2 v2:172.21.15.84:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc2c02f070 con 0x7fcc20004800 2024-05-15T15:40:03.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.125+0000 7fcc337fe640 1 -- 172.21.15.12:0/3930792774 <== mon.2 v2:172.21.15.84:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc2c02bae0 con 0x7fcc20004800 2024-05-15T15:40:03.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.125+0000 7f8d893ff640 1 -- 172.21.15.12:0/514638819 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8d7c0cb9e0 msgr2=0x7f8d7c0d4e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:03.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.125+0000 7f8d893ff640 1 --2- 172.21.15.12:0/514638819 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8d7c0cb9e0 0x7f8d7c0d4e30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8d8406a9d0 tx=0x7f8d840a7420 comp rx=0 tx=0).stop 2024-05-15T15:40:03.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.126+0000 7f8d893ff640 1 -- 172.21.15.12:0/514638819 shutdown_connections 2024-05-15T15:40:03.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.126+0000 7f8d893ff640 1 --2- 172.21.15.12:0/514638819 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8d7c0cb9e0 0x7f8d7c0d4e30 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:03.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.126+0000 7f8d893ff640 1 --2- 172.21.15.12:0/514638819 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8d7c0408e0 0x7f8d7c0cb4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:03.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.126+0000 7f8d893ff640 1 --2- 172.21.15.12:0/514638819 >> v2:172.21.15.12:3300/0 conn(0x7f8d7c043040 0x7f8d7c0078d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:03.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.126+0000 7f8d893ff640 1 -- 172.21.15.12:0/514638819 >> 172.21.15.12:0/514638819 conn(0x7f8d7c043650 msgr2=0x7f8d7c043a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:03.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.126+0000 7fa1425c9640 1 Processor -- start 2024-05-15T15:40:03.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.126+0000 7f89b2822640 1 -- 172.21.15.12:0/974422061 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89a400b180 msgr2=0x7f89a4038040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:03.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.126+0000 7f89b2822640 1 --2- 172.21.15.12:0/974422061 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89a400b180 0x7f89a4038040 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f89a8009850 tx=0x7f89a802c3d0 comp rx=0 tx=0).stop 2024-05-15T15:40:03.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.126+0000 7fa1425c9640 1 -- start start 2024-05-15T15:40:03.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.126+0000 7fcc3983d640 1 -- 172.21.15.12:0/3930792774 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fcc20004800 msgr2=0x7fcc20004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:03.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.126+0000 7fcc3983d640 1 --2- 172.21.15.12:0/3930792774 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fcc20004800 0x7fcc20004c10 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fcc34074f60 tx=0x7fcc20005830 comp rx=0 tx=0).stop 2024-05-15T15:40:03.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.126+0000 7fa2d2ffd640 1 --2- 172.21.15.12:0/2676914542 >> v2:172.21.15.12:3300/0 conn(0x7fa2d40bd510 0x7fa2d40bd920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:03.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.126+0000 7f89b2822640 1 -- 172.21.15.12:0/974422061 shutdown_connections 2024-05-15T15:40:03.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.126+0000 7f89b2822640 1 --2- 172.21.15.12:0/974422061 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f89a403a130 0x7f89a4038ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:03.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.126+0000 7f89b2822640 1 --2- 172.21.15.12:0/974422061 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89a400b180 0x7f89a4038040 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:03.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.126+0000 7f89b2822640 1 -- 172.21.15.12:0/974422061 >> 172.21.15.12:0/974422061 conn(0x7f89a403f670 msgr2=0x7f89a40060d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:03.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.126+0000 7fcc3903c640 1 -- 172.21.15.12:0/3930792774 reap_dead start 2024-05-15T15:40:03.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.126+0000 7fd4e1a42640 1 -- 172.21.15.12:0/1909622165 shutdown_connections 2024-05-15T15:40:03.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.126+0000 7fd4e1a42640 1 --2- 172.21.15.12:0/1909622165 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd4d403c810 0x7fd4d40ce5b0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:03.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.126+0000 7fd4e1a42640 1 --2- 172.21.15.12:0/1909622165 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fd4d403a850 0x7fd4d4039eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:03.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.126+0000 7fdd29bea640 1 -- 172.21.15.12:0/3374472529 shutdown_connections 2024-05-15T15:40:03.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.126+0000 7fd4e1a42640 1 -- 172.21.15.12:0/1909622165 >> 172.21.15.12:0/1909622165 conn(0x7fd4d4040d90 msgr2=0x7fd4d40411d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:03.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.126+0000 7fdd29bea640 1 -- 172.21.15.12:0/3374472529 wait complete. 2024-05-15T15:40:03.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.126+0000 7fd4e1a42640 1 -- 172.21.15.12:0/1909622165 shutdown_connections 2024-05-15T15:40:03.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.126+0000 7fd4e1a42640 1 -- 172.21.15.12:0/1909622165 wait complete. 2024-05-15T15:40:03.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.126+0000 7f89b2822640 1 -- 172.21.15.12:0/974422061 shutdown_connections 2024-05-15T15:40:03.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.126+0000 7f89b2822640 1 -- 172.21.15.12:0/974422061 wait complete. 2024-05-15T15:40:03.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.126+0000 7fa2d27fc640 1 -- 172.21.15.12:0/2676914542 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3000500235 0 0) 0x7fa2d40bea40 con 0x7fa2d40be230 2024-05-15T15:40:03.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.127+0000 7fcc3983d640 1 -- 172.21.15.12:0/3930792774 shutdown_connections 2024-05-15T15:40:03.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.127+0000 7fcc3983d640 1 -- 172.21.15.12:0/3930792774 >> 172.21.15.12:0/3930792774 conn(0x7fcc3406d9d0 msgr2=0x7fcc3406dde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:03.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.127+0000 7f8d893ff640 1 -- 172.21.15.12:0/514638819 shutdown_connections 2024-05-15T15:40:03.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.127+0000 7f8d893ff640 1 -- 172.21.15.12:0/514638819 wait complete. 2024-05-15T15:40:03.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.126+0000 7fa2d3fff640 1 -- 172.21.15.12:0/2676914542 >> v2:172.21.15.12:3300/0 conn(0x7fa2d40bd510 msgr2=0x7fa2d40bd920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:40:03.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.127+0000 7fa2d3fff640 1 --2- 172.21.15.12:0/2676914542 >> v2:172.21.15.12:3300/0 conn(0x7fa2d40bd510 0x7fa2d40bd920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:03.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.127+0000 7fcc3983d640 1 -- 172.21.15.12:0/3930792774 shutdown_connections 2024-05-15T15:40:03.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.127+0000 7fa2d3fff640 1 -- 172.21.15.12:0/2676914542 >> v1:172.21.15.12:6789/0 conn(0x7fa2d40be230 legacy=0x7fa2d406dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:03.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.127+0000 7fa2d3fff640 1 -- 172.21.15.12:0/2676914542 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2d40bef90 con 0x7fa2d414ebd0 2024-05-15T15:40:03.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.127+0000 7fa2d2ffd640 1 --2- 172.21.15.12:0/2676914542 >> v2:172.21.15.12:3300/0 conn(0x7fa2d40bd510 0x7fa2d40bd920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-15T15:40:03.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.127+0000 7fcc3983d640 1 -- 172.21.15.12:0/3930792774 wait complete. 2024-05-15T15:40:03.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.128+0000 7fa1425c9640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa13403cf50 0x7fa1340e4750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:03.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.128+0000 7fa1425c9640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa13403d360 0x7fa13401bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:03.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.128+0000 7fa1425c9640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa1340efe70 0x7fa1340ebf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:03.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.128+0000 7fa1425c9640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa13403b300 con 0x7fa13403d360 2024-05-15T15:40:03.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.128+0000 7fdd29bea640 1 Processor -- start 2024-05-15T15:40:03.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.128+0000 7fa1425c9640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa13403d770 con 0x7fa1340efe70 2024-05-15T15:40:03.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.128+0000 7fa1425c9640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fa13403b480 con 0x7fa13403cf50 2024-05-15T15:40:03.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.128+0000 7fa141dc8640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa1340efe70 0x7fa1340ebf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:03.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.129+0000 7fdd29bea640 1 -- start start 2024-05-15T15:40:03.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.128+0000 7fa141dc8640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa1340efe70 0x7fa1340ebf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.12:36018/0 (socket says 172.21.15.12:36018) 2024-05-15T15:40:03.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.128+0000 7fa141dc8640 1 -- 172.21.15.12:0/1385526468 learned_addr learned my addr 172.21.15.12:0/1385526468 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:03.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.129+0000 7fecd2957640 1 -- 172.21.15.12:0/3822723237 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fecc403cf40 msgr2=0x7fecc403ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:03.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.129+0000 7fecd2957640 1 --2- 172.21.15.12:0/3822723237 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fecc403cf40 0x7fecc403ad10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fecb8009860 tx=0x7fecb802a1e0 comp rx=0 tx=0).stop 2024-05-15T15:40:03.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.129+0000 7f89b2822640 1 Processor -- start 2024-05-15T15:40:03.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.129+0000 7fd4e1a42640 1 Processor -- start 2024-05-15T15:40:03.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.129+0000 7fcc3983d640 1 Processor -- start 2024-05-15T15:40:03.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.129+0000 7fecd2957640 1 -- 172.21.15.12:0/3822723237 shutdown_connections 2024-05-15T15:40:03.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.129+0000 7fecd2957640 1 --2- 172.21.15.12:0/3822723237 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fecc40399c0 0x7fecc40e03b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:03.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.129+0000 7fa2d3fff640 1 --2- 172.21.15.12:0/2676914542 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2d414ebd0 0x7fa2d414efe0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa2d408d080 tx=0x7fa2c402a300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a11c948cb2498890 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:03.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.129+0000 7fecd2957640 1 --2- 172.21.15.12:0/3822723237 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fecc403cf40 0x7fecc403ad10 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:03.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.129+0000 7fecd2957640 1 -- 172.21.15.12:0/3822723237 >> 172.21.15.12:0/3822723237 conn(0x7fecc403f670 msgr2=0x7fecc40060d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:03.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.129+0000 7fcc3983d640 1 -- start start 2024-05-15T15:40:03.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.128+0000 7fa140dc6640 1 --2- 172.21.15.12:0/1385526468 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa13403d360 0x7fa13401bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:03.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.129+0000 7fd4e1a42640 1 -- start start 2024-05-15T15:40:03.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.129+0000 7fa141dc8640 1 -- 172.21.15.12:0/1385526468 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa13403cf50 msgr2=0x7fa1340e4750 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-15T15:40:03.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.129+0000 7fa141dc8640 1 --2- 172.21.15.12:0/1385526468 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa13403cf50 0x7fa1340e4750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:03.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.129+0000 7fa141dc8640 1 -- 172.21.15.12:0/1385526468 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa13403d360 msgr2=0x7fa13401bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:03.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.129+0000 7fa141dc8640 1 --2- 172.21.15.12:0/1385526468 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa13403d360 0x7fa13401bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:03.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.129+0000 7fa141dc8640 1 -- 172.21.15.12:0/1385526468 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1340ec970 con 0x7fa1340efe70 2024-05-15T15:40:03.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.129+0000 7f89b2822640 1 -- start start 2024-05-15T15:40:03.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.129+0000 7fa140dc6640 1 --2- 172.21.15.12:0/1385526468 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa13403d360 0x7fa13401bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-15T15:40:03.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.130+0000 7fa2d27fc640 1 -- 172.21.15.12:0/2676914542 <== mon.1 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2c4037070 con 0x7fa2d414ebd0 2024-05-15T15:40:03.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.130+0000 7f8d893ff640 1 Processor -- start 2024-05-15T15:40:03.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.130+0000 7fa2d27fc640 1 -- 172.21.15.12:0/2676914542 <== mon.1 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2c402ae50 con 0x7fa2d414ebd0 2024-05-15T15:40:03.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.130+0000 7f8d893ff640 1 -- start start 2024-05-15T15:40:03.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.130+0000 7fa141dc8640 1 --2- 172.21.15.12:0/1385526468 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa1340efe70 0x7fa1340ebf60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa13c07cfd0 tx=0x7fa13c075e20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:03.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.130+0000 7fa131ffb640 1 -- 172.21.15.12:0/1385526468 <== mon.1 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa13c0aa6b0 con 0x7fa1340efe70 2024-05-15T15:40:03.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.130+0000 7fa131ffb640 1 -- 172.21.15.12:0/1385526468 <== mon.1 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa13c0aa850 con 0x7fa1340efe70 2024-05-15T15:40:03.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.130+0000 7fa131ffb640 1 -- 172.21.15.12:0/1385526468 <== mon.1 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa13c0aac00 con 0x7fa1340efe70 2024-05-15T15:40:03.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.130+0000 7fa1425c9640 1 -- 172.21.15.12:0/1385526468 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1340eab10 con 0x7fa1340efe70 2024-05-15T15:40:03.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.130+0000 7fa1425c9640 1 -- 172.21.15.12:0/1385526468 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1340eb0d0 con 0x7fa1340efe70 2024-05-15T15:40:03.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.130+0000 7fdd29bea640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd240742a0 0x7fdd24149a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:03.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.130+0000 7fdd29bea640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdd2414c960 0x7fdd241ebbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:03.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.131+0000 7fdd29bea640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fdd24152db0 0x7fdd241db8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:03.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.131+0000 7fdd29bea640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fdd2406f890 con 0x7fdd2414c960 2024-05-15T15:40:03.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.131+0000 7fdd29bea640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fdd2406f710 con 0x7fdd240742a0 2024-05-15T15:40:03.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.131+0000 7fdd29bea640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fdd240bc390 con 0x7fdd24152db0 2024-05-15T15:40:03.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.131+0000 7fcc3983d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcc20004800 0x7fcc340a35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:03.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.131+0000 7fcc3983d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcc340a50f0 0x7fcc340a43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:03.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.131+0000 7fdd23fff640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fdd24152db0 0x7fdd241db8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:03.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.131+0000 7fdd23fff640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fdd24152db0 0x7fdd241db8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3301/0 says I am v2:172.21.15.12:37852/0 (socket says 172.21.15.12:37852) 2024-05-15T15:40:03.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.131+0000 7fdd23fff640 1 -- 172.21.15.12:0/384944550 learned_addr learned my addr 172.21.15.12:0/384944550 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:03.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.131+0000 7f89b2822640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89a400b180 0x7f89a40c8db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:03.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.131+0000 7fcc3983d640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fcc34141e90 0x7fcc341422a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:03.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.131+0000 7fcc3983d640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fcc340b7340 con 0x7fcc20004800 2024-05-15T15:40:03.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.131+0000 7f89b2822640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f89a403a130 0x7f89a40ca350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:03.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.131+0000 7fcc3983d640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fcc34073a00 con 0x7fcc340a50f0 2024-05-15T15:40:03.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.131+0000 7fcc3883b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcc20004800 0x7fcc340a35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:03.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.131+0000 7fcc3983d640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fcc340b74c0 con 0x7fcc34141e90 2024-05-15T15:40:03.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.131+0000 7fcc3883b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcc20004800 0x7fcc340a35c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59708/0 (socket says 172.21.15.12:59708) 2024-05-15T15:40:03.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.131+0000 7fcc3883b640 1 -- 172.21.15.12:0/458192410 learned_addr learned my addr 172.21.15.12:0/458192410 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:03.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.131+0000 7fa2d9cc6640 1 -- 172.21.15.12:0/2676914542 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2d414ebd0 msgr2=0x7fa2d414efe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:03.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.131+0000 7fa2d9cc6640 1 --2- 172.21.15.12:0/2676914542 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2d414ebd0 0x7fa2d414efe0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa2d408d080 tx=0x7fa2c402a300 comp rx=0 tx=0).stop 2024-05-15T15:40:03.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.131+0000 7fdd22ffd640 1 --2- 172.21.15.12:0/384944550 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdd2414c960 0x7fdd241ebbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:03.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.131+0000 7f89b1820640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89a400b180 0x7f89a40c8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:03.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.131+0000 7f89b1820640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89a400b180 0x7f89a40c8db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59718/0 (socket says 172.21.15.12:59718) 2024-05-15T15:40:03.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.131+0000 7fdd23fff640 1 -- 172.21.15.12:0/384944550 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd240742a0 msgr2=0x7fdd24149a50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-15T15:40:03.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.131+0000 7fdd23fff640 1 --2- 172.21.15.12:0/384944550 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd240742a0 0x7fdd24149a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:03.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.131+0000 7fdd23fff640 1 -- 172.21.15.12:0/384944550 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdd2414c960 msgr2=0x7fdd241ebbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:03.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.131+0000 7f89b101f640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f89a403a130 0x7f89a40ca350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:03.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.131+0000 7fdd23fff640 1 --2- 172.21.15.12:0/384944550 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdd2414c960 0x7fdd241ebbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:03.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.131+0000 7fdd23fff640 1 -- 172.21.15.12:0/384944550 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd24149f90 con 0x7fdd24152db0 2024-05-15T15:40:03.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.131+0000 7f89b101f640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f89a403a130 0x7f89a40ca350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3301/0 says I am v2:172.21.15.12:37860/0 (socket says 172.21.15.12:37860) 2024-05-15T15:40:03.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.131+0000 7fecd2957640 1 -- 172.21.15.12:0/3822723237 shutdown_connections 2024-05-15T15:40:03.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.131+0000 7f89b2822640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89a40cd800 0x7f89a4031ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:03.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.131+0000 7fecd2957640 1 -- 172.21.15.12:0/3822723237 wait complete. 2024-05-15T15:40:03.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.131+0000 7fdd22ffd640 1 --2- 172.21.15.12:0/384944550 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdd2414c960 0x7fdd241ebbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-15T15:40:03.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.131+0000 7f89b1820640 1 -- 172.21.15.12:0/1765706986 learned_addr learned my addr 172.21.15.12:0/1765706986 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:03.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.132+0000 7f89b2822640 1 -- 172.21.15.12:0/1765706986 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f89a403ad80 con 0x7f89a400b180 2024-05-15T15:40:03.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.132+0000 7f89b2822640 1 -- 172.21.15.12:0/1765706986 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f89a403a540 con 0x7f89a40cd800 2024-05-15T15:40:03.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.132+0000 7f89b2822640 1 -- 172.21.15.12:0/1765706986 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f89a403af00 con 0x7f89a403a130 2024-05-15T15:40:03.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.132+0000 7f89b2021640 1 --2- 172.21.15.12:0/1765706986 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89a40cd800 0x7f89a4031ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:03.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.132+0000 7fdd23fff640 1 --2- 172.21.15.12:0/384944550 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fdd24152db0 0x7fdd241db8f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fdd1c00efc0 tx=0x7fdd1c00c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:03.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.132+0000 7fa2d9cc6640 1 -- 172.21.15.12:0/2676914542 shutdown_connections 2024-05-15T15:40:03.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.132+0000 7fa2d9cc6640 1 --2- 172.21.15.12:0/2676914542 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2d414ebd0 0x7fa2d414efe0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:03.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.132+0000 7fa2d9cc6640 1 --2- 172.21.15.12:0/2676914542 >> v2:172.21.15.12:3300/0 conn(0x7fa2d40bd510 0x7fa2d40bd920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:03.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.132+0000 7fcc3883b640 1 -- 172.21.15.12:0/458192410 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fcc34141e90 msgr2=0x7fcc341422a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-15T15:40:03.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.132+0000 7fcc3883b640 1 --2- 172.21.15.12:0/458192410 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fcc34141e90 0x7fcc341422a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:03.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.132+0000 7fcc3883b640 1 -- 172.21.15.12:0/458192410 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcc340a50f0 msgr2=0x7fcc340a43d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-15T15:40:03.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.132+0000 7fcc3883b640 1 --2- 172.21.15.12:0/458192410 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcc340a50f0 0x7fcc340a43d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:03.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.132+0000 7fa2d9cc6640 1 -- 172.21.15.12:0/2676914542 >> 172.21.15.12:0/2676914542 conn(0x7fa2d40c3cd0 msgr2=0x7fa2d40c40e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:03.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.132+0000 7fcc3883b640 1 -- 172.21.15.12:0/458192410 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc340a4910 con 0x7fcc20004800 2024-05-15T15:40:03.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.132+0000 7fa2d9cc6640 1 -- 172.21.15.12:0/2676914542 shutdown_connections 2024-05-15T15:40:03.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.132+0000 7fdd0bfff640 1 -- 172.21.15.12:0/384944550 <== mon.2 v2:172.21.15.84:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd1c018020 con 0x7fdd24152db0 2024-05-15T15:40:03.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.132+0000 7fdd0bfff640 1 -- 172.21.15.12:0/384944550 <== mon.2 v2:172.21.15.84:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd1c014480 con 0x7fdd24152db0 2024-05-15T15:40:03.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.132+0000 7fdd0bfff640 1 -- 172.21.15.12:0/384944550 <== mon.2 v2:172.21.15.84:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd1c009e60 con 0x7fdd24152db0 2024-05-15T15:40:03.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.132+0000 7fdd29bea640 1 -- 172.21.15.12:0/384944550 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd241ec110 con 0x7fdd24152db0 2024-05-15T15:40:03.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.132+0000 7fdd29bea640 1 -- 172.21.15.12:0/384944550 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd240bdd40 con 0x7fdd24152db0 2024-05-15T15:40:03.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.133+0000 7fcc3883b640 1 --2- 172.21.15.12:0/458192410 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcc20004800 0x7fcc340a35c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c010580 tx=0x7fcc1c010a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:03.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.133+0000 7f8d893ff640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8d7c0408e0 0x7f8d7c0d3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:03.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.133+0000 7f8d893ff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8d7c043040 0x7f8d7c0c64b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:03.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.133+0000 7f8d82ffd640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8d7c0408e0 0x7f8d7c0d3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:03.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.133+0000 7fd4e1a42640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fd4d403a850 0x7fd4d40cb1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:03.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.133+0000 7fa1425c9640 1 -- 172.21.15.12:0/1385526468 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1340054a0 con 0x7fa1340efe70 2024-05-15T15:40:03.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.133+0000 7f8d82ffd640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8d7c0408e0 0x7f8d7c0d3740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3301/0 says I am v2:172.21.15.12:37868/0 (socket says 172.21.15.12:37868) 2024-05-15T15:40:03.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.133+0000 7fd4e1a42640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd4d403c810 0x7fd4d415a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:03.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.133+0000 7f8d827fc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8d7c043040 0x7f8d7c0c64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:03.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.133+0000 7fd4e1a42640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4d403cc20 0x7fd4d40c9bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:03.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.133+0000 7f8d827fc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8d7c043040 0x7f8d7c0c64b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.12:36048/0 (socket says 172.21.15.12:36048) 2024-05-15T15:40:03.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.133+0000 7fd4e1a42640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fd4d403ac60 con 0x7fd4d403c810 2024-05-15T15:40:03.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.132+0000 7f89b1820640 1 -- 172.21.15.12:0/1765706986 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f89a403a130 msgr2=0x7f89a40ca350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:03.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.132+0000 7f89b1820640 1 --2- 172.21.15.12:0/1765706986 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f89a403a130 0x7f89a40ca350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:03.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.132+0000 7f89b1820640 1 -- 172.21.15.12:0/1765706986 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89a40cd800 msgr2=0x7f89a4031ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:03.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.132+0000 7f89b1820640 1 --2- 172.21.15.12:0/1765706986 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89a40cd800 0x7f89a4031ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:03.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.133+0000 7f89b1820640 1 -- 172.21.15.12:0/1765706986 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89a40c92f0 con 0x7f89a400b180 2024-05-15T15:40:03.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.133+0000 7f89b1820640 1 --2- 172.21.15.12:0/1765706986 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89a400b180 0x7f89a40c8db0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f89a8000c00 tx=0x7f89a80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:03.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.133+0000 7fcc317fa640 1 -- 172.21.15.12:0/458192410 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc1c00f040 con 0x7fcc20004800 2024-05-15T15:40:03.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.133+0000 7fcc317fa640 1 -- 172.21.15.12:0/458192410 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc1c014800 con 0x7fcc20004800 2024-05-15T15:40:03.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.133+0000 7fcc317fa640 1 -- 172.21.15.12:0/458192410 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc1c014bd0 con 0x7fcc20004800 2024-05-15T15:40:03.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.134+0000 7fcc3983d640 1 -- 172.21.15.12:0/458192410 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc340a4c10 con 0x7fcc20004800 2024-05-15T15:40:03.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.134+0000 7fcc3983d640 1 -- 172.21.15.12:0/458192410 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc340b6050 con 0x7fcc20004800 2024-05-15T15:40:03.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.134+0000 7fecd2957640 1 Processor -- start 2024-05-15T15:40:03.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.134+0000 7fecd2957640 1 -- start start 2024-05-15T15:40:03.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.134+0000 7fdd29bea640 1 -- 172.21.15.12:0/384944550 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd24050860 con 0x7fdd24152db0 2024-05-15T15:40:03.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.134+0000 7f89a27fc640 1 -- 172.21.15.12:0/1765706986 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89a8041030 con 0x7f89a400b180 2024-05-15T15:40:03.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.134+0000 7f89a27fc640 1 -- 172.21.15.12:0/1765706986 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89a8039040 con 0x7f89a400b180 2024-05-15T15:40:03.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.135+0000 7f89a27fc640 1 -- 172.21.15.12:0/1765706986 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89a8038050 con 0x7f89a400b180 2024-05-15T15:40:03.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.132+0000 7fa2d9cc6640 1 -- 172.21.15.12:0/2676914542 wait complete. 2024-05-15T15:40:03.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.135+0000 7f89b2822640 1 -- 172.21.15.12:0/1765706986 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89a40d1860 con 0x7f89a400b180 2024-05-15T15:40:03.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.135+0000 7f89b2822640 1 -- 172.21.15.12:0/1765706986 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89a4178110 con 0x7f89a400b180 2024-05-15T15:40:03.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.135+0000 7fa2d9cc6640 1 Processor -- start 2024-05-15T15:40:03.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.134+0000 7f8d893ff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8d7c0cb9e0 0x7f8d7c0bb170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:03.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.134+0000 7f8d893ff640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f8d7c0d5370 con 0x7f8d7c0cb9e0 2024-05-15T15:40:03.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.134+0000 7f8d893ff640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f8d7c040cf0 con 0x7f8d7c043040 2024-05-15T15:40:03.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.134+0000 7f8d893ff640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f8d7c0d54f0 con 0x7f8d7c0408e0 2024-05-15T15:40:03.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.134+0000 7f8d82ffd640 1 -- 172.21.15.12:0/288451555 learned_addr learned my addr 172.21.15.12:0/288451555 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:03.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.135+0000 7f8d827fc640 1 -- 172.21.15.12:0/288451555 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8d7c0408e0 msgr2=0x7f8d7c0d3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:03.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.135+0000 7f8d827fc640 1 --2- 172.21.15.12:0/288451555 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8d7c0408e0 0x7f8d7c0d3740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:03.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.135+0000 7f8d827fc640 1 -- 172.21.15.12:0/288451555 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8d7c0cb9e0 msgr2=0x7f8d7c0bb170 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-15T15:40:03.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.135+0000 7f8d827fc640 1 --2- 172.21.15.12:0/288451555 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8d7c0cb9e0 0x7f8d7c0bb170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:03.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.135+0000 7f8d827fc640 1 -- 172.21.15.12:0/288451555 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d7c0d3c80 con 0x7f8d7c043040 2024-05-15T15:40:03.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.135+0000 7fdd0bfff640 1 -- 172.21.15.12:0/384944550 <== mon.2 v2:172.21.15.84:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fdd1c005d10 con 0x7fdd24152db0 2024-05-15T15:40:03.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.136+0000 7fa2d9cc6640 1 -- start start 2024-05-15T15:40:03.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.135+0000 7fa131ffb640 1 -- 172.21.15.12:0/1385526468 <== mon.1 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa13c0b2020 con 0x7fa1340efe70 2024-05-15T15:40:03.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.136+0000 7fecd2957640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fecc40399c0 0x7fecc40d0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:03.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.136+0000 7fdd0bfff640 1 --2- 172.21.15.12:0/384944550 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fdd100763a0 0x7fdd100788b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:03.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.136+0000 7fdd0bfff640 1 -- 172.21.15.12:0/384944550 <== mon.2 v2:172.21.15.84:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fdd1c098340 con 0x7fdd24152db0 2024-05-15T15:40:03.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.136+0000 7fecd2957640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fecc403cf40 0x7fecc40d2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:03.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.136+0000 7fdd237fe640 1 --2- 172.21.15.12:0/384944550 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fdd100763a0 0x7fdd100788b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:03.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.136+0000 7fa131ffb640 1 --2- 172.21.15.12:0/1385526468 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fa1200763a0 0x7fa1200788b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:03.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.136+0000 7feccbfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fecc40399c0 0x7fecc40d0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:03.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.136+0000 7feccbfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fecc40399c0 0x7fecc40d0fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.12:36072/0 (socket says 172.21.15.12:36072) 2024-05-15T15:40:03.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.136+0000 7fecd2957640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fecc40cfc40 0x7fecc401e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:03.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.137+0000 7fecd2957640 1 -- 172.21.15.12:0/2385817368 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fecc4039dd0 con 0x7fecc403cf40 2024-05-15T15:40:03.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.137+0000 7feccbfff640 1 -- 172.21.15.12:0/2385817368 learned_addr learned my addr 172.21.15.12:0/2385817368 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:03.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.137+0000 7fecd2957640 1 -- 172.21.15.12:0/2385817368 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fecc403a440 con 0x7fecc40399c0 2024-05-15T15:40:03.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.137+0000 7fecd2957640 1 -- 172.21.15.12:0/2385817368 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fecc4039f50 con 0x7fecc40cfc40 2024-05-15T15:40:03.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.137+0000 7feccb7fe640 1 --2- 172.21.15.12:0/2385817368 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fecc403cf40 0x7fecc40d2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:03.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.134+0000 7fd4e1a42640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fd4d403a3f0 con 0x7fd4d403cc20 2024-05-15T15:40:03.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.134+0000 7fd4e1a42640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fd4d40d19d0 con 0x7fd4d403a850 2024-05-15T15:40:03.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.134+0000 7fd4dbfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4d403cc20 0x7fd4d40c9bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:03.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.136+0000 7fd4dbfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4d403cc20 0x7fd4d40c9bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.12:36064/0 (socket says 172.21.15.12:36064) 2024-05-15T15:40:03.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.136+0000 7fd4dbfff640 1 -- 172.21.15.12:0/2027102930 learned_addr learned my addr 172.21.15.12:0/2027102930 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:03.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.136+0000 7fd4daffd640 1 --2- 172.21.15.12:0/2027102930 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fd4d403a850 0x7fd4d40cb1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:03.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.136+0000 7fd4dbfff640 1 -- 172.21.15.12:0/2027102930 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fd4d403a850 msgr2=0x7fd4d40cb1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:03.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.136+0000 7fd4dbfff640 1 --2- 172.21.15.12:0/2027102930 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fd4d403a850 0x7fd4d40cb1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:03.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.136+0000 7fd4dbfff640 1 -- 172.21.15.12:0/2027102930 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd4d403c810 msgr2=0x7fd4d415a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:03.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.136+0000 7fd4dbfff640 1 --2- 172.21.15.12:0/2027102930 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd4d403c810 0x7fd4d415a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:03.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.136+0000 7fd4dbfff640 1 -- 172.21.15.12:0/2027102930 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4d416ab30 con 0x7fd4d403cc20 2024-05-15T15:40:03.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.137+0000 7fecd0ef4640 1 --2- 172.21.15.12:0/2385817368 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fecc40cfc40 0x7fecc401e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:03.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.137+0000 7feccbfff640 1 -- 172.21.15.12:0/2385817368 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fecc40cfc40 msgr2=0x7fecc401e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:03.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.137+0000 7feccbfff640 1 --2- 172.21.15.12:0/2385817368 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fecc40cfc40 0x7fecc401e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:03.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.137+0000 7feccbfff640 1 -- 172.21.15.12:0/2385817368 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fecc403cf40 msgr2=0x7fecc40d2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:03.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.137+0000 7feccbfff640 1 --2- 172.21.15.12:0/2385817368 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fecc403cf40 0x7fecc40d2ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:03.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.137+0000 7feccbfff640 1 -- 172.21.15.12:0/2385817368 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecc40d31e0 con 0x7fecc40399c0 2024-05-15T15:40:03.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.137+0000 7fcc2affd640 1 -- 172.21.15.12:0/458192410 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc34050860 con 0x7fcc20004800 2024-05-15T15:40:03.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.137+0000 7fa131ffb640 1 -- 172.21.15.12:0/1385526468 <== mon.1 v2:172.21.15.84:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fa13c123dc0 con 0x7fa1340efe70 2024-05-15T15:40:03.196 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.137+0000 7fd4dbfff640 1 --2- 172.21.15.12:0/2027102930 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4d403cc20 0x7fd4d40c9bd0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd4dc0770f0 tx=0x7fd4dc06ec40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:03.196 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.137+0000 7f89b2822640 1 -- 172.21.15.12:0/1765706986 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89a4005040 con 0x7f89a400b180 2024-05-15T15:40:03.196 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.137+0000 7fa1415c7640 1 --2- 172.21.15.12:0/1385526468 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fa1200763a0 0x7fa1200788b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:03.196 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.137+0000 7fcc317fa640 1 -- 172.21.15.12:0/458192410 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fcc1c01c400 con 0x7fcc20004800 2024-05-15T15:40:03.197 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.137+0000 7fdd237fe640 1 --2- 172.21.15.12:0/384944550 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fdd100763a0 0x7fdd100788b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fdd14034000 tx=0x7fdd1402e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:03.197 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.137+0000 7feccbfff640 1 --2- 172.21.15.12:0/2385817368 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fecc40399c0 0x7fecc40d0fe0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fecb8009860 tx=0x7fecb80046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:03.197 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.138+0000 7f8d827fc640 1 --2- 172.21.15.12:0/288451555 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8d7c043040 0x7f8d7c0c64b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8d7800d600 tx=0x7f8d7800dac0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:03.197 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.138+0000 7fa2d9cc6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2d40bd510 0x7fa2d4150710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:03.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.138+0000 7fcc317fa640 1 --2- 172.21.15.12:0/458192410 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fcc14076320 0x7fcc14078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:03.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.138+0000 7fa1415c7640 1 --2- 172.21.15.12:0/1385526468 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fa1200763a0 0x7fa1200788b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa1340363d0 tx=0x7fa12c007c90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:03.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.138+0000 7fa2d9cc6640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2d40be230 0x7fa2d41499f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:03.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.138+0000 7fa2d37fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2d40bd510 0x7fa2d4150710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:03.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.138+0000 7fcc317fa640 1 -- 172.21.15.12:0/458192410 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fcc1c0979e0 con 0x7fcc20004800 2024-05-15T15:40:03.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.138+0000 7fcc33fff640 1 --2- 172.21.15.12:0/458192410 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fcc14076320 0x7fcc14078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:03.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.138+0000 7fa2d2ffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2d40be230 0x7fa2d41499f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:03.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.138+0000 7fa2d2ffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2d40be230 0x7fa2d41499f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.12:36088/0 (socket says 172.21.15.12:36088) 2024-05-15T15:40:03.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.138+0000 7fa2d2ffd640 1 -- 172.21.15.12:0/1470642464 learned_addr learned my addr 172.21.15.12:0/1470642464 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:03.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.138+0000 7f89a27fc640 1 -- 172.21.15.12:0/1765706986 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f89a8044070 con 0x7f89a400b180 2024-05-15T15:40:03.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.139+0000 7f89a27fc640 1 --2- 172.21.15.12:0/1765706986 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f8990076320 0x7f8990078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:03.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.138+0000 7fa2d37fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2d40bd510 0x7fa2d4150710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59738/0 (socket says 172.21.15.12:59738) 2024-05-15T15:40:03.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.139+0000 7f89a27fc640 1 -- 172.21.15.12:0/1765706986 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f89a80b7c30 con 0x7f89a400b180 2024-05-15T15:40:03.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.139+0000 7fa2d9cc6640 1 --2- 172.21.15.12:0/1470642464 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa2d414ebd0 0x7fa2d41e7480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:03.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.139+0000 7fcc33fff640 1 --2- 172.21.15.12:0/458192410 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fcc14076320 0x7fcc14078830 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fcc2c033000 tx=0x7fcc2c009030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:03.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.139+0000 7f89b101f640 1 --2- 172.21.15.12:0/1765706986 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f8990076320 0x7f8990078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:03.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.139+0000 7fa2d9cc6640 1 -- 172.21.15.12:0/1470642464 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa2d40be640 con 0x7fa2d40bd510 2024-05-15T15:40:03.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.139+0000 7fa2d9cc6640 1 -- 172.21.15.12:0/1470642464 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa2d406ea70 con 0x7fa2d40be230 2024-05-15T15:40:03.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.139+0000 7fa2d3fff640 1 --2- 172.21.15.12:0/1470642464 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa2d414ebd0 0x7fa2d41e7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:03.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.139+0000 7fa2d9cc6640 1 -- 172.21.15.12:0/1470642464 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fa2d408d850 con 0x7fa2d414ebd0 2024-05-15T15:40:03.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.139+0000 7f89b101f640 1 --2- 172.21.15.12:0/1765706986 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f8990076320 0x7f8990078830 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f89a4005d30 tx=0x7f899c009060 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:03.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.139+0000 7fa2d37fe640 1 -- 172.21.15.12:0/1470642464 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa2d414ebd0 msgr2=0x7fa2d41e7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:03.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.139+0000 7fa2d37fe640 1 --2- 172.21.15.12:0/1470642464 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa2d414ebd0 0x7fa2d41e7480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:03.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.139+0000 7fa2d37fe640 1 -- 172.21.15.12:0/1470642464 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2d40be230 msgr2=0x7fa2d41499f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:03.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.139+0000 7fa2d37fe640 1 --2- 172.21.15.12:0/1470642464 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2d40be230 0x7fa2d41499f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:03.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.139+0000 7fa2d37fe640 1 -- 172.21.15.12:0/1470642464 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2d4150c50 con 0x7fa2d40bd510 2024-05-15T15:40:03.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.140+0000 7fa2d2ffd640 1 --2- 172.21.15.12:0/1470642464 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2d40be230 0x7fa2d41499f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-15T15:40:03.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.140+0000 7fa2d37fe640 1 --2- 172.21.15.12:0/1470642464 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2d40bd510 0x7fa2d4150710 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa2cc00c700 tx=0x7fa2cc00cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:03.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.141+0000 7fd4c3fff640 1 -- 172.21.15.12:0/2027102930 <== mon.1 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4dc0768a0 con 0x7fd4d403cc20 2024-05-15T15:40:03.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.141+0000 7fd4c3fff640 1 -- 172.21.15.12:0/2027102930 <== mon.1 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4dc090070 con 0x7fd4d403cc20 2024-05-15T15:40:03.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.141+0000 7fd4c3fff640 1 -- 172.21.15.12:0/2027102930 <== mon.1 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4dc0956b0 con 0x7fd4d403cc20 2024-05-15T15:40:03.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.141+0000 7fecc8ff9640 1 -- 172.21.15.12:0/2385817368 <== mon.1 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecb8037040 con 0x7fecc40399c0 2024-05-15T15:40:03.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.141+0000 7fecc8ff9640 1 -- 172.21.15.12:0/2385817368 <== mon.1 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecb8004230 con 0x7fecc40399c0 2024-05-15T15:40:03.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.141+0000 7fecd2957640 1 -- 172.21.15.12:0/2385817368 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecc416b940 con 0x7fecc40399c0 2024-05-15T15:40:03.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.141+0000 7fecd2957640 1 -- 172.21.15.12:0/2385817368 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecc416bec0 con 0x7fecc40399c0 2024-05-15T15:40:03.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.141+0000 7fa131ffb640 1 -- 172.21.15.12:0/1385526468 <== mon.1 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fa13c0b9020 con 0x7fa1340efe70 2024-05-15T15:40:03.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.142+0000 7fdd0bfff640 1 -- 172.21.15.12:0/384944550 <== mon.2 v2:172.21.15.84:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fdd1c022030 con 0x7fdd24152db0 2024-05-15T15:40:03.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.142+0000 7fd4e1a42640 1 -- 172.21.15.12:0/2027102930 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4d40ca9e0 con 0x7fd4d403cc20 2024-05-15T15:40:03.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.142+0000 7fd4e1a42640 1 -- 172.21.15.12:0/2027102930 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4d40c9490 con 0x7fd4d403cc20 2024-05-15T15:40:03.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.141+0000 7f8d6b7fe640 1 -- 172.21.15.12:0/288451555 <== mon.1 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d78018020 con 0x7f8d7c043040 2024-05-15T15:40:03.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.141+0000 7f8d6b7fe640 1 -- 172.21.15.12:0/288451555 <== mon.1 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d78014620 con 0x7f8d7c043040 2024-05-15T15:40:03.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.141+0000 7f8d6b7fe640 1 -- 172.21.15.12:0/288451555 <== mon.1 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d780149f0 con 0x7f8d7c043040 2024-05-15T15:40:03.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.142+0000 7f8d893ff640 1 -- 172.21.15.12:0/288451555 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d7c0c0c80 con 0x7f8d7c043040 2024-05-15T15:40:03.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.142+0000 7fecc8ff9640 1 -- 172.21.15.12:0/2385817368 <== mon.1 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecb8003610 con 0x7fecc40399c0 2024-05-15T15:40:03.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.143+0000 7f8d893ff640 1 -- 172.21.15.12:0/288451555 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d7c0453b0 con 0x7f8d7c043040 2024-05-15T15:40:03.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.143+0000 7fecd2957640 1 -- 172.21.15.12:0/2385817368 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fecc4006610 con 0x7fecc40399c0 2024-05-15T15:40:03.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.143+0000 7fd4e1a42640 1 -- 172.21.15.12:0/2027102930 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4d415af90 con 0x7fd4d403cc20 2024-05-15T15:40:03.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.144+0000 7fecc8ff9640 1 -- 172.21.15.12:0/2385817368 <== mon.1 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fecb80037b0 con 0x7fecc40399c0 2024-05-15T15:40:03.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.144+0000 7f8d893ff640 1 -- 172.21.15.12:0/288451555 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d7c008390 con 0x7f8d7c043040 2024-05-15T15:40:03.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.144+0000 7fecc8ff9640 1 --2- 172.21.15.12:0/2385817368 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fecb0076350 0x7fecb0078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:03.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.145+0000 7fecc8ff9640 1 -- 172.21.15.12:0/2385817368 <== mon.1 v2:172.21.15.84:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fecb80b7fe0 con 0x7fecc40399c0 2024-05-15T15:40:03.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.145+0000 7feccb7fe640 1 --2- 172.21.15.12:0/2385817368 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fecb0076350 0x7fecb0078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:03.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.145+0000 7fd4c3fff640 1 -- 172.21.15.12:0/2027102930 <== mon.1 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd4dc095850 con 0x7fd4d403cc20 2024-05-15T15:40:03.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.145+0000 7f8d6b7fe640 1 -- 172.21.15.12:0/288451555 <== mon.1 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8d7801b020 con 0x7f8d7c043040 2024-05-15T15:40:03.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.145+0000 7feccb7fe640 1 --2- 172.21.15.12:0/2385817368 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fecb0076350 0x7fecb0078860 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fecc40d3b10 tx=0x7fecc0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:03.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.145+0000 7fd4c3fff640 1 --2- 172.21.15.12:0/2027102930 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fd4c80762d0 0x7fd4c80787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:03.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.146+0000 7fd4daffd640 1 --2- 172.21.15.12:0/2027102930 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fd4c80762d0 0x7fd4c80787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:03.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.146+0000 7fd4c3fff640 1 -- 172.21.15.12:0/2027102930 <== mon.1 v2:172.21.15.84:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fd4dc113db0 con 0x7fd4d403cc20 2024-05-15T15:40:03.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.146+0000 7f8d6b7fe640 1 --2- 172.21.15.12:0/288451555 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f8d70076320 0x7f8d70078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:03.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.146+0000 7f8d6b7fe640 1 -- 172.21.15.12:0/288451555 <== mon.1 v2:172.21.15.84:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f8d78097960 con 0x7f8d7c043040 2024-05-15T15:40:03.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.146+0000 7fcc317fa640 1 -- 172.21.15.12:0/458192410 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fcc1c018030 con 0x7fcc20004800 2024-05-15T15:40:03.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.147+0000 7fd4daffd640 1 --2- 172.21.15.12:0/2027102930 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fd4c80762d0 0x7fd4c80787e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd4cc009aa0 tx=0x7fd4cc009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:03.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.148+0000 7f8d82ffd640 1 --2- 172.21.15.12:0/288451555 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f8d70076320 0x7f8d70078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:03.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.148+0000 7f8d82ffd640 1 --2- 172.21.15.12:0/288451555 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f8d70076320 0x7f8d70078830 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8d74007a60 tx=0x7f8d74008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:03.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.149+0000 7fecc8ff9640 1 -- 172.21.15.12:0/2385817368 <== mon.1 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fecb8081920 con 0x7fecc40399c0 2024-05-15T15:40:03.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.151+0000 7fa2bbfff640 1 -- 172.21.15.12:0/1470642464 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2cc017070 con 0x7fa2d40bd510 2024-05-15T15:40:03.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.151+0000 7fa2bbfff640 1 -- 172.21.15.12:0/1470642464 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2cc003b90 con 0x7fa2d40bd510 2024-05-15T15:40:03.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.151+0000 7fa2d9cc6640 1 -- 172.21.15.12:0/1470642464 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2d414f990 con 0x7fa2d40bd510 2024-05-15T15:40:03.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.152+0000 7f89a27fc640 1 -- 172.21.15.12:0/1765706986 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f89a4005040 con 0x7f89a400b180 2024-05-15T15:40:03.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.152+0000 7fa2d9cc6640 1 -- 172.21.15.12:0/1470642464 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2d4151bb0 con 0x7fa2d40bd510 2024-05-15T15:40:03.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.153+0000 7fa2bbfff640 1 -- 172.21.15.12:0/1470642464 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2cc005070 con 0x7fa2d40bd510 2024-05-15T15:40:03.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.154+0000 7fa2d9cc6640 1 -- 172.21.15.12:0/1470642464 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2d40ba640 con 0x7fa2d40bd510 2024-05-15T15:40:03.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.154+0000 7fa2bbfff640 1 -- 172.21.15.12:0/1470642464 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa2cc01a070 con 0x7fa2d40bd510 2024-05-15T15:40:03.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.154+0000 7fd4c3fff640 1 -- 172.21.15.12:0/2027102930 <== mon.1 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fd4dc118070 con 0x7fd4d403cc20 2024-05-15T15:40:03.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.155+0000 7fa2bbfff640 1 --2- 172.21.15.12:0/1470642464 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fa2c0076300 0x7fa2c0078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:03.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.155+0000 7fa2bbfff640 1 -- 172.21.15.12:0/1470642464 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fa2cc096af0 con 0x7fa2d40bd510 2024-05-15T15:40:03.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.156+0000 7fa2d2ffd640 1 --2- 172.21.15.12:0/1470642464 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fa2c0076300 0x7fa2c0078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:03.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.156+0000 7fa2d2ffd640 1 --2- 172.21.15.12:0/1470642464 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fa2c0076300 0x7fa2c0078810 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa2d40b99d0 tx=0x7fa2c8009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:03.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.162+0000 7f8d6b7fe640 1 -- 172.21.15.12:0/288451555 <== mon.1 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f8d7c008390 con 0x7f8d7c043040 2024-05-15T15:40:03.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.165+0000 7fa2bbfff640 1 -- 172.21.15.12:0/1470642464 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fa2cc05fe00 con 0x7fa2d40bd510 2024-05-15T15:40:03.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.590+0000 7fecd2957640 1 -- 172.21.15.12:0/2385817368 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fecc401fa00 con 0x7fecc40399c0 2024-05-15T15:40:03.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.590+0000 7fdd29bea640 1 -- 172.21.15.12:0/384944550 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fdd2414ffc0 con 0x7fdd24152db0 2024-05-15T15:40:03.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.591+0000 7fdd0bfff640 1 -- 172.21.15.12:0/384944550 <== mon.2 v2:172.21.15.84:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fdd1c010040 con 0x7fdd24152db0 2024-05-15T15:40:03.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.591+0000 7fecc8ff9640 1 -- 172.21.15.12:0/2385817368 <== mon.1 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fecb8081220 con 0x7fecc40399c0 2024-05-15T15:40:03.593 INFO:teuthology.orchestra.run.smithi012.stdout:64424509446 2024-05-15T15:40:03.594 INFO:teuthology.orchestra.run.smithi012.stdout:64424509447 2024-05-15T15:40:03.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.593+0000 7fa1425c9640 1 -- 172.21.15.12:0/1385526468 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fa134039b10 con 0x7fa1340efe70 2024-05-15T15:40:03.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.593+0000 7fa131ffb640 1 -- 172.21.15.12:0/1385526468 <== mon.1 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa13c0ed790 con 0x7fa1340efe70 2024-05-15T15:40:03.595 INFO:teuthology.orchestra.run.smithi012.stdout:55834574855 2024-05-15T15:40:03.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.594+0000 7fecd2957640 1 -- 172.21.15.12:0/2385817368 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fecb0076350 msgr2=0x7fecb0078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:03.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.594+0000 7fecd2957640 1 --2- 172.21.15.12:0/2385817368 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fecb0076350 0x7fecb0078860 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fecc40d3b10 tx=0x7fecc0009040 comp rx=0 tx=0).stop 2024-05-15T15:40:03.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.594+0000 7fecd2957640 1 -- 172.21.15.12:0/2385817368 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fecc40399c0 msgr2=0x7fecc40d0fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:03.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.595+0000 7fdd29bea640 1 -- 172.21.15.12:0/384944550 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fdd100763a0 msgr2=0x7fdd100788b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:03.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.595+0000 7fecd2957640 1 --2- 172.21.15.12:0/2385817368 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fecc40399c0 0x7fecc40d0fe0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fecb8009860 tx=0x7fecb80046c0 comp rx=0 tx=0).stop 2024-05-15T15:40:03.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.595+0000 7fdd29bea640 1 --2- 172.21.15.12:0/384944550 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fdd100763a0 0x7fdd100788b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fdd14034000 tx=0x7fdd1402e000 comp rx=0 tx=0).stop 2024-05-15T15:40:03.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.595+0000 7fecd2957640 1 -- 172.21.15.12:0/2385817368 shutdown_connections 2024-05-15T15:40:03.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.595+0000 7fecd2957640 1 --2- 172.21.15.12:0/2385817368 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fecc40cfc40 0x7fecc401e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:03.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.595+0000 7fecd2957640 1 --2- 172.21.15.12:0/2385817368 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fecb0076350 0x7fecb0078860 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:03.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.595+0000 7fecd2957640 1 --2- 172.21.15.12:0/2385817368 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fecc403cf40 0x7fecc40d2ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:03.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.595+0000 7fecd2957640 1 --2- 172.21.15.12:0/2385817368 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fecc40399c0 0x7fecc40d0fe0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:03.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.595+0000 7fecd2957640 1 -- 172.21.15.12:0/2385817368 >> 172.21.15.12:0/2385817368 conn(0x7fecc403f670 msgr2=0x7fecc40cc820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:03.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.595+0000 7fdd29bea640 1 -- 172.21.15.12:0/384944550 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fdd24152db0 msgr2=0x7fdd241db8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:03.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.595+0000 7fdd29bea640 1 --2- 172.21.15.12:0/384944550 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fdd24152db0 0x7fdd241db8f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fdd1c00efc0 tx=0x7fdd1c00c490 comp rx=0 tx=0).stop 2024-05-15T15:40:03.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.595+0000 7fecd2957640 1 -- 172.21.15.12:0/2385817368 shutdown_connections 2024-05-15T15:40:03.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.595+0000 7fecd2957640 1 -- 172.21.15.12:0/2385817368 wait complete. 2024-05-15T15:40:03.600 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.595+0000 7fdd29bea640 1 -- 172.21.15.12:0/384944550 shutdown_connections 2024-05-15T15:40:03.600 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.595+0000 7fdd29bea640 1 --2- 172.21.15.12:0/384944550 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fdd24152db0 0x7fdd241db8f0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:03.600 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.595+0000 7fdd29bea640 1 --2- 172.21.15.12:0/384944550 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fdd100763a0 0x7fdd100788b0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:03.600 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.595+0000 7fdd29bea640 1 --2- 172.21.15.12:0/384944550 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdd2414c960 0x7fdd241ebbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:03.600 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.595+0000 7fdd29bea640 1 --2- 172.21.15.12:0/384944550 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd240742a0 0x7fdd24149a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:03.600 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.595+0000 7fdd29bea640 1 -- 172.21.15.12:0/384944550 >> 172.21.15.12:0/384944550 conn(0x7fdd2406d700 msgr2=0x7fdd240b5ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:03.600 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.596+0000 7fdd29bea640 1 -- 172.21.15.12:0/384944550 shutdown_connections 2024-05-15T15:40:03.600 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.596+0000 7fdd29bea640 1 -- 172.21.15.12:0/384944550 wait complete. 2024-05-15T15:40:03.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.597+0000 7fa1277fe640 1 -- 172.21.15.12:0/1385526468 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fa1200763a0 msgr2=0x7fa1200788b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:03.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.597+0000 7fa1277fe640 1 --2- 172.21.15.12:0/1385526468 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fa1200763a0 0x7fa1200788b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa1340363d0 tx=0x7fa12c007c90 comp rx=0 tx=0).stop 2024-05-15T15:40:03.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.597+0000 7fa1277fe640 1 -- 172.21.15.12:0/1385526468 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa1340efe70 msgr2=0x7fa1340ebf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:03.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.597+0000 7fa1277fe640 1 --2- 172.21.15.12:0/1385526468 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa1340efe70 0x7fa1340ebf60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa13c07cfd0 tx=0x7fa13c075e20 comp rx=0 tx=0).stop 2024-05-15T15:40:03.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.597+0000 7fa1277fe640 1 -- 172.21.15.12:0/1385526468 shutdown_connections 2024-05-15T15:40:03.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.597+0000 7fa1277fe640 1 --2- 172.21.15.12:0/1385526468 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa1340efe70 0x7fa1340ebf60 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:03.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.597+0000 7fa1277fe640 1 --2- 172.21.15.12:0/1385526468 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fa1200763a0 0x7fa1200788b0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:03.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.597+0000 7fa1277fe640 1 --2- 172.21.15.12:0/1385526468 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa13403d360 0x7fa13401bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:03.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.597+0000 7fa1277fe640 1 --2- 172.21.15.12:0/1385526468 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa13403cf50 0x7fa1340e4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:03.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.597+0000 7fa1277fe640 1 -- 172.21.15.12:0/1385526468 >> 172.21.15.12:0/1385526468 conn(0x7fa13403f230 msgr2=0x7fa1340e8370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:03.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.597+0000 7fa1277fe640 1 -- 172.21.15.12:0/1385526468 shutdown_connections 2024-05-15T15:40:03.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.597+0000 7fa1277fe640 1 -- 172.21.15.12:0/1385526468 wait complete. 2024-05-15T15:40:03.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.602+0000 7f89b2822640 1 -- 172.21.15.12:0/1765706986 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f89a40068a0 con 0x7f89a400b180 2024-05-15T15:40:03.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.603+0000 7f89a27fc640 1 -- 172.21.15.12:0/1765706986 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f89a8081020 con 0x7f89a400b180 2024-05-15T15:40:03.608 INFO:teuthology.orchestra.run.smithi012.stdout:64424509446 2024-05-15T15:40:03.608 INFO:teuthology.orchestra.run.smithi012.stdout:64424509446 2024-05-15T15:40:03.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.604+0000 7fcc2affd640 1 -- 172.21.15.12:0/458192410 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fcc34150040 con 0x7fcc20004800 2024-05-15T15:40:03.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.605+0000 7fcc317fa640 1 -- 172.21.15.12:0/458192410 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fcc1c0612a0 con 0x7fcc20004800 2024-05-15T15:40:03.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.606+0000 7fd4e1a42640 1 -- 172.21.15.12:0/2027102930 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fd4d4006da0 con 0x7fd4d403cc20 2024-05-15T15:40:03.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.607+0000 7fd4c3fff640 1 -- 172.21.15.12:0/2027102930 <== mon.1 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd4dc0dd5e0 con 0x7fd4d403cc20 2024-05-15T15:40:03.609 INFO:teuthology.orchestra.run.smithi012.stdout:64424509447 2024-05-15T15:40:03.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.607+0000 7f89b2822640 1 -- 172.21.15.12:0/1765706986 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f8990076320 msgr2=0x7f8990078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:03.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.607+0000 7f89b2822640 1 --2- 172.21.15.12:0/1765706986 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f8990076320 0x7f8990078830 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f89a4005d30 tx=0x7f899c009060 comp rx=0 tx=0).stop 2024-05-15T15:40:03.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.607+0000 7f89b2822640 1 -- 172.21.15.12:0/1765706986 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89a400b180 msgr2=0x7f89a40c8db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:03.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.607+0000 7f89b2822640 1 --2- 172.21.15.12:0/1765706986 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89a400b180 0x7f89a40c8db0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f89a8000c00 tx=0x7f89a80046c0 comp rx=0 tx=0).stop 2024-05-15T15:40:03.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.608+0000 7f89b2822640 1 -- 172.21.15.12:0/1765706986 shutdown_connections 2024-05-15T15:40:03.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.608+0000 7f89b2822640 1 --2- 172.21.15.12:0/1765706986 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89a40cd800 0x7f89a4031ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:03.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.608+0000 7f89b2822640 1 --2- 172.21.15.12:0/1765706986 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f89a403a130 0x7f89a40ca350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:03.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.608+0000 7f89b2822640 1 --2- 172.21.15.12:0/1765706986 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f8990076320 0x7f8990078830 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:03.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.608+0000 7f89b2822640 1 --2- 172.21.15.12:0/1765706986 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89a400b180 0x7f89a40c8db0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:03.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.608+0000 7f89b2822640 1 -- 172.21.15.12:0/1765706986 >> 172.21.15.12:0/1765706986 conn(0x7f89a403f670 msgr2=0x7f89a4004930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:03.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.608+0000 7f89b2822640 1 -- 172.21.15.12:0/1765706986 shutdown_connections 2024-05-15T15:40:03.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.608+0000 7f89b2822640 1 -- 172.21.15.12:0/1765706986 wait complete. 2024-05-15T15:40:03.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.609+0000 7fcc2affd640 1 -- 172.21.15.12:0/458192410 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fcc14076320 msgr2=0x7fcc14078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:03.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.609+0000 7fcc2affd640 1 --2- 172.21.15.12:0/458192410 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fcc14076320 0x7fcc14078830 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fcc2c033000 tx=0x7fcc2c009030 comp rx=0 tx=0).stop 2024-05-15T15:40:03.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.609+0000 7fcc2affd640 1 -- 172.21.15.12:0/458192410 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcc20004800 msgr2=0x7fcc340a35c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:03.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.609+0000 7fcc2affd640 1 --2- 172.21.15.12:0/458192410 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcc20004800 0x7fcc340a35c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c010580 tx=0x7fcc1c010a40 comp rx=0 tx=0).stop 2024-05-15T15:40:03.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.609+0000 7fcc2affd640 1 -- 172.21.15.12:0/458192410 shutdown_connections 2024-05-15T15:40:03.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.609+0000 7fcc2affd640 1 --2- 172.21.15.12:0/458192410 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fcc34141e90 0x7fcc341422a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:03.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.609+0000 7fcc2affd640 1 --2- 172.21.15.12:0/458192410 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcc340a50f0 0x7fcc340a43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:03.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.609+0000 7fcc2affd640 1 --2- 172.21.15.12:0/458192410 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fcc14076320 0x7fcc14078830 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:03.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.609+0000 7fcc2affd640 1 --2- 172.21.15.12:0/458192410 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcc20004800 0x7fcc340a35c0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:03.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.609+0000 7fcc2affd640 1 -- 172.21.15.12:0/458192410 >> 172.21.15.12:0/458192410 conn(0x7fcc3406d9d0 msgr2=0x7fcc340be210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:03.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.609+0000 7fcc2affd640 1 -- 172.21.15.12:0/458192410 shutdown_connections 2024-05-15T15:40:03.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.609+0000 7f8d893ff640 1 -- 172.21.15.12:0/288451555 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f8d7c0d30a0 con 0x7f8d7c043040 2024-05-15T15:40:03.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.609+0000 7fcc2affd640 1 -- 172.21.15.12:0/458192410 wait complete. 2024-05-15T15:40:03.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.610+0000 7f8d6b7fe640 1 -- 172.21.15.12:0/288451555 <== mon.1 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8d78022020 con 0x7f8d7c043040 2024-05-15T15:40:03.614 INFO:teuthology.orchestra.run.smithi012.stdout:64424509446 2024-05-15T15:40:03.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.612+0000 7fd4e1a42640 1 -- 172.21.15.12:0/2027102930 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fd4c80762d0 msgr2=0x7fd4c80787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:03.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.613+0000 7fd4e1a42640 1 --2- 172.21.15.12:0/2027102930 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fd4c80762d0 0x7fd4c80787e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd4cc009aa0 tx=0x7fd4cc009190 comp rx=0 tx=0).stop 2024-05-15T15:40:03.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.613+0000 7fd4e1a42640 1 -- 172.21.15.12:0/2027102930 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4d403cc20 msgr2=0x7fd4d40c9bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:03.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.613+0000 7fd4e1a42640 1 --2- 172.21.15.12:0/2027102930 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4d403cc20 0x7fd4d40c9bd0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd4dc0770f0 tx=0x7fd4dc06ec40 comp rx=0 tx=0).stop 2024-05-15T15:40:03.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.613+0000 7fd4e1a42640 1 -- 172.21.15.12:0/2027102930 shutdown_connections 2024-05-15T15:40:03.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.613+0000 7fd4e1a42640 1 --2- 172.21.15.12:0/2027102930 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4d403cc20 0x7fd4d40c9bd0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:03.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.613+0000 7fd4e1a42640 1 --2- 172.21.15.12:0/2027102930 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fd4c80762d0 0x7fd4c80787e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:03.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.613+0000 7fd4e1a42640 1 --2- 172.21.15.12:0/2027102930 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd4d403c810 0x7fd4d415a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:03.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.613+0000 7fd4e1a42640 1 --2- 172.21.15.12:0/2027102930 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fd4d403a850 0x7fd4d40cb1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:03.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.613+0000 7fd4e1a42640 1 -- 172.21.15.12:0/2027102930 >> 172.21.15.12:0/2027102930 conn(0x7fd4d4040d90 msgr2=0x7fd4d403edc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:03.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.613+0000 7fd4e1a42640 1 -- 172.21.15.12:0/2027102930 shutdown_connections 2024-05-15T15:40:03.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.613+0000 7fd4e1a42640 1 -- 172.21.15.12:0/2027102930 wait complete. 2024-05-15T15:40:03.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.615+0000 7f8d697fa640 1 -- 172.21.15.12:0/288451555 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f8d70076320 msgr2=0x7f8d70078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:03.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.615+0000 7f8d697fa640 1 --2- 172.21.15.12:0/288451555 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f8d70076320 0x7f8d70078830 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8d74007a60 tx=0x7f8d74008040 comp rx=0 tx=0).stop 2024-05-15T15:40:03.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.615+0000 7f8d697fa640 1 -- 172.21.15.12:0/288451555 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8d7c043040 msgr2=0x7f8d7c0c64b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:03.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.615+0000 7f8d697fa640 1 --2- 172.21.15.12:0/288451555 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8d7c043040 0x7f8d7c0c64b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8d7800d600 tx=0x7f8d7800dac0 comp rx=0 tx=0).stop 2024-05-15T15:40:03.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.615+0000 7f8d697fa640 1 -- 172.21.15.12:0/288451555 shutdown_connections 2024-05-15T15:40:03.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.615+0000 7f8d697fa640 1 --2- 172.21.15.12:0/288451555 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f8d70076320 0x7f8d70078830 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:03.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.615+0000 7f8d697fa640 1 --2- 172.21.15.12:0/288451555 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8d7c0cb9e0 0x7f8d7c0bb170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:03.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.615+0000 7f8d697fa640 1 --2- 172.21.15.12:0/288451555 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8d7c043040 0x7f8d7c0c64b0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:03.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.615+0000 7f8d697fa640 1 --2- 172.21.15.12:0/288451555 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8d7c0408e0 0x7f8d7c0d3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:03.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.615+0000 7f8d697fa640 1 -- 172.21.15.12:0/288451555 >> 172.21.15.12:0/288451555 conn(0x7f8d7c043650 msgr2=0x7f8d7c004b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:03.619 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509447 for osd.1 2024-05-15T15:40:03.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.616+0000 7f8d697fa640 1 -- 172.21.15.12:0/288451555 shutdown_connections 2024-05-15T15:40:03.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.616+0000 7f8d697fa640 1 -- 172.21.15.12:0/288451555 wait complete. 2024-05-15T15:40:03.620 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.0 2024-05-15T15:40:03.621 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.4 2024-05-15T15:40:03.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.622+0000 7fa2d9cc6640 1 -- 172.21.15.12:0/1470642464 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fa2d40c3610 con 0x7fa2d40bd510 2024-05-15T15:40:03.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.622+0000 7fa2bbfff640 1 -- 172.21.15.12:0/1470642464 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa2cc064100 con 0x7fa2d40bd510 2024-05-15T15:40:03.624 INFO:teuthology.orchestra.run.smithi012.stdout:64424509446 2024-05-15T15:40:03.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.626+0000 7fa2d9cc6640 1 -- 172.21.15.12:0/1470642464 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fa2c0076300 msgr2=0x7fa2c0078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:03.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.626+0000 7fa2d9cc6640 1 --2- 172.21.15.12:0/1470642464 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fa2c0076300 0x7fa2c0078810 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa2d40b99d0 tx=0x7fa2c8009190 comp rx=0 tx=0).stop 2024-05-15T15:40:03.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.626+0000 7fa2d9cc6640 1 -- 172.21.15.12:0/1470642464 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2d40bd510 msgr2=0x7fa2d4150710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:03.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.626+0000 7fa2d9cc6640 1 --2- 172.21.15.12:0/1470642464 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2d40bd510 0x7fa2d4150710 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa2cc00c700 tx=0x7fa2cc00cbc0 comp rx=0 tx=0).stop 2024-05-15T15:40:03.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.626+0000 7fa2d9cc6640 1 -- 172.21.15.12:0/1470642464 shutdown_connections 2024-05-15T15:40:03.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.626+0000 7fa2d9cc6640 1 --2- 172.21.15.12:0/1470642464 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa2d414ebd0 0x7fa2d41e7480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:03.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.626+0000 7fa2d9cc6640 1 --2- 172.21.15.12:0/1470642464 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2d40be230 0x7fa2d41499f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:03.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.626+0000 7fa2d9cc6640 1 --2- 172.21.15.12:0/1470642464 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fa2c0076300 0x7fa2c0078810 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:03.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.626+0000 7fa2d9cc6640 1 --2- 172.21.15.12:0/1470642464 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2d40bd510 0x7fa2d4150710 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:03.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.626+0000 7fa2d9cc6640 1 -- 172.21.15.12:0/1470642464 >> 172.21.15.12:0/1470642464 conn(0x7fa2d40c3cd0 msgr2=0x7fa2d40bd920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:03.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.626+0000 7fa2d9cc6640 1 -- 172.21.15.12:0/1470642464 shutdown_connections 2024-05-15T15:40:03.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:03.626+0000 7fa2d9cc6640 1 -- 172.21.15.12:0/1470642464 wait complete. 2024-05-15T15:40:03.630 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.2 2024-05-15T15:40:03.631 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.7 2024-05-15T15:40:03.635 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509447 for osd.5 2024-05-15T15:40:03.635 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.3 2024-05-15T15:40:03.640 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.6 2024-05-15T15:40:04.620 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-15T15:40:04.621 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-15T15:40:04.621 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-05-15T15:40:04.630 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-15T15:40:04.632 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-05-15T15:40:04.636 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-05-15T15:40:04.636 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-15T15:40:04.641 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-05-15T15:40:04.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.812+0000 7f7421b94640 1 Processor -- start 2024-05-15T15:40:04.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.812+0000 7f7421b94640 1 -- start start 2024-05-15T15:40:04.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.815+0000 7f7421b94640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f741c144830 0x7f741c14ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:04.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.815+0000 7f7421b94640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f741c0a0dc0 0x7f741c0b4500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:04.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.815+0000 7f7421b94640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f741c0b6010 con 0x7f741c074760 2024-05-15T15:40:04.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.815+0000 7f7421b94640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f741c14a800 con 0x7f741c144830 2024-05-15T15:40:04.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.815+0000 7f7421b94640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f741c0b62b0 con 0x7f741c0a0dc0 2024-05-15T15:40:04.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.812+0000 7f4a1cf47640 1 Processor -- start 2024-05-15T15:40:04.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.816+0000 7f741b7fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f741c144830 0x7f741c14ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:04.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.816+0000 7f741b7fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f741c144830 0x7f741c14ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59752/0 (socket says 172.21.15.12:59752) 2024-05-15T15:40:04.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.816+0000 7f741b7fe640 1 -- 172.21.15.12:0/1846360882 learned_addr learned my addr 172.21.15.12:0/1846360882 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:04.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.816+0000 7f741affd640 1 --2- 172.21.15.12:0/1846360882 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f741c0a0dc0 0x7f741c0b4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:04.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.812+0000 7f4a1cf47640 1 -- start start 2024-05-15T15:40:04.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.815+0000 7f4a1cf47640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4a180ba2e0 0x7f4a18153160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:04.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.816+0000 7f741a7fc640 1 -- 172.21.15.12:0/1846360882 <== mon.1 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3566617847 0 0) 0x7f741c0b6010 con 0x7f741c074760 2024-05-15T15:40:04.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.817+0000 7f741a7fc640 1 -- 172.21.15.12:0/1846360882 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7404003520 con 0x7f741c074760 2024-05-15T15:40:04.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.815+0000 7f4a1cf47640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4a181536a0 0x7f4a1815d250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:04.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.815+0000 7f4a1cf47640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a180ba6f0 con 0x7f4a180b62d0 2024-05-15T15:40:04.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.815+0000 7f4a1cf47640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f4a180b66e0 con 0x7f4a181536a0 2024-05-15T15:40:04.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.815+0000 7f4a1cf47640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f4a180b55a0 con 0x7f4a180ba2e0 2024-05-15T15:40:04.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.817+0000 7f741b7fe640 1 -- 172.21.15.12:0/1846360882 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f741c0a0dc0 msgr2=0x7f741c0b4500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:40:04.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.817+0000 7f741b7fe640 1 --2- 172.21.15.12:0/1846360882 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f741c0a0dc0 0x7f741c0b4500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:04.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.817+0000 7f741b7fe640 1 -- 172.21.15.12:0/1846360882 >> v1:172.21.15.84:6789/0 conn(0x7f741c074760 legacy=0x7f741c14d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:04.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.815+0000 7f4a1659c640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f4a180b62d0 0x7f4a1806d0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:45276/0 (socket says 172.21.15.12:45276) 2024-05-15T15:40:04.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.815+0000 7f4a1659c640 1 -- 172.21.15.12:0/3949809499 learned_addr learned my addr 172.21.15.12:0/3949809499 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-05-15T15:40:04.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.815+0000 7f4a15d9b640 1 --2- 172.21.15.12:0/3949809499 >> v2:172.21.15.84:3300/0 conn(0x7f4a180ba2e0 0x7f4a18153160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:04.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.815+0000 7f4a16d9d640 1 --2- 172.21.15.12:0/3949809499 >> v2:172.21.15.12:3300/0 conn(0x7f4a181536a0 0x7f4a1815d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:04.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.816+0000 7f4a1559a640 1 -- 172.21.15.12:0/3949809499 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 279142208 0 0) 0x7f4a0c001110 con 0x7f4a180b62d0 2024-05-15T15:40:04.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.816+0000 7f4a1559a640 1 -- 172.21.15.12:0/3949809499 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4a00003520 con 0x7f4a180b62d0 2024-05-15T15:40:04.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.817+0000 7f741a7fc640 1 -- 172.21.15.12:0/1846360882 <== mon.1 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3972943330 0 0) 0x7f7404003520 con 0x7f741c074760 2024-05-15T15:40:04.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.817+0000 7f4a16d9d640 1 -- 172.21.15.12:0/3949809499 >> v2:172.21.15.84:3300/0 conn(0x7f4a180ba2e0 msgr2=0x7f4a18153160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:40:04.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.817+0000 7f4a16d9d640 1 --2- 172.21.15.12:0/3949809499 >> v2:172.21.15.84:3300/0 conn(0x7f4a180ba2e0 0x7f4a18153160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:04.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.817+0000 7f4a16d9d640 1 -- 172.21.15.12:0/3949809499 >> v1:172.21.15.12:6789/0 conn(0x7f4a180b62d0 legacy=0x7f4a1806d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:04.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.817+0000 7f4a16d9d640 1 -- 172.21.15.12:0/3949809499 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a180a0d40 con 0x7f4a181536a0 2024-05-15T15:40:04.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.817+0000 7f741b7fe640 1 -- 172.21.15.12:0/1846360882 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f741c14a490 con 0x7f741c144830 2024-05-15T15:40:04.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.819+0000 7f4a16d9d640 1 --2- 172.21.15.12:0/3949809499 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a181536a0 0x7f4a1815d250 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f4a180b68b0 tx=0x7f4a0802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e15f1f5e528fe47b server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:04.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.819+0000 7f741b7fe640 1 --2- 172.21.15.12:0/1846360882 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f741c144830 0x7f741c14ac90 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f740c008870 tx=0x7f740c02c7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79a0ba9367f12e24 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:04.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.820+0000 7f741a7fc640 1 -- 172.21.15.12:0/1846360882 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f740c03a070 con 0x7f741c144830 2024-05-15T15:40:04.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.820+0000 7f4a1559a640 1 -- 172.21.15.12:0/3949809499 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a08037070 con 0x7f4a181536a0 2024-05-15T15:40:04.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.820+0000 7f4a1559a640 1 -- 172.21.15.12:0/3949809499 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a08032440 con 0x7f4a181536a0 2024-05-15T15:40:04.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.820+0000 7f4a1559a640 1 -- 172.21.15.12:0/3949809499 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a08032850 con 0x7f4a181536a0 2024-05-15T15:40:04.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.820+0000 7f741a7fc640 1 -- 172.21.15.12:0/1846360882 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f740c032480 con 0x7f741c144830 2024-05-15T15:40:04.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.821+0000 7f741a7fc640 1 -- 172.21.15.12:0/1846360882 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7414001a70 con 0x7f741c144830 2024-05-15T15:40:04.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.817+0000 7f895577a640 1 Processor -- start 2024-05-15T15:40:04.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.817+0000 7f895577a640 1 -- start start 2024-05-15T15:40:04.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.819+0000 7f895577a640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f894803eb70 0x7f894803c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:04.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.819+0000 7f895577a640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8948041db0 0x7f89480cf480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:04.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.819+0000 7f895577a640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f89480c9050 0x7f89480c9460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:04.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.819+0000 7f895577a640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f894803c700 con 0x7f89480c9050 2024-05-15T15:40:04.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.819+0000 7f895577a640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f894803d060 con 0x7f894803eb70 2024-05-15T15:40:04.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.819+0000 7f895577a640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f894803d340 con 0x7f8948041db0 2024-05-15T15:40:04.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.821+0000 7f894e7fc640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8948041db0 0x7f89480cf480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:04.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.821+0000 7f894e7fc640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8948041db0 0x7f89480cf480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3301/0 says I am v2:172.21.15.12:37912/0 (socket says 172.21.15.12:37912) 2024-05-15T15:40:04.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.821+0000 7f894e7fc640 1 -- 172.21.15.12:0/2819955417 learned_addr learned my addr 172.21.15.12:0/2819955417 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:04.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.821+0000 7f894effd640 1 --2- 172.21.15.12:0/2819955417 >> v2:172.21.15.84:3300/0 conn(0x7f894803eb70 0x7f894803c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:04.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.821+0000 7f4a1cf47640 1 -- 172.21.15.12:0/3949809499 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a181536a0 msgr2=0x7f4a1815d250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:04.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.821+0000 7f4a1cf47640 1 --2- 172.21.15.12:0/3949809499 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a181536a0 0x7f4a1815d250 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f4a180b68b0 tx=0x7f4a0802a1c0 comp rx=0 tx=0).stop 2024-05-15T15:40:04.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.821+0000 7f7421b94640 1 -- 172.21.15.12:0/1846360882 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f741c144830 msgr2=0x7f741c14ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:04.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.821+0000 7f4a1cf47640 1 -- 172.21.15.12:0/3949809499 shutdown_connections 2024-05-15T15:40:04.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.821+0000 7f894ffff640 1 --2- 172.21.15.12:0/2819955417 >> v2:172.21.15.12:3300/0 conn(0x7f89480c9050 0x7f89480c9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:04.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.821+0000 7f4a1cf47640 1 --2- 172.21.15.12:0/3949809499 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a181536a0 0x7f4a1815d250 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:04.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.821+0000 7f4a1cf47640 1 --2- 172.21.15.12:0/3949809499 >> v2:172.21.15.84:3300/0 conn(0x7f4a180ba2e0 0x7f4a18153160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:04.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.821+0000 7f7421b94640 1 --2- 172.21.15.12:0/1846360882 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f741c144830 0x7f741c14ac90 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f740c008870 tx=0x7f740c02c7a0 comp rx=0 tx=0).stop 2024-05-15T15:40:04.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.821+0000 7f4a1cf47640 1 -- 172.21.15.12:0/3949809499 >> 172.21.15.12:0/3949809499 conn(0x7f4a180a16b0 msgr2=0x7f4a180a1ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:04.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.822+0000 7f4a1cf47640 1 -- 172.21.15.12:0/3949809499 shutdown_connections 2024-05-15T15:40:04.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.822+0000 7f894ffff640 1 -- 172.21.15.12:0/2819955417 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8948041db0 msgr2=0x7f89480cf480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:40:04.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.822+0000 7f4a1cf47640 1 -- 172.21.15.12:0/3949809499 wait complete. 2024-05-15T15:40:04.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.822+0000 7f894ffff640 1 --2- 172.21.15.12:0/2819955417 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8948041db0 0x7f89480cf480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:04.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.822+0000 7f894ffff640 1 -- 172.21.15.12:0/2819955417 >> v2:172.21.15.84:3300/0 conn(0x7f894803eb70 msgr2=0x7f894803c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:40:04.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.822+0000 7f894ffff640 1 --2- 172.21.15.12:0/2819955417 >> v2:172.21.15.84:3300/0 conn(0x7f894803eb70 0x7f894803c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:04.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.822+0000 7f894ffff640 1 -- 172.21.15.12:0/2819955417 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f894803d860 con 0x7f89480c9050 2024-05-15T15:40:04.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.823+0000 7f894ffff640 1 --2- 172.21.15.12:0/2819955417 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89480c9050 0x7f89480c9460 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f895006a9d0 tx=0x7f89500ab750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=646ea19a24ae33c7 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:04.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.824+0000 7f894dffb640 1 -- 172.21.15.12:0/2819955417 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89500b7070 con 0x7f89480c9050 2024-05-15T15:40:04.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.824+0000 7f894dffb640 1 -- 172.21.15.12:0/2819955417 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89500b2600 con 0x7f89480c9050 2024-05-15T15:40:04.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.825+0000 7f895577a640 1 -- 172.21.15.12:0/2819955417 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89480c9050 msgr2=0x7f89480c9460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:04.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.823+0000 7f7421b94640 1 -- 172.21.15.12:0/1846360882 shutdown_connections 2024-05-15T15:40:04.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.823+0000 7f7421b94640 1 --2- 172.21.15.12:0/1846360882 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f741c0a0dc0 0x7f741c0b4500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:04.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.823+0000 7f7421b94640 1 --2- 172.21.15.12:0/1846360882 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f741c144830 0x7f741c14ac90 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:04.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.823+0000 7f7421b94640 1 -- 172.21.15.12:0/1846360882 >> 172.21.15.12:0/1846360882 conn(0x7f741c0a16b0 msgr2=0x7f741c0a1ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:04.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.823+0000 7f7421b94640 1 -- 172.21.15.12:0/1846360882 shutdown_connections 2024-05-15T15:40:04.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.823+0000 7f7421b94640 1 -- 172.21.15.12:0/1846360882 wait complete. 2024-05-15T15:40:04.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.826+0000 7f7421b94640 1 Processor -- start 2024-05-15T15:40:04.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.825+0000 7f895577a640 1 --2- 172.21.15.12:0/2819955417 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89480c9050 0x7f89480c9460 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f895006a9d0 tx=0x7f89500ab750 comp rx=0 tx=0).stop 2024-05-15T15:40:04.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.826+0000 7f7421b94640 1 -- start start 2024-05-15T15:40:04.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.826+0000 7f895577a640 1 -- 172.21.15.12:0/2819955417 shutdown_connections 2024-05-15T15:40:04.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.826+0000 7f895577a640 1 --2- 172.21.15.12:0/2819955417 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89480c9050 0x7f89480c9460 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:04.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.826+0000 7f895577a640 1 --2- 172.21.15.12:0/2819955417 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8948041db0 0x7f89480cf480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:04.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.826+0000 7f895577a640 1 --2- 172.21.15.12:0/2819955417 >> v2:172.21.15.84:3300/0 conn(0x7f894803eb70 0x7f894803c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:04.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.826+0000 7f895577a640 1 -- 172.21.15.12:0/2819955417 >> 172.21.15.12:0/2819955417 conn(0x7f89480450e0 msgr2=0x7f89480414c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:04.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.825+0000 7f4a1cf47640 1 Processor -- start 2024-05-15T15:40:04.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.825+0000 7f4a1cf47640 1 -- start start 2024-05-15T15:40:04.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.827+0000 7f4a1cf47640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a180b62d0 0x7f4a18072510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:04.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.827+0000 7f4a1659c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a180b62d0 0x7f4a18072510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:04.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.827+0000 7f4a1659c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a180b62d0 0x7f4a18072510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59770/0 (socket says 172.21.15.12:59770) 2024-05-15T15:40:04.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.827+0000 7f4a1659c640 1 -- 172.21.15.12:0/3938660687 learned_addr learned my addr 172.21.15.12:0/3938660687 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:04.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.827+0000 7f4a1cf47640 1 --2- 172.21.15.12:0/3938660687 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f4a180ba2e0 0x7f4a18152440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:04.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.827+0000 7f4a1cf47640 1 --2- 172.21.15.12:0/3938660687 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a181536a0 0x7f4a18150fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:04.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.827+0000 7f4a1cf47640 1 -- 172.21.15.12:0/3938660687 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f4a180a1020 con 0x7f4a180b62d0 2024-05-15T15:40:04.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.827+0000 7f4a1cf47640 1 -- 172.21.15.12:0/3938660687 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f4a180b57f0 con 0x7f4a181536a0 2024-05-15T15:40:04.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.828+0000 7f4a1cf47640 1 -- 172.21.15.12:0/3938660687 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f4a180bbb80 con 0x7f4a180ba2e0 2024-05-15T15:40:04.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.828+0000 7f4a16d9d640 1 --2- 172.21.15.12:0/3938660687 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a181536a0 0x7f4a18150fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:04.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.828+0000 7f7421b94640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f741c074760 0x7f741c1e10d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:04.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.828+0000 7f895577a640 1 -- 172.21.15.12:0/2819955417 shutdown_connections 2024-05-15T15:40:04.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.828+0000 7f4a15d9b640 1 --2- 172.21.15.12:0/3938660687 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f4a180ba2e0 0x7f4a18152440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:04.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.828+0000 7f741b7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f741c074760 0x7f741c1e10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:04.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.828+0000 7f741b7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f741c074760 0x7f741c1e10d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59774/0 (socket says 172.21.15.12:59774) 2024-05-15T15:40:04.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.829+0000 7f741b7fe640 1 -- 172.21.15.12:0/2799248555 learned_addr learned my addr 172.21.15.12:0/2799248555 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:04.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.828+0000 7f4a1659c640 1 -- 172.21.15.12:0/3938660687 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f4a180ba2e0 msgr2=0x7f4a18152440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:04.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.828+0000 7f4a1659c640 1 --2- 172.21.15.12:0/3938660687 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f4a180ba2e0 0x7f4a18152440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:04.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.828+0000 7f4a1659c640 1 -- 172.21.15.12:0/3938660687 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a181536a0 msgr2=0x7f4a18150fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:04.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.828+0000 7f4a1659c640 1 --2- 172.21.15.12:0/3938660687 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a181536a0 0x7f4a18150fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:04.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.828+0000 7f4a1659c640 1 -- 172.21.15.12:0/3938660687 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a181428f0 con 0x7f4a180b62d0 2024-05-15T15:40:04.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.829+0000 7f7421b94640 1 --2- 172.21.15.12:0/2799248555 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f741c0a0dc0 0x7f741c1d5d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:04.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.829+0000 7f7421b94640 1 --2- 172.21.15.12:0/2799248555 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f741c144830 0x7f741c1d62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:04.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.829+0000 7f7421b94640 1 -- 172.21.15.12:0/2799248555 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f741c0b6590 con 0x7f741c074760 2024-05-15T15:40:04.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.829+0000 7f7421b94640 1 -- 172.21.15.12:0/2799248555 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f741c0b9fc0 con 0x7f741c0a0dc0 2024-05-15T15:40:04.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.829+0000 7f7421b94640 1 -- 172.21.15.12:0/2799248555 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f741c14b1d0 con 0x7f741c144830 2024-05-15T15:40:04.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.829+0000 7f4a1659c640 1 --2- 172.21.15.12:0/3938660687 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a180b62d0 0x7f4a18072510 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4a0c0013f0 tx=0x7f4a0c00cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:04.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.829+0000 7f4a06ffd640 1 -- 172.21.15.12:0/3938660687 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a0c0058b0 con 0x7f4a180b62d0 2024-05-15T15:40:04.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.830+0000 7f4a06ffd640 1 -- 172.21.15.12:0/3938660687 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a0c005a50 con 0x7f4a180b62d0 2024-05-15T15:40:04.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.830+0000 7f4a06ffd640 1 -- 172.21.15.12:0/3938660687 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a0c005e40 con 0x7f4a180b62d0 2024-05-15T15:40:04.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.830+0000 7f741b7fe640 1 -- 172.21.15.12:0/2799248555 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f741c144830 msgr2=0x7f741c1d62a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-15T15:40:04.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.830+0000 7f741b7fe640 1 --2- 172.21.15.12:0/2799248555 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f741c144830 0x7f741c1d62a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:04.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.830+0000 7f4a1cf47640 1 -- 172.21.15.12:0/3938660687 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a18072a50 con 0x7f4a180b62d0 2024-05-15T15:40:04.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.830+0000 7f741b7fe640 1 -- 172.21.15.12:0/2799248555 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f741c0a0dc0 msgr2=0x7f741c1d5d60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-15T15:40:04.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.830+0000 7f741b7fe640 1 --2- 172.21.15.12:0/2799248555 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f741c0a0dc0 0x7f741c1d5d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:04.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.830+0000 7f741b7fe640 1 -- 172.21.15.12:0/2799248555 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f741c1e1610 con 0x7f741c074760 2024-05-15T15:40:04.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.828+0000 7f895577a640 1 -- 172.21.15.12:0/2819955417 wait complete. 2024-05-15T15:40:04.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.831+0000 7f895577a640 1 Processor -- start 2024-05-15T15:40:04.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.831+0000 7f741b7fe640 1 --2- 172.21.15.12:0/2799248555 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f741c074760 0x7f741c1e10d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f740c000c00 tx=0x7f740c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:04.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.831+0000 7f4a1cf47640 1 -- 172.21.15.12:0/3938660687 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a18143c70 con 0x7f4a180b62d0 2024-05-15T15:40:04.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.831+0000 7f895577a640 1 -- start start 2024-05-15T15:40:04.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.833+0000 7f4a1cf47640 1 -- 172.21.15.12:0/3938660687 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a180a4250 con 0x7f4a180b62d0 2024-05-15T15:40:04.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.832+0000 7f7403fff640 1 -- 172.21.15.12:0/2799248555 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f740c043030 con 0x7f741c074760 2024-05-15T15:40:04.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.832+0000 7f7403fff640 1 -- 172.21.15.12:0/2799248555 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f740c03b040 con 0x7f741c074760 2024-05-15T15:40:04.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.833+0000 7f7403fff640 1 -- 172.21.15.12:0/2799248555 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f740c03a070 con 0x7f741c074760 2024-05-15T15:40:04.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.833+0000 7f7421b94640 1 -- 172.21.15.12:0/2799248555 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f741c149970 con 0x7f741c074760 2024-05-15T15:40:04.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.833+0000 7f7421b94640 1 -- 172.21.15.12:0/2799248555 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f741c149f30 con 0x7f741c074760 2024-05-15T15:40:04.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.833+0000 7f895577a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f894803eb70 0x7f8948177050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:04.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.833+0000 7f895577a640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8948041db0 0x7f89480d2570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:04.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.833+0000 7f895577a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89480c9050 0x7f89480c3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:04.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.833+0000 7f895577a640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f8948041220 con 0x7f89480c9050 2024-05-15T15:40:04.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.833+0000 7f895577a640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f89480410a0 con 0x7f894803eb70 2024-05-15T15:40:04.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.833+0000 7f895577a640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f89480cf9c0 con 0x7f8948041db0 2024-05-15T15:40:04.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.833+0000 7f894e7fc640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8948041db0 0x7f89480d2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:04.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.834+0000 7f894ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89480c9050 0x7f89480c3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:04.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.835+0000 7f894ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89480c9050 0x7f89480c3ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59788/0 (socket says 172.21.15.12:59788) 2024-05-15T15:40:04.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.835+0000 7f894ffff640 1 -- 172.21.15.12:0/2308624776 learned_addr learned my addr 172.21.15.12:0/2308624776 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:04.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.835+0000 7f894ffff640 1 -- 172.21.15.12:0/2308624776 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8948041db0 msgr2=0x7f89480d2570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:04.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.835+0000 7f894ffff640 1 --2- 172.21.15.12:0/2308624776 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8948041db0 0x7f89480d2570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:04.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.835+0000 7f894ffff640 1 -- 172.21.15.12:0/2308624776 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f894803eb70 msgr2=0x7f8948177050 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-15T15:40:04.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.835+0000 7f894ffff640 1 --2- 172.21.15.12:0/2308624776 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f894803eb70 0x7f8948177050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:04.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.835+0000 7f894ffff640 1 -- 172.21.15.12:0/2308624776 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89480cec40 con 0x7f89480c9050 2024-05-15T15:40:04.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.836+0000 7f7401ffb640 1 -- 172.21.15.12:0/2799248555 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f741c0b4c10 con 0x7f741c074760 2024-05-15T15:40:04.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.835+0000 7f4a06ffd640 1 -- 172.21.15.12:0/3938660687 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f4a0c007070 con 0x7f4a180b62d0 2024-05-15T15:40:04.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.836+0000 7f4a06ffd640 1 --2- 172.21.15.12:0/3938660687 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f49f80763a0 0x7f49f80788b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:04.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.836+0000 7f4a15d9b640 1 --2- 172.21.15.12:0/3938660687 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f49f80763a0 0x7f49f80788b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:04.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.836+0000 7f894ffff640 1 --2- 172.21.15.12:0/2308624776 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89480c9050 0x7f89480c3ac0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f895006a9d0 tx=0x7f895006b670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:04.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.836+0000 7f4a06ffd640 1 -- 172.21.15.12:0/3938660687 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f4a0c097080 con 0x7f4a180b62d0 2024-05-15T15:40:04.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.837+0000 7f4a15d9b640 1 --2- 172.21.15.12:0/3938660687 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f49f80763a0 0x7f49f80788b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4a1806d3b0 tx=0x7f4a1000b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:04.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.845+0000 7f4a06ffd640 1 -- 172.21.15.12:0/3938660687 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f4a180a4250 con 0x7f4a180b62d0 2024-05-15T15:40:04.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.848+0000 7f89377fe640 1 -- 172.21.15.12:0/2308624776 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89500c0070 con 0x7f89480c9050 2024-05-15T15:40:04.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.848+0000 7f7403fff640 1 -- 172.21.15.12:0/2799248555 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f740c046030 con 0x7f741c074760 2024-05-15T15:40:04.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.848+0000 7f7403fff640 1 --2- 172.21.15.12:0/2799248555 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f74080763a0 0x7f74080788b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:04.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.848+0000 7f7403fff640 1 -- 172.21.15.12:0/2799248555 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f740c0bb580 con 0x7f741c074760 2024-05-15T15:40:04.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.848+0000 7f895577a640 1 -- 172.21.15.12:0/2308624776 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89480c2900 con 0x7f89480c9050 2024-05-15T15:40:04.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.848+0000 7f895577a640 1 -- 172.21.15.12:0/2308624776 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89480c44b0 con 0x7f89480c9050 2024-05-15T15:40:04.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.849+0000 7f89377fe640 1 -- 172.21.15.12:0/2308624776 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89500b1a60 con 0x7f89480c9050 2024-05-15T15:40:04.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.850+0000 7f89377fe640 1 -- 172.21.15.12:0/2308624776 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89500b7050 con 0x7f89480c9050 2024-05-15T15:40:04.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.850+0000 7f741affd640 1 --2- 172.21.15.12:0/2799248555 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f74080763a0 0x7f74080788b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:04.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.851+0000 7f741affd640 1 --2- 172.21.15.12:0/2799248555 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f74080763a0 0x7f74080788b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f741c142890 tx=0x7f7410009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:04.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.851+0000 7f895577a640 1 -- 172.21.15.12:0/2308624776 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8930005290 con 0x7f89480c9050 2024-05-15T15:40:04.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.858+0000 7f7403fff640 1 -- 172.21.15.12:0/2799248555 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f741c0b4c10 con 0x7f741c074760 2024-05-15T15:40:04.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.861+0000 7f89377fe640 1 -- 172.21.15.12:0/2308624776 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f89500c3070 con 0x7f89480c9050 2024-05-15T15:40:04.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.862+0000 7f89377fe640 1 --2- 172.21.15.12:0/2308624776 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f893c0763a0 0x7f893c0788b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:04.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.862+0000 7f894effd640 1 --2- 172.21.15.12:0/2308624776 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f893c0763a0 0x7f893c0788b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:04.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.863+0000 7f89377fe640 1 -- 172.21.15.12:0/2308624776 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f8950133d30 con 0x7f89480c9050 2024-05-15T15:40:04.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.863+0000 7f894effd640 1 --2- 172.21.15.12:0/2308624776 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f893c0763a0 0x7f893c0788b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f89440098b0 tx=0x7f8944009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:04.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.867+0000 7f89377fe640 1 -- 172.21.15.12:0/2308624776 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f89500fd020 con 0x7f89480c9050 2024-05-15T15:40:04.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.872+0000 7fc5136cd640 1 Processor -- start 2024-05-15T15:40:04.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.873+0000 7fc5136cd640 1 -- start start 2024-05-15T15:40:04.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.875+0000 7fc5136cd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fc50c0b62d0 0x7fc50c0ba2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:04.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.875+0000 7fc5136cd640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc50c06d0d0 0x7fc50c153160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:04.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.875+0000 7fc5136cd640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc50c1536a0 0x7fc50c06e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:04.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.875+0000 7fc5136cd640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fc50c0b66e0 con 0x7fc50c0b62d0 2024-05-15T15:40:04.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.875+0000 7fc5136cd640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7fc50c0b55a0 con 0x7fc50c06d0d0 2024-05-15T15:40:04.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.875+0000 7fc5136cd640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fc50c0b57f0 con 0x7fc50c1536a0 2024-05-15T15:40:04.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.875+0000 7fc510c68640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc50c06d0d0 0x7fc50c153160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:04.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.875+0000 7fc510c68640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc50c06d0d0 0x7fc50c153160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.12:36150/0 (socket says 172.21.15.12:36150) 2024-05-15T15:40:04.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.875+0000 7fc510c68640 1 -- 172.21.15.12:0/2349625046 learned_addr learned my addr 172.21.15.12:0/2349625046 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:04.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.873+0000 7f9c24c4d640 1 Processor -- start 2024-05-15T15:40:04.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.874+0000 7f9c24c4d640 1 -- start start 2024-05-15T15:40:04.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.876+0000 7f9c24c4d640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f9c18006cf0 0x7f9c180078b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:04.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.875+0000 7fc511c6a640 1 --2- 172.21.15.12:0/2349625046 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc50c1536a0 0x7fc50c06e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:04.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.875+0000 7fc511469640 1 --2- 172.21.15.12:0/2349625046 >> v2:172.21.15.12:3300/0 conn(0x7fc50c0b62d0 0x7fc50c0ba2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:04.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.876+0000 7fc511c6a640 1 -- 172.21.15.12:0/2349625046 >> v2:172.21.15.84:3300/0 conn(0x7fc50c06d0d0 msgr2=0x7fc50c153160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:40:04.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.876+0000 7fc511c6a640 1 --2- 172.21.15.12:0/2349625046 >> v2:172.21.15.84:3300/0 conn(0x7fc50c06d0d0 0x7fc50c153160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:04.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.876+0000 7fc511c6a640 1 -- 172.21.15.12:0/2349625046 >> v2:172.21.15.12:3300/0 conn(0x7fc50c0b62d0 msgr2=0x7fc50c0ba2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:40:04.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.876+0000 7fc511c6a640 1 --2- 172.21.15.12:0/2349625046 >> v2:172.21.15.12:3300/0 conn(0x7fc50c0b62d0 0x7fc50c0ba2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:04.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.876+0000 7fc511c6a640 1 -- 172.21.15.12:0/2349625046 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc50c0a0d40 con 0x7fc50c1536a0 2024-05-15T15:40:04.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.876+0000 7fc511469640 1 --2- 172.21.15.12:0/2349625046 >> v2:172.21.15.12:3300/0 conn(0x7fc50c0b62d0 0x7fc50c0ba2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-15T15:40:04.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.876+0000 7f9c24c4d640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f9c18009090 0x7f9c1803f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:04.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.876+0000 7f9c24c4d640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c1803f5a0 con 0x7f9c1803b1e0 2024-05-15T15:40:04.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.876+0000 7f9c24c4d640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f9c18008920 con 0x7f9c18006cf0 2024-05-15T15:40:04.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.876+0000 7f9c24c4d640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f9c18008c00 con 0x7f9c18009090 2024-05-15T15:40:04.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.877+0000 7fc511c6a640 1 --2- 172.21.15.12:0/2349625046 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc50c1536a0 0x7fc50c06e7b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc50c0b68b0 tx=0x7fc50402a5f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b2f20e719776df6 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:04.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.876+0000 7f9c1f7fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f9c18006cf0 0x7f9c180078b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:04.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.876+0000 7f9c1f7fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f9c18006cf0 0x7f9c180078b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59806/0 (socket says 172.21.15.12:59806) 2024-05-15T15:40:04.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.876+0000 7f9c1f7fe640 1 -- 172.21.15.12:0/3901330752 learned_addr learned my addr 172.21.15.12:0/3901330752 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:04.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.876+0000 7f9c1effd640 1 --2- 172.21.15.12:0/3901330752 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f9c18009090 0x7f9c1803f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:04.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.877+0000 7f9c1f7fe640 1 -- 172.21.15.12:0/3901330752 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f9c18009090 msgr2=0x7f9c1803f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:40:04.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.877+0000 7f9c1f7fe640 1 --2- 172.21.15.12:0/3901330752 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f9c18009090 0x7f9c1803f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:04.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.877+0000 7f9c1f7fe640 1 -- 172.21.15.12:0/3901330752 >> v1:172.21.15.12:6789/0 conn(0x7f9c1803b1e0 legacy=0x7f9c180cf970 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-15T15:40:04.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.877+0000 7fc503fff640 1 -- 172.21.15.12:0/2349625046 <== mon.2 v2:172.21.15.84:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc504007740 con 0x7fc50c1536a0 2024-05-15T15:40:04.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.877+0000 7fc503fff640 1 -- 172.21.15.12:0/2349625046 <== mon.2 v2:172.21.15.84:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5040078e0 con 0x7fc50c1536a0 2024-05-15T15:40:04.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.877+0000 7fc503fff640 1 -- 172.21.15.12:0/2349625046 <== mon.2 v2:172.21.15.84:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc504007c90 con 0x7fc50c1536a0 2024-05-15T15:40:04.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.878+0000 7fc5136cd640 1 -- 172.21.15.12:0/2349625046 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc50c1536a0 msgr2=0x7fc50c06e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:04.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.878+0000 7fc5136cd640 1 --2- 172.21.15.12:0/2349625046 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc50c1536a0 0x7fc50c06e7b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc50c0b68b0 tx=0x7fc50402a5f0 comp rx=0 tx=0).stop 2024-05-15T15:40:04.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.878+0000 7f9c1f7fe640 1 -- 172.21.15.12:0/3901330752 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c180071f0 con 0x7f9c18006cf0 2024-05-15T15:40:04.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.879+0000 7f9c1f7fe640 1 --2- 172.21.15.12:0/3901330752 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9c18006cf0 0x7f9c180078b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9c20051610 tx=0x7f9c200a7460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1d98043b5856839 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:04.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.879+0000 7fc5136cd640 1 -- 172.21.15.12:0/2349625046 shutdown_connections 2024-05-15T15:40:04.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.879+0000 7fc5136cd640 1 --2- 172.21.15.12:0/2349625046 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc50c1536a0 0x7fc50c06e7b0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:04.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.879+0000 7fc5136cd640 1 --2- 172.21.15.12:0/2349625046 >> v2:172.21.15.84:3300/0 conn(0x7fc50c06d0d0 0x7fc50c153160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:04.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.879+0000 7fc5136cd640 1 --2- 172.21.15.12:0/2349625046 >> v2:172.21.15.12:3300/0 conn(0x7fc50c0b62d0 0x7fc50c0ba2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:04.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.880+0000 7fc5136cd640 1 -- 172.21.15.12:0/2349625046 >> 172.21.15.12:0/2349625046 conn(0x7fc50c0a16b0 msgr2=0x7fc50c0a1ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:04.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.879+0000 7fd52bd38640 1 Processor -- start 2024-05-15T15:40:04.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.880+0000 7fd52bd38640 1 -- start start 2024-05-15T15:40:04.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.879+0000 7f0d6f6a7640 1 Processor -- start 2024-05-15T15:40:04.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.879+0000 7f0d6f6a7640 1 -- start start 2024-05-15T15:40:04.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.880+0000 7f9c1e7fc640 1 -- 172.21.15.12:0/3901330752 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c200b3070 con 0x7f9c18006cf0 2024-05-15T15:40:04.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.880+0000 7f9c1e7fc640 1 -- 172.21.15.12:0/3901330752 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c200ae660 con 0x7f9c18006cf0 2024-05-15T15:40:04.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.880+0000 7f9c1e7fc640 1 -- 172.21.15.12:0/3901330752 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c200aea50 con 0x7f9c18006cf0 2024-05-15T15:40:04.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.881+0000 7fc5136cd640 1 -- 172.21.15.12:0/2349625046 shutdown_connections 2024-05-15T15:40:04.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.881+0000 7fc5136cd640 1 -- 172.21.15.12:0/2349625046 wait complete. 2024-05-15T15:40:04.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.881+0000 7f972bacd640 1 Processor -- start 2024-05-15T15:40:04.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.881+0000 7f972bacd640 1 -- start start 2024-05-15T15:40:04.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.881+0000 7f9c24c4d640 1 -- 172.21.15.12:0/3901330752 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9c18006cf0 msgr2=0x7f9c180078b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:04.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.881+0000 7f9c24c4d640 1 --2- 172.21.15.12:0/3901330752 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9c18006cf0 0x7f9c180078b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9c20051610 tx=0x7f9c200a7460 comp rx=0 tx=0).stop 2024-05-15T15:40:04.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.881+0000 7fd52bd38640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd5240a2690 0x7fd524146120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:04.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.881+0000 7fd52bd38640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5240a2aa0 con 0x7fd524074660 2024-05-15T15:40:04.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.881+0000 7fd52bd38640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5240a3c10 con 0x7fd524146660 2024-05-15T15:40:04.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.881+0000 7fd52bd38640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fd5240a0cc0 con 0x7fd5240a2690 2024-05-15T15:40:04.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.882+0000 7fd529ad4640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fd524074660 0x7fd52406d0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:45280/0 (socket says 172.21.15.12:45280) 2024-05-15T15:40:04.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.882+0000 7fd529ad4640 1 -- 172.21.15.12:0/1061042612 learned_addr learned my addr 172.21.15.12:0/1061042612 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-05-15T15:40:04.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.882+0000 7fd5292d3640 1 --2- 172.21.15.12:0/1061042612 >> v2:172.21.15.12:3300/0 conn(0x7fd5240a2690 0x7fd524146120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:04.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.882+0000 7fd528ad2640 1 -- 172.21.15.12:0/1061042612 <== mon.1 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2994674424 0 0) 0x7fd5240a3c10 con 0x7fd524146660 2024-05-15T15:40:04.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.882+0000 7fd528ad2640 1 -- 172.21.15.12:0/1061042612 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd510003520 con 0x7fd524146660 2024-05-15T15:40:04.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.882+0000 7fd528ad2640 1 -- 172.21.15.12:0/1061042612 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2277739766 0 0) 0x7fd5240a2aa0 con 0x7fd524074660 2024-05-15T15:40:04.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.882+0000 7fd528ad2640 1 -- 172.21.15.12:0/1061042612 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd5240a3c10 con 0x7fd524074660 2024-05-15T15:40:04.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.881+0000 7f0d6f6a7640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0d68073920 0x7f0d68144b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:04.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.881+0000 7f0d6f6a7640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0d6806d6f0 0x7f0d6814abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:04.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.881+0000 7f0d6f6a7640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d68073ee0 con 0x7f0d68072e00 2024-05-15T15:40:04.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.881+0000 7f0d6f6a7640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f0d68076860 con 0x7f0d68073920 2024-05-15T15:40:04.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.881+0000 7f0d6f6a7640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f0d68074780 con 0x7f0d6806d6f0 2024-05-15T15:40:04.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.882+0000 7f0d6dc44640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0d6806d6f0 0x7f0d6814abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:04.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.882+0000 7f0d6dc44640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0d6806d6f0 0x7f0d6814abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.12:36152/0 (socket says 172.21.15.12:36152) 2024-05-15T15:40:04.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.882+0000 7f0d6dc44640 1 -- 172.21.15.12:0/582011796 learned_addr learned my addr 172.21.15.12:0/582011796 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:04.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.882+0000 7f0d6dc44640 1 -- 172.21.15.12:0/582011796 >> v2:172.21.15.12:3300/0 conn(0x7f0d68073920 msgr2=0x7f0d68144b40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-15T15:40:04.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.882+0000 7fd528ad2640 1 -- 172.21.15.12:0/1061042612 <== mon.1 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2140434919 0 0) 0x7fd510003520 con 0x7fd524146660 2024-05-15T15:40:04.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.883+0000 7f9c24c4d640 1 -- 172.21.15.12:0/3901330752 shutdown_connections 2024-05-15T15:40:04.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.883+0000 7f9c24c4d640 1 --2- 172.21.15.12:0/3901330752 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f9c18009090 0x7f9c1803f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:04.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.883+0000 7f9c24c4d640 1 --2- 172.21.15.12:0/3901330752 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9c18006cf0 0x7f9c180078b0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:04.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.883+0000 7f9c24c4d640 1 -- 172.21.15.12:0/3901330752 >> 172.21.15.12:0/3901330752 conn(0x7f9c18007e00 msgr2=0x7f9c18008210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:04.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.882+0000 7fd528ad2640 1 -- 172.21.15.12:0/1061042612 >> v2:172.21.15.12:3300/0 conn(0x7fd5240a2690 msgr2=0x7fd524146120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:40:04.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.882+0000 7fd528ad2640 1 --2- 172.21.15.12:0/1061042612 >> v2:172.21.15.12:3300/0 conn(0x7fd5240a2690 0x7fd524146120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:04.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.882+0000 7fd528ad2640 1 -- 172.21.15.12:0/1061042612 >> v1:172.21.15.12:6789/0 conn(0x7fd524074660 legacy=0x7fd52406d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:04.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.882+0000 7fd528ad2640 1 -- 172.21.15.12:0/1061042612 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5240a0f10 con 0x7fd524146660 2024-05-15T15:40:04.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.882+0000 7fd528ad2640 1 -- 172.21.15.12:0/1061042612 <== mon.1 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 38171736 0 0) 0x7fd51c001a70 con 0x7fd524146660 2024-05-15T15:40:04.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.882+0000 7fd528ad2640 1 -- 172.21.15.12:0/1061042612 >> v1:172.21.15.84:6789/0 conn(0x7fd524146660 legacy=0x7fd5240a40f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:04.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.882+0000 7fd528ad2640 1 --2- 172.21.15.12:0/1061042612 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd510003c30 0x7fd510004080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:04.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.882+0000 7fd528ad2640 1 --2- 172.21.15.12:0/1061042612 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd5100079a0 0x7fd510009dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:04.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.882+0000 7fd528ad2640 1 --2- 172.21.15.12:0/1061042612 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fd51000a3f0 0x7fd51000c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:04.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.882+0000 7fd528ad2640 1 -- 172.21.15.12:0/1061042612 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fd5240a0cc0 con 0x7fd5100079a0 2024-05-15T15:40:04.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.882+0000 7fd528ad2640 1 -- 172.21.15.12:0/1061042612 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fd51000d1e0 con 0x7fd510003c30 2024-05-15T15:40:04.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.882+0000 7fd528ad2640 1 -- 172.21.15.12:0/1061042612 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fd51000d3e0 con 0x7fd51000a3f0 2024-05-15T15:40:04.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.883+0000 7fd5292d3640 1 --2- 172.21.15.12:0/1061042612 >> v2:172.21.15.12:3300/0 conn(0x7fd5240a2690 0x7fd524146120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-15T15:40:04.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.883+0000 7fd52a2d5640 1 --2- 172.21.15.12:0/1061042612 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fd51000a3f0 0x7fd51000c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:04.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.883+0000 7fd529ad4640 1 --2- 172.21.15.12:0/1061042612 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd510003c30 0x7fd510004080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:04.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.882+0000 7f0d6cc42640 1 --2- 172.21.15.12:0/582011796 >> v2:172.21.15.12:3300/0 conn(0x7f0d68073920 0x7f0d68144b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:04.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.883+0000 7f0d6dc44640 1 --2- 172.21.15.12:0/582011796 >> v2:172.21.15.12:3300/0 conn(0x7f0d68073920 0x7f0d68144b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:04.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.883+0000 7f0d6dc44640 1 -- 172.21.15.12:0/582011796 >> v1:172.21.15.12:6789/0 conn(0x7f0d68072e00 legacy=0x7f0d68076150 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-15T15:40:04.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.883+0000 7fd5292d3640 1 --2- 172.21.15.12:0/1061042612 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd5100079a0 0x7fd510009dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:04.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.883+0000 7f9c24c4d640 1 -- 172.21.15.12:0/3901330752 shutdown_connections 2024-05-15T15:40:04.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.883+0000 7f9c24c4d640 1 -- 172.21.15.12:0/3901330752 wait complete. 2024-05-15T15:40:04.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.883+0000 7f0d6dc44640 1 -- 172.21.15.12:0/582011796 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d680741c0 con 0x7f0d6806d6f0 2024-05-15T15:40:04.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.883+0000 7f972bacd640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f972406d6f0 0x7f972414dd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:04.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.884+0000 7f0d6cc42640 1 --2- 172.21.15.12:0/582011796 >> v2:172.21.15.12:3300/0 conn(0x7f0d68073920 0x7f0d68144b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-15T15:40:04.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.884+0000 7f972bacd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f972406db00 0x7f972414e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:04.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.884+0000 7f9729869640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f9724144b40 0x7f97240b6470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.12:53808/0 (socket says 172.21.15.12:53808) 2024-05-15T15:40:04.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.884+0000 7fc5136cd640 1 Processor -- start 2024-05-15T15:40:04.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.884+0000 7fc5136cd640 1 -- start start 2024-05-15T15:40:04.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.884+0000 7f9729068640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f972406d6f0 0x7f972414dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:04.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.884+0000 7f9729068640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f972406d6f0 0x7f972414dd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.12:36170/0 (socket says 172.21.15.12:36170) 2024-05-15T15:40:04.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.884+0000 7f972a06a640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f972406db00 0x7f972414e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:04.896 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.884+0000 7fd52a2d5640 1 -- 172.21.15.12:0/1061042612 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd510003c30 msgr2=0x7fd510004080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:40:04.896 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.884+0000 7fd52a2d5640 1 --2- 172.21.15.12:0/1061042612 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd510003c30 0x7fd510004080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:04.896 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.884+0000 7fd52a2d5640 1 -- 172.21.15.12:0/1061042612 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd5100079a0 msgr2=0x7fd510009dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:40:04.896 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.884+0000 7fd52a2d5640 1 --2- 172.21.15.12:0/1061042612 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd5100079a0 0x7fd510009dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:04.896 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.884+0000 7fd52a2d5640 1 -- 172.21.15.12:0/1061042612 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5240a0f10 con 0x7fd51000a3f0 2024-05-15T15:40:04.896 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.884+0000 7f972a06a640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f972406db00 0x7f972414e2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59832/0 (socket says 172.21.15.12:59832) 2024-05-15T15:40:04.897 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.884+0000 7f0d6dc44640 1 --2- 172.21.15.12:0/582011796 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d6806d6f0 0x7f0d6814abe0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0d680bbad0 tx=0x7f0d5802a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f7331ecc1d8d1aab server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:04.897 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.885+0000 7f9729869640 1 -- 172.21.15.12:0/1941823950 learned_addr learned my addr 172.21.15.12:0/1941823950 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-05-15T15:40:04.897 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.885+0000 7f972bacd640 1 -- 172.21.15.12:0/1941823950 --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9724073bb0 con 0x7f9724144b40 2024-05-15T15:40:04.897 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.885+0000 7f972bacd640 1 -- 172.21.15.12:0/1941823950 --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f97240b6b80 con 0x7f972406db00 2024-05-15T15:40:04.897 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.885+0000 7f972bacd640 1 -- 172.21.15.12:0/1941823950 --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f9724073e90 con 0x7f972406d6f0 2024-05-15T15:40:04.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.885+0000 7f0d5ffff640 1 -- 172.21.15.12:0/582011796 <== mon.1 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d58037070 con 0x7f0d6806d6f0 2024-05-15T15:40:04.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.885+0000 7f0d5ffff640 1 -- 172.21.15.12:0/582011796 <== mon.1 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d58032440 con 0x7f0d6806d6f0 2024-05-15T15:40:04.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.885+0000 7f0d5ffff640 1 -- 172.21.15.12:0/582011796 <== mon.1 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d58032810 con 0x7f0d6806d6f0 2024-05-15T15:40:04.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.885+0000 7fd52a2d5640 1 -- 172.21.15.12:0/1061042612 reap_dead start 2024-05-15T15:40:04.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.885+0000 7f9729068640 1 -- 172.21.15.12:0/1941823950 >> v2:172.21.15.12:3300/0 conn(0x7f972406db00 msgr2=0x7f972414e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:40:04.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.886+0000 7fd52a2d5640 1 --2- 172.21.15.12:0/1061042612 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fd51000a3f0 0x7fd51000c900 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd51c002230 tx=0x7fd510005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=26d0b15103105f87 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:04.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.886+0000 7f9728867640 1 -- 172.21.15.12:0/1941823950 <== mon.1 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2973719275 0 0) 0x7f9724073bb0 con 0x7f9724144b40 2024-05-15T15:40:04.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.886+0000 7f9729068640 1 --2- 172.21.15.12:0/1941823950 >> v2:172.21.15.12:3300/0 conn(0x7f972406db00 0x7f972414e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:04.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.886+0000 7f9729068640 1 -- 172.21.15.12:0/1941823950 >> v1:172.21.15.84:6789/0 conn(0x7f9724144b40 legacy=0x7f97240b6470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:04.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.886+0000 7f9729068640 1 -- 172.21.15.12:0/1941823950 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9724074170 con 0x7f972406d6f0 2024-05-15T15:40:04.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.886+0000 7fc5136cd640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc50c06d0d0 0x7fc50c06ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:04.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.886+0000 7fc5136cd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc50c0b62d0 0x7fc50c0b8b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:04.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.886+0000 7fc5136cd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc50c1536a0 0x7fc50c071f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:04.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.886+0000 7fc5136cd640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fc50c0bbb80 con 0x7fc50c0b62d0 2024-05-15T15:40:04.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.886+0000 7fc5136cd640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fc50c0a1020 con 0x7fc50c1536a0 2024-05-15T15:40:04.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.886+0000 7fc5136cd640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fc50c0bb2c0 con 0x7fc50c06d0d0 2024-05-15T15:40:04.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.886+0000 7f9c24c4d640 1 Processor -- start 2024-05-15T15:40:04.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.886+0000 7fd528ad2640 1 -- 172.21.15.12:0/1061042612 <== mon.2 v2:172.21.15.84:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd51c033020 con 0x7fd51000a3f0 2024-05-15T15:40:04.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.886+0000 7fd528ad2640 1 -- 172.21.15.12:0/1061042612 <== mon.2 v2:172.21.15.84:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd51c006d50 con 0x7fd51000a3f0 2024-05-15T15:40:04.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.886+0000 7fd528ad2640 1 -- 172.21.15.12:0/1061042612 <== mon.2 v2:172.21.15.84:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd51c00c0e0 con 0x7fd51000a3f0 2024-05-15T15:40:04.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.886+0000 7fc510c68640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc50c0b62d0 0x7fc50c0b8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:04.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.886+0000 7fc510c68640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc50c0b62d0 0x7fc50c0b8b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59846/0 (socket says 172.21.15.12:59846) 2024-05-15T15:40:04.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.886+0000 7fc510c68640 1 -- 172.21.15.12:0/878619590 learned_addr learned my addr 172.21.15.12:0/878619590 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:04.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.886+0000 7fc511c6a640 1 --2- 172.21.15.12:0/878619590 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc50c1536a0 0x7fc50c071f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:04.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.886+0000 7fc510c68640 1 -- 172.21.15.12:0/878619590 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc50c06d0d0 msgr2=0x7fc50c06ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:04.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.886+0000 7fc510c68640 1 --2- 172.21.15.12:0/878619590 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc50c06d0d0 0x7fc50c06ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:04.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.886+0000 7fc510c68640 1 -- 172.21.15.12:0/878619590 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc50c1536a0 msgr2=0x7fc50c071f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:04.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.886+0000 7fc510c68640 1 --2- 172.21.15.12:0/878619590 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc50c1536a0 0x7fc50c071f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:04.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.886+0000 7fc510c68640 1 -- 172.21.15.12:0/878619590 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc50c06f480 con 0x7fc50c0b62d0 2024-05-15T15:40:04.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.887+0000 7fc510c68640 1 --2- 172.21.15.12:0/878619590 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc50c0b62d0 0x7fc50c0b8b40 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc4fc00d830 tx=0x7fc4fc00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:04.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.887+0000 7fd52bd38640 1 -- 172.21.15.12:0/1061042612 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fd51000a3f0 msgr2=0x7fd51000c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:04.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.887+0000 7fd52bd38640 1 --2- 172.21.15.12:0/1061042612 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fd51000a3f0 0x7fd51000c900 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd51c002230 tx=0x7fd510005830 comp rx=0 tx=0).stop 2024-05-15T15:40:04.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.887+0000 7f972a06a640 1 --2- 172.21.15.12:0/1941823950 >> v2:172.21.15.12:3300/0 conn(0x7f972406db00 0x7f972414e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-15T15:40:04.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.887+0000 7f9729068640 1 --2- 172.21.15.12:0/1941823950 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f972406d6f0 0x7f972414dd90 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f972414b950 tx=0x7f972002e690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=51ddf799bfdebb17 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:04.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.888+0000 7f9728867640 1 -- 172.21.15.12:0/1941823950 <== mon.1 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f972000b040 con 0x7f972406d6f0 2024-05-15T15:40:04.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.888+0000 7fc501ffb640 1 -- 172.21.15.12:0/878619590 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4fc009640 con 0x7fc50c0b62d0 2024-05-15T15:40:04.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.888+0000 7fc501ffb640 1 -- 172.21.15.12:0/878619590 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4fc019070 con 0x7fc50c0b62d0 2024-05-15T15:40:04.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.888+0000 7fc501ffb640 1 -- 172.21.15.12:0/878619590 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4fc009a00 con 0x7fc50c0b62d0 2024-05-15T15:40:04.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.888+0000 7fc5136cd640 1 -- 172.21.15.12:0/878619590 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc50c14d490 con 0x7fc50c0b62d0 2024-05-15T15:40:04.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.888+0000 7fc5136cd640 1 -- 172.21.15.12:0/878619590 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc50c1ec690 con 0x7fc50c0b62d0 2024-05-15T15:40:04.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.888+0000 7f9728867640 1 -- 172.21.15.12:0/1941823950 <== mon.1 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9720033710 con 0x7f972406d6f0 2024-05-15T15:40:04.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.888+0000 7f9728867640 1 -- 172.21.15.12:0/1941823950 <== mon.1 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9720033b20 con 0x7f972406d6f0 2024-05-15T15:40:04.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.886+0000 7f9c24c4d640 1 -- start start 2024-05-15T15:40:04.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.888+0000 7f9c24c4d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9c18006cf0 0x7f9c18033420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:04.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.888+0000 7f9c24c4d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c18009090 0x7f9c18160ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:04.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.888+0000 7f9c24c4d640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f9c1803b1e0 0x7f9c180cb250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:04.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.888+0000 7f9c24c4d640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f9c18029aa0 con 0x7f9c18006cf0 2024-05-15T15:40:04.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.888+0000 7f9c24c4d640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f9c18029920 con 0x7f9c18009090 2024-05-15T15:40:04.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.888+0000 7f9c24c4d640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f9c1803b5f0 con 0x7f9c1803b1e0 2024-05-15T15:40:04.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.888+0000 7fd52bd38640 1 -- 172.21.15.12:0/1061042612 shutdown_connections 2024-05-15T15:40:04.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.888+0000 7fd52bd38640 1 --2- 172.21.15.12:0/1061042612 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fd51000a3f0 0x7fd51000c900 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:04.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.888+0000 7fd52bd38640 1 -- 172.21.15.12:0/1061042612 >> 172.21.15.12:0/1061042612 conn(0x7fd5240a16b0 msgr2=0x7fd5240a1ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:04.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.888+0000 7f0d6f6a7640 1 -- 172.21.15.12:0/582011796 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d6806d6f0 msgr2=0x7f0d6814abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:04.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.888+0000 7f0d6f6a7640 1 --2- 172.21.15.12:0/582011796 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d6806d6f0 0x7f0d6814abe0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0d680bbad0 tx=0x7f0d5802a270 comp rx=0 tx=0).stop 2024-05-15T15:40:04.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.888+0000 7f0d6f6a7640 1 -- 172.21.15.12:0/582011796 shutdown_connections 2024-05-15T15:40:04.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.888+0000 7f0d6f6a7640 1 --2- 172.21.15.12:0/582011796 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d6806d6f0 0x7f0d6814abe0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:04.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.888+0000 7f0d6f6a7640 1 --2- 172.21.15.12:0/582011796 >> v2:172.21.15.12:3300/0 conn(0x7f0d68073920 0x7f0d68144b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:04.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.888+0000 7f0d6f6a7640 1 -- 172.21.15.12:0/582011796 >> 172.21.15.12:0/582011796 conn(0x7f0d6806f390 msgr2=0x7f0d6806f7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:04.907 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.889+0000 7f972bacd640 1 -- 172.21.15.12:0/1941823950 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f972406d6f0 msgr2=0x7f972414dd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:04.907 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.889+0000 7f972bacd640 1 --2- 172.21.15.12:0/1941823950 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f972406d6f0 0x7f972414dd90 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f972414b950 tx=0x7f972002e690 comp rx=0 tx=0).stop 2024-05-15T15:40:04.907 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.889+0000 7fd52bd38640 1 -- 172.21.15.12:0/1061042612 shutdown_connections 2024-05-15T15:40:04.907 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.889+0000 7f9c1effd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c18009090 0x7f9c18160ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:04.907 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.889+0000 7f9c1ffff640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f9c1803b1e0 0x7f9c180cb250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:04.907 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.889+0000 7f9c1ffff640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f9c1803b1e0 0x7f9c180cb250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3301/0 says I am v2:172.21.15.12:37988/0 (socket says 172.21.15.12:37988) 2024-05-15T15:40:04.907 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.889+0000 7f9c1ffff640 1 -- 172.21.15.12:0/1165423766 learned_addr learned my addr 172.21.15.12:0/1165423766 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:04.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.889+0000 7fd52bd38640 1 -- 172.21.15.12:0/1061042612 wait complete. 2024-05-15T15:40:04.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.890+0000 7f9c1f7fe640 1 --2- 172.21.15.12:0/1165423766 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9c18006cf0 0x7f9c18033420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:04.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.890+0000 7fc5136cd640 1 -- 172.21.15.12:0/878619590 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc50c0b4c30 con 0x7fc50c0b62d0 2024-05-15T15:40:04.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.890+0000 7f9c1effd640 1 -- 172.21.15.12:0/1165423766 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f9c1803b1e0 msgr2=0x7f9c180cb250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:04.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.890+0000 7f9c1effd640 1 --2- 172.21.15.12:0/1165423766 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f9c1803b1e0 0x7f9c180cb250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:04.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.890+0000 7f9c1effd640 1 -- 172.21.15.12:0/1165423766 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9c18006cf0 msgr2=0x7f9c18033420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:04.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.890+0000 7f9c1effd640 1 --2- 172.21.15.12:0/1165423766 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9c18006cf0 0x7f9c18033420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:04.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.890+0000 7f9c1effd640 1 -- 172.21.15.12:0/1165423766 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c18161010 con 0x7f9c18009090 2024-05-15T15:40:04.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.890+0000 7f0d6f6a7640 1 -- 172.21.15.12:0/582011796 shutdown_connections 2024-05-15T15:40:04.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.890+0000 7f0d6f6a7640 1 -- 172.21.15.12:0/582011796 wait complete. 2024-05-15T15:40:04.910 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.890+0000 7f9c1effd640 1 --2- 172.21.15.12:0/1165423766 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c18009090 0x7f9c18160ad0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9c1400e8a0 tx=0x7f9c1400ed60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:04.910 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.890+0000 7f972bacd640 1 -- 172.21.15.12:0/1941823950 shutdown_connections 2024-05-15T15:40:04.910 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.890+0000 7f972bacd640 1 --2- 172.21.15.12:0/1941823950 >> v2:172.21.15.12:3300/0 conn(0x7f972406db00 0x7f972414e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:04.910 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.890+0000 7f972bacd640 1 --2- 172.21.15.12:0/1941823950 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f972406d6f0 0x7f972414dd90 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:04.910 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.890+0000 7f972bacd640 1 -- 172.21.15.12:0/1941823950 >> 172.21.15.12:0/1941823950 conn(0x7f972406f580 msgr2=0x7f972406f990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:04.910 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.890+0000 7f9c0bfff640 1 -- 172.21.15.12:0/1165423766 <== mon.1 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c14017070 con 0x7f9c18009090 2024-05-15T15:40:04.910 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.890+0000 7f9c0bfff640 1 -- 172.21.15.12:0/1165423766 <== mon.1 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c1400c940 con 0x7f9c18009090 2024-05-15T15:40:04.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.890+0000 7f9c0bfff640 1 -- 172.21.15.12:0/1165423766 <== mon.1 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c14009e60 con 0x7f9c18009090 2024-05-15T15:40:04.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.890+0000 7f9c24c4d640 1 -- 172.21.15.12:0/1165423766 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c180d89e0 con 0x7f9c18009090 2024-05-15T15:40:04.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.890+0000 7f9c24c4d640 1 -- 172.21.15.12:0/1165423766 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c18032f00 con 0x7f9c18009090 2024-05-15T15:40:04.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.891+0000 7f972bacd640 1 -- 172.21.15.12:0/1941823950 shutdown_connections 2024-05-15T15:40:04.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.891+0000 7f972bacd640 1 -- 172.21.15.12:0/1941823950 wait complete. 2024-05-15T15:40:04.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.892+0000 7fd52bd38640 1 Processor -- start 2024-05-15T15:40:04.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.894+0000 7f972bacd640 1 Processor -- start 2024-05-15T15:40:04.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.894+0000 7f972bacd640 1 -- start start 2024-05-15T15:40:04.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.892+0000 7fd52bd38640 1 -- start start 2024-05-15T15:40:04.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.894+0000 7fd52bd38640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd51000a3f0 0x7fd524073a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:04.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.894+0000 7fd52bd38640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fd52413ef40 0x7fd52413c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:04.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.894+0000 7fd52bd38640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd52413cc30 0x7fd5241f4200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:04.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.894+0000 7fd52bd38640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fd524146120 con 0x7fd51000a3f0 2024-05-15T15:40:04.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.894+0000 7fd52bd38640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fd5240bb920 con 0x7fd52413cc30 2024-05-15T15:40:04.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.894+0000 7fd52bd38640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fd5241462a0 con 0x7fd52413ef40 2024-05-15T15:40:04.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.894+0000 7fd5292d3640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fd52413ef40 0x7fd52413c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:04.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.894+0000 7fd52a2d5640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd52413cc30 0x7fd5241f4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:04.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.894+0000 7fd52a2d5640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd52413cc30 0x7fd5241f4200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.12:36190/0 (socket says 172.21.15.12:36190) 2024-05-15T15:40:04.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.894+0000 7fd52a2d5640 1 -- 172.21.15.12:0/1889893932 learned_addr learned my addr 172.21.15.12:0/1889893932 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:04.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.894+0000 7f9c0bfff640 1 -- 172.21.15.12:0/1165423766 <== mon.1 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f9c1401a070 con 0x7f9c18009090 2024-05-15T15:40:04.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.894+0000 7f9c0bfff640 1 --2- 172.21.15.12:0/1165423766 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f9c04076300 0x7f9c04078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:04.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.894+0000 7f9c0bfff640 1 -- 172.21.15.12:0/1165423766 <== mon.1 v2:172.21.15.84:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f9c140977c0 con 0x7f9c18009090 2024-05-15T15:40:04.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.892+0000 7f0d6f6a7640 1 Processor -- start 2024-05-15T15:40:04.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.895+0000 7fd529ad4640 1 --2- 172.21.15.12:0/1889893932 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd51000a3f0 0x7fd524073a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:04.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.892+0000 7f0d6f6a7640 1 -- start start 2024-05-15T15:40:04.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.895+0000 7fd52a2d5640 1 -- 172.21.15.12:0/1889893932 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fd52413ef40 msgr2=0x7fd52413c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:04.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.894+0000 7f0d6f6a7640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f0d6806d6f0 0x7f0d68147210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:04.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.894+0000 7f0d6f6a7640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d68072e00 0x7f0d680a32f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:04.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.894+0000 7f0d6f6a7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d68073920 0x7f0d68148900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:04.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.894+0000 7f0d6f6a7640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f0d680bc7f0 con 0x7f0d68073920 2024-05-15T15:40:04.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.894+0000 7f0d6f6a7640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f0d680bc670 con 0x7f0d68072e00 2024-05-15T15:40:04.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.894+0000 7f0d6f6a7640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f0d6806db00 con 0x7f0d6806d6f0 2024-05-15T15:40:04.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.894+0000 7f0d6dc44640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d68073920 0x7f0d68148900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:04.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.894+0000 7f0d6dc44640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d68073920 0x7f0d68148900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59866/0 (socket says 172.21.15.12:59866) 2024-05-15T15:40:04.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.894+0000 7f0d6dc44640 1 -- 172.21.15.12:0/2938922925 learned_addr learned my addr 172.21.15.12:0/2938922925 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:04.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.894+0000 7f0d6cc42640 1 --2- 172.21.15.12:0/2938922925 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d68072e00 0x7f0d680a32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:04.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.895+0000 7f0d6d443640 1 --2- 172.21.15.12:0/2938922925 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f0d6806d6f0 0x7f0d68147210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:04.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.895+0000 7f0d6dc44640 1 -- 172.21.15.12:0/2938922925 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f0d6806d6f0 msgr2=0x7f0d68147210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:04.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.895+0000 7f0d6dc44640 1 --2- 172.21.15.12:0/2938922925 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f0d6806d6f0 0x7f0d68147210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:04.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.895+0000 7f0d6dc44640 1 -- 172.21.15.12:0/2938922925 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d68072e00 msgr2=0x7f0d680a32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:04.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.895+0000 7f0d6dc44640 1 --2- 172.21.15.12:0/2938922925 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d68072e00 0x7f0d680a32f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:04.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.895+0000 7f0d6dc44640 1 -- 172.21.15.12:0/2938922925 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d6815bd00 con 0x7f0d68073920 2024-05-15T15:40:04.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.895+0000 7f0d6dc44640 1 --2- 172.21.15.12:0/2938922925 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d68073920 0x7f0d68148900 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f0d5802a860 tx=0x7f0d580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:04.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.896+0000 7f972bacd640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f972406d6f0 0x7f97241e3af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:04.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.895+0000 7fd52a2d5640 1 --2- 172.21.15.12:0/1889893932 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fd52413ef40 0x7fd52413c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:04.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.896+0000 7fc501ffb640 1 -- 172.21.15.12:0/878619590 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc4fc01e460 con 0x7fc50c0b62d0 2024-05-15T15:40:04.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.895+0000 7fd52a2d5640 1 -- 172.21.15.12:0/1889893932 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd51000a3f0 msgr2=0x7fd524073a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:04.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.895+0000 7fd52a2d5640 1 --2- 172.21.15.12:0/1889893932 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd51000a3f0 0x7fd524073a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:04.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.896+0000 7f972bacd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f972406db00 0x7f9724146030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:04.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.895+0000 7fd52a2d5640 1 -- 172.21.15.12:0/1889893932 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd524138170 con 0x7fd52413cc30 2024-05-15T15:40:04.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.896+0000 7f9729869640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f972406d6f0 0x7f97241e3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:04.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.896+0000 7f9729869640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f972406d6f0 0x7f97241e3af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3301/0 says I am v2:172.21.15.12:38022/0 (socket says 172.21.15.12:38022) 2024-05-15T15:40:04.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.896+0000 7fd5292d3640 1 --2- 172.21.15.12:0/1889893932 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fd52413ef40 0x7fd52413c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-15T15:40:04.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.896+0000 7f9729068640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f972406db00 0x7f9724146030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:04.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.896+0000 7f9c1f7fe640 1 --2- 172.21.15.12:0/1165423766 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f9c04076300 0x7f9c04078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:04.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.896+0000 7fd529ad4640 1 --2- 172.21.15.12:0/1889893932 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd51000a3f0 0x7fd524073a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-15T15:40:04.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.896+0000 7f9729068640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f972406db00 0x7f9724146030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.12:36200/0 (socket says 172.21.15.12:36200) 2024-05-15T15:40:04.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.896+0000 7fd52a2d5640 1 --2- 172.21.15.12:0/1889893932 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd52413cc30 0x7fd5241f4200 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd51c00c550 tx=0x7fd51c001c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:04.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.896+0000 7f9729068640 1 -- 172.21.15.12:0/3881163491 learned_addr learned my addr 172.21.15.12:0/3881163491 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:04.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.896+0000 7fc501ffb640 1 --2- 172.21.15.12:0/878619590 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fc4f00763a0 0x7fc4f00788b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:04.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.896+0000 7fd51a7fc640 1 -- 172.21.15.12:0/1889893932 <== mon.1 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd51c033030 con 0x7fd52413cc30 2024-05-15T15:40:04.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.896+0000 7f972bacd640 1 --2- 172.21.15.12:0/3881163491 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9724144b40 0x7f972413e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:04.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.897+0000 7fc501ffb640 1 -- 172.21.15.12:0/878619590 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fc4fc097b40 con 0x7fc50c0b62d0 2024-05-15T15:40:04.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.897+0000 7f972a06a640 1 --2- 172.21.15.12:0/3881163491 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9724144b40 0x7f972413e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:04.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.897+0000 7fc511469640 1 --2- 172.21.15.12:0/878619590 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fc4f00763a0 0x7fc4f00788b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:04.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.897+0000 7f972bacd640 1 -- 172.21.15.12:0/3881163491 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f97240b6ff0 con 0x7f9724144b40 2024-05-15T15:40:04.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.897+0000 7f9c24c4d640 1 -- 172.21.15.12:0/1165423766 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c00005290 con 0x7f9c18009090 2024-05-15T15:40:04.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.897+0000 7f972bacd640 1 -- 172.21.15.12:0/3881163491 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f9724144f50 con 0x7f972406db00 2024-05-15T15:40:04.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.897+0000 7f9c1f7fe640 1 --2- 172.21.15.12:0/1165423766 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f9c04076300 0x7f9c04078810 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9c1800d9b0 tx=0x7f9c200ab000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:04.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.897+0000 7f972bacd640 1 -- 172.21.15.12:0/3881163491 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f97240b7170 con 0x7f972406d6f0 2024-05-15T15:40:04.925 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.897+0000 7fd52bd38640 1 -- 172.21.15.12:0/1889893932 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5241f0cb0 con 0x7fd52413cc30 2024-05-15T15:40:04.925 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.898+0000 7f972a06a640 1 -- 172.21.15.12:0/3881163491 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f972406d6f0 msgr2=0x7f97241e3af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:04.925 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.898+0000 7f972a06a640 1 --2- 172.21.15.12:0/3881163491 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f972406d6f0 0x7f97241e3af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:04.925 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.898+0000 7f972a06a640 1 -- 172.21.15.12:0/3881163491 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f972406db00 msgr2=0x7f9724146030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:04.925 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.898+0000 7f972a06a640 1 --2- 172.21.15.12:0/3881163491 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f972406db00 0x7f9724146030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:04.925 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.898+0000 7f972a06a640 1 -- 172.21.15.12:0/3881163491 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97241e4030 con 0x7f9724144b40 2024-05-15T15:40:04.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.897+0000 7fd52bd38640 1 -- 172.21.15.12:0/1889893932 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd524073530 con 0x7fd52413cc30 2024-05-15T15:40:04.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.897+0000 7fd51a7fc640 1 -- 172.21.15.12:0/1889893932 <== mon.1 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd51c003970 con 0x7fd52413cc30 2024-05-15T15:40:04.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.897+0000 7fd51a7fc640 1 -- 172.21.15.12:0/1889893932 <== mon.1 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd51c02fe60 con 0x7fd52413cc30 2024-05-15T15:40:04.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.898+0000 7f972a06a640 1 --2- 172.21.15.12:0/3881163491 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9724144b40 0x7f972413e180 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f971c00bdf0 tx=0x7f971c00f500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:04.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.898+0000 7fc511469640 1 --2- 172.21.15.12:0/878619590 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fc4f00763a0 0x7fc4f00788b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc508006fd0 tx=0x7fc508008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:04.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.899+0000 7f9729869640 1 --2- 172.21.15.12:0/3881163491 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f972406d6f0 0x7f97241e3af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-15T15:40:04.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.899+0000 7fd52bd38640 1 -- 172.21.15.12:0/1889893932 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd50c005290 con 0x7fd52413cc30 2024-05-15T15:40:04.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.900+0000 7fd51a7fc640 1 -- 172.21.15.12:0/1889893932 <== mon.1 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd51c036020 con 0x7fd52413cc30 2024-05-15T15:40:04.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.900+0000 7fd51a7fc640 1 --2- 172.21.15.12:0/1889893932 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fd5080762d0 0x7fd5080787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:04.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.901+0000 7fd529ad4640 1 --2- 172.21.15.12:0/1889893932 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fd5080762d0 0x7fd5080787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:04.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.901+0000 7fd51a7fc640 1 -- 172.21.15.12:0/1889893932 <== mon.1 v2:172.21.15.84:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fd51c0b7bb0 con 0x7fd52413cc30 2024-05-15T15:40:04.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.901+0000 7f0d5dffb640 1 -- 172.21.15.12:0/2938922925 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d58041020 con 0x7f0d68073920 2024-05-15T15:40:04.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.901+0000 7f971a7fc640 1 -- 172.21.15.12:0/3881163491 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f971c00b0d0 con 0x7f9724144b40 2024-05-15T15:40:04.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.901+0000 7fc501ffb640 1 -- 172.21.15.12:0/878619590 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fc4fc061480 con 0x7fc50c0b62d0 2024-05-15T15:40:04.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.901+0000 7f971a7fc640 1 -- 172.21.15.12:0/3881163491 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f971c01a070 con 0x7f9724144b40 2024-05-15T15:40:04.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.901+0000 7f972bacd640 1 -- 172.21.15.12:0/3881163491 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9724146570 con 0x7f9724144b40 2024-05-15T15:40:04.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.901+0000 7f972bacd640 1 -- 172.21.15.12:0/3881163491 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97241e42a0 con 0x7f9724144b40 2024-05-15T15:40:04.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.902+0000 7f971a7fc640 1 -- 172.21.15.12:0/3881163491 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f971c009540 con 0x7f9724144b40 2024-05-15T15:40:04.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.901+0000 7f0d6f6a7640 1 -- 172.21.15.12:0/2938922925 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d68145f10 con 0x7f0d68073920 2024-05-15T15:40:04.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.901+0000 7f0d6f6a7640 1 -- 172.21.15.12:0/2938922925 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d68147b30 con 0x7f0d68073920 2024-05-15T15:40:04.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.903+0000 7f972bacd640 1 -- 172.21.15.12:0/3881163491 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f970c005290 con 0x7f9724144b40 2024-05-15T15:40:04.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.902+0000 7fd529ad4640 1 --2- 172.21.15.12:0/1889893932 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fd5080762d0 0x7fd5080787e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd514007fd0 tx=0x7fd514010040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:04.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.904+0000 7f9c0bfff640 1 -- 172.21.15.12:0/1165423766 <== mon.1 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f9c14060ff0 con 0x7f9c18009090 2024-05-15T15:40:04.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.905+0000 7f971a7fc640 1 -- 172.21.15.12:0/3881163491 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f971c005d10 con 0x7f9724144b40 2024-05-15T15:40:04.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.906+0000 7f971a7fc640 1 --2- 172.21.15.12:0/3881163491 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f97080763d0 0x7f97080788e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:04.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.906+0000 7f971a7fc640 1 -- 172.21.15.12:0/3881163491 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f971c097990 con 0x7f9724144b40 2024-05-15T15:40:04.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.903+0000 7f0d5dffb640 1 -- 172.21.15.12:0/2938922925 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d58032440 con 0x7f0d68073920 2024-05-15T15:40:04.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.903+0000 7f0d537fe640 1 -- 172.21.15.12:0/2938922925 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d68147d90 con 0x7f0d68073920 2024-05-15T15:40:04.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.903+0000 7f0d5dffb640 1 -- 172.21.15.12:0/2938922925 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d58037040 con 0x7f0d68073920 2024-05-15T15:40:04.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.907+0000 7f9729869640 1 --2- 172.21.15.12:0/3881163491 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f97080763d0 0x7f97080788e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:04.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.906+0000 7f0d5dffb640 1 -- 172.21.15.12:0/2938922925 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0d58044020 con 0x7f0d68073920 2024-05-15T15:40:04.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.907+0000 7f0d5dffb640 1 --2- 172.21.15.12:0/2938922925 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f0d4c0762d0 0x7f0d4c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:04.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.907+0000 7f0d5dffb640 1 -- 172.21.15.12:0/2938922925 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f0d580b86f0 con 0x7f0d68073920 2024-05-15T15:40:04.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.908+0000 7f0d6d443640 1 --2- 172.21.15.12:0/2938922925 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f0d4c0762d0 0x7f0d4c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:04.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.908+0000 7fd51a7fc640 1 -- 172.21.15.12:0/1889893932 <== mon.1 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fd51c0813e0 con 0x7fd52413cc30 2024-05-15T15:40:04.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.908+0000 7f9729869640 1 --2- 172.21.15.12:0/3881163491 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f97080763d0 0x7f97080788e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9714001750 tx=0x7f9714009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:04.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.909+0000 7f0d6d443640 1 --2- 172.21.15.12:0/2938922925 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f0d4c0762d0 0x7f0d4c0787e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0d64006fd0 tx=0x7f0d64009060 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:04.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.915+0000 7f0d5dffb640 1 -- 172.21.15.12:0/2938922925 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f0d5804b020 con 0x7f0d68073920 2024-05-15T15:40:04.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:04.925+0000 7f971a7fc640 1 -- 172.21.15.12:0/3881163491 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f971c0612d0 con 0x7f9724144b40 2024-05-15T15:40:05.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:05.267+0000 7f4a1cf47640 1 -- 172.21.15.12:0/3938660687 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f4a18074070 con 0x7f4a180b62d0 2024-05-15T15:40:05.273 INFO:teuthology.orchestra.run.smithi012.stdout:55834574855 2024-05-15T15:40:05.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:05.269+0000 7f4a06ffd640 1 -- 172.21.15.12:0/3938660687 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4a181428f0 con 0x7f4a180b62d0 2024-05-15T15:40:05.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:05.272+0000 7f4a1cf47640 1 -- 172.21.15.12:0/3938660687 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f49f80763a0 msgr2=0x7f49f80788b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:05.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:05.272+0000 7f4a1cf47640 1 --2- 172.21.15.12:0/3938660687 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f49f80763a0 0x7f49f80788b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4a1806d3b0 tx=0x7f4a1000b040 comp rx=0 tx=0).stop 2024-05-15T15:40:05.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:05.272+0000 7f4a1cf47640 1 -- 172.21.15.12:0/3938660687 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a180b62d0 msgr2=0x7f4a18072510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:05.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:05.272+0000 7f4a1cf47640 1 --2- 172.21.15.12:0/3938660687 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a180b62d0 0x7f4a18072510 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4a0c0013f0 tx=0x7f4a0c00cbb0 comp rx=0 tx=0).stop 2024-05-15T15:40:05.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:05.272+0000 7f4a1cf47640 1 -- 172.21.15.12:0/3938660687 shutdown_connections 2024-05-15T15:40:05.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:05.272+0000 7f4a1cf47640 1 --2- 172.21.15.12:0/3938660687 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a181536a0 0x7f4a18150fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:05.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:05.272+0000 7f4a1cf47640 1 --2- 172.21.15.12:0/3938660687 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f4a180ba2e0 0x7f4a18152440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:05.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:05.272+0000 7f4a1cf47640 1 --2- 172.21.15.12:0/3938660687 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f49f80763a0 0x7f49f80788b0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:05.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:05.272+0000 7f4a1cf47640 1 --2- 172.21.15.12:0/3938660687 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a180b62d0 0x7f4a18072510 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:05.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:05.272+0000 7f4a1cf47640 1 -- 172.21.15.12:0/3938660687 >> 172.21.15.12:0/3938660687 conn(0x7f4a180a16b0 msgr2=0x7f4a18068600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:05.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:05.273+0000 7f4a1cf47640 1 -- 172.21.15.12:0/3938660687 shutdown_connections 2024-05-15T15:40:05.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:05.273+0000 7f4a1cf47640 1 -- 172.21.15.12:0/3938660687 wait complete. 2024-05-15T15:40:05.296 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.4 2024-05-15T15:40:05.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:05.303+0000 7f7401ffb640 1 -- 172.21.15.12:0/2799248555 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f741c1e17e0 con 0x7f741c074760 2024-05-15T15:40:05.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:05.304+0000 7f7403fff640 1 -- 172.21.15.12:0/2799248555 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f741c1e17e0 con 0x7f741c074760 2024-05-15T15:40:05.306 INFO:teuthology.orchestra.run.smithi012.stdout:64424509447 2024-05-15T15:40:05.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:05.307+0000 7f7401ffb640 1 -- 172.21.15.12:0/2799248555 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f74080763a0 msgr2=0x7f74080788b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:05.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:05.307+0000 7f7401ffb640 1 --2- 172.21.15.12:0/2799248555 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f74080763a0 0x7f74080788b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f741c142890 tx=0x7f7410009190 comp rx=0 tx=0).stop 2024-05-15T15:40:05.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:05.307+0000 7f7401ffb640 1 -- 172.21.15.12:0/2799248555 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f741c074760 msgr2=0x7f741c1e10d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:05.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:05.307+0000 7f7401ffb640 1 --2- 172.21.15.12:0/2799248555 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f741c074760 0x7f741c1e10d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f740c000c00 tx=0x7f740c0046c0 comp rx=0 tx=0).stop 2024-05-15T15:40:05.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:05.307+0000 7f7401ffb640 1 -- 172.21.15.12:0/2799248555 shutdown_connections 2024-05-15T15:40:05.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:05.307+0000 7f7401ffb640 1 --2- 172.21.15.12:0/2799248555 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f741c144830 0x7f741c1d62a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:05.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:05.307+0000 7f7401ffb640 1 --2- 172.21.15.12:0/2799248555 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f741c0a0dc0 0x7f741c1d5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:05.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:05.307+0000 7f7401ffb640 1 --2- 172.21.15.12:0/2799248555 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f74080763a0 0x7f74080788b0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:05.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:05.307+0000 7f7401ffb640 1 --2- 172.21.15.12:0/2799248555 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f741c074760 0x7f741c1e10d0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:05.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:05.307+0000 7f7401ffb640 1 -- 172.21.15.12:0/2799248555 >> 172.21.15.12:0/2799248555 conn(0x7f741c0a16b0 msgr2=0x7f741c0b4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:05.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:05.308+0000 7f7401ffb640 1 -- 172.21.15.12:0/2799248555 shutdown_connections 2024-05-15T15:40:05.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:05.308+0000 7f7401ffb640 1 -- 172.21.15.12:0/2799248555 wait complete. 2024-05-15T15:40:05.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:05.309+0000 7f895577a640 1 -- 172.21.15.12:0/2308624776 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f8930005850 con 0x7f89480c9050 2024-05-15T15:40:05.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:05.309+0000 7f89377fe640 1 -- 172.21.15.12:0/2308624776 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8950101320 con 0x7f89480c9050 2024-05-15T15:40:05.312 INFO:teuthology.orchestra.run.smithi012.stdout:64424509446 2024-05-15T15:40:05.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:05.312+0000 7f895577a640 1 -- 172.21.15.12:0/2308624776 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f893c0763a0 msgr2=0x7f893c0788b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:05.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:05.312+0000 7f895577a640 1 --2- 172.21.15.12:0/2308624776 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f893c0763a0 0x7f893c0788b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f89440098b0 tx=0x7f8944009190 comp rx=0 tx=0).stop 2024-05-15T15:40:05.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:05.313+0000 7f895577a640 1 -- 172.21.15.12:0/2308624776 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89480c9050 msgr2=0x7f89480c3ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:05.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:05.313+0000 7f895577a640 1 --2- 172.21.15.12:0/2308624776 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89480c9050 0x7f89480c3ac0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f895006a9d0 tx=0x7f895006b670 comp rx=0 tx=0).stop 2024-05-15T15:40:05.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:05.313+0000 7f895577a640 1 -- 172.21.15.12:0/2308624776 shutdown_connections 2024-05-15T15:40:05.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:05.313+0000 7f895577a640 1 --2- 172.21.15.12:0/2308624776 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f893c0763a0 0x7f893c0788b0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:05.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:05.313+0000 7f895577a640 1 --2- 172.21.15.12:0/2308624776 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89480c9050 0x7f89480c3ac0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:05.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:05.313+0000 7f895577a640 1 --2- 172.21.15.12:0/2308624776 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8948041db0 0x7f89480d2570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:05.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:05.313+0000 7f895577a640 1 --2- 172.21.15.12:0/2308624776 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f894803eb70 0x7f8948177050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:05.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:05.313+0000 7f895577a640 1 -- 172.21.15.12:0/2308624776 >> 172.21.15.12:0/2308624776 conn(0x7f89480450e0 msgr2=0x7f89480c6ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:05.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:05.313+0000 7f895577a640 1 -- 172.21.15.12:0/2308624776 shutdown_connections 2024-05-15T15:40:05.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:05.313+0000 7f895577a640 1 -- 172.21.15.12:0/2308624776 wait complete. 2024-05-15T15:40:05.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:05.326+0000 7f9c24c4d640 1 -- 172.21.15.12:0/1165423766 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f9c00005580 con 0x7f9c18009090 2024-05-15T15:40:05.329 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509447 for osd.1 2024-05-15T15:40:05.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:05.327+0000 7f9c0bfff640 1 -- 172.21.15.12:0/1165423766 <== mon.1 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9c140608f0 con 0x7f9c18009090 2024-05-15T15:40:05.330 INFO:teuthology.orchestra.run.smithi012.stdout:64424509447 2024-05-15T15:40:05.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:05.328+0000 7f0d537fe640 1 -- 172.21.15.12:0/2938922925 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f0d68069b50 con 0x7f0d68073920 2024-05-15T15:40:05.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:05.329+0000 7f0d5dffb640 1 -- 172.21.15.12:0/2938922925 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0d580819e0 con 0x7f0d68073920 2024-05-15T15:40:05.331 INFO:teuthology.orchestra.run.smithi012.stdout:64424509446 2024-05-15T15:40:05.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:05.329+0000 7f9c24c4d640 1 -- 172.21.15.12:0/1165423766 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f9c04076300 msgr2=0x7f9c04078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:05.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:05.329+0000 7f9c24c4d640 1 --2- 172.21.15.12:0/1165423766 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f9c04076300 0x7f9c04078810 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9c1800d9b0 tx=0x7f9c200ab000 comp rx=0 tx=0).stop 2024-05-15T15:40:05.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:05.329+0000 7f9c24c4d640 1 -- 172.21.15.12:0/1165423766 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c18009090 msgr2=0x7f9c18160ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:05.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:05.329+0000 7f9c24c4d640 1 --2- 172.21.15.12:0/1165423766 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c18009090 0x7f9c18160ad0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9c1400e8a0 tx=0x7f9c1400ed60 comp rx=0 tx=0).stop 2024-05-15T15:40:05.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:05.329+0000 7f9c24c4d640 1 -- 172.21.15.12:0/1165423766 shutdown_connections 2024-05-15T15:40:05.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:05.329+0000 7f9c24c4d640 1 --2- 172.21.15.12:0/1165423766 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f9c1803b1e0 0x7f9c180cb250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:05.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:05.329+0000 7f9c24c4d640 1 --2- 172.21.15.12:0/1165423766 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c18009090 0x7f9c18160ad0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:05.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:05.329+0000 7f9c24c4d640 1 --2- 172.21.15.12:0/1165423766 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f9c04076300 0x7f9c04078810 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:05.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:05.330+0000 7f9c24c4d640 1 --2- 172.21.15.12:0/1165423766 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9c18006cf0 0x7f9c18033420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:05.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:05.330+0000 7f9c24c4d640 1 -- 172.21.15.12:0/1165423766 >> 172.21.15.12:0/1165423766 conn(0x7f9c18007e00 msgr2=0x7f9c1803cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:05.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:05.330+0000 7f9c24c4d640 1 -- 172.21.15.12:0/1165423766 shutdown_connections 2024-05-15T15:40:05.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:05.330+0000 7f9c24c4d640 1 -- 172.21.15.12:0/1165423766 wait complete. 2024-05-15T15:40:05.336 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.0 2024-05-15T15:40:05.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:05.331+0000 7f0d537fe640 1 -- 172.21.15.12:0/2938922925 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f0d4c0762d0 msgr2=0x7f0d4c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:05.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:05.331+0000 7f0d537fe640 1 --2- 172.21.15.12:0/2938922925 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f0d4c0762d0 0x7f0d4c0787e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0d64006fd0 tx=0x7f0d64009060 comp rx=0 tx=0).stop 2024-05-15T15:40:05.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:05.331+0000 7f0d537fe640 1 -- 172.21.15.12:0/2938922925 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d68073920 msgr2=0x7f0d68148900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:05.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:05.331+0000 7f0d537fe640 1 --2- 172.21.15.12:0/2938922925 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d68073920 0x7f0d68148900 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f0d5802a860 tx=0x7f0d580046c0 comp rx=0 tx=0).stop 2024-05-15T15:40:05.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:05.331+0000 7f0d537fe640 1 -- 172.21.15.12:0/2938922925 shutdown_connections 2024-05-15T15:40:05.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:05.331+0000 7f0d537fe640 1 --2- 172.21.15.12:0/2938922925 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f0d4c0762d0 0x7f0d4c0787e0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:05.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:05.331+0000 7f0d537fe640 1 --2- 172.21.15.12:0/2938922925 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d68073920 0x7f0d68148900 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:05.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:05.331+0000 7f0d537fe640 1 --2- 172.21.15.12:0/2938922925 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d68072e00 0x7f0d680a32f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:05.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:05.331+0000 7f0d537fe640 1 --2- 172.21.15.12:0/2938922925 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f0d6806d6f0 0x7f0d68147210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:05.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:05.331+0000 7f0d537fe640 1 -- 172.21.15.12:0/2938922925 >> 172.21.15.12:0/2938922925 conn(0x7f0d6806f390 msgr2=0x7f0d680b5d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:05.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:05.331+0000 7f0d537fe640 1 -- 172.21.15.12:0/2938922925 shutdown_connections 2024-05-15T15:40:05.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:05.331+0000 7f0d537fe640 1 -- 172.21.15.12:0/2938922925 wait complete. 2024-05-15T15:40:05.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:05.337+0000 7fc5136cd640 1 -- 172.21.15.12:0/878619590 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fc50c0b5230 con 0x7fc50c0b62d0 2024-05-15T15:40:05.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:05.337+0000 7fc501ffb640 1 -- 172.21.15.12:0/878619590 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc4fc060d80 con 0x7fc50c0b62d0 2024-05-15T15:40:05.340 INFO:teuthology.orchestra.run.smithi012.stdout:64424509446 2024-05-15T15:40:05.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:05.340+0000 7fc5136cd640 1 -- 172.21.15.12:0/878619590 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fc4f00763a0 msgr2=0x7fc4f00788b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:05.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:05.340+0000 7fc5136cd640 1 --2- 172.21.15.12:0/878619590 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fc4f00763a0 0x7fc4f00788b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc508006fd0 tx=0x7fc508008040 comp rx=0 tx=0).stop 2024-05-15T15:40:05.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:05.340+0000 7fc5136cd640 1 -- 172.21.15.12:0/878619590 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc50c0b62d0 msgr2=0x7fc50c0b8b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:05.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:05.340+0000 7fc5136cd640 1 --2- 172.21.15.12:0/878619590 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc50c0b62d0 0x7fc50c0b8b40 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc4fc00d830 tx=0x7fc4fc00dcf0 comp rx=0 tx=0).stop 2024-05-15T15:40:05.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:05.340+0000 7fc5136cd640 1 -- 172.21.15.12:0/878619590 shutdown_connections 2024-05-15T15:40:05.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:05.340+0000 7fc5136cd640 1 --2- 172.21.15.12:0/878619590 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc50c1536a0 0x7fc50c071f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:05.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:05.340+0000 7fc5136cd640 1 --2- 172.21.15.12:0/878619590 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fc4f00763a0 0x7fc4f00788b0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:05.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:05.340+0000 7fc5136cd640 1 --2- 172.21.15.12:0/878619590 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc50c0b62d0 0x7fc50c0b8b40 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:05.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:05.340+0000 7fc5136cd640 1 --2- 172.21.15.12:0/878619590 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc50c06d0d0 0x7fc50c06ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:05.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:05.340+0000 7fc5136cd640 1 -- 172.21.15.12:0/878619590 >> 172.21.15.12:0/878619590 conn(0x7fc50c0a16b0 msgr2=0x7fc50c0bec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:05.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:05.340+0000 7fc5136cd640 1 -- 172.21.15.12:0/878619590 shutdown_connections 2024-05-15T15:40:05.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:05.340+0000 7fc5136cd640 1 -- 172.21.15.12:0/878619590 wait complete. 2024-05-15T15:40:05.349 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509447 for osd.5 2024-05-15T15:40:05.350 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.6 2024-05-15T15:40:05.353 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.2 2024-05-15T15:40:05.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:05.357+0000 7fd52bd38640 1 -- 172.21.15.12:0/1889893932 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fd50c005580 con 0x7fd52413cc30 2024-05-15T15:40:05.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:05.357+0000 7fd51a7fc640 1 -- 172.21.15.12:0/1889893932 <== mon.1 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd51c080ce0 con 0x7fd52413cc30 2024-05-15T15:40:05.359 INFO:teuthology.orchestra.run.smithi012.stdout:64424509446 2024-05-15T15:40:05.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:05.360+0000 7fd52bd38640 1 -- 172.21.15.12:0/1889893932 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fd5080762d0 msgr2=0x7fd5080787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:05.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:05.360+0000 7fd52bd38640 1 --2- 172.21.15.12:0/1889893932 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fd5080762d0 0x7fd5080787e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd514007fd0 tx=0x7fd514010040 comp rx=0 tx=0).stop 2024-05-15T15:40:05.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:05.360+0000 7fd52bd38640 1 -- 172.21.15.12:0/1889893932 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd52413cc30 msgr2=0x7fd5241f4200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:05.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:05.360+0000 7fd52bd38640 1 --2- 172.21.15.12:0/1889893932 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd52413cc30 0x7fd5241f4200 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd51c00c550 tx=0x7fd51c001c10 comp rx=0 tx=0).stop 2024-05-15T15:40:05.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:05.360+0000 7fd52bd38640 1 -- 172.21.15.12:0/1889893932 shutdown_connections 2024-05-15T15:40:05.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:05.360+0000 7fd52bd38640 1 --2- 172.21.15.12:0/1889893932 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd52413cc30 0x7fd5241f4200 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:05.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:05.360+0000 7fd52bd38640 1 --2- 172.21.15.12:0/1889893932 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fd52413ef40 0x7fd52413c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:05.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:05.360+0000 7fd52bd38640 1 --2- 172.21.15.12:0/1889893932 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fd5080762d0 0x7fd5080787e0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:05.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:05.360+0000 7fd52bd38640 1 --2- 172.21.15.12:0/1889893932 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd51000a3f0 0x7fd524073a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:05.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:05.360+0000 7fd52bd38640 1 -- 172.21.15.12:0/1889893932 >> 172.21.15.12:0/1889893932 conn(0x7fd5240a16b0 msgr2=0x7fd52406f100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:05.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:05.360+0000 7fd52bd38640 1 -- 172.21.15.12:0/1889893932 shutdown_connections 2024-05-15T15:40:05.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:05.360+0000 7fd52bd38640 1 -- 172.21.15.12:0/1889893932 wait complete. 2024-05-15T15:40:05.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:05.370+0000 7f972bacd640 1 -- 172.21.15.12:0/3881163491 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f970c005580 con 0x7f9724144b40 2024-05-15T15:40:05.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:05.370+0000 7f971a7fc640 1 -- 172.21.15.12:0/3881163491 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f971c060bd0 con 0x7f9724144b40 2024-05-15T15:40:05.373 INFO:teuthology.orchestra.run.smithi012.stdout:64424509446 2024-05-15T15:40:05.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:05.372+0000 7f972bacd640 1 -- 172.21.15.12:0/3881163491 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f97080763d0 msgr2=0x7f97080788e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:05.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:05.372+0000 7f972bacd640 1 --2- 172.21.15.12:0/3881163491 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f97080763d0 0x7f97080788e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9714001750 tx=0x7f9714009040 comp rx=0 tx=0).stop 2024-05-15T15:40:05.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:05.372+0000 7f972bacd640 1 -- 172.21.15.12:0/3881163491 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9724144b40 msgr2=0x7f972413e180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:05.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:05.372+0000 7f972bacd640 1 --2- 172.21.15.12:0/3881163491 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9724144b40 0x7f972413e180 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f971c00bdf0 tx=0x7f971c00f500 comp rx=0 tx=0).stop 2024-05-15T15:40:05.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:05.372+0000 7f972bacd640 1 -- 172.21.15.12:0/3881163491 shutdown_connections 2024-05-15T15:40:05.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:05.372+0000 7f972bacd640 1 --2- 172.21.15.12:0/3881163491 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f97080763d0 0x7f97080788e0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:05.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:05.372+0000 7f972bacd640 1 --2- 172.21.15.12:0/3881163491 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9724144b40 0x7f972413e180 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:05.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:05.372+0000 7f972bacd640 1 --2- 172.21.15.12:0/3881163491 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f972406db00 0x7f9724146030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:05.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:05.372+0000 7f972bacd640 1 --2- 172.21.15.12:0/3881163491 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f972406d6f0 0x7f97241e3af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:05.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:05.372+0000 7f972bacd640 1 -- 172.21.15.12:0/3881163491 >> 172.21.15.12:0/3881163491 conn(0x7f972406f580 msgr2=0x7f9724073180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:05.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:05.372+0000 7f972bacd640 1 -- 172.21.15.12:0/3881163491 shutdown_connections 2024-05-15T15:40:05.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:05.372+0000 7f972bacd640 1 -- 172.21.15.12:0/3881163491 wait complete. 2024-05-15T15:40:05.377 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.3 2024-05-15T15:40:05.385 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.7 2024-05-15T15:40:06.297 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-05-15T15:40:06.330 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-15T15:40:06.337 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-15T15:40:06.350 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-05-15T15:40:06.351 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-05-15T15:40:06.354 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-15T15:40:06.379 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-15T15:40:06.386 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-05-15T15:40:06.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.452+0000 7f17c7401640 1 Processor -- start 2024-05-15T15:40:06.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.452+0000 7f17c7401640 1 -- start start 2024-05-15T15:40:06.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.454+0000 7f17c7401640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f17c01455f0 0x7f17c014ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:06.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.454+0000 7f17c7401640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f17c00bb060 0x7f17c014e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:06.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.454+0000 7f17c7401640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17c00bc710 con 0x7f17c00bb470 2024-05-15T15:40:06.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.454+0000 7f17c7401640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f17c014b590 con 0x7f17c01455f0 2024-05-15T15:40:06.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.454+0000 7f17c7401640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f17c014f1c0 con 0x7f17c00bb060 2024-05-15T15:40:06.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.455+0000 7f17c599e640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f17c00bb470 0x7f17c00becd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:45308/0 (socket says 172.21.15.12:45308) 2024-05-15T15:40:06.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.455+0000 7f17c599e640 1 -- 172.21.15.12:0/4269279787 learned_addr learned my addr 172.21.15.12:0/4269279787 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-05-15T15:40:06.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.456+0000 7f17c499c640 1 --2- 172.21.15.12:0/4269279787 >> v2:172.21.15.84:3300/0 conn(0x7f17c00bb060 0x7f17c014e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:06.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.456+0000 7f17c519d640 1 --2- 172.21.15.12:0/4269279787 >> v2:172.21.15.12:3300/0 conn(0x7f17c01455f0 0x7f17c014ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:06.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.456+0000 7f17c499c640 1 -- 172.21.15.12:0/4269279787 >> v2:172.21.15.12:3300/0 conn(0x7f17c01455f0 msgr2=0x7f17c014ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:40:06.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.456+0000 7f17c499c640 1 --2- 172.21.15.12:0/4269279787 >> v2:172.21.15.12:3300/0 conn(0x7f17c01455f0 0x7f17c014ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:06.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.456+0000 7f17c499c640 1 -- 172.21.15.12:0/4269279787 >> v1:172.21.15.12:6789/0 conn(0x7f17c00bb470 legacy=0x7f17c00becd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:06.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.456+0000 7f17c499c640 1 -- 172.21.15.12:0/4269279787 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17c014b220 con 0x7f17c00bb060 2024-05-15T15:40:06.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.458+0000 7f17c499c640 1 --2- 172.21.15.12:0/4269279787 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f17c00bb060 0x7f17c014e680 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f17c00bbf90 tx=0x7f17bc02a150 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3b017096cb089079 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:06.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.459+0000 7f17b7fff640 1 -- 172.21.15.12:0/4269279787 <== mon.1 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17bc037070 con 0x7f17c00bb060 2024-05-15T15:40:06.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.459+0000 7f17b7fff640 1 -- 172.21.15.12:0/4269279787 <== mon.1 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17bc02ade0 con 0x7f17c00bb060 2024-05-15T15:40:06.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.459+0000 7f17b7fff640 1 -- 172.21.15.12:0/4269279787 <== mon.1 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17bc032640 con 0x7f17c00bb060 2024-05-15T15:40:06.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.461+0000 7f17c7401640 1 -- 172.21.15.12:0/4269279787 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f17c00bb060 msgr2=0x7f17c014e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:06.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.461+0000 7f17c7401640 1 --2- 172.21.15.12:0/4269279787 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f17c00bb060 0x7f17c014e680 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f17c00bbf90 tx=0x7f17bc02a150 comp rx=0 tx=0).stop 2024-05-15T15:40:06.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.461+0000 7f17c7401640 1 -- 172.21.15.12:0/4269279787 shutdown_connections 2024-05-15T15:40:06.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.461+0000 7f17c7401640 1 --2- 172.21.15.12:0/4269279787 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f17c00bb060 0x7f17c014e680 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:06.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.461+0000 7f17c7401640 1 --2- 172.21.15.12:0/4269279787 >> v2:172.21.15.12:3300/0 conn(0x7f17c01455f0 0x7f17c014ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:06.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.461+0000 7f17c7401640 1 -- 172.21.15.12:0/4269279787 >> 172.21.15.12:0/4269279787 conn(0x7f17c00bd160 msgr2=0x7f17c00bd570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:06.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.461+0000 7f17c7401640 1 -- 172.21.15.12:0/4269279787 shutdown_connections 2024-05-15T15:40:06.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.461+0000 7f17c7401640 1 -- 172.21.15.12:0/4269279787 wait complete. 2024-05-15T15:40:06.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.464+0000 7f17c7401640 1 Processor -- start 2024-05-15T15:40:06.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.464+0000 7f17c7401640 1 -- start start 2024-05-15T15:40:06.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.466+0000 7f17c7401640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f17c00bb060 0x7f17c0145c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:06.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.466+0000 7f17c7401640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f17c00bb470 0x7f17c0143960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:06.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.466+0000 7f17c519d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f17c00bb060 0x7f17c0145c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:06.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.466+0000 7f17c7401640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f17c01455f0 0x7f17c0147fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:06.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.466+0000 7f17c519d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f17c00bb060 0x7f17c0145c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59912/0 (socket says 172.21.15.12:59912) 2024-05-15T15:40:06.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.467+0000 7f17c499c640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f17c00bb470 0x7f17c0143960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:06.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.467+0000 7f17c499c640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f17c00bb470 0x7f17c0143960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3301/0 says I am v2:172.21.15.12:38034/0 (socket says 172.21.15.12:38034) 2024-05-15T15:40:06.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.467+0000 7f17c599e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f17c01455f0 0x7f17c0147fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:06.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.467+0000 7f17c599e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f17c01455f0 0x7f17c0147fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.12:36220/0 (socket says 172.21.15.12:36220) 2024-05-15T15:40:06.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.467+0000 7f17c7401640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f17c0073120 con 0x7f17c00bb060 2024-05-15T15:40:06.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.467+0000 7f17c7401640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f17c014f4a0 con 0x7f17c01455f0 2024-05-15T15:40:06.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.467+0000 7f17c7401640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f17c0144370 con 0x7f17c00bb470 2024-05-15T15:40:06.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.467+0000 7f17c519d640 1 -- 172.21.15.12:0/1996330792 learned_addr learned my addr 172.21.15.12:0/1996330792 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:06.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.468+0000 7f17c519d640 1 -- 172.21.15.12:0/1996330792 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f17c00bb470 msgr2=0x7f17c0143960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:06.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.468+0000 7f17c519d640 1 --2- 172.21.15.12:0/1996330792 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f17c00bb470 0x7f17c0143960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:06.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.468+0000 7f17c519d640 1 -- 172.21.15.12:0/1996330792 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f17c01455f0 msgr2=0x7f17c0147fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:06.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.468+0000 7f17c519d640 1 --2- 172.21.15.12:0/1996330792 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f17c01455f0 0x7f17c0147fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:06.472 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.468+0000 7f17c519d640 1 -- 172.21.15.12:0/1996330792 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17c01461a0 con 0x7f17c00bb060 2024-05-15T15:40:06.472 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.468+0000 7f17c519d640 1 --2- 172.21.15.12:0/1996330792 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f17c00bb060 0x7f17c0145c60 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f17b000e8a0 tx=0x7f17b000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:06.472 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.469+0000 7f17b5ffb640 1 -- 172.21.15.12:0/1996330792 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17b0017070 con 0x7f17c00bb060 2024-05-15T15:40:06.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.470+0000 7f17c7401640 1 -- 172.21.15.12:0/1996330792 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17c0143ea0 con 0x7f17c00bb060 2024-05-15T15:40:06.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.473+0000 7f17c7401640 1 -- 172.21.15.12:0/1996330792 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17c00a5a10 con 0x7f17c00bb060 2024-05-15T15:40:06.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.475+0000 7f17b5ffb640 1 -- 172.21.15.12:0/1996330792 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17b000c940 con 0x7f17c00bb060 2024-05-15T15:40:06.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.477+0000 7f17b5ffb640 1 -- 172.21.15.12:0/1996330792 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17b000cd10 con 0x7f17c00bb060 2024-05-15T15:40:06.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.477+0000 7f17b5ffb640 1 -- 172.21.15.12:0/1996330792 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f17b001a070 con 0x7f17c00bb060 2024-05-15T15:40:06.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.478+0000 7f17b5ffb640 1 --2- 172.21.15.12:0/1996330792 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f17a40763d0 0x7f17a40788e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:06.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.478+0000 7f17b5ffb640 1 -- 172.21.15.12:0/1996330792 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f17b009b170 con 0x7f17c00bb060 2024-05-15T15:40:06.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.478+0000 7f17ab7fe640 1 -- 172.21.15.12:0/1996330792 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17a0005290 con 0x7f17c00bb060 2024-05-15T15:40:06.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.489+0000 7f17b5ffb640 1 -- 172.21.15.12:0/1996330792 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f17b005ffc0 con 0x7f17c00bb060 2024-05-15T15:40:06.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.491+0000 7f17c499c640 1 --2- 172.21.15.12:0/1996330792 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f17a40763d0 0x7f17a40788e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:06.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.501+0000 7f17c499c640 1 --2- 172.21.15.12:0/1996330792 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f17a40763d0 0x7f17a40788e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f17bc034000 tx=0x7f17bc02e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:06.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.518+0000 7fca2a73f640 1 Processor -- start 2024-05-15T15:40:06.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.519+0000 7fe13d510640 1 Processor -- start 2024-05-15T15:40:06.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.518+0000 7fca2a73f640 1 -- start start 2024-05-15T15:40:06.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.521+0000 7fca2a73f640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fca240bc150 0x7fca240bfea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:06.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.521+0000 7fca2a73f640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fca24156820 0x7fca24070a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:06.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.521+0000 7fca2a73f640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca240c1580 con 0x7fca24070fd0 2024-05-15T15:40:06.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.521+0000 7fca2a73f640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7fca240bfbc0 con 0x7fca24156820 2024-05-15T15:40:06.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.521+0000 7fca2a73f640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fca240c1210 con 0x7fca240bc150 2024-05-15T15:40:06.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.519+0000 7fe13d510640 1 -- start start 2024-05-15T15:40:06.527 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.522+0000 7fca23fff640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fca240bc150 0x7fca240bfea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:06.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.522+0000 7fe13d510640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe138144520 0x7fe13814a350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:06.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.522+0000 7fe13d510640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe13806d200 0x7fe13814a890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:06.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.522+0000 7fe13d510640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe13806fda0 con 0x7fe1380b62c0 2024-05-15T15:40:06.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.522+0000 7fe13d510640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7fe13814e4e0 con 0x7fe13806d200 2024-05-15T15:40:06.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.522+0000 7fe13d510640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fe138144930 con 0x7fe138144520 2024-05-15T15:40:06.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.522+0000 7fca23fff640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fca240bc150 0x7fca240bfea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3301/0 says I am v2:172.21.15.12:38038/0 (socket says 172.21.15.12:38038) 2024-05-15T15:40:06.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.522+0000 7fca237fe640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fca24156820 0x7fca24070a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:06.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.522+0000 7fca28cdc640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fca24070fd0 0x7fca240bd990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:45318/0 (socket says 172.21.15.12:45318) 2024-05-15T15:40:06.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.522+0000 7fe1377fe640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe138144520 0x7fe13814a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:06.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.522+0000 7fe1377fe640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe138144520 0x7fe13814a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3301/0 says I am v2:172.21.15.12:38046/0 (socket says 172.21.15.12:38046) 2024-05-15T15:40:06.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.522+0000 7fe1377fe640 1 -- 172.21.15.12:0/4210858697 learned_addr learned my addr 172.21.15.12:0/4210858697 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:06.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.522+0000 7fe13cd0f640 1 --2- 172.21.15.12:0/4210858697 >> v2:172.21.15.84:3300/0 conn(0x7fe13806d200 0x7fe13814a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:06.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.522+0000 7fca237fe640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fca24156820 0x7fca24070a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.12:36224/0 (socket says 172.21.15.12:36224) 2024-05-15T15:40:06.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.522+0000 7fca237fe640 1 -- 172.21.15.12:0/2261189282 learned_addr learned my addr 172.21.15.12:0/2261189282 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:06.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.522+0000 7fca237fe640 1 -- 172.21.15.12:0/2261189282 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fca240bc150 msgr2=0x7fca240bfea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:40:06.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.522+0000 7fca237fe640 1 --2- 172.21.15.12:0/2261189282 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fca240bc150 0x7fca240bfea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:06.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.522+0000 7fca237fe640 1 -- 172.21.15.12:0/2261189282 >> v1:172.21.15.12:6789/0 conn(0x7fca24070fd0 legacy=0x7fca240bd990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:40:06.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.522+0000 7fe1377fe640 1 -- 172.21.15.12:0/4210858697 >> v2:172.21.15.84:3300/0 conn(0x7fe13806d200 msgr2=0x7fe13814a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:40:06.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.522+0000 7fe1377fe640 1 --2- 172.21.15.12:0/4210858697 >> v2:172.21.15.84:3300/0 conn(0x7fe13806d200 0x7fe13814a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:06.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.523+0000 7fe1377fe640 1 -- 172.21.15.12:0/4210858697 >> v1:172.21.15.84:6789/0 conn(0x7fe1380b62c0 legacy=0x7fe13806f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:06.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.523+0000 7fe1377fe640 1 -- 172.21.15.12:0/4210858697 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe13814dbb0 con 0x7fe138144520 2024-05-15T15:40:06.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.523+0000 7fca237fe640 1 -- 172.21.15.12:0/2261189282 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca24156c30 con 0x7fca24156820 2024-05-15T15:40:06.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.524+0000 7fe1377fe640 1 --2- 172.21.15.12:0/4210858697 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe138144520 0x7fe13814a350 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe130009e50 tx=0x7fe13002a730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=912d6c53b5926b18 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:06.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.524+0000 7fca23fff640 1 --2- 172.21.15.12:0/2261189282 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fca240bc150 0x7fca240bfea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-15T15:40:06.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.524+0000 7fca237fe640 1 --2- 172.21.15.12:0/2261189282 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca24156820 0x7fca24070a90 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fca1c009870 tx=0x7fca1c02a1e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=df666176f77b870a server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:06.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.524+0000 7fca22ffd640 1 -- 172.21.15.12:0/2261189282 <== mon.1 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca1c037070 con 0x7fca24156820 2024-05-15T15:40:06.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.524+0000 7fca22ffd640 1 -- 172.21.15.12:0/2261189282 <== mon.1 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca1c032440 con 0x7fca24156820 2024-05-15T15:40:06.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.524+0000 7fca22ffd640 1 -- 172.21.15.12:0/2261189282 <== mon.1 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca1c032850 con 0x7fca24156820 2024-05-15T15:40:06.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.524+0000 7fe136ffd640 1 -- 172.21.15.12:0/4210858697 <== mon.2 v2:172.21.15.84:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe130036070 con 0x7fe138144520 2024-05-15T15:40:06.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.524+0000 7fe136ffd640 1 -- 172.21.15.12:0/4210858697 <== mon.2 v2:172.21.15.84:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe130031600 con 0x7fe138144520 2024-05-15T15:40:06.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.526+0000 7fe13d510640 1 -- 172.21.15.12:0/4210858697 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe138144520 msgr2=0x7fe13814a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:06.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.526+0000 7fca2a73f640 1 -- 172.21.15.12:0/2261189282 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca24156820 msgr2=0x7fca24070a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:06.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.526+0000 7fca2a73f640 1 --2- 172.21.15.12:0/2261189282 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca24156820 0x7fca24070a90 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fca1c009870 tx=0x7fca1c02a1e0 comp rx=0 tx=0).stop 2024-05-15T15:40:06.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.526+0000 7fe13d510640 1 --2- 172.21.15.12:0/4210858697 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe138144520 0x7fe13814a350 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe130009e50 tx=0x7fe13002a730 comp rx=0 tx=0).stop 2024-05-15T15:40:06.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.526+0000 7fca2a73f640 1 -- 172.21.15.12:0/2261189282 shutdown_connections 2024-05-15T15:40:06.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.526+0000 7fca2a73f640 1 --2- 172.21.15.12:0/2261189282 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca24156820 0x7fca24070a90 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:06.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.526+0000 7fca2a73f640 1 --2- 172.21.15.12:0/2261189282 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fca240bc150 0x7fca240bfea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:06.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.526+0000 7fe13d510640 1 -- 172.21.15.12:0/4210858697 shutdown_connections 2024-05-15T15:40:06.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.526+0000 7fe13d510640 1 --2- 172.21.15.12:0/4210858697 >> v2:172.21.15.84:3300/0 conn(0x7fe13806d200 0x7fe13814a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:06.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.526+0000 7fe13d510640 1 --2- 172.21.15.12:0/4210858697 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe138144520 0x7fe13814a350 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:06.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.526+0000 7fe13d510640 1 -- 172.21.15.12:0/4210858697 >> 172.21.15.12:0/4210858697 conn(0x7fe13806c6e0 msgr2=0x7fe13806caf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:06.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.526+0000 7fca2a73f640 1 -- 172.21.15.12:0/2261189282 >> 172.21.15.12:0/2261189282 conn(0x7fca240c1750 msgr2=0x7fca240c1b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:06.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.526+0000 7fe13d510640 1 -- 172.21.15.12:0/4210858697 shutdown_connections 2024-05-15T15:40:06.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.526+0000 7fe13d510640 1 -- 172.21.15.12:0/4210858697 wait complete. 2024-05-15T15:40:06.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.528+0000 7fca2a73f640 1 -- 172.21.15.12:0/2261189282 shutdown_connections 2024-05-15T15:40:06.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.529+0000 7fe13d510640 1 Processor -- start 2024-05-15T15:40:06.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.529+0000 7fe13d510640 1 -- start start 2024-05-15T15:40:06.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.528+0000 7fca2a73f640 1 -- 172.21.15.12:0/2261189282 wait complete. 2024-05-15T15:40:06.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.530+0000 7fca2a73f640 1 Processor -- start 2024-05-15T15:40:06.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.531+0000 7fca2a73f640 1 -- start start 2024-05-15T15:40:06.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.532+0000 7fe13d510640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe13806d200 0x7fe13814b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:06.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.532+0000 7fe13d510640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1380b62c0 0x7fe1381ec0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:06.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.532+0000 7fe137fff640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe13806d200 0x7fe13814b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:06.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.532+0000 7fe137fff640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe13806d200 0x7fe13814b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3301/0 says I am v2:172.21.15.12:38060/0 (socket says 172.21.15.12:38060) 2024-05-15T15:40:06.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.532+0000 7fe1377fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1380b62c0 0x7fe1381ec0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:06.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.533+0000 7fe1377fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1380b62c0 0x7fe1381ec0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59926/0 (socket says 172.21.15.12:59926) 2024-05-15T15:40:06.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.533+0000 7fe137fff640 1 -- 172.21.15.12:0/376251037 learned_addr learned my addr 172.21.15.12:0/376251037 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:06.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.533+0000 7fca2a73f640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca24070fd0 0x7fca240a6cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:06.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.533+0000 7fca2a73f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fca240bc150 0x7fca2414f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:06.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.533+0000 7fe13d510640 1 --2- 172.21.15.12:0/376251037 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe138144520 0x7fe138136ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:06.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.533+0000 7fca2a73f640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fca24156820 0x7fca24148060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:06.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.533+0000 7fca2a73f640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fca24155dc0 con 0x7fca240bc150 2024-05-15T15:40:06.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.533+0000 7fca2a73f640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fca240713e0 con 0x7fca24070fd0 2024-05-15T15:40:06.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.533+0000 7fca2a73f640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fca241de6f0 con 0x7fca24156820 2024-05-15T15:40:06.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.533+0000 7fca237fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fca240bc150 0x7fca2414f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:06.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.533+0000 7fca237fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fca240bc150 0x7fca2414f560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59942/0 (socket says 172.21.15.12:59942) 2024-05-15T15:40:06.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.533+0000 7fca237fe640 1 -- 172.21.15.12:0/1412845176 learned_addr learned my addr 172.21.15.12:0/1412845176 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:06.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.533+0000 7fca23fff640 1 --2- 172.21.15.12:0/1412845176 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca24070fd0 0x7fca240a6cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:06.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.534+0000 7fca28cdc640 1 --2- 172.21.15.12:0/1412845176 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fca24156820 0x7fca24148060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:06.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.534+0000 7fe13d510640 1 -- 172.21.15.12:0/376251037 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fe13814d760 con 0x7fe1380b62c0 2024-05-15T15:40:06.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.534+0000 7fe13d510640 1 -- 172.21.15.12:0/376251037 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fe13814e170 con 0x7fe138144520 2024-05-15T15:40:06.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.534+0000 7fe13d510640 1 -- 172.21.15.12:0/376251037 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fe13814d8e0 con 0x7fe13806d200 2024-05-15T15:40:06.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.534+0000 7fe13cd0f640 1 --2- 172.21.15.12:0/376251037 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe138144520 0x7fe138136ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:06.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.534+0000 7fca23fff640 1 -- 172.21.15.12:0/1412845176 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fca24156820 msgr2=0x7fca24148060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:06.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.534+0000 7fca23fff640 1 --2- 172.21.15.12:0/1412845176 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fca24156820 0x7fca24148060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:06.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.534+0000 7fca23fff640 1 -- 172.21.15.12:0/1412845176 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fca240bc150 msgr2=0x7fca2414f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:06.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.534+0000 7fca23fff640 1 --2- 172.21.15.12:0/1412845176 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fca240bc150 0x7fca2414f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:06.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.534+0000 7fca23fff640 1 -- 172.21.15.12:0/1412845176 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca240a71f0 con 0x7fca24070fd0 2024-05-15T15:40:06.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.534+0000 7fe1377fe640 1 -- 172.21.15.12:0/376251037 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe13806d200 msgr2=0x7fe13814b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:06.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.534+0000 7fe1377fe640 1 --2- 172.21.15.12:0/376251037 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe13806d200 0x7fe13814b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:06.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.534+0000 7fe1377fe640 1 -- 172.21.15.12:0/376251037 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe138144520 msgr2=0x7fe138136ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:06.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.534+0000 7fe1377fe640 1 --2- 172.21.15.12:0/376251037 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe138144520 0x7fe138136ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:06.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.534+0000 7fe1377fe640 1 -- 172.21.15.12:0/376251037 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1380be2a0 con 0x7fe1380b62c0 2024-05-15T15:40:06.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.535+0000 7fca23fff640 1 --2- 172.21.15.12:0/1412845176 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca24070fd0 0x7fca240a6cb0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fca1400cd50 tx=0x7fca1400a650 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:06.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.535+0000 7fe1377fe640 1 --2- 172.21.15.12:0/376251037 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1380b62c0 0x7fe1381ec0b0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe13814e660 tx=0x7fe130004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:06.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.535+0000 7fe134ff9640 1 -- 172.21.15.12:0/376251037 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe130041020 con 0x7fe1380b62c0 2024-05-15T15:40:06.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.535+0000 7fe13d510640 1 -- 172.21.15.12:0/376251037 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1380be580 con 0x7fe1380b62c0 2024-05-15T15:40:06.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.536+0000 7fe13d510640 1 -- 172.21.15.12:0/376251037 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1380beb40 con 0x7fe1380b62c0 2024-05-15T15:40:06.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.536+0000 7fca20ff9640 1 -- 172.21.15.12:0/1412845176 <== mon.1 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca1400f680 con 0x7fca24070fd0 2024-05-15T15:40:06.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.536+0000 7fca2a73f640 1 -- 172.21.15.12:0/1412845176 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca2414faa0 con 0x7fca24070fd0 2024-05-15T15:40:06.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.536+0000 7fca2a73f640 1 -- 172.21.15.12:0/1412845176 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca241de8a0 con 0x7fca24070fd0 2024-05-15T15:40:06.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.536+0000 7fca20ff9640 1 -- 172.21.15.12:0/1412845176 <== mon.1 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca1400f820 con 0x7fca24070fd0 2024-05-15T15:40:06.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.536+0000 7fca20ff9640 1 -- 172.21.15.12:0/1412845176 <== mon.1 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca1400fc10 con 0x7fca24070fd0 2024-05-15T15:40:06.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.537+0000 7fe13d510640 1 -- 172.21.15.12:0/376251037 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe13806a280 con 0x7fe1380b62c0 2024-05-15T15:40:06.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.537+0000 7fe134ff9640 1 -- 172.21.15.12:0/376251037 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe130031600 con 0x7fe1380b62c0 2024-05-15T15:40:06.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.537+0000 7fe134ff9640 1 -- 172.21.15.12:0/376251037 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe130036040 con 0x7fe1380b62c0 2024-05-15T15:40:06.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.539+0000 7fca2a73f640 1 -- 172.21.15.12:0/1412845176 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca04005290 con 0x7fca24070fd0 2024-05-15T15:40:06.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.541+0000 7fca20ff9640 1 -- 172.21.15.12:0/1412845176 <== mon.1 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fca14018400 con 0x7fca24070fd0 2024-05-15T15:40:06.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.542+0000 7fca20ff9640 1 --2- 172.21.15.12:0/1412845176 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fca0c0764e0 0x7fca0c0789f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:06.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.542+0000 7fca237fe640 1 --2- 172.21.15.12:0/1412845176 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fca0c0764e0 0x7fca0c0789f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:06.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.542+0000 7fca20ff9640 1 -- 172.21.15.12:0/1412845176 <== mon.1 v2:172.21.15.84:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fca140981b0 con 0x7fca24070fd0 2024-05-15T15:40:06.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.544+0000 7fe134ff9640 1 -- 172.21.15.12:0/376251037 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe130044020 con 0x7fe1380b62c0 2024-05-15T15:40:06.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.544+0000 7fe134ff9640 1 --2- 172.21.15.12:0/376251037 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fe1240762d0 0x7fe1240787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:06.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.545+0000 7fe134ff9640 1 -- 172.21.15.12:0/376251037 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fe1300b8ad0 con 0x7fe1380b62c0 2024-05-15T15:40:06.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.545+0000 7fe137fff640 1 --2- 172.21.15.12:0/376251037 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fe1240762d0 0x7fe1240787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:06.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.545+0000 7fca237fe640 1 --2- 172.21.15.12:0/1412845176 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fca0c0764e0 0x7fca0c0789f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fca2414be80 tx=0x7fca1c02e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:06.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.547+0000 7fca20ff9640 1 -- 172.21.15.12:0/1412845176 <== mon.1 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fca14014030 con 0x7fca24070fd0 2024-05-15T15:40:06.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.550+0000 7fe134ff9640 1 -- 172.21.15.12:0/376251037 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fe13806a280 con 0x7fe1380b62c0 2024-05-15T15:40:06.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.557+0000 7fe137fff640 1 --2- 172.21.15.12:0/376251037 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fe1240762d0 0x7fe1240787e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe128001800 tx=0x7fe128009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:06.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.581+0000 7ffb14e43640 1 Processor -- start 2024-05-15T15:40:06.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.581+0000 7ffb14e43640 1 -- start start 2024-05-15T15:40:06.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.583+0000 7ffb14e43640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ffb100be770 0x7ffb100736e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:06.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.583+0000 7ffb14e43640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ffb101537f0 0x7ffb10073c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:06.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.583+0000 7ffb14e43640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ffb100bb9b0 0x7ffb100bbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:06.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.583+0000 7ffb14e43640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7ffb10074d60 con 0x7ffb100be770 2024-05-15T15:40:06.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.583+0000 7ffb14e43640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7ffb1006d130 con 0x7ffb101537f0 2024-05-15T15:40:06.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.583+0000 7ffb14e43640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7ffb1006cb70 con 0x7ffb100bb9b0 2024-05-15T15:40:06.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.584+0000 7ffb0dd9b640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ffb101537f0 0x7ffb10073c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:06.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.584+0000 7f1ffedb4640 1 Processor -- start 2024-05-15T15:40:06.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.584+0000 7ffb0e59c640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ffb100be770 0x7ffb100736e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:06.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.584+0000 7ffb0dd9b640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ffb101537f0 0x7ffb10073c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.12:36282/0 (socket says 172.21.15.12:36282) 2024-05-15T15:40:06.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.584+0000 7ffb0dd9b640 1 -- 172.21.15.12:0/3127803993 learned_addr learned my addr 172.21.15.12:0/3127803993 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:06.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.584+0000 7f1ffedb4640 1 -- start start 2024-05-15T15:40:06.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.585+0000 7ffb0e59c640 1 -- 172.21.15.12:0/3127803993 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ffb100bb9b0 msgr2=0x7ffb100bbdc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-15T15:40:06.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.585+0000 7ffb0e59c640 1 --2- 172.21.15.12:0/3127803993 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ffb100bb9b0 0x7ffb100bbdc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:06.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.586+0000 7f1ffedb4640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1ff8072d80 0x7f1ff8073190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:06.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.586+0000 7f1ffedb4640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ff80b62b0 con 0x7f1ff814cc20 2024-05-15T15:40:06.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.586+0000 7f1ffedb4640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ff80701a0 con 0x7f1ff815b070 2024-05-15T15:40:06.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.586+0000 7f1ffedb4640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f1ff814d030 con 0x7f1ff8072d80 2024-05-15T15:40:06.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.585+0000 7ffb0e59c640 1 -- 172.21.15.12:0/3127803993 >> v2:172.21.15.84:3300/0 conn(0x7ffb101537f0 msgr2=0x7ffb10073c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:40:06.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.585+0000 7ffb0e59c640 1 --2- 172.21.15.12:0/3127803993 >> v2:172.21.15.84:3300/0 conn(0x7ffb101537f0 0x7ffb10073c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:06.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.585+0000 7ffb0e59c640 1 -- 172.21.15.12:0/3127803993 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb1006ce50 con 0x7ffb100be770 2024-05-15T15:40:06.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.580+0000 7f7e01434640 1 Processor -- start 2024-05-15T15:40:06.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.580+0000 7f7e01434640 1 -- start start 2024-05-15T15:40:06.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.582+0000 7f7e01434640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7dfc0be430 0x7f7dfc14ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:06.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.582+0000 7f7e01434640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f7dfc0ba200 0x7f7dfc0ba610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:06.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.582+0000 7f7e01434640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7dfc0bac20 con 0x7f7dfc14a160 2024-05-15T15:40:06.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.582+0000 7f7e01434640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f7dfc0baf00 con 0x7f7dfc0ba200 2024-05-15T15:40:06.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.582+0000 7f7e01434640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f7dfc14d6d0 con 0x7f7dfc0be430 2024-05-15T15:40:06.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.583+0000 7f7dfbfff640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7dfc0be430 0x7f7dfc14ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:06.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.583+0000 7f7dfbfff640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7dfc0be430 0x7f7dfc14ded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.12:36272/0 (socket says 172.21.15.12:36272) 2024-05-15T15:40:06.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.583+0000 7f7dfbfff640 1 -- 172.21.15.12:0/1604520123 learned_addr learned my addr 172.21.15.12:0/1604520123 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:06.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.583+0000 7f7dfb7fe640 1 --2- 172.21.15.12:0/1604520123 >> v2:172.21.15.12:3300/0 conn(0x7f7dfc0ba200 0x7f7dfc0ba610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:06.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.583+0000 7f7dfb7fe640 1 -- 172.21.15.12:0/1604520123 >> v2:172.21.15.84:3300/0 conn(0x7f7dfc0be430 msgr2=0x7f7dfc14ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:40:06.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.583+0000 7f7dfb7fe640 1 --2- 172.21.15.12:0/1604520123 >> v2:172.21.15.84:3300/0 conn(0x7f7dfc0be430 0x7f7dfc14ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:06.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.583+0000 7f7dfb7fe640 1 -- 172.21.15.12:0/1604520123 >> v1:172.21.15.84:6789/0 conn(0x7f7dfc14a160 legacy=0x7f7dfc14a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:40:06.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.583+0000 7f7dfb7fe640 1 -- 172.21.15.12:0/1604520123 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dfc0bf080 con 0x7f7dfc0ba200 2024-05-15T15:40:06.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.584+0000 7f7dfb7fe640 1 --2- 172.21.15.12:0/1604520123 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7dfc0ba200 0x7f7dfc0ba610 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7dfc0bbea0 tx=0x7f7dec02a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3675098721b5912e server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:06.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.585+0000 7f7dfaffd640 1 -- 172.21.15.12:0/1604520123 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dec037070 con 0x7f7dfc0ba200 2024-05-15T15:40:06.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.585+0000 7f7dfaffd640 1 -- 172.21.15.12:0/1604520123 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7dec02ae40 con 0x7f7dfc0ba200 2024-05-15T15:40:06.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.585+0000 7f7dfaffd640 1 -- 172.21.15.12:0/1604520123 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dec032660 con 0x7f7dfc0ba200 2024-05-15T15:40:06.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.586+0000 7f1ff7fff640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1ff8072d80 0x7f1ff8073190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:06.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.586+0000 7f1ff7fff640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1ff8072d80 0x7f1ff8073190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3301/0 says I am v2:172.21.15.12:38072/0 (socket says 172.21.15.12:38072) 2024-05-15T15:40:06.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.586+0000 7ffb0e59c640 1 --2- 172.21.15.12:0/3127803993 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb100be770 0x7ffb100736e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ffb1006e930 tx=0x7ffb0802a890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85716f0c1e9f91e4 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:06.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.587+0000 7ffb0d59a640 1 -- 172.21.15.12:0/3127803993 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb08031620 con 0x7ffb100be770 2024-05-15T15:40:06.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.586+0000 7f1ff7fff640 1 -- 172.21.15.12:0/3500676742 learned_addr learned my addr 172.21.15.12:0/3500676742 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:06.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.587+0000 7f1ff77fe640 1 -- 172.21.15.12:0/3500676742 <== mon.1 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 857622031 0 0) 0x7f1ff80701a0 con 0x7f1ff815b070 2024-05-15T15:40:06.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.587+0000 7f1ff77fe640 1 -- 172.21.15.12:0/3500676742 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1fe0003520 con 0x7f1ff815b070 2024-05-15T15:40:06.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.586+0000 7f7e01434640 1 -- 172.21.15.12:0/1604520123 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7dfc0ba200 msgr2=0x7f7dfc0ba610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:06.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.586+0000 7f7e01434640 1 --2- 172.21.15.12:0/1604520123 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7dfc0ba200 0x7f7dfc0ba610 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7dfc0bbea0 tx=0x7f7dec02a300 comp rx=0 tx=0).stop 2024-05-15T15:40:06.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.587+0000 7f7e01434640 1 -- 172.21.15.12:0/1604520123 shutdown_connections 2024-05-15T15:40:06.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.587+0000 7f7e01434640 1 --2- 172.21.15.12:0/1604520123 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7dfc0ba200 0x7f7dfc0ba610 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:06.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.587+0000 7f7e01434640 1 --2- 172.21.15.12:0/1604520123 >> v2:172.21.15.84:3300/0 conn(0x7f7dfc0be430 0x7f7dfc14ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:06.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.587+0000 7f7e01434640 1 -- 172.21.15.12:0/1604520123 >> 172.21.15.12:0/1604520123 conn(0x7f7dfc0a1180 msgr2=0x7f7dfc0a1590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:06.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.587+0000 7ffb0d59a640 1 -- 172.21.15.12:0/3127803993 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb08036070 con 0x7ffb100be770 2024-05-15T15:40:06.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.587+0000 7ffb0d59a640 1 -- 172.21.15.12:0/3127803993 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb08031a20 con 0x7ffb100be770 2024-05-15T15:40:06.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.587+0000 7f1ff7fff640 1 -- 172.21.15.12:0/3500676742 >> v1:172.21.15.84:6789/0 conn(0x7f1ff815b070 legacy=0x7f1ff815d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:06.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.587+0000 7f1ff7fff640 1 -- 172.21.15.12:0/3500676742 >> v1:172.21.15.12:6789/0 conn(0x7f1ff814cc20 legacy=0x7f1ff80b5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:06.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.587+0000 7f1ff7fff640 1 -- 172.21.15.12:0/3500676742 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ff8152af0 con 0x7f1ff8072d80 2024-05-15T15:40:06.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.587+0000 7f1ff77fe640 1 -- 172.21.15.12:0/3500676742 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 939822682 0 0) 0x7f1fe8001110 con 0x7f1ff814cc20 2024-05-15T15:40:06.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.588+0000 7f7e01434640 1 -- 172.21.15.12:0/1604520123 shutdown_connections 2024-05-15T15:40:06.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.588+0000 7f7e01434640 1 -- 172.21.15.12:0/1604520123 wait complete. 2024-05-15T15:40:06.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.588+0000 7ffb14e43640 1 -- 172.21.15.12:0/3127803993 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb100be770 msgr2=0x7ffb100736e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:06.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.588+0000 7ffb14e43640 1 --2- 172.21.15.12:0/3127803993 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb100be770 0x7ffb100736e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ffb1006e930 tx=0x7ffb0802a890 comp rx=0 tx=0).stop 2024-05-15T15:40:06.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.588+0000 7fb906394640 1 Processor -- start 2024-05-15T15:40:06.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.588+0000 7fb906394640 1 -- start start 2024-05-15T15:40:06.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.589+0000 7ffb14e43640 1 -- 172.21.15.12:0/3127803993 shutdown_connections 2024-05-15T15:40:06.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.589+0000 7ffb14e43640 1 --2- 172.21.15.12:0/3127803993 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ffb100bb9b0 0x7ffb100bbdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:06.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.589+0000 7ffb14e43640 1 --2- 172.21.15.12:0/3127803993 >> v2:172.21.15.84:3300/0 conn(0x7ffb101537f0 0x7ffb10073c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:06.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.589+0000 7ffb14e43640 1 --2- 172.21.15.12:0/3127803993 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb100be770 0x7ffb100736e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:06.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.589+0000 7ffb14e43640 1 -- 172.21.15.12:0/3127803993 >> 172.21.15.12:0/3127803993 conn(0x7ffb100bd160 msgr2=0x7ffb100bd570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:06.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.589+0000 7ffb14e43640 1 -- 172.21.15.12:0/3127803993 shutdown_connections 2024-05-15T15:40:06.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.590+0000 7f7e01434640 1 Processor -- start 2024-05-15T15:40:06.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.589+0000 7f1ff7fff640 1 --2- 172.21.15.12:0/3500676742 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1ff8072d80 0x7f1ff8073190 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1ff0009e80 tx=0x7f1ff002a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=38987be263797453 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:06.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.589+0000 7f1ff77fe640 1 -- 172.21.15.12:0/3500676742 <== mon.2 v2:172.21.15.84:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ff0036070 con 0x7f1ff8072d80 2024-05-15T15:40:06.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.589+0000 7f1ff77fe640 1 -- 172.21.15.12:0/3500676742 <== mon.2 v2:172.21.15.84:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ff0031600 con 0x7f1ff8072d80 2024-05-15T15:40:06.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.589+0000 7f1ff77fe640 1 -- 172.21.15.12:0/3500676742 <== mon.2 v2:172.21.15.84:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ff00319d0 con 0x7f1ff8072d80 2024-05-15T15:40:06.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.590+0000 7fb906394640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb9000b6340 0x7fb9000ba320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:06.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.590+0000 7fb906394640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb900153210 0x7fb90015d250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:06.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.590+0000 7fb906394640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9000bb8e0 con 0x7fb9000a0ba0 2024-05-15T15:40:06.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.590+0000 7fb906394640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fb9000b5bf0 con 0x7fb900153210 2024-05-15T15:40:06.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.590+0000 7fb906394640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7fb9000b6750 con 0x7fb9000b6340 2024-05-15T15:40:06.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.589+0000 7ffb14e43640 1 -- 172.21.15.12:0/3127803993 wait complete. 2024-05-15T15:40:06.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.591+0000 7fb904931640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb900153210 0x7fb90015d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:06.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.591+0000 7fb904931640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb900153210 0x7fb90015d250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59984/0 (socket says 172.21.15.12:59984) 2024-05-15T15:40:06.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.591+0000 7fb8ff7fe640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fb9000a0ba0 0x7fb9000bc8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.12:53836/0 (socket says 172.21.15.12:53836) 2024-05-15T15:40:06.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.591+0000 7fb8ff7fe640 1 -- 172.21.15.12:0/3533806569 learned_addr learned my addr 172.21.15.12:0/3533806569 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-05-15T15:40:06.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.591+0000 7fb8fffff640 1 --2- 172.21.15.12:0/3533806569 >> v2:172.21.15.84:3300/0 conn(0x7fb9000b6340 0x7fb9000ba320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:06.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.592+0000 7fb904931640 1 -- 172.21.15.12:0/3533806569 >> v2:172.21.15.84:3300/0 conn(0x7fb9000b6340 msgr2=0x7fb9000ba320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:40:06.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.592+0000 7fb904931640 1 --2- 172.21.15.12:0/3533806569 >> v2:172.21.15.84:3300/0 conn(0x7fb9000b6340 0x7fb9000ba320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:06.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.592+0000 7fb904931640 1 -- 172.21.15.12:0/3533806569 >> v1:172.21.15.84:6789/0 conn(0x7fb9000a0ba0 legacy=0x7fb9000bc8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:06.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.592+0000 7fb904931640 1 -- 172.21.15.12:0/3533806569 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9000bbb50 con 0x7fb900153210 2024-05-15T15:40:06.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.592+0000 7ffb14e43640 1 Processor -- start 2024-05-15T15:40:06.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.591+0000 7f7e01434640 1 -- start start 2024-05-15T15:40:06.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.593+0000 7ffb14e43640 1 -- start start 2024-05-15T15:40:06.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.591+0000 7f1ffedb4640 1 -- 172.21.15.12:0/3500676742 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1ff8072d80 msgr2=0x7f1ff8073190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:06.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.591+0000 7f1ffedb4640 1 --2- 172.21.15.12:0/3500676742 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1ff8072d80 0x7f1ff8073190 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1ff0009e80 tx=0x7f1ff002a710 comp rx=0 tx=0).stop 2024-05-15T15:40:06.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.591+0000 7f1ffedb4640 1 -- 172.21.15.12:0/3500676742 shutdown_connections 2024-05-15T15:40:06.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.591+0000 7f1ffedb4640 1 --2- 172.21.15.12:0/3500676742 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1ff8072d80 0x7f1ff8073190 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:06.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.591+0000 7f1ffedb4640 1 -- 172.21.15.12:0/3500676742 >> 172.21.15.12:0/3500676742 conn(0x7f1ff80bc4f0 msgr2=0x7f1ff80bc900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:06.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.591+0000 7f1ffedb4640 1 -- 172.21.15.12:0/3500676742 shutdown_connections 2024-05-15T15:40:06.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.591+0000 7f1ffedb4640 1 -- 172.21.15.12:0/3500676742 wait complete. 2024-05-15T15:40:06.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.593+0000 7f7e01434640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f7dfc0ba200 0x7f7dfc08b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:06.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.593+0000 7f7e01434640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7dfc0be430 0x7f7dfc0b8550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:06.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.593+0000 7fb8fffff640 1 --2- 172.21.15.12:0/3533806569 >> v2:172.21.15.84:3300/0 conn(0x7fb9000b6340 0x7fb9000ba320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-15T15:40:06.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.593+0000 7f7dfbfff640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f7dfc0ba200 0x7f7dfc08b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:06.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.593+0000 7fb904931640 1 --2- 172.21.15.12:0/3533806569 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb900153210 0x7fb90015d250 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb9000bd040 tx=0x7fb8e802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d870bd4641753862 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:06.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.593+0000 7f7e01434640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7dfc14a160 0x7f7dfc1439f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:06.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.593+0000 7f7dfbfff640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f7dfc0ba200 0x7f7dfc08b170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3301/0 says I am v2:172.21.15.12:38076/0 (socket says 172.21.15.12:38076) 2024-05-15T15:40:06.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.593+0000 7f7dfb7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7dfc0be430 0x7f7dfc0b8550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:06.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.593+0000 7f7dfb7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7dfc0be430 0x7f7dfc0b8550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.12:36304/0 (socket says 172.21.15.12:36304) 2024-05-15T15:40:06.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.593+0000 7f7dfbfff640 1 -- 172.21.15.12:0/668802439 learned_addr learned my addr 172.21.15.12:0/668802439 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:06.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.593+0000 7f7e01434640 1 -- 172.21.15.12:0/668802439 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f7dfc0bba90 con 0x7f7dfc14a160 2024-05-15T15:40:06.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.593+0000 7f7e01434640 1 -- 172.21.15.12:0/668802439 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f7dfc0be840 con 0x7f7dfc0be430 2024-05-15T15:40:06.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.594+0000 7f7e01434640 1 -- 172.21.15.12:0/668802439 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f7dfc0bbc10 con 0x7f7dfc0ba200 2024-05-15T15:40:06.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.594+0000 7f7e00c33640 1 --2- 172.21.15.12:0/668802439 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7dfc14a160 0x7f7dfc1439f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:06.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.594+0000 7fb8feffd640 1 -- 172.21.15.12:0/3533806569 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8e8037070 con 0x7fb900153210 2024-05-15T15:40:06.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.594+0000 7f7e00c33640 1 -- 172.21.15.12:0/668802439 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f7dfc0ba200 msgr2=0x7f7dfc08b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:06.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.594+0000 7f1ffedb4640 1 Processor -- start 2024-05-15T15:40:06.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.594+0000 7f7e00c33640 1 --2- 172.21.15.12:0/668802439 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f7dfc0ba200 0x7f7dfc08b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:06.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.595+0000 7ffb14e43640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb100bb9b0 0x7ffb1006fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:06.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.595+0000 7ffb14e43640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb100be770 0x7ffb100714f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:06.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.595+0000 7ffb14e43640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ffb101537f0 0x7ffb101dbb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:06.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.595+0000 7ffb14e43640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7ffb100bc480 con 0x7ffb100be770 2024-05-15T15:40:06.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.595+0000 7ffb14e43640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ffb100bc300 con 0x7ffb100bb9b0 2024-05-15T15:40:06.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.595+0000 7ffb14e43640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7ffb1006c6e0 con 0x7ffb101537f0 2024-05-15T15:40:06.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.594+0000 7fb8feffd640 1 -- 172.21.15.12:0/3533806569 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8e8032440 con 0x7fb900153210 2024-05-15T15:40:06.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.595+0000 7f1ffedb4640 1 -- start start 2024-05-15T15:40:06.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.594+0000 7f7e00c33640 1 -- 172.21.15.12:0/668802439 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7dfc0be430 msgr2=0x7f7dfc0b8550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:06.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.594+0000 7f7e00c33640 1 --2- 172.21.15.12:0/668802439 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7dfc0be430 0x7f7dfc0b8550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:06.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.594+0000 7f7e00c33640 1 -- 172.21.15.12:0/668802439 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dfc0b8a90 con 0x7f7dfc14a160 2024-05-15T15:40:06.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.595+0000 7f7e00c33640 1 --2- 172.21.15.12:0/668802439 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7dfc14a160 0x7f7dfc1439f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7dfc06ffe0 tx=0x7f7df4009ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:06.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.595+0000 7f7df8ff9640 1 -- 172.21.15.12:0/668802439 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7df4019070 con 0x7f7dfc14a160 2024-05-15T15:40:06.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.595+0000 7fb8feffd640 1 -- 172.21.15.12:0/3533806569 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8e8032810 con 0x7fb900153210 2024-05-15T15:40:06.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.595+0000 7f7e01434640 1 -- 172.21.15.12:0/668802439 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7dfc144d20 con 0x7f7dfc14a160 2024-05-15T15:40:06.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.595+0000 7f7e01434640 1 -- 172.21.15.12:0/668802439 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7dfc1452e0 con 0x7f7dfc14a160 2024-05-15T15:40:06.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.595+0000 7f7df8ff9640 1 -- 172.21.15.12:0/668802439 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7df400cdf0 con 0x7f7dfc14a160 2024-05-15T15:40:06.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.595+0000 7f7df8ff9640 1 -- 172.21.15.12:0/668802439 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7df4014660 con 0x7f7dfc14a160 2024-05-15T15:40:06.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.596+0000 7fb906394640 1 -- 172.21.15.12:0/3533806569 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb900153210 msgr2=0x7fb90015d250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:06.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.596+0000 7fb906394640 1 --2- 172.21.15.12:0/3533806569 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb900153210 0x7fb90015d250 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb9000bd040 tx=0x7fb8e802a270 comp rx=0 tx=0).stop 2024-05-15T15:40:06.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.596+0000 7fb906394640 1 -- 172.21.15.12:0/3533806569 shutdown_connections 2024-05-15T15:40:06.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.596+0000 7fb906394640 1 --2- 172.21.15.12:0/3533806569 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb900153210 0x7fb90015d250 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:06.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.596+0000 7fb906394640 1 --2- 172.21.15.12:0/3533806569 >> v2:172.21.15.84:3300/0 conn(0x7fb9000b6340 0x7fb9000ba320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:06.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.596+0000 7fb906394640 1 -- 172.21.15.12:0/3533806569 >> 172.21.15.12:0/3533806569 conn(0x7fb9000a1ac0 msgr2=0x7fb9000bbfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:06.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.596+0000 7fb906394640 1 -- 172.21.15.12:0/3533806569 shutdown_connections 2024-05-15T15:40:06.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.596+0000 7fb906394640 1 -- 172.21.15.12:0/3533806569 wait complete. 2024-05-15T15:40:06.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.598+0000 7f1ffedb4640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1ff8072d80 0x7f1ff81ec260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:06.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.598+0000 7f1ffedb4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1ff814cc20 0x7f1ff80bb130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:06.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.598+0000 7f1ffcb50640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1ff8072d80 0x7f1ff81ec260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:06.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.596+0000 7ffb0e59c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb100bb9b0 0x7ffb1006fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:06.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.596+0000 7ffb0ed9d640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ffb101537f0 0x7ffb101dbb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:06.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.596+0000 7ffb0dd9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb100be770 0x7ffb100714f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:06.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.596+0000 7ffb0dd9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb100be770 0x7ffb100714f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60006/0 (socket says 172.21.15.12:60006) 2024-05-15T15:40:06.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.596+0000 7ffb0dd9b640 1 -- 172.21.15.12:0/3493656294 learned_addr learned my addr 172.21.15.12:0/3493656294 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:06.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.597+0000 7ffb0dd9b640 1 -- 172.21.15.12:0/3493656294 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ffb101537f0 msgr2=0x7ffb101dbb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:06.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.597+0000 7ffb0dd9b640 1 --2- 172.21.15.12:0/3493656294 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ffb101537f0 0x7ffb101dbb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:06.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.597+0000 7ffb0dd9b640 1 -- 172.21.15.12:0/3493656294 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb100bb9b0 msgr2=0x7ffb1006fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:06.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.597+0000 7ffb0dd9b640 1 --2- 172.21.15.12:0/3493656294 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb100bb9b0 0x7ffb1006fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:06.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.597+0000 7ffb0dd9b640 1 -- 172.21.15.12:0/3493656294 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb10071a30 con 0x7ffb100be770 2024-05-15T15:40:06.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.598+0000 7f1ffcb50640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1ff8072d80 0x7f1ff81ec260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3301/0 says I am v2:172.21.15.12:38096/0 (socket says 172.21.15.12:38096) 2024-05-15T15:40:06.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.598+0000 7f1ffcb50640 1 -- 172.21.15.12:0/824842586 learned_addr learned my addr 172.21.15.12:0/824842586 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:06.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.598+0000 7f1ffedb4640 1 --2- 172.21.15.12:0/824842586 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1ff815b070 0x7f1ff8144670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:06.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.598+0000 7f1ffedb4640 1 -- 172.21.15.12:0/824842586 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f1ff8152800 con 0x7f1ff814cc20 2024-05-15T15:40:06.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.598+0000 7f1ffedb4640 1 -- 172.21.15.12:0/824842586 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f1ff8153140 con 0x7f1ff815b070 2024-05-15T15:40:06.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.598+0000 7f1ffedb4640 1 -- 172.21.15.12:0/824842586 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f1ff81535d0 con 0x7f1ff8072d80 2024-05-15T15:40:06.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.599+0000 7fb906394640 1 Processor -- start 2024-05-15T15:40:06.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.599+0000 7ffb0dd9b640 1 --2- 172.21.15.12:0/3493656294 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb100be770 0x7ffb100714f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ffb0000e840 tx=0x7ffb0000ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:06.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.599+0000 7fb906394640 1 -- start start 2024-05-15T15:40:06.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.599+0000 7f1ff7fff640 1 --2- 172.21.15.12:0/824842586 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1ff814cc20 0x7f1ff80bb130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:06.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.599+0000 7f1ffd351640 1 --2- 172.21.15.12:0/824842586 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1ff815b070 0x7f1ff8144670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:06.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.599+0000 7f7e01434640 1 -- 172.21.15.12:0/668802439 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ddc005290 con 0x7f7dfc14a160 2024-05-15T15:40:06.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.599+0000 7ffafeffd640 1 -- 172.21.15.12:0/3493656294 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb00017070 con 0x7ffb100be770 2024-05-15T15:40:06.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.599+0000 7ffafeffd640 1 -- 172.21.15.12:0/3493656294 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb0000c8e0 con 0x7ffb100be770 2024-05-15T15:40:06.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.599+0000 7ffafeffd640 1 -- 172.21.15.12:0/3493656294 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb00017070 con 0x7ffb100be770 2024-05-15T15:40:06.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.599+0000 7ffb14e43640 1 -- 172.21.15.12:0/3493656294 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb100a48a0 con 0x7ffb100be770 2024-05-15T15:40:06.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.599+0000 7f1ffcb50640 1 -- 172.21.15.12:0/824842586 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1ff815b070 msgr2=0x7f1ff8144670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:06.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.599+0000 7f1ffcb50640 1 --2- 172.21.15.12:0/824842586 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1ff815b070 0x7f1ff8144670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:06.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.599+0000 7f1ffcb50640 1 -- 172.21.15.12:0/824842586 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1ff814cc20 msgr2=0x7f1ff80bb130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:06.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.599+0000 7f1ffcb50640 1 --2- 172.21.15.12:0/824842586 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1ff814cc20 0x7f1ff80bb130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:06.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.599+0000 7f1ffcb50640 1 -- 172.21.15.12:0/824842586 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ff814d900 con 0x7f1ff8072d80 2024-05-15T15:40:06.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.601+0000 7f1ffcb50640 1 --2- 172.21.15.12:0/824842586 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1ff8072d80 0x7f1ff81ec260 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1fe800c370 tx=0x7f1fe800c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:06.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.600+0000 7f7df8ff9640 1 -- 172.21.15.12:0/668802439 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7df401c070 con 0x7f7dfc14a160 2024-05-15T15:40:06.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.601+0000 7fb906394640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb9000a0ba0 0x7fb9001e8e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:06.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.602+0000 7fb906394640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb9000b6340 0x7fb9000b8960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:06.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.602+0000 7fb906394640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb900153210 0x7fb900146f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:06.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.602+0000 7f1ff57fa640 1 -- 172.21.15.12:0/824842586 <== mon.2 v2:172.21.15.84:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fe8017070 con 0x7f1ff8072d80 2024-05-15T15:40:06.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.602+0000 7f1ff57fa640 1 -- 172.21.15.12:0/824842586 <== mon.2 v2:172.21.15.84:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fe80035f0 con 0x7f1ff8072d80 2024-05-15T15:40:06.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.602+0000 7fb906394640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fb9000b5eb0 con 0x7fb900153210 2024-05-15T15:40:06.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.602+0000 7fb906394640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fb9000bbe30 con 0x7fb9000b6340 2024-05-15T15:40:06.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.602+0000 7fb906394640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fb9000a0fb0 con 0x7fb9000a0ba0 2024-05-15T15:40:06.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.602+0000 7fb904931640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb900153210 0x7fb900146f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:06.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.602+0000 7fb904931640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb900153210 0x7fb900146f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60034/0 (socket says 172.21.15.12:60034) 2024-05-15T15:40:06.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.602+0000 7fb904931640 1 -- 172.21.15.12:0/1739655215 learned_addr learned my addr 172.21.15.12:0/1739655215 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:06.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.601+0000 7f7df8ff9640 1 --2- 172.21.15.12:0/668802439 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f7de8076300 0x7f7de8078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:06.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.602+0000 7f7df8ff9640 1 -- 172.21.15.12:0/668802439 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f7df40973f0 con 0x7f7dfc14a160 2024-05-15T15:40:06.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.601+0000 7ffb14e43640 1 -- 172.21.15.12:0/3493656294 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb100a4b40 con 0x7ffb100be770 2024-05-15T15:40:06.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.603+0000 7f7dfbfff640 1 --2- 172.21.15.12:0/668802439 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f7de8076300 0x7f7de8078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:06.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.603+0000 7fb904931640 1 -- 172.21.15.12:0/1739655215 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb9000a0ba0 msgr2=0x7fb9001e8e70 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-15T15:40:06.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.603+0000 7fb904931640 1 --2- 172.21.15.12:0/1739655215 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb9000a0ba0 0x7fb9001e8e70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:06.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.603+0000 7fb904931640 1 -- 172.21.15.12:0/1739655215 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb9000b6340 msgr2=0x7fb9000b8960 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-15T15:40:06.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.603+0000 7fb904931640 1 --2- 172.21.15.12:0/1739655215 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb9000b6340 0x7fb9000b8960 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:06.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.603+0000 7fb904931640 1 -- 172.21.15.12:0/1739655215 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9001e93b0 con 0x7fb900153210 2024-05-15T15:40:06.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.602+0000 7f1ff57fa640 1 -- 172.21.15.12:0/824842586 <== mon.2 v2:172.21.15.84:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fe80039e0 con 0x7f1ff8072d80 2024-05-15T15:40:06.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.603+0000 7fb904931640 1 --2- 172.21.15.12:0/1739655215 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb900153210 0x7fb900146f90 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb8e8035040 tx=0x7fb8e80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:06.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.603+0000 7f1ffedb4640 1 -- 172.21.15.12:0/824842586 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ff81e9000 con 0x7f1ff8072d80 2024-05-15T15:40:06.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.604+0000 7f1ffedb4640 1 -- 172.21.15.12:0/824842586 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ff81e8cd0 con 0x7f1ff8072d80 2024-05-15T15:40:06.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.604+0000 7ffb14e43640 1 -- 172.21.15.12:0/3493656294 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb10069b50 con 0x7ffb100be770 2024-05-15T15:40:06.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.605+0000 7f7dfbfff640 1 --2- 172.21.15.12:0/668802439 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f7de8076300 0x7f7de8078810 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7df0006a90 tx=0x7f7df0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:06.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.605+0000 7ffafeffd640 1 -- 172.21.15.12:0/3493656294 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ffb0001a070 con 0x7ffb100be770 2024-05-15T15:40:06.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.605+0000 7f1ffedb4640 1 -- 172.21.15.12:0/824842586 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ff814bb60 con 0x7f1ff8072d80 2024-05-15T15:40:06.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.605+0000 7ffafeffd640 1 --2- 172.21.15.12:0/3493656294 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7ffaf00766d0 0x7ffaf0078be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:06.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.606+0000 7ffb0e59c640 1 --2- 172.21.15.12:0/3493656294 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7ffaf00766d0 0x7ffaf0078be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:06.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.606+0000 7f1ff57fa640 1 -- 172.21.15.12:0/824842586 <== mon.2 v2:172.21.15.84:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1fe801a070 con 0x7f1ff8072d80 2024-05-15T15:40:06.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.606+0000 7ffb0e59c640 1 --2- 172.21.15.12:0/3493656294 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7ffaf00766d0 0x7ffaf0078be0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ffb08035000 tx=0x7ffb08030000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:06.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.607+0000 7f1ff57fa640 1 --2- 172.21.15.12:0/824842586 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f1fe4076300 0x7f1fe4078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:06.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.607+0000 7f1ff57fa640 1 -- 172.21.15.12:0/824842586 <== mon.2 v2:172.21.15.84:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f1fe8096a60 con 0x7f1ff8072d80 2024-05-15T15:40:06.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.607+0000 7f1ff7fff640 1 --2- 172.21.15.12:0/824842586 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f1fe4076300 0x7f1fe4078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:06.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.608+0000 7f1ff7fff640 1 --2- 172.21.15.12:0/824842586 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f1fe4076300 0x7f1fe4078810 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1ff0033000 tx=0x7f1ff0009000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:06.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.609+0000 7ffafeffd640 1 -- 172.21.15.12:0/3493656294 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7ffb0000f040 con 0x7ffb100be770 2024-05-15T15:40:06.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.609+0000 7fb8fcff9640 1 -- 172.21.15.12:0/1739655215 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8e8041020 con 0x7fb900153210 2024-05-15T15:40:06.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.609+0000 7fb906394640 1 -- 172.21.15.12:0/1739655215 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9000b74d0 con 0x7fb900153210 2024-05-15T15:40:06.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.609+0000 7fb8fcff9640 1 -- 172.21.15.12:0/1739655215 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8e8032e20 con 0x7fb900153210 2024-05-15T15:40:06.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.609+0000 7f7df8ff9640 1 -- 172.21.15.12:0/668802439 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f7df4060660 con 0x7f7dfc14a160 2024-05-15T15:40:06.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.609+0000 7fb8fcff9640 1 -- 172.21.15.12:0/1739655215 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8e8037040 con 0x7fb900153210 2024-05-15T15:40:06.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.611+0000 7fb906394640 1 -- 172.21.15.12:0/1739655215 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9000b71f0 con 0x7fb900153210 2024-05-15T15:40:06.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.612+0000 7fb8f67fc640 1 -- 172.21.15.12:0/1739655215 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8d8005290 con 0x7fb900153210 2024-05-15T15:40:06.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.612+0000 7f1ff57fa640 1 -- 172.21.15.12:0/824842586 <== mon.2 v2:172.21.15.84:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f1ff80b62b0 con 0x7f1ff8072d80 2024-05-15T15:40:06.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.620+0000 7fb8fcff9640 1 -- 172.21.15.12:0/1739655215 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb8e8044020 con 0x7fb900153210 2024-05-15T15:40:06.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.620+0000 7ffafeffd640 1 -- 172.21.15.12:0/3493656294 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7ffb00099030 con 0x7ffb100be770 2024-05-15T15:40:06.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.620+0000 7fb8fcff9640 1 --2- 172.21.15.12:0/1739655215 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fb8e0076300 0x7fb8e0078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:06.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.621+0000 7fb8fcff9640 1 -- 172.21.15.12:0/1739655215 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fb8e80b84a0 con 0x7fb900153210 2024-05-15T15:40:06.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.622+0000 7fb8fffff640 1 --2- 172.21.15.12:0/1739655215 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fb8e0076300 0x7fb8e0078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:06.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.629+0000 7fb8fcff9640 1 -- 172.21.15.12:0/1739655215 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fb8e804b030 con 0x7fb900153210 2024-05-15T15:40:06.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.629+0000 7fb8fffff640 1 --2- 172.21.15.12:0/1739655215 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fb8e0076300 0x7fb8e0078810 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb8f800b810 tx=0x7fb8f8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:06.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.634+0000 7ff384415640 1 Processor -- start 2024-05-15T15:40:06.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.634+0000 7ff384415640 1 -- start start 2024-05-15T15:40:06.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.636+0000 7ff384415640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff37c09fb90 0x7ff37c14b620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:06.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.636+0000 7ff384415640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff37c14bb60 0x7ff37c155a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:06.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.636+0000 7ff384415640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff37c0bf8d0 con 0x7ff37c145660 2024-05-15T15:40:06.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.636+0000 7ff384415640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7ff37c070080 con 0x7ff37c14bb60 2024-05-15T15:40:06.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.636+0000 7ff384415640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7ff37c0befa0 con 0x7ff37c09fb90 2024-05-15T15:40:06.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.637+0000 7ff3829b2640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff37c14bb60 0x7ff37c155a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:06.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.637+0000 7ff3829b2640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff37c14bb60 0x7ff37c155a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.12:36346/0 (socket says 172.21.15.12:36346) 2024-05-15T15:40:06.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.637+0000 7ff3829b2640 1 -- 172.21.15.12:0/4193959777 learned_addr learned my addr 172.21.15.12:0/4193959777 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:06.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.637+0000 7ff3829b2640 1 -- 172.21.15.12:0/4193959777 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff37c09fb90 msgr2=0x7ff37c14b620 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-15T15:40:06.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.637+0000 7ff3829b2640 1 --2- 172.21.15.12:0/4193959777 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff37c09fb90 0x7ff37c14b620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:06.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.637+0000 7ff3829b2640 1 -- 172.21.15.12:0/4193959777 >> v1:172.21.15.12:6789/0 conn(0x7ff37c145660 legacy=0x7ff37c06f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:40:06.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.638+0000 7ff3829b2640 1 -- 172.21.15.12:0/4193959777 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff37c0bf280 con 0x7ff37c14bb60 2024-05-15T15:40:06.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.639+0000 7ff3829b2640 1 --2- 172.21.15.12:0/4193959777 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff37c14bb60 0x7ff37c155a90 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff37400bef0 tx=0x7ff37402eac0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=db1c8b1ff175087e server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:06.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.640+0000 7ff3811af640 1 -- 172.21.15.12:0/4193959777 <== mon.1 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff374036070 con 0x7ff37c14bb60 2024-05-15T15:40:06.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.640+0000 7ff3811af640 1 -- 172.21.15.12:0/4193959777 <== mon.1 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff374009600 con 0x7ff37c14bb60 2024-05-15T15:40:06.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.641+0000 7ff384415640 1 -- 172.21.15.12:0/4193959777 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff37c14bb60 msgr2=0x7ff37c155a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:06.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.641+0000 7ff384415640 1 --2- 172.21.15.12:0/4193959777 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff37c14bb60 0x7ff37c155a90 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff37400bef0 tx=0x7ff37402eac0 comp rx=0 tx=0).stop 2024-05-15T15:40:06.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.641+0000 7ff384415640 1 -- 172.21.15.12:0/4193959777 shutdown_connections 2024-05-15T15:40:06.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.641+0000 7ff384415640 1 --2- 172.21.15.12:0/4193959777 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff37c14bb60 0x7ff37c155a90 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:06.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.641+0000 7ff384415640 1 --2- 172.21.15.12:0/4193959777 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff37c09fb90 0x7ff37c14b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:06.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.641+0000 7ff384415640 1 -- 172.21.15.12:0/4193959777 >> 172.21.15.12:0/4193959777 conn(0x7ff37c0bd1d0 msgr2=0x7ff37c0bd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:06.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.642+0000 7ff384415640 1 -- 172.21.15.12:0/4193959777 shutdown_connections 2024-05-15T15:40:06.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.642+0000 7ff384415640 1 -- 172.21.15.12:0/4193959777 wait complete. 2024-05-15T15:40:06.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.644+0000 7ff384415640 1 Processor -- start 2024-05-15T15:40:06.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.644+0000 7ff384415640 1 -- start start 2024-05-15T15:40:06.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.647+0000 7ff384415640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff37c09fb90 0x7ff37c0b66f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:06.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.647+0000 7ff384415640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff37c145660 0x7ff37c0a4740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:06.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.647+0000 7ff384415640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff37c14bb60 0x7ff37c1373a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:06.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.647+0000 7ff384415640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7ff37c09ffa0 con 0x7ff37c14bb60 2024-05-15T15:40:06.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.647+0000 7ff384415640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ff37c14bf70 con 0x7ff37c145660 2024-05-15T15:40:06.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.647+0000 7ff384415640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7ff37c0be6f0 con 0x7ff37c09fb90 2024-05-15T15:40:06.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.647+0000 7ff3819b0640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff37c145660 0x7ff37c0a4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:06.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.647+0000 7ff3819b0640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff37c145660 0x7ff37c0a4740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.12:36356/0 (socket says 172.21.15.12:36356) 2024-05-15T15:40:06.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.647+0000 7ff3819b0640 1 -- 172.21.15.12:0/4183103547 learned_addr learned my addr 172.21.15.12:0/4183103547 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:06.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.647+0000 7ff3829b2640 1 --2- 172.21.15.12:0/4183103547 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff37c14bb60 0x7ff37c1373a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:06.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.648+0000 7ff3819b0640 1 -- 172.21.15.12:0/4183103547 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff37c09fb90 msgr2=0x7ff37c0b66f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-15T15:40:06.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.648+0000 7ff3819b0640 1 --2- 172.21.15.12:0/4183103547 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff37c09fb90 0x7ff37c0b66f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:06.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.648+0000 7ff3819b0640 1 -- 172.21.15.12:0/4183103547 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff37c14bb60 msgr2=0x7ff37c1373a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:06.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.648+0000 7ff3819b0640 1 --2- 172.21.15.12:0/4183103547 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff37c14bb60 0x7ff37c1373a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:06.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.648+0000 7ff3819b0640 1 -- 172.21.15.12:0/4183103547 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff37c0b6c30 con 0x7ff37c145660 2024-05-15T15:40:06.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.648+0000 7ff3829b2640 1 --2- 172.21.15.12:0/4183103547 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff37c14bb60 0x7ff37c1373a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-15T15:40:06.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.648+0000 7ff3819b0640 1 --2- 172.21.15.12:0/4183103547 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff37c145660 0x7ff37c0a4740 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff36c00b3c0 tx=0x7ff36c00b880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:06.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.649+0000 7ff372ffd640 1 -- 172.21.15.12:0/4183103547 <== mon.1 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff36c011830 con 0x7ff37c145660 2024-05-15T15:40:06.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.649+0000 7ff372ffd640 1 -- 172.21.15.12:0/4183103547 <== mon.1 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff36c016070 con 0x7ff37c145660 2024-05-15T15:40:06.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.650+0000 7ff372ffd640 1 -- 172.21.15.12:0/4183103547 <== mon.1 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff36c011c10 con 0x7ff37c145660 2024-05-15T15:40:06.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.650+0000 7ff384415640 1 -- 172.21.15.12:0/4183103547 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff37c0a4c80 con 0x7ff37c145660 2024-05-15T15:40:06.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.650+0000 7ff384415640 1 -- 172.21.15.12:0/4183103547 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff37c1d6190 con 0x7ff37c145660 2024-05-15T15:40:06.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.654+0000 7ff384415640 1 -- 172.21.15.12:0/4183103547 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff37c0a3960 con 0x7ff37c145660 2024-05-15T15:40:06.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.656+0000 7ff372ffd640 1 -- 172.21.15.12:0/4183103547 <== mon.1 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff36c01b460 con 0x7ff37c145660 2024-05-15T15:40:06.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.657+0000 7ff372ffd640 1 --2- 172.21.15.12:0/4183103547 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7ff3600762d0 0x7ff3600787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:06.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.657+0000 7ff372ffd640 1 -- 172.21.15.12:0/4183103547 <== mon.1 v2:172.21.15.84:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7ff36c097bf0 con 0x7ff37c145660 2024-05-15T15:40:06.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.658+0000 7ff3821b1640 1 --2- 172.21.15.12:0/4183103547 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7ff3600762d0 0x7ff3600787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:06.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.658+0000 7ff3821b1640 1 --2- 172.21.15.12:0/4183103547 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7ff3600762d0 0x7ff3600787e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff3780095f0 tx=0x7ff378006b70 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:06.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.661+0000 7ff372ffd640 1 -- 172.21.15.12:0/4183103547 <== mon.1 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7ff36c0615c0 con 0x7ff37c145660 2024-05-15T15:40:06.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.920+0000 7f17ab7fe640 1 -- 172.21.15.12:0/1996330792 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f17a0005850 con 0x7f17c00bb060 2024-05-15T15:40:06.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.921+0000 7f17b5ffb640 1 -- 172.21.15.12:0/1996330792 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f17b00642c0 con 0x7f17c00bb060 2024-05-15T15:40:06.923 INFO:teuthology.orchestra.run.smithi012.stdout:55834574856 2024-05-15T15:40:06.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.925+0000 7f17c7401640 1 -- 172.21.15.12:0/1996330792 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f17a40763d0 msgr2=0x7f17a40788e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:06.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.925+0000 7f17c7401640 1 --2- 172.21.15.12:0/1996330792 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f17a40763d0 0x7f17a40788e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f17bc034000 tx=0x7f17bc02e000 comp rx=0 tx=0).stop 2024-05-15T15:40:06.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.925+0000 7f17c7401640 1 -- 172.21.15.12:0/1996330792 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f17c00bb060 msgr2=0x7f17c0145c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:06.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.925+0000 7f17c7401640 1 --2- 172.21.15.12:0/1996330792 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f17c00bb060 0x7f17c0145c60 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f17b000e8a0 tx=0x7f17b000ed60 comp rx=0 tx=0).stop 2024-05-15T15:40:06.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.925+0000 7f17c7401640 1 -- 172.21.15.12:0/1996330792 shutdown_connections 2024-05-15T15:40:06.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.925+0000 7f17c7401640 1 --2- 172.21.15.12:0/1996330792 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f17c01455f0 0x7f17c0147fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:06.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.925+0000 7f17c7401640 1 --2- 172.21.15.12:0/1996330792 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f17c00bb470 0x7f17c0143960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:06.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.926+0000 7f17c7401640 1 --2- 172.21.15.12:0/1996330792 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f17a40763d0 0x7f17a40788e0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:06.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.926+0000 7f17c7401640 1 --2- 172.21.15.12:0/1996330792 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f17c00bb060 0x7f17c0145c60 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:06.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.926+0000 7f17c7401640 1 -- 172.21.15.12:0/1996330792 >> 172.21.15.12:0/1996330792 conn(0x7f17c00bd160 msgr2=0x7f17c0144cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:06.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.926+0000 7f17c7401640 1 -- 172.21.15.12:0/1996330792 shutdown_connections 2024-05-15T15:40:06.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.926+0000 7f17c7401640 1 -- 172.21.15.12:0/1996330792 wait complete. 2024-05-15T15:40:06.945 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.4 2024-05-15T15:40:06.946 DEBUG:teuthology.parallel:result is None 2024-05-15T15:40:06.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.954+0000 7fca2a73f640 1 -- 172.21.15.12:0/1412845176 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fca04005580 con 0x7fca24070fd0 2024-05-15T15:40:06.957 INFO:teuthology.orchestra.run.smithi012.stdout:64424509449 2024-05-15T15:40:06.958 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.955+0000 7fca20ff9640 1 -- 172.21.15.12:0/1412845176 <== mon.1 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fca14061af0 con 0x7fca24070fd0 2024-05-15T15:40:06.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.957+0000 7fca2a73f640 1 -- 172.21.15.12:0/1412845176 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fca0c0764e0 msgr2=0x7fca0c0789f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:06.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.958+0000 7fca2a73f640 1 --2- 172.21.15.12:0/1412845176 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fca0c0764e0 0x7fca0c0789f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fca2414be80 tx=0x7fca1c02e000 comp rx=0 tx=0).stop 2024-05-15T15:40:06.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.958+0000 7fca2a73f640 1 -- 172.21.15.12:0/1412845176 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca24070fd0 msgr2=0x7fca240a6cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:06.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.958+0000 7fca2a73f640 1 --2- 172.21.15.12:0/1412845176 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca24070fd0 0x7fca240a6cb0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fca1400cd50 tx=0x7fca1400a650 comp rx=0 tx=0).stop 2024-05-15T15:40:06.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.958+0000 7fca2a73f640 1 -- 172.21.15.12:0/1412845176 shutdown_connections 2024-05-15T15:40:06.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.958+0000 7fca2a73f640 1 --2- 172.21.15.12:0/1412845176 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fca24156820 0x7fca24148060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:06.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.958+0000 7fca2a73f640 1 --2- 172.21.15.12:0/1412845176 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fca0c0764e0 0x7fca0c0789f0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:06.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.958+0000 7fca2a73f640 1 --2- 172.21.15.12:0/1412845176 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fca240bc150 0x7fca2414f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:06.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.958+0000 7fca2a73f640 1 --2- 172.21.15.12:0/1412845176 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca24070fd0 0x7fca240a6cb0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:06.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.958+0000 7fca2a73f640 1 -- 172.21.15.12:0/1412845176 >> 172.21.15.12:0/1412845176 conn(0x7fca240c1750 msgr2=0x7fca2414b320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:06.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.958+0000 7fca2a73f640 1 -- 172.21.15.12:0/1412845176 shutdown_connections 2024-05-15T15:40:06.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.958+0000 7fca2a73f640 1 -- 172.21.15.12:0/1412845176 wait complete. 2024-05-15T15:40:06.972 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509449 for osd.1 2024-05-15T15:40:06.973 DEBUG:teuthology.parallel:result is None 2024-05-15T15:40:06.988 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.986+0000 7fe13d510640 1 -- 172.21.15.12:0/376251037 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fe138050860 con 0x7fe1380b62c0 2024-05-15T15:40:06.988 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.987+0000 7fe134ff9640 1 -- 172.21.15.12:0/376251037 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe13004b030 con 0x7fe1380b62c0 2024-05-15T15:40:06.989 INFO:teuthology.orchestra.run.smithi012.stdout:64424509448 2024-05-15T15:40:06.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.990+0000 7fe13d510640 1 -- 172.21.15.12:0/376251037 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fe1240762d0 msgr2=0x7fe1240787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:06.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.990+0000 7fe13d510640 1 --2- 172.21.15.12:0/376251037 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fe1240762d0 0x7fe1240787e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe128001800 tx=0x7fe128009040 comp rx=0 tx=0).stop 2024-05-15T15:40:06.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.990+0000 7fe13d510640 1 -- 172.21.15.12:0/376251037 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1380b62c0 msgr2=0x7fe1381ec0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:06.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.990+0000 7fe13d510640 1 --2- 172.21.15.12:0/376251037 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1380b62c0 0x7fe1381ec0b0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe13814e660 tx=0x7fe130004a40 comp rx=0 tx=0).stop 2024-05-15T15:40:06.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.990+0000 7fe13d510640 1 -- 172.21.15.12:0/376251037 shutdown_connections 2024-05-15T15:40:06.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.990+0000 7fe13d510640 1 --2- 172.21.15.12:0/376251037 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe138144520 0x7fe138136ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:06.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.990+0000 7fe13d510640 1 --2- 172.21.15.12:0/376251037 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fe1240762d0 0x7fe1240787e0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:06.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.990+0000 7fe13d510640 1 --2- 172.21.15.12:0/376251037 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1380b62c0 0x7fe1381ec0b0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:06.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.990+0000 7fe13d510640 1 --2- 172.21.15.12:0/376251037 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe13806d200 0x7fe13814b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:06.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.990+0000 7fe13d510640 1 -- 172.21.15.12:0/376251037 >> 172.21.15.12:0/376251037 conn(0x7fe13806c6e0 msgr2=0x7fe13806ef20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:06.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.990+0000 7fe13d510640 1 -- 172.21.15.12:0/376251037 shutdown_connections 2024-05-15T15:40:06.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:06.990+0000 7fe13d510640 1 -- 172.21.15.12:0/376251037 wait complete. 2024-05-15T15:40:07.005 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509448 for osd.0 2024-05-15T15:40:07.005 DEBUG:teuthology.parallel:result is None 2024-05-15T15:40:07.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.020+0000 7f1ffedb4640 1 -- 172.21.15.12:0/824842586 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f1ff8050940 con 0x7f1ff8072d80 2024-05-15T15:40:07.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.020+0000 7f1ff57fa640 1 -- 172.21.15.12:0/824842586 <== mon.2 v2:172.21.15.84:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1fe8060290 con 0x7f1ff8072d80 2024-05-15T15:40:07.022 INFO:teuthology.orchestra.run.smithi012.stdout:64424509448 2024-05-15T15:40:07.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.023+0000 7f1ffedb4640 1 -- 172.21.15.12:0/824842586 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f1fe4076300 msgr2=0x7f1fe4078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:07.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.023+0000 7f1ffedb4640 1 --2- 172.21.15.12:0/824842586 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f1fe4076300 0x7f1fe4078810 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1ff0033000 tx=0x7f1ff0009000 comp rx=0 tx=0).stop 2024-05-15T15:40:07.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.023+0000 7f1ffedb4640 1 -- 172.21.15.12:0/824842586 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1ff8072d80 msgr2=0x7f1ff81ec260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:07.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.023+0000 7f1ffedb4640 1 --2- 172.21.15.12:0/824842586 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1ff8072d80 0x7f1ff81ec260 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1fe800c370 tx=0x7f1fe800c830 comp rx=0 tx=0).stop 2024-05-15T15:40:07.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.023+0000 7f1ffedb4640 1 -- 172.21.15.12:0/824842586 shutdown_connections 2024-05-15T15:40:07.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.023+0000 7f1ffedb4640 1 --2- 172.21.15.12:0/824842586 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1ff815b070 0x7f1ff8144670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:07.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.023+0000 7f1ffedb4640 1 --2- 172.21.15.12:0/824842586 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f1fe4076300 0x7f1fe4078810 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:07.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.023+0000 7f1ffedb4640 1 --2- 172.21.15.12:0/824842586 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1ff814cc20 0x7f1ff80bb130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:07.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.023+0000 7f1ffedb4640 1 --2- 172.21.15.12:0/824842586 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1ff8072d80 0x7f1ff81ec260 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:07.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.023+0000 7f1ffedb4640 1 -- 172.21.15.12:0/824842586 >> 172.21.15.12:0/824842586 conn(0x7f1ff80bc4f0 msgr2=0x7f1ff8141550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:07.026 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.023+0000 7f1ffedb4640 1 -- 172.21.15.12:0/824842586 shutdown_connections 2024-05-15T15:40:07.026 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.023+0000 7f1ffedb4640 1 -- 172.21.15.12:0/824842586 wait complete. 2024-05-15T15:40:07.036 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509448 for osd.2 2024-05-15T15:40:07.036 DEBUG:teuthology.parallel:result is None 2024-05-15T15:40:07.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.052+0000 7f7e01434640 1 -- 172.21.15.12:0/668802439 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f7ddc005580 con 0x7f7dfc14a160 2024-05-15T15:40:07.055 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.053+0000 7f7df8ff9640 1 -- 172.21.15.12:0/668802439 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7df4064960 con 0x7f7dfc14a160 2024-05-15T15:40:07.055 INFO:teuthology.orchestra.run.smithi012.stdout:64424509448 2024-05-15T15:40:07.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.056+0000 7f7e01434640 1 -- 172.21.15.12:0/668802439 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f7de8076300 msgr2=0x7f7de8078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:07.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.056+0000 7f7e01434640 1 --2- 172.21.15.12:0/668802439 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f7de8076300 0x7f7de8078810 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7df0006a90 tx=0x7f7df0008040 comp rx=0 tx=0).stop 2024-05-15T15:40:07.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.056+0000 7f7e01434640 1 -- 172.21.15.12:0/668802439 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7dfc14a160 msgr2=0x7f7dfc1439f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:07.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.056+0000 7f7e01434640 1 --2- 172.21.15.12:0/668802439 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7dfc14a160 0x7f7dfc1439f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7dfc06ffe0 tx=0x7f7df4009ed0 comp rx=0 tx=0).stop 2024-05-15T15:40:07.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.056+0000 7f7e01434640 1 -- 172.21.15.12:0/668802439 shutdown_connections 2024-05-15T15:40:07.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.056+0000 7f7e01434640 1 --2- 172.21.15.12:0/668802439 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f7de8076300 0x7f7de8078810 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:07.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.056+0000 7f7e01434640 1 --2- 172.21.15.12:0/668802439 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7dfc14a160 0x7f7dfc1439f0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:07.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.056+0000 7f7e01434640 1 --2- 172.21.15.12:0/668802439 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7dfc0be430 0x7f7dfc0b8550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:07.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.056+0000 7f7e01434640 1 --2- 172.21.15.12:0/668802439 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f7dfc0ba200 0x7f7dfc08b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:07.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.056+0000 7f7e01434640 1 -- 172.21.15.12:0/668802439 >> 172.21.15.12:0/668802439 conn(0x7f7dfc0a1180 msgr2=0x7f7dfc1499a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:07.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.056+0000 7f7e01434640 1 -- 172.21.15.12:0/668802439 shutdown_connections 2024-05-15T15:40:07.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.056+0000 7f7e01434640 1 -- 172.21.15.12:0/668802439 wait complete. 2024-05-15T15:40:07.073 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509448 for osd.3 2024-05-15T15:40:07.073 DEBUG:teuthology.parallel:result is None 2024-05-15T15:40:07.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.072+0000 7ffb14e43640 1 -- 172.21.15.12:0/3493656294 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7ffb10050940 con 0x7ffb100be770 2024-05-15T15:40:07.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.073+0000 7ffafeffd640 1 -- 172.21.15.12:0/3493656294 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ffb00064e20 con 0x7ffb100be770 2024-05-15T15:40:07.075 INFO:teuthology.orchestra.run.smithi012.stdout:64424509449 2024-05-15T15:40:07.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.076+0000 7ffb14e43640 1 -- 172.21.15.12:0/3493656294 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7ffaf00766d0 msgr2=0x7ffaf0078be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:07.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.076+0000 7ffb14e43640 1 --2- 172.21.15.12:0/3493656294 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7ffaf00766d0 0x7ffaf0078be0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ffb08035000 tx=0x7ffb08030000 comp rx=0 tx=0).stop 2024-05-15T15:40:07.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.076+0000 7ffb14e43640 1 -- 172.21.15.12:0/3493656294 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb100be770 msgr2=0x7ffb100714f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:07.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.076+0000 7ffb14e43640 1 --2- 172.21.15.12:0/3493656294 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb100be770 0x7ffb100714f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ffb0000e840 tx=0x7ffb0000ed00 comp rx=0 tx=0).stop 2024-05-15T15:40:07.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.076+0000 7ffb14e43640 1 -- 172.21.15.12:0/3493656294 shutdown_connections 2024-05-15T15:40:07.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.076+0000 7ffb14e43640 1 --2- 172.21.15.12:0/3493656294 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ffb101537f0 0x7ffb101dbb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:07.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.076+0000 7ffb14e43640 1 --2- 172.21.15.12:0/3493656294 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7ffaf00766d0 0x7ffaf0078be0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:07.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.076+0000 7ffb14e43640 1 --2- 172.21.15.12:0/3493656294 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb100be770 0x7ffb100714f0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:07.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.076+0000 7ffb14e43640 1 --2- 172.21.15.12:0/3493656294 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb100bb9b0 0x7ffb1006fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:07.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.076+0000 7ffb14e43640 1 -- 172.21.15.12:0/3493656294 >> 172.21.15.12:0/3493656294 conn(0x7ffb100bd160 msgr2=0x7ffb1014fcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:07.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.076+0000 7ffb14e43640 1 -- 172.21.15.12:0/3493656294 shutdown_connections 2024-05-15T15:40:07.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.076+0000 7ffb14e43640 1 -- 172.21.15.12:0/3493656294 wait complete. 2024-05-15T15:40:07.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.078+0000 7fb8f67fc640 1 -- 172.21.15.12:0/1739655215 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fb8d8005850 con 0x7fb900153210 2024-05-15T15:40:07.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.079+0000 7fb8fcff9640 1 -- 172.21.15.12:0/1739655215 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb8e8081cd0 con 0x7fb900153210 2024-05-15T15:40:07.081 INFO:teuthology.orchestra.run.smithi012.stdout:64424509448 2024-05-15T15:40:07.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.081+0000 7fb8f67fc640 1 -- 172.21.15.12:0/1739655215 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fb8e0076300 msgr2=0x7fb8e0078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:07.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.081+0000 7fb8f67fc640 1 --2- 172.21.15.12:0/1739655215 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fb8e0076300 0x7fb8e0078810 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb8f800b810 tx=0x7fb8f8008040 comp rx=0 tx=0).stop 2024-05-15T15:40:07.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.081+0000 7fb8f67fc640 1 -- 172.21.15.12:0/1739655215 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb900153210 msgr2=0x7fb900146f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:07.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.081+0000 7fb8f67fc640 1 --2- 172.21.15.12:0/1739655215 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb900153210 0x7fb900146f90 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb8e8035040 tx=0x7fb8e80046c0 comp rx=0 tx=0).stop 2024-05-15T15:40:07.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.081+0000 7fb8f67fc640 1 -- 172.21.15.12:0/1739655215 shutdown_connections 2024-05-15T15:40:07.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.081+0000 7fb8f67fc640 1 --2- 172.21.15.12:0/1739655215 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fb8e0076300 0x7fb8e0078810 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:07.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.081+0000 7fb8f67fc640 1 --2- 172.21.15.12:0/1739655215 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb900153210 0x7fb900146f90 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:07.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.081+0000 7fb8f67fc640 1 --2- 172.21.15.12:0/1739655215 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb9000b6340 0x7fb9000b8960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:07.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.081+0000 7fb8f67fc640 1 --2- 172.21.15.12:0/1739655215 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb9000a0ba0 0x7fb9001e8e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:07.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.081+0000 7fb8f67fc640 1 -- 172.21.15.12:0/1739655215 >> 172.21.15.12:0/1739655215 conn(0x7fb9000a1ac0 msgr2=0x7fb900152720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:07.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.081+0000 7fb8f67fc640 1 -- 172.21.15.12:0/1739655215 shutdown_connections 2024-05-15T15:40:07.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.081+0000 7fb8f67fc640 1 -- 172.21.15.12:0/1739655215 wait complete. 2024-05-15T15:40:07.095 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509448 for osd.6 2024-05-15T15:40:07.096 DEBUG:teuthology.parallel:result is None 2024-05-15T15:40:07.096 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509449 for osd.5 2024-05-15T15:40:07.096 DEBUG:teuthology.parallel:result is None 2024-05-15T15:40:07.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.097+0000 7ff384415640 1 -- 172.21.15.12:0/4183103547 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7ff37c069b50 con 0x7ff37c145660 2024-05-15T15:40:07.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.098+0000 7ff372ffd640 1 -- 172.21.15.12:0/4183103547 <== mon.1 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff36c060ec0 con 0x7ff37c145660 2024-05-15T15:40:07.099 INFO:teuthology.orchestra.run.smithi012.stdout:64424509448 2024-05-15T15:40:07.102 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.100+0000 7ff384415640 1 -- 172.21.15.12:0/4183103547 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7ff3600762d0 msgr2=0x7ff3600787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:07.102 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.100+0000 7ff384415640 1 --2- 172.21.15.12:0/4183103547 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7ff3600762d0 0x7ff3600787e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff3780095f0 tx=0x7ff378006b70 comp rx=0 tx=0).stop 2024-05-15T15:40:07.102 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.100+0000 7ff384415640 1 -- 172.21.15.12:0/4183103547 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff37c145660 msgr2=0x7ff37c0a4740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:07.102 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.100+0000 7ff384415640 1 --2- 172.21.15.12:0/4183103547 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff37c145660 0x7ff37c0a4740 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff36c00b3c0 tx=0x7ff36c00b880 comp rx=0 tx=0).stop 2024-05-15T15:40:07.102 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.100+0000 7ff384415640 1 -- 172.21.15.12:0/4183103547 shutdown_connections 2024-05-15T15:40:07.102 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.100+0000 7ff384415640 1 --2- 172.21.15.12:0/4183103547 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7ff3600762d0 0x7ff3600787e0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:07.102 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.100+0000 7ff384415640 1 --2- 172.21.15.12:0/4183103547 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff37c14bb60 0x7ff37c1373a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:07.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.100+0000 7ff384415640 1 --2- 172.21.15.12:0/4183103547 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff37c145660 0x7ff37c0a4740 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:07.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.100+0000 7ff384415640 1 --2- 172.21.15.12:0/4183103547 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff37c09fb90 0x7ff37c0b66f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:07.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.100+0000 7ff384415640 1 -- 172.21.15.12:0/4183103547 >> 172.21.15.12:0/4183103547 conn(0x7ff37c0bd1d0 msgr2=0x7ff37c068d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:07.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.100+0000 7ff384415640 1 -- 172.21.15.12:0/4183103547 shutdown_connections 2024-05-15T15:40:07.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.100+0000 7ff384415640 1 -- 172.21.15.12:0/4183103547 wait complete. 2024-05-15T15:40:07.113 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509448 for osd.7 2024-05-15T15:40:07.113 DEBUG:teuthology.parallel:result is None 2024-05-15T15:40:07.113 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-15T15:40:07.113 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-15T15:40:07.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.262+0000 7f2d06cf9640 1 Processor -- start 2024-05-15T15:40:07.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.262+0000 7f2d06cf9640 1 -- start start 2024-05-15T15:40:07.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.263+0000 7f2d06cf9640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f2d000bd440 0x7f2d000bd850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:07.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.263+0000 7f2d06cf9640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f2d000b8d70 0x7f2d000b9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:07.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.263+0000 7f2d06cf9640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d000bdd90 con 0x7f2d0014e530 2024-05-15T15:40:07.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.263+0000 7f2d06cf9640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f2d000b88e0 con 0x7f2d000b8d70 2024-05-15T15:40:07.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.263+0000 7f2d06cf9640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f2d0014ece0 con 0x7f2d000bd440 2024-05-15T15:40:07.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.263+0000 7f2cfffff640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f2d000bd440 0x7f2d000bd850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:07.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.263+0000 7f2d05296640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f2d000b8d70 0x7f2d000b9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:07.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.263+0000 7f2d04a95640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f2d0014e530 0x7f2d000ba320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.12:47732/0 (socket says 172.21.15.12:47732) 2024-05-15T15:40:07.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.263+0000 7f2d04a95640 1 -- 172.21.15.12:0/1439580721 learned_addr learned my addr 172.21.15.12:0/1439580721 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-05-15T15:40:07.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.264+0000 7f2cff7fe640 1 -- 172.21.15.12:0/1439580721 <== mon.1 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1487130950 0 0) 0x7f2d000bdd90 con 0x7f2d0014e530 2024-05-15T15:40:07.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.264+0000 7f2cff7fe640 1 -- 172.21.15.12:0/1439580721 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2ce8003520 con 0x7f2d0014e530 2024-05-15T15:40:07.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.264+0000 7f2d05296640 1 -- 172.21.15.12:0/1439580721 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f2d000bd440 msgr2=0x7f2d000bd850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:40:07.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.264+0000 7f2d05296640 1 --2- 172.21.15.12:0/1439580721 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f2d000bd440 0x7f2d000bd850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:07.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.264+0000 7f2d05296640 1 -- 172.21.15.12:0/1439580721 >> v1:172.21.15.84:6789/0 conn(0x7f2d0014e530 legacy=0x7f2d000ba320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:07.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.264+0000 7f2d05296640 1 -- 172.21.15.12:0/1439580721 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d0014efc0 con 0x7f2d000b8d70 2024-05-15T15:40:07.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.264+0000 7f2cfffff640 1 --2- 172.21.15.12:0/1439580721 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f2d000bd440 0x7f2d000bd850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-15T15:40:07.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.265+0000 7f2d05296640 1 --2- 172.21.15.12:0/1439580721 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d000b8d70 0x7f2d000b9180 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f2cf8009d90 tx=0x7f2cf802a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9805b7bedeb313e server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:07.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.265+0000 7f2cff7fe640 1 -- 172.21.15.12:0/1439580721 <== mon.1 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cf8007740 con 0x7f2d000b8d70 2024-05-15T15:40:07.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.265+0000 7f2cff7fe640 1 -- 172.21.15.12:0/1439580721 <== mon.1 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cf80078e0 con 0x7f2d000b8d70 2024-05-15T15:40:07.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.265+0000 7f2cff7fe640 1 -- 172.21.15.12:0/1439580721 <== mon.1 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cf8007cb0 con 0x7f2d000b8d70 2024-05-15T15:40:07.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.265+0000 7f2d06cf9640 1 -- 172.21.15.12:0/1439580721 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d000b8d70 msgr2=0x7f2d000b9180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:07.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.265+0000 7f2d06cf9640 1 --2- 172.21.15.12:0/1439580721 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d000b8d70 0x7f2d000b9180 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f2cf8009d90 tx=0x7f2cf802a660 comp rx=0 tx=0).stop 2024-05-15T15:40:07.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.265+0000 7f2d06cf9640 1 -- 172.21.15.12:0/1439580721 shutdown_connections 2024-05-15T15:40:07.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.265+0000 7f2d06cf9640 1 --2- 172.21.15.12:0/1439580721 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d000b8d70 0x7f2d000b9180 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:07.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.265+0000 7f2d06cf9640 1 --2- 172.21.15.12:0/1439580721 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f2d000bd440 0x7f2d000bd850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:07.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.265+0000 7f2d06cf9640 1 -- 172.21.15.12:0/1439580721 >> 172.21.15.12:0/1439580721 conn(0x7f2d000c0570 msgr2=0x7f2d000c0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:07.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.266+0000 7f2d06cf9640 1 -- 172.21.15.12:0/1439580721 shutdown_connections 2024-05-15T15:40:07.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.266+0000 7f2d06cf9640 1 -- 172.21.15.12:0/1439580721 wait complete. 2024-05-15T15:40:07.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.267+0000 7f2d06cf9640 1 Processor -- start 2024-05-15T15:40:07.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.267+0000 7f2d06cf9640 1 -- start start 2024-05-15T15:40:07.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.268+0000 7f2d06cf9640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d000b8d70 0x7f2d00144c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:07.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.268+0000 7f2d06cf9640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f2d000bd440 0x7f2d001520d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:07.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.268+0000 7f2d06cf9640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d0014e530 0x7f2d00146760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:07.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.268+0000 7f2d06cf9640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f2d000b96c0 con 0x7f2d000b8d70 2024-05-15T15:40:07.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.268+0000 7f2d06cf9640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f2d000bbb70 con 0x7f2d0014e530 2024-05-15T15:40:07.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.268+0000 7f2d06cf9640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f2d0014e940 con 0x7f2d000bd440 2024-05-15T15:40:07.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.268+0000 7f2d04a95640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d000b8d70 0x7f2d00144c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:07.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.268+0000 7f2cfffff640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f2d000bd440 0x7f2d001520d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:07.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.268+0000 7f2d04a95640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d000b8d70 0x7f2d00144c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52580/0 (socket says 172.21.15.12:52580) 2024-05-15T15:40:07.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.268+0000 7f2d04a95640 1 -- 172.21.15.12:0/2063538544 learned_addr learned my addr 172.21.15.12:0/2063538544 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:07.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.268+0000 7f2d05296640 1 --2- 172.21.15.12:0/2063538544 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d0014e530 0x7f2d00146760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:07.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.269+0000 7f2d04a95640 1 -- 172.21.15.12:0/2063538544 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f2d000bd440 msgr2=0x7f2d001520d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:07.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.269+0000 7f2d04a95640 1 --2- 172.21.15.12:0/2063538544 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f2d000bd440 0x7f2d001520d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:07.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.269+0000 7f2d04a95640 1 -- 172.21.15.12:0/2063538544 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d0014e530 msgr2=0x7f2d00146760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:07.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.269+0000 7f2d04a95640 1 --2- 172.21.15.12:0/2063538544 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d0014e530 0x7f2d00146760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:07.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.269+0000 7f2d04a95640 1 -- 172.21.15.12:0/2063538544 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d00145170 con 0x7f2d000b8d70 2024-05-15T15:40:07.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.269+0000 7f2d05296640 1 --2- 172.21.15.12:0/2063538544 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d0014e530 0x7f2d00146760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-15T15:40:07.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.269+0000 7f2d04a95640 1 --2- 172.21.15.12:0/2063538544 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d000b8d70 0x7f2d00144c30 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f2cf000c440 tx=0x7f2cf000c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:07.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.269+0000 7f2cfd7fa640 1 -- 172.21.15.12:0/2063538544 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cf0017070 con 0x7f2d000b8d70 2024-05-15T15:40:07.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.269+0000 7f2cfd7fa640 1 -- 172.21.15.12:0/2063538544 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cf0005d30 con 0x7f2d000b8d70 2024-05-15T15:40:07.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.269+0000 7f2cfd7fa640 1 -- 172.21.15.12:0/2063538544 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cf00072f0 con 0x7f2d000b8d70 2024-05-15T15:40:07.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.269+0000 7f2d06cf9640 1 -- 172.21.15.12:0/2063538544 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d0013dc10 con 0x7f2d000b8d70 2024-05-15T15:40:07.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.269+0000 7f2d06cf9640 1 -- 172.21.15.12:0/2063538544 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d001e42e0 con 0x7f2d000b8d70 2024-05-15T15:40:07.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.270+0000 7f2d06cf9640 1 -- 172.21.15.12:0/2063538544 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d00050940 con 0x7f2d000b8d70 2024-05-15T15:40:07.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.271+0000 7f2cfd7fa640 1 -- 172.21.15.12:0/2063538544 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2cf001a070 con 0x7f2d000b8d70 2024-05-15T15:40:07.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.271+0000 7f2cfd7fa640 1 --2- 172.21.15.12:0/2063538544 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f2cec076300 0x7f2cec078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:07.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.272+0000 7f2cfd7fa640 1 -- 172.21.15.12:0/2063538544 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f2cf0096970 con 0x7f2d000b8d70 2024-05-15T15:40:07.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.272+0000 7f2cfffff640 1 --2- 172.21.15.12:0/2063538544 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f2cec076300 0x7f2cec078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:07.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.272+0000 7f2cfffff640 1 --2- 172.21.15.12:0/2063538544 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f2cec076300 0x7f2cec078810 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2d00144950 tx=0x7f2cf4009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:07.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.276+0000 7f2cfd7fa640 1 -- 172.21.15.12:0/2063538544 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f2cf005fbf0 con 0x7f2d000b8d70 2024-05-15T15:40:07.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.464+0000 7f2d06cf9640 1 -- 172.21.15.12:0/2063538544 --> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2d0014fa90 con 0x7f2cec076300 2024-05-15T15:40:07.472 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.471+0000 7f2cfd7fa640 1 -- 172.21.15.12:0/2063538544 <== mgr.4106 v2:172.21.15.84:6832/4173299311 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251822 (secure 0 0 0) 0x7f2d0014fa90 con 0x7f2cec076300 2024-05-15T15:40:07.475 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-05-15T15:40:07.477 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-05-15T15:40:07.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.474+0000 7f2d06cf9640 1 -- 172.21.15.12:0/2063538544 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f2cec076300 msgr2=0x7f2cec078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:07.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.474+0000 7f2d06cf9640 1 --2- 172.21.15.12:0/2063538544 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f2cec076300 0x7f2cec078810 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2d00144950 tx=0x7f2cf4009190 comp rx=0 tx=0).stop 2024-05-15T15:40:07.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.474+0000 7f2d06cf9640 1 -- 172.21.15.12:0/2063538544 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d000b8d70 msgr2=0x7f2d00144c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:07.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.474+0000 7f2d06cf9640 1 --2- 172.21.15.12:0/2063538544 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d000b8d70 0x7f2d00144c30 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f2cf000c440 tx=0x7f2cf000c900 comp rx=0 tx=0).stop 2024-05-15T15:40:07.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.474+0000 7f2d06cf9640 1 -- 172.21.15.12:0/2063538544 shutdown_connections 2024-05-15T15:40:07.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.474+0000 7f2d06cf9640 1 --2- 172.21.15.12:0/2063538544 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d0014e530 0x7f2d00146760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:07.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.474+0000 7f2d06cf9640 1 --2- 172.21.15.12:0/2063538544 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f2d000bd440 0x7f2d001520d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:07.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.474+0000 7f2d06cf9640 1 --2- 172.21.15.12:0/2063538544 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f2cec076300 0x7f2cec078810 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:07.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.474+0000 7f2d06cf9640 1 --2- 172.21.15.12:0/2063538544 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d000b8d70 0x7f2d00144c30 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:07.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.474+0000 7f2d06cf9640 1 -- 172.21.15.12:0/2063538544 >> 172.21.15.12:0/2063538544 conn(0x7f2d000c0570 msgr2=0x7f2d000c0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:07.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.474+0000 7f2d06cf9640 1 -- 172.21.15.12:0/2063538544 shutdown_connections 2024-05-15T15:40:07.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.474+0000 7f2d06cf9640 1 -- 172.21.15.12:0/2063538544 wait complete. 2024-05-15T15:40:07.487 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":31,"stamp":"2024-05-15T15:40:06.704082+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219212,"kb_used_data":3048,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755508,"statfs":{"total":773094113280,"available":772869640192,"internally_reserved":0,"allocated":3121152,"data_stored":1835436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003502"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057108+0000","last_change":"2024-05-15T15:39:52.474245+0000","last_active":"2024-05-15T15:39:54.057108+0000","last_peered":"2024-05-15T15:39:54.057108+0000","last_clean":"2024-05-15T15:39:54.057108+0000","last_became_active":"2024-05-15T15:39:52.473919+0000","last_became_peered":"2024-05-15T15:39:52.473919+0000","last_unstale":"2024-05-15T15:39:54.057108+0000","last_undegraded":"2024-05-15T15:39:54.057108+0000","last_fullsized":"2024-05-15T15:39:54.057108+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:35:07.996967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.464974+0000","last_change":"2024-05-15T15:39:52.472587+0000","last_active":"2024-05-15T15:39:53.464974+0000","last_peered":"2024-05-15T15:39:53.464974+0000","last_clean":"2024-05-15T15:39:53.464974+0000","last_became_active":"2024-05-15T15:39:52.472268+0000","last_became_peered":"2024-05-15T15:39:52.472268+0000","last_unstale":"2024-05-15T15:39:53.464974+0000","last_undegraded":"2024-05-15T15:39:53.464974+0000","last_fullsized":"2024-05-15T15:39:53.464974+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:39:07.633570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.464154+0000","last_change":"2024-05-15T15:39:52.474404+0000","last_active":"2024-05-15T15:39:53.464154+0000","last_peered":"2024-05-15T15:39:53.464154+0000","last_clean":"2024-05-15T15:39:53.464154+0000","last_became_active":"2024-05-15T15:39:52.474102+0000","last_became_peered":"2024-05-15T15:39:52.474102+0000","last_unstale":"2024-05-15T15:39:53.464154+0000","last_undegraded":"2024-05-15T15:39:53.464154+0000","last_fullsized":"2024-05-15T15:39:53.464154+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:13:19.570085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.056856+0000","last_change":"2024-05-15T15:39:52.462504+0000","last_active":"2024-05-15T15:39:54.056856+0000","last_peered":"2024-05-15T15:39:54.056856+0000","last_clean":"2024-05-15T15:39:54.056856+0000","last_became_active":"2024-05-15T15:39:52.462135+0000","last_became_peered":"2024-05-15T15:39:52.462135+0000","last_unstale":"2024-05-15T15:39:54.056856+0000","last_undegraded":"2024-05-15T15:39:54.056856+0000","last_fullsized":"2024-05-15T15:39:54.056856+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:53:35.715007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057365+0000","last_change":"2024-05-15T15:39:52.477733+0000","last_active":"2024-05-15T15:39:54.057365+0000","last_peered":"2024-05-15T15:39:54.057365+0000","last_clean":"2024-05-15T15:39:54.057365+0000","last_became_active":"2024-05-15T15:39:52.474778+0000","last_became_peered":"2024-05-15T15:39:52.474778+0000","last_unstale":"2024-05-15T15:39:54.057365+0000","last_undegraded":"2024-05-15T15:39:54.057365+0000","last_fullsized":"2024-05-15T15:39:54.057365+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:18:51.904529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057477+0000","last_change":"2024-05-15T15:39:52.458241+0000","last_active":"2024-05-15T15:39:54.057477+0000","last_peered":"2024-05-15T15:39:54.057477+0000","last_clean":"2024-05-15T15:39:54.057477+0000","last_became_active":"2024-05-15T15:39:52.457883+0000","last_became_peered":"2024-05-15T15:39:52.457883+0000","last_unstale":"2024-05-15T15:39:54.057477+0000","last_undegraded":"2024-05-15T15:39:54.057477+0000","last_fullsized":"2024-05-15T15:39:54.057477+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:19:06.288701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.056535+0000","last_change":"2024-05-15T15:39:52.474619+0000","last_active":"2024-05-15T15:39:54.056535+0000","last_peered":"2024-05-15T15:39:54.056535+0000","last_clean":"2024-05-15T15:39:54.056535+0000","last_became_active":"2024-05-15T15:39:52.474314+0000","last_became_peered":"2024-05-15T15:39:52.474314+0000","last_unstale":"2024-05-15T15:39:54.056535+0000","last_undegraded":"2024-05-15T15:39:54.056535+0000","last_fullsized":"2024-05-15T15:39:54.056535+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:07:46.287281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.463913+0000","last_change":"2024-05-15T15:39:52.468997+0000","last_active":"2024-05-15T15:39:53.463913+0000","last_peered":"2024-05-15T15:39:53.463913+0000","last_clean":"2024-05-15T15:39:53.463913+0000","last_became_active":"2024-05-15T15:39:52.468155+0000","last_became_peered":"2024-05-15T15:39:52.468155+0000","last_unstale":"2024-05-15T15:39:53.463913+0000","last_undegraded":"2024-05-15T15:39:53.463913+0000","last_fullsized":"2024-05-15T15:39:53.463913+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:07:46.287281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.506277+0000","last_change":"2024-05-15T15:39:52.468077+0000","last_active":"2024-05-15T15:39:53.506277+0000","last_peered":"2024-05-15T15:39:53.506277+0000","last_clean":"2024-05-15T15:39:53.506277+0000","last_became_active":"2024-05-15T15:39:52.467754+0000","last_became_peered":"2024-05-15T15:39:52.467754+0000","last_unstale":"2024-05-15T15:39:53.506277+0000","last_undegraded":"2024-05-15T15:39:53.506277+0000","last_fullsized":"2024-05-15T15:39:53.506277+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:46:06.269771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057388+0000","last_change":"2024-05-15T15:39:52.480897+0000","last_active":"2024-05-15T15:39:54.057388+0000","last_peered":"2024-05-15T15:39:54.057388+0000","last_clean":"2024-05-15T15:39:54.057388+0000","last_became_active":"2024-05-15T15:39:52.479910+0000","last_became_peered":"2024-05-15T15:39:52.479910+0000","last_unstale":"2024-05-15T15:39:54.057388+0000","last_undegraded":"2024-05-15T15:39:54.057388+0000","last_fullsized":"2024-05-15T15:39:54.057388+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:13:19.570085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057782+0000","last_change":"2024-05-15T15:39:52.473167+0000","last_active":"2024-05-15T15:39:54.057782+0000","last_peered":"2024-05-15T15:39:54.057782+0000","last_clean":"2024-05-15T15:39:54.057782+0000","last_became_active":"2024-05-15T15:39:52.472835+0000","last_became_peered":"2024-05-15T15:39:52.472835+0000","last_unstale":"2024-05-15T15:39:54.057782+0000","last_undegraded":"2024-05-15T15:39:54.057782+0000","last_fullsized":"2024-05-15T15:39:54.057782+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:39:30.074726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057803+0000","last_change":"2024-05-15T15:39:52.467676+0000","last_active":"2024-05-15T15:39:54.057803+0000","last_peered":"2024-05-15T15:39:54.057803+0000","last_clean":"2024-05-15T15:39:54.057803+0000","last_became_active":"2024-05-15T15:39:52.467064+0000","last_became_peered":"2024-05-15T15:39:52.467064+0000","last_unstale":"2024-05-15T15:39:54.057803+0000","last_undegraded":"2024-05-15T15:39:54.057803+0000","last_fullsized":"2024-05-15T15:39:54.057803+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:58:23.539973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.463567+0000","last_change":"2024-05-15T15:39:52.472464+0000","last_active":"2024-05-15T15:39:53.463567+0000","last_peered":"2024-05-15T15:39:53.463567+0000","last_clean":"2024-05-15T15:39:53.463567+0000","last_became_active":"2024-05-15T15:39:52.472129+0000","last_became_peered":"2024-05-15T15:39:52.472129+0000","last_unstale":"2024-05-15T15:39:53.463567+0000","last_undegraded":"2024-05-15T15:39:53.463567+0000","last_fullsized":"2024-05-15T15:39:53.463567+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:14:40.347641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.463905+0000","last_change":"2024-05-15T15:39:52.465747+0000","last_active":"2024-05-15T15:39:53.463905+0000","last_peered":"2024-05-15T15:39:53.463905+0000","last_clean":"2024-05-15T15:39:53.463905+0000","last_became_active":"2024-05-15T15:39:52.465239+0000","last_became_peered":"2024-05-15T15:39:52.465239+0000","last_unstale":"2024-05-15T15:39:53.463905+0000","last_undegraded":"2024-05-15T15:39:53.463905+0000","last_fullsized":"2024-05-15T15:39:53.463905+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:56:24.242548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.463549+0000","last_change":"2024-05-15T15:39:52.467317+0000","last_active":"2024-05-15T15:39:53.463549+0000","last_peered":"2024-05-15T15:39:53.463549+0000","last_clean":"2024-05-15T15:39:53.463549+0000","last_became_active":"2024-05-15T15:39:52.466968+0000","last_became_peered":"2024-05-15T15:39:52.466968+0000","last_unstale":"2024-05-15T15:39:53.463549+0000","last_undegraded":"2024-05-15T15:39:53.463549+0000","last_fullsized":"2024-05-15T15:39:53.463549+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:36:37.195191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.462383+0000","last_change":"2024-05-15T15:39:52.469584+0000","last_active":"2024-05-15T15:39:53.462383+0000","last_peered":"2024-05-15T15:39:53.462383+0000","last_clean":"2024-05-15T15:39:53.462383+0000","last_became_active":"2024-05-15T15:39:52.469257+0000","last_became_peered":"2024-05-15T15:39:52.469257+0000","last_unstale":"2024-05-15T15:39:53.462383+0000","last_undegraded":"2024-05-15T15:39:53.462383+0000","last_fullsized":"2024-05-15T15:39:53.462383+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:52:43.064362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.463038+0000","last_change":"2024-05-15T15:39:52.473647+0000","last_active":"2024-05-15T15:39:53.463038+0000","last_peered":"2024-05-15T15:39:53.463038+0000","last_clean":"2024-05-15T15:39:53.463038+0000","last_became_active":"2024-05-15T15:39:52.472719+0000","last_became_peered":"2024-05-15T15:39:52.472719+0000","last_unstale":"2024-05-15T15:39:53.463038+0000","last_undegraded":"2024-05-15T15:39:53.463038+0000","last_fullsized":"2024-05-15T15:39:53.463038+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:48:23.434946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.056800+0000","last_change":"2024-05-15T15:39:52.465815+0000","last_active":"2024-05-15T15:39:54.056800+0000","last_peered":"2024-05-15T15:39:54.056800+0000","last_clean":"2024-05-15T15:39:54.056800+0000","last_became_active":"2024-05-15T15:39:52.465471+0000","last_became_peered":"2024-05-15T15:39:52.465471+0000","last_unstale":"2024-05-15T15:39:54.056800+0000","last_undegraded":"2024-05-15T15:39:54.056800+0000","last_fullsized":"2024-05-15T15:39:54.056800+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:53:35.715007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.463021+0000","last_change":"2024-05-15T15:39:52.463837+0000","last_active":"2024-05-15T15:39:53.463021+0000","last_peered":"2024-05-15T15:39:53.463021+0000","last_clean":"2024-05-15T15:39:53.463021+0000","last_became_active":"2024-05-15T15:39:52.459388+0000","last_became_peered":"2024-05-15T15:39:52.459388+0000","last_unstale":"2024-05-15T15:39:53.463021+0000","last_undegraded":"2024-05-15T15:39:53.463021+0000","last_fullsized":"2024-05-15T15:39:53.463021+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:55:50.961472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057274+0000","last_change":"2024-05-15T15:39:52.467411+0000","last_active":"2024-05-15T15:39:54.057274+0000","last_peered":"2024-05-15T15:39:54.057274+0000","last_clean":"2024-05-15T15:39:54.057274+0000","last_became_active":"2024-05-15T15:39:52.466666+0000","last_became_peered":"2024-05-15T15:39:52.466666+0000","last_unstale":"2024-05-15T15:39:54.057274+0000","last_undegraded":"2024-05-15T15:39:54.057274+0000","last_fullsized":"2024-05-15T15:39:54.057274+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:22:17.968105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.056682+0000","last_change":"2024-05-15T15:39:52.459193+0000","last_active":"2024-05-15T15:39:54.056682+0000","last_peered":"2024-05-15T15:39:54.056682+0000","last_clean":"2024-05-15T15:39:54.056682+0000","last_became_active":"2024-05-15T15:39:52.458872+0000","last_became_peered":"2024-05-15T15:39:52.458872+0000","last_unstale":"2024-05-15T15:39:54.056682+0000","last_undegraded":"2024-05-15T15:39:54.056682+0000","last_fullsized":"2024-05-15T15:39:54.056682+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:57:04.417030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.506016+0000","last_change":"2024-05-15T15:39:52.477675+0000","last_active":"2024-05-15T15:39:53.506016+0000","last_peered":"2024-05-15T15:39:53.506016+0000","last_clean":"2024-05-15T15:39:53.506016+0000","last_became_active":"2024-05-15T15:39:52.477314+0000","last_became_peered":"2024-05-15T15:39:52.477314+0000","last_unstale":"2024-05-15T15:39:53.506016+0000","last_undegraded":"2024-05-15T15:39:53.506016+0000","last_fullsized":"2024-05-15T15:39:53.506016+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:49:27.658296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.463806+0000","last_change":"2024-05-15T15:39:52.471743+0000","last_active":"2024-05-15T15:39:53.463806+0000","last_peered":"2024-05-15T15:39:53.463806+0000","last_clean":"2024-05-15T15:39:53.463806+0000","last_became_active":"2024-05-15T15:39:52.471382+0000","last_became_peered":"2024-05-15T15:39:52.471382+0000","last_unstale":"2024-05-15T15:39:53.463806+0000","last_undegraded":"2024-05-15T15:39:53.463806+0000","last_fullsized":"2024-05-15T15:39:53.463806+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:01:48.794566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.462381+0000","last_change":"2024-05-15T15:39:52.463540+0000","last_active":"2024-05-15T15:39:53.462381+0000","last_peered":"2024-05-15T15:39:53.462381+0000","last_clean":"2024-05-15T15:39:53.462381+0000","last_became_active":"2024-05-15T15:39:52.463162+0000","last_became_peered":"2024-05-15T15:39:52.463162+0000","last_unstale":"2024-05-15T15:39:53.462381+0000","last_undegraded":"2024-05-15T15:39:53.462381+0000","last_fullsized":"2024-05-15T15:39:53.462381+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:18:51.904529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.464627+0000","last_change":"2024-05-15T15:39:52.474224+0000","last_active":"2024-05-15T15:39:53.464627+0000","last_peered":"2024-05-15T15:39:53.464627+0000","last_clean":"2024-05-15T15:39:53.464627+0000","last_became_active":"2024-05-15T15:39:52.473890+0000","last_became_peered":"2024-05-15T15:39:52.473890+0000","last_unstale":"2024-05-15T15:39:53.464627+0000","last_undegraded":"2024-05-15T15:39:53.464627+0000","last_fullsized":"2024-05-15T15:39:53.464627+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:22:17.968105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057129+0000","last_change":"2024-05-15T15:39:52.466971+0000","last_active":"2024-05-15T15:39:54.057129+0000","last_peered":"2024-05-15T15:39:54.057129+0000","last_clean":"2024-05-15T15:39:54.057129+0000","last_became_active":"2024-05-15T15:39:52.466656+0000","last_became_peered":"2024-05-15T15:39:52.466656+0000","last_unstale":"2024-05-15T15:39:54.057129+0000","last_undegraded":"2024-05-15T15:39:54.057129+0000","last_fullsized":"2024-05-15T15:39:54.057129+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:52:27.027535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.464322+0000","last_change":"2024-05-15T15:39:52.470364+0000","last_active":"2024-05-15T15:39:53.464322+0000","last_peered":"2024-05-15T15:39:53.464322+0000","last_clean":"2024-05-15T15:39:53.464322+0000","last_became_active":"2024-05-15T15:39:52.470067+0000","last_became_peered":"2024-05-15T15:39:52.470067+0000","last_unstale":"2024-05-15T15:39:53.464322+0000","last_undegraded":"2024-05-15T15:39:53.464322+0000","last_fullsized":"2024-05-15T15:39:53.464322+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:07:28.350502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.463525+0000","last_change":"2024-05-15T15:39:52.473274+0000","last_active":"2024-05-15T15:39:53.463525+0000","last_peered":"2024-05-15T15:39:53.463525+0000","last_clean":"2024-05-15T15:39:53.463525+0000","last_became_active":"2024-05-15T15:39:52.472954+0000","last_became_peered":"2024-05-15T15:39:52.472954+0000","last_unstale":"2024-05-15T15:39:53.463525+0000","last_undegraded":"2024-05-15T15:39:53.463525+0000","last_fullsized":"2024-05-15T15:39:53.463525+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:46:06.269771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.464564+0000","last_change":"2024-05-15T15:39:52.473238+0000","last_active":"2024-05-15T15:39:53.464564+0000","last_peered":"2024-05-15T15:39:53.464564+0000","last_clean":"2024-05-15T15:39:53.464564+0000","last_became_active":"2024-05-15T15:39:52.472848+0000","last_became_peered":"2024-05-15T15:39:52.472848+0000","last_unstale":"2024-05-15T15:39:53.464564+0000","last_undegraded":"2024-05-15T15:39:53.464564+0000","last_fullsized":"2024-05-15T15:39:53.464564+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:48:53.088055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.462876+0000","last_change":"2024-05-15T15:39:52.464689+0000","last_active":"2024-05-15T15:39:53.462876+0000","last_peered":"2024-05-15T15:39:53.462876+0000","last_clean":"2024-05-15T15:39:53.462876+0000","last_became_active":"2024-05-15T15:39:52.462649+0000","last_became_peered":"2024-05-15T15:39:52.462649+0000","last_unstale":"2024-05-15T15:39:53.462876+0000","last_undegraded":"2024-05-15T15:39:53.462876+0000","last_fullsized":"2024-05-15T15:39:53.462876+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:17:05.581127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.056464+0000","last_change":"2024-05-15T15:39:52.465485+0000","last_active":"2024-05-15T15:39:54.056464+0000","last_peered":"2024-05-15T15:39:54.056464+0000","last_clean":"2024-05-15T15:39:54.056464+0000","last_became_active":"2024-05-15T15:39:52.464733+0000","last_became_peered":"2024-05-15T15:39:52.464733+0000","last_unstale":"2024-05-15T15:39:54.056464+0000","last_undegraded":"2024-05-15T15:39:54.056464+0000","last_fullsized":"2024-05-15T15:39:54.056464+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:17:34.380965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057300+0000","last_change":"2024-05-15T15:39:52.465924+0000","last_active":"2024-05-15T15:39:54.057300+0000","last_peered":"2024-05-15T15:39:54.057300+0000","last_clean":"2024-05-15T15:39:54.057300+0000","last_became_active":"2024-05-15T15:39:52.464704+0000","last_became_peered":"2024-05-15T15:39:52.464704+0000","last_unstale":"2024-05-15T15:39:54.057300+0000","last_undegraded":"2024-05-15T15:39:54.057300+0000","last_fullsized":"2024-05-15T15:39:54.057300+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:49:27.658296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.506001+0000","last_change":"2024-05-15T15:39:52.465099+0000","last_active":"2024-05-15T15:39:53.506001+0000","last_peered":"2024-05-15T15:39:53.506001+0000","last_clean":"2024-05-15T15:39:53.506001+0000","last_became_active":"2024-05-15T15:39:52.464775+0000","last_became_peered":"2024-05-15T15:39:52.464775+0000","last_unstale":"2024-05-15T15:39:53.506001+0000","last_undegraded":"2024-05-15T15:39:53.506001+0000","last_fullsized":"2024-05-15T15:39:53.506001+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:52:27.027535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.464681+0000","last_change":"2024-05-15T15:39:51.443546+0000","last_active":"2024-05-15T15:39:53.464681+0000","last_peered":"2024-05-15T15:39:53.464681+0000","last_clean":"2024-05-15T15:39:53.464681+0000","last_became_active":"2024-05-15T15:39:51.443177+0000","last_became_peered":"2024-05-15T15:39:51.443177+0000","last_unstale":"2024-05-15T15:39:53.464681+0000","last_undegraded":"2024-05-15T15:39:53.464681+0000","last_fullsized":"2024-05-15T15:39:53.464681+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:18:35.801621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.056878+0000","last_change":"2024-05-15T15:39:52.470469+0000","last_active":"2024-05-15T15:39:54.056878+0000","last_peered":"2024-05-15T15:39:54.056878+0000","last_clean":"2024-05-15T15:39:54.056878+0000","last_became_active":"2024-05-15T15:39:52.468716+0000","last_became_peered":"2024-05-15T15:39:52.468716+0000","last_unstale":"2024-05-15T15:39:54.056878+0000","last_undegraded":"2024-05-15T15:39:54.056878+0000","last_fullsized":"2024-05-15T15:39:54.056878+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:58:08.602086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.462997+0000","last_change":"2024-05-15T15:39:51.451403+0000","last_active":"2024-05-15T15:39:53.462997+0000","last_peered":"2024-05-15T15:39:53.462997+0000","last_clean":"2024-05-15T15:39:53.462997+0000","last_became_active":"2024-05-15T15:39:51.451074+0000","last_became_peered":"2024-05-15T15:39:51.451074+0000","last_unstale":"2024-05-15T15:39:53.462997+0000","last_undegraded":"2024-05-15T15:39:53.462997+0000","last_fullsized":"2024-05-15T15:39:53.462997+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:52:26.020009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.463548+0000","last_change":"2024-05-15T15:39:51.457243+0000","last_active":"2024-05-15T15:39:53.463548+0000","last_peered":"2024-05-15T15:39:53.463548+0000","last_clean":"2024-05-15T15:39:53.463548+0000","last_became_active":"2024-05-15T15:39:51.456904+0000","last_became_peered":"2024-05-15T15:39:51.456904+0000","last_unstale":"2024-05-15T15:39:53.463548+0000","last_undegraded":"2024-05-15T15:39:53.463548+0000","last_fullsized":"2024-05-15T15:39:53.463548+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:45:30.896866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.464271+0000","last_change":"2024-05-15T15:39:52.461438+0000","last_active":"2024-05-15T15:39:53.464271+0000","last_peered":"2024-05-15T15:39:53.464271+0000","last_clean":"2024-05-15T15:39:53.464271+0000","last_became_active":"2024-05-15T15:39:52.460666+0000","last_became_peered":"2024-05-15T15:39:52.460666+0000","last_unstale":"2024-05-15T15:39:53.464271+0000","last_undegraded":"2024-05-15T15:39:53.464271+0000","last_fullsized":"2024-05-15T15:39:53.464271+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:35:07.996967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.462502+0000","last_change":"2024-05-15T15:39:51.444590+0000","last_active":"2024-05-15T15:39:53.462502+0000","last_peered":"2024-05-15T15:39:53.462502+0000","last_clean":"2024-05-15T15:39:53.462502+0000","last_became_active":"2024-05-15T15:39:51.444114+0000","last_became_peered":"2024-05-15T15:39:51.444114+0000","last_unstale":"2024-05-15T15:39:53.462502+0000","last_undegraded":"2024-05-15T15:39:53.462502+0000","last_fullsized":"2024-05-15T15:39:53.462502+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:17:33.373439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.056759+0000","last_change":"2024-05-15T15:39:52.463132+0000","last_active":"2024-05-15T15:39:54.056759+0000","last_peered":"2024-05-15T15:39:54.056759+0000","last_clean":"2024-05-15T15:39:54.056759+0000","last_became_active":"2024-05-15T15:39:52.462785+0000","last_became_peered":"2024-05-15T15:39:52.462785+0000","last_unstale":"2024-05-15T15:39:54.056759+0000","last_undegraded":"2024-05-15T15:39:54.056759+0000","last_fullsized":"2024-05-15T15:39:54.056759+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:08:58.790860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.506255+0000","last_change":"2024-05-15T15:39:51.453203+0000","last_active":"2024-05-15T15:39:53.506255+0000","last_peered":"2024-05-15T15:39:53.506255+0000","last_clean":"2024-05-15T15:39:53.506255+0000","last_became_active":"2024-05-15T15:39:51.452835+0000","last_became_peered":"2024-05-15T15:39:51.452835+0000","last_unstale":"2024-05-15T15:39:53.506255+0000","last_undegraded":"2024-05-15T15:39:53.506255+0000","last_fullsized":"2024-05-15T15:39:53.506255+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:00:28.591473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057390+0000","last_change":"2024-05-15T15:39:52.467091+0000","last_active":"2024-05-15T15:39:54.057390+0000","last_peered":"2024-05-15T15:39:54.057390+0000","last_clean":"2024-05-15T15:39:54.057390+0000","last_became_active":"2024-05-15T15:39:52.465260+0000","last_became_peered":"2024-05-15T15:39:52.465260+0000","last_unstale":"2024-05-15T15:39:54.057390+0000","last_undegraded":"2024-05-15T15:39:54.057390+0000","last_fullsized":"2024-05-15T15:39:54.057390+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:46:06.269771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057238+0000","last_change":"2024-05-15T15:39:51.459005+0000","last_active":"2024-05-15T15:39:54.057238+0000","last_peered":"2024-05-15T15:39:54.057238+0000","last_clean":"2024-05-15T15:39:54.057238+0000","last_became_active":"2024-05-15T15:39:51.458484+0000","last_became_peered":"2024-05-15T15:39:51.458484+0000","last_unstale":"2024-05-15T15:39:54.057238+0000","last_undegraded":"2024-05-15T15:39:54.057238+0000","last_fullsized":"2024-05-15T15:39:54.057238+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:53:34.707481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.464984+0000","last_change":"2024-05-15T15:39:52.470997+0000","last_active":"2024-05-15T15:39:53.464984+0000","last_peered":"2024-05-15T15:39:53.464984+0000","last_clean":"2024-05-15T15:39:53.464984+0000","last_became_active":"2024-05-15T15:39:52.470669+0000","last_became_peered":"2024-05-15T15:39:52.470669+0000","last_unstale":"2024-05-15T15:39:53.464984+0000","last_undegraded":"2024-05-15T15:39:53.464984+0000","last_fullsized":"2024-05-15T15:39:53.464984+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:52:43.064362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.056727+0000","last_change":"2024-05-15T15:39:51.448163+0000","last_active":"2024-05-15T15:39:54.056727+0000","last_peered":"2024-05-15T15:39:54.056727+0000","last_clean":"2024-05-15T15:39:54.056727+0000","last_became_active":"2024-05-15T15:39:51.447878+0000","last_became_peered":"2024-05-15T15:39:51.447878+0000","last_unstale":"2024-05-15T15:39:54.056727+0000","last_undegraded":"2024-05-15T15:39:54.056727+0000","last_fullsized":"2024-05-15T15:39:54.056727+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:45:30.896866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.463183+0000","last_change":"2024-05-15T15:39:52.471719+0000","last_active":"2024-05-15T15:39:53.463183+0000","last_peered":"2024-05-15T15:39:53.463183+0000","last_clean":"2024-05-15T15:39:53.463183+0000","last_became_active":"2024-05-15T15:39:52.471352+0000","last_became_peered":"2024-05-15T15:39:52.471352+0000","last_unstale":"2024-05-15T15:39:53.463183+0000","last_undegraded":"2024-05-15T15:39:53.463183+0000","last_fullsized":"2024-05-15T15:39:53.463183+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:09:35.247678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"22'6","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.056826+0000","last_change":"2024-05-15T15:39:51.449551+0000","last_active":"2024-05-15T15:39:54.056826+0000","last_peered":"2024-05-15T15:39:54.056826+0000","last_clean":"2024-05-15T15:39:54.056826+0000","last_became_active":"2024-05-15T15:39:51.449185+0000","last_became_peered":"2024-05-15T15:39:51.449185+0000","last_unstale":"2024-05-15T15:39:54.056826+0000","last_undegraded":"2024-05-15T15:39:54.056826+0000","last_fullsized":"2024-05-15T15:39:54.056826+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:56:40.086761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057182+0000","last_change":"2024-05-15T15:39:52.477094+0000","last_active":"2024-05-15T15:39:54.057182+0000","last_peered":"2024-05-15T15:39:54.057182+0000","last_clean":"2024-05-15T15:39:54.057182+0000","last_became_active":"2024-05-15T15:39:52.476694+0000","last_became_peered":"2024-05-15T15:39:52.476694+0000","last_unstale":"2024-05-15T15:39:54.057182+0000","last_undegraded":"2024-05-15T15:39:54.057182+0000","last_fullsized":"2024-05-15T15:39:54.057182+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:48:53.088055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057190+0000","last_change":"2024-05-15T15:39:51.455537+0000","last_active":"2024-05-15T15:39:54.057190+0000","last_peered":"2024-05-15T15:39:54.057190+0000","last_clean":"2024-05-15T15:39:54.057190+0000","last_became_active":"2024-05-15T15:39:51.455169+0000","last_became_peered":"2024-05-15T15:39:51.455169+0000","last_unstale":"2024-05-15T15:39:54.057190+0000","last_undegraded":"2024-05-15T15:39:54.057190+0000","last_fullsized":"2024-05-15T15:39:54.057190+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:15:32.911265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.464093+0000","last_change":"2024-05-15T15:39:52.464580+0000","last_active":"2024-05-15T15:39:53.464093+0000","last_peered":"2024-05-15T15:39:53.464093+0000","last_clean":"2024-05-15T15:39:53.464093+0000","last_became_active":"2024-05-15T15:39:52.464252+0000","last_became_peered":"2024-05-15T15:39:52.464252+0000","last_unstale":"2024-05-15T15:39:53.464093+0000","last_undegraded":"2024-05-15T15:39:53.464093+0000","last_fullsized":"2024-05-15T15:39:53.464093+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:00:28.874513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.463192+0000","last_change":"2024-05-15T15:39:51.456191+0000","last_active":"2024-05-15T15:39:53.463192+0000","last_peered":"2024-05-15T15:39:53.463192+0000","last_clean":"2024-05-15T15:39:53.463192+0000","last_became_active":"2024-05-15T15:39:51.455844+0000","last_became_peered":"2024-05-15T15:39:51.455844+0000","last_unstale":"2024-05-15T15:39:53.463192+0000","last_undegraded":"2024-05-15T15:39:53.463192+0000","last_fullsized":"2024-05-15T15:39:53.463192+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:19:05.281175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.462897+0000","last_change":"2024-05-15T15:39:52.473375+0000","last_active":"2024-05-15T15:39:53.462897+0000","last_peered":"2024-05-15T15:39:53.462897+0000","last_clean":"2024-05-15T15:39:53.462897+0000","last_became_active":"2024-05-15T15:39:52.473046+0000","last_became_peered":"2024-05-15T15:39:52.473046+0000","last_unstale":"2024-05-15T15:39:53.462897+0000","last_undegraded":"2024-05-15T15:39:53.462897+0000","last_fullsized":"2024-05-15T15:39:53.462897+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:15:12.564736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.056485+0000","last_change":"2024-05-15T15:39:51.461928+0000","last_active":"2024-05-15T15:39:54.056485+0000","last_peered":"2024-05-15T15:39:54.056485+0000","last_clean":"2024-05-15T15:39:54.056485+0000","last_became_active":"2024-05-15T15:39:51.461604+0000","last_became_peered":"2024-05-15T15:39:51.461604+0000","last_unstale":"2024-05-15T15:39:54.056485+0000","last_undegraded":"2024-05-15T15:39:54.056485+0000","last_fullsized":"2024-05-15T15:39:54.056485+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:13:01.291506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.505919+0000","last_change":"2024-05-15T15:39:52.474668+0000","last_active":"2024-05-15T15:39:53.505919+0000","last_peered":"2024-05-15T15:39:53.505919+0000","last_clean":"2024-05-15T15:39:53.505919+0000","last_became_active":"2024-05-15T15:39:52.474222+0000","last_became_peered":"2024-05-15T15:39:52.474222+0000","last_unstale":"2024-05-15T15:39:53.505919+0000","last_undegraded":"2024-05-15T15:39:53.505919+0000","last_fullsized":"2024-05-15T15:39:53.505919+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:53:35.715007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.056855+0000","last_change":"2024-05-15T15:39:51.446711+0000","last_active":"2024-05-15T15:39:54.056855+0000","last_peered":"2024-05-15T15:39:54.056855+0000","last_clean":"2024-05-15T15:39:54.056855+0000","last_became_active":"2024-05-15T15:39:51.446392+0000","last_became_peered":"2024-05-15T15:39:51.446392+0000","last_unstale":"2024-05-15T15:39:54.056855+0000","last_undegraded":"2024-05-15T15:39:54.056855+0000","last_fullsized":"2024-05-15T15:39:54.056855+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:02:03.970482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.462447+0000","last_change":"2024-05-15T15:39:52.468710+0000","last_active":"2024-05-15T15:39:53.462447+0000","last_peered":"2024-05-15T15:39:53.462447+0000","last_clean":"2024-05-15T15:39:53.462447+0000","last_became_active":"2024-05-15T15:39:52.468364+0000","last_became_peered":"2024-05-15T15:39:52.468364+0000","last_unstale":"2024-05-15T15:39:53.462447+0000","last_undegraded":"2024-05-15T15:39:53.462447+0000","last_fullsized":"2024-05-15T15:39:53.462447+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:39:07.633570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057781+0000","last_change":"2024-05-15T15:39:51.454815+0000","last_active":"2024-05-15T15:39:54.057781+0000","last_peered":"2024-05-15T15:39:54.057781+0000","last_clean":"2024-05-15T15:39:54.057781+0000","last_became_active":"2024-05-15T15:39:51.454302+0000","last_became_peered":"2024-05-15T15:39:51.454302+0000","last_unstale":"2024-05-15T15:39:54.057781+0000","last_undegraded":"2024-05-15T15:39:54.057781+0000","last_fullsized":"2024-05-15T15:39:54.057781+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:52:26.020009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057590+0000","last_change":"2024-05-15T15:39:52.478397+0000","last_active":"2024-05-15T15:39:54.057590+0000","last_peered":"2024-05-15T15:39:54.057590+0000","last_clean":"2024-05-15T15:39:54.057590+0000","last_became_active":"2024-05-15T15:39:52.477855+0000","last_became_peered":"2024-05-15T15:39:52.477855+0000","last_unstale":"2024-05-15T15:39:54.057590+0000","last_undegraded":"2024-05-15T15:39:54.057590+0000","last_fullsized":"2024-05-15T15:39:54.057590+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:43:53.153262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057138+0000","last_change":"2024-05-15T15:39:51.451802+0000","last_active":"2024-05-15T15:39:54.057138+0000","last_peered":"2024-05-15T15:39:54.057138+0000","last_clean":"2024-05-15T15:39:54.057138+0000","last_became_active":"2024-05-15T15:39:51.451413+0000","last_became_peered":"2024-05-15T15:39:51.451413+0000","last_unstale":"2024-05-15T15:39:54.057138+0000","last_undegraded":"2024-05-15T15:39:54.057138+0000","last_fullsized":"2024-05-15T15:39:54.057138+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:13:11.699438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057652+0000","last_change":"2024-05-15T15:39:52.477925+0000","last_active":"2024-05-15T15:39:54.057652+0000","last_peered":"2024-05-15T15:39:54.057652+0000","last_clean":"2024-05-15T15:39:54.057652+0000","last_became_active":"2024-05-15T15:39:52.477255+0000","last_became_peered":"2024-05-15T15:39:52.477255+0000","last_unstale":"2024-05-15T15:39:54.057652+0000","last_undegraded":"2024-05-15T15:39:54.057652+0000","last_fullsized":"2024-05-15T15:39:54.057652+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:39:07.633570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.464272+0000","last_change":"2024-05-15T15:39:51.450383+0000","last_active":"2024-05-15T15:39:53.464272+0000","last_peered":"2024-05-15T15:39:53.464272+0000","last_clean":"2024-05-15T15:39:53.464272+0000","last_became_active":"2024-05-15T15:39:51.449318+0000","last_became_peered":"2024-05-15T15:39:51.449318+0000","last_unstale":"2024-05-15T15:39:53.464272+0000","last_undegraded":"2024-05-15T15:39:53.464272+0000","last_fullsized":"2024-05-15T15:39:53.464272+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:17:33.373439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057489+0000","last_change":"2024-05-15T15:39:52.471316+0000","last_active":"2024-05-15T15:39:54.057489+0000","last_peered":"2024-05-15T15:39:54.057489+0000","last_clean":"2024-05-15T15:39:54.057489+0000","last_became_active":"2024-05-15T15:39:52.471014+0000","last_became_peered":"2024-05-15T15:39:52.471014+0000","last_unstale":"2024-05-15T15:39:54.057489+0000","last_undegraded":"2024-05-15T15:39:54.057489+0000","last_fullsized":"2024-05-15T15:39:54.057489+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:52:43.064362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.463830+0000","last_change":"2024-05-15T15:39:51.454584+0000","last_active":"2024-05-15T15:39:53.463830+0000","last_peered":"2024-05-15T15:39:53.463830+0000","last_clean":"2024-05-15T15:39:53.463830+0000","last_became_active":"2024-05-15T15:39:51.454260+0000","last_became_peered":"2024-05-15T15:39:51.454260+0000","last_unstale":"2024-05-15T15:39:53.463830+0000","last_undegraded":"2024-05-15T15:39:53.463830+0000","last_fullsized":"2024-05-15T15:39:53.463830+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:17:48.368852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.462838+0000","last_change":"2024-05-15T15:39:52.464130+0000","last_active":"2024-05-15T15:39:53.462838+0000","last_peered":"2024-05-15T15:39:53.462838+0000","last_clean":"2024-05-15T15:39:53.462838+0000","last_became_active":"2024-05-15T15:39:52.463486+0000","last_became_peered":"2024-05-15T15:39:52.463486+0000","last_unstale":"2024-05-15T15:39:53.462838+0000","last_undegraded":"2024-05-15T15:39:53.462838+0000","last_fullsized":"2024-05-15T15:39:53.462838+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:58:23.539973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":110,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.505802+0000","last_change":"2024-05-15T15:39:42.584601+0000","last_active":"2024-05-15T15:39:53.505802+0000","last_peered":"2024-05-15T15:39:53.505802+0000","last_clean":"2024-05-15T15:39:53.505802+0000","last_became_active":"2024-05-15T15:39:42.584129+0000","last_became_peered":"2024-05-15T15:39:42.584129+0000","last_unstale":"2024-05-15T15:39:53.505802+0000","last_undegraded":"2024-05-15T15:39:53.505802+0000","last_fullsized":"2024-05-15T15:39:53.505802+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:41.378107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:41.378107+0000","last_clean_scrub_stamp":"2024-05-15T15:39:41.378107+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:23:25.285669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.462726+0000","last_change":"2024-05-15T15:39:51.451749+0000","last_active":"2024-05-15T15:39:53.462726+0000","last_peered":"2024-05-15T15:39:53.462726+0000","last_clean":"2024-05-15T15:39:53.462726+0000","last_became_active":"2024-05-15T15:39:51.451438+0000","last_became_peered":"2024-05-15T15:39:51.451438+0000","last_unstale":"2024-05-15T15:39:53.462726+0000","last_undegraded":"2024-05-15T15:39:53.462726+0000","last_fullsized":"2024-05-15T15:39:53.462726+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:46:05.262245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057001+0000","last_change":"2024-05-15T15:39:52.462888+0000","last_active":"2024-05-15T15:39:54.057001+0000","last_peered":"2024-05-15T15:39:54.057001+0000","last_clean":"2024-05-15T15:39:54.057001+0000","last_became_active":"2024-05-15T15:39:52.462435+0000","last_became_peered":"2024-05-15T15:39:52.462435+0000","last_unstale":"2024-05-15T15:39:54.057001+0000","last_undegraded":"2024-05-15T15:39:54.057001+0000","last_fullsized":"2024-05-15T15:39:54.057001+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:49:18.132410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.462612+0000","last_change":"2024-05-15T15:39:51.457051+0000","last_active":"2024-05-15T15:39:53.462612+0000","last_peered":"2024-05-15T15:39:53.462612+0000","last_clean":"2024-05-15T15:39:53.462612+0000","last_became_active":"2024-05-15T15:39:51.456748+0000","last_became_peered":"2024-05-15T15:39:51.456748+0000","last_unstale":"2024-05-15T15:39:53.462612+0000","last_undegraded":"2024-05-15T15:39:53.462612+0000","last_fullsized":"2024-05-15T15:39:53.462612+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:53:34.707481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.463666+0000","last_change":"2024-05-15T15:39:52.467728+0000","last_active":"2024-05-15T15:39:53.463666+0000","last_peered":"2024-05-15T15:39:53.463666+0000","last_clean":"2024-05-15T15:39:53.463666+0000","last_became_active":"2024-05-15T15:39:52.467352+0000","last_became_peered":"2024-05-15T15:39:52.467352+0000","last_unstale":"2024-05-15T15:39:53.463666+0000","last_undegraded":"2024-05-15T15:39:53.463666+0000","last_fullsized":"2024-05-15T15:39:53.463666+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:19:06.288701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.056496+0000","last_change":"2024-05-15T15:39:51.454058+0000","last_active":"2024-05-15T15:39:54.056496+0000","last_peered":"2024-05-15T15:39:54.056496+0000","last_clean":"2024-05-15T15:39:54.056496+0000","last_became_active":"2024-05-15T15:39:51.453765+0000","last_became_peered":"2024-05-15T15:39:51.453765+0000","last_unstale":"2024-05-15T15:39:54.056496+0000","last_undegraded":"2024-05-15T15:39:54.056496+0000","last_fullsized":"2024-05-15T15:39:54.056496+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:17:48.368852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.464095+0000","last_change":"2024-05-15T15:39:52.474812+0000","last_active":"2024-05-15T15:39:53.464095+0000","last_peered":"2024-05-15T15:39:53.464095+0000","last_clean":"2024-05-15T15:39:53.464095+0000","last_became_active":"2024-05-15T15:39:52.472883+0000","last_became_peered":"2024-05-15T15:39:52.472883+0000","last_unstale":"2024-05-15T15:39:53.464095+0000","last_undegraded":"2024-05-15T15:39:53.464095+0000","last_fullsized":"2024-05-15T15:39:53.464095+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:00:05.496148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.463124+0000","last_change":"2024-05-15T15:39:51.449647+0000","last_active":"2024-05-15T15:39:53.463124+0000","last_peered":"2024-05-15T15:39:53.463124+0000","last_clean":"2024-05-15T15:39:53.463124+0000","last_became_active":"2024-05-15T15:39:51.449332+0000","last_became_peered":"2024-05-15T15:39:51.449332+0000","last_unstale":"2024-05-15T15:39:53.463124+0000","last_undegraded":"2024-05-15T15:39:53.463124+0000","last_fullsized":"2024-05-15T15:39:53.463124+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:43:52.145736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.056740+0000","last_change":"2024-05-15T15:39:52.479896+0000","last_active":"2024-05-15T15:39:54.056740+0000","last_peered":"2024-05-15T15:39:54.056740+0000","last_clean":"2024-05-15T15:39:54.056740+0000","last_became_active":"2024-05-15T15:39:52.479462+0000","last_became_peered":"2024-05-15T15:39:52.479462+0000","last_unstale":"2024-05-15T15:39:54.056740+0000","last_undegraded":"2024-05-15T15:39:54.056740+0000","last_fullsized":"2024-05-15T15:39:54.056740+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:00:05.496148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.463525+0000","last_change":"2024-05-15T15:39:51.450193+0000","last_active":"2024-05-15T15:39:53.463525+0000","last_peered":"2024-05-15T15:39:53.463525+0000","last_clean":"2024-05-15T15:39:53.463525+0000","last_became_active":"2024-05-15T15:39:51.449868+0000","last_became_peered":"2024-05-15T15:39:51.449868+0000","last_unstale":"2024-05-15T15:39:53.463525+0000","last_undegraded":"2024-05-15T15:39:53.463525+0000","last_fullsized":"2024-05-15T15:39:53.463525+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:13:01.291506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057411+0000","last_change":"2024-05-15T15:39:52.466700+0000","last_active":"2024-05-15T15:39:54.057411+0000","last_peered":"2024-05-15T15:39:54.057411+0000","last_clean":"2024-05-15T15:39:54.057411+0000","last_became_active":"2024-05-15T15:39:52.464696+0000","last_became_peered":"2024-05-15T15:39:52.464696+0000","last_unstale":"2024-05-15T15:39:54.057411+0000","last_undegraded":"2024-05-15T15:39:54.057411+0000","last_fullsized":"2024-05-15T15:39:54.057411+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:14:40.347641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.463133+0000","last_change":"2024-05-15T15:39:51.449690+0000","last_active":"2024-05-15T15:39:53.463133+0000","last_peered":"2024-05-15T15:39:53.463133+0000","last_clean":"2024-05-15T15:39:53.463133+0000","last_became_active":"2024-05-15T15:39:51.448404+0000","last_became_peered":"2024-05-15T15:39:51.448404+0000","last_unstale":"2024-05-15T15:39:53.463133+0000","last_undegraded":"2024-05-15T15:39:53.463133+0000","last_fullsized":"2024-05-15T15:39:53.463133+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:56:23.235022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.463699+0000","last_change":"2024-05-15T15:39:52.475321+0000","last_active":"2024-05-15T15:39:53.463699+0000","last_peered":"2024-05-15T15:39:53.463699+0000","last_clean":"2024-05-15T15:39:53.463699+0000","last_became_active":"2024-05-15T15:39:52.475018+0000","last_became_peered":"2024-05-15T15:39:52.475018+0000","last_unstale":"2024-05-15T15:39:53.463699+0000","last_undegraded":"2024-05-15T15:39:53.463699+0000","last_fullsized":"2024-05-15T15:39:53.463699+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:43:53.153262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057301+0000","last_change":"2024-05-15T15:39:51.455435+0000","last_active":"2024-05-15T15:39:54.057301+0000","last_peered":"2024-05-15T15:39:54.057301+0000","last_clean":"2024-05-15T15:39:54.057301+0000","last_became_active":"2024-05-15T15:39:51.455047+0000","last_became_peered":"2024-05-15T15:39:51.455047+0000","last_unstale":"2024-05-15T15:39:54.057301+0000","last_undegraded":"2024-05-15T15:39:54.057301+0000","last_fullsized":"2024-05-15T15:39:54.057301+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:49:40.863334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057303+0000","last_change":"2024-05-15T15:39:52.459873+0000","last_active":"2024-05-15T15:39:54.057303+0000","last_peered":"2024-05-15T15:39:54.057303+0000","last_clean":"2024-05-15T15:39:54.057303+0000","last_became_active":"2024-05-15T15:39:52.459582+0000","last_became_peered":"2024-05-15T15:39:52.459582+0000","last_unstale":"2024-05-15T15:39:54.057303+0000","last_undegraded":"2024-05-15T15:39:54.057303+0000","last_fullsized":"2024-05-15T15:39:54.057303+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:54:18.294364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.463011+0000","last_change":"2024-05-15T15:39:51.456218+0000","last_active":"2024-05-15T15:39:53.463011+0000","last_peered":"2024-05-15T15:39:53.463011+0000","last_clean":"2024-05-15T15:39:53.463011+0000","last_became_active":"2024-05-15T15:39:51.455592+0000","last_became_peered":"2024-05-15T15:39:51.455592+0000","last_unstale":"2024-05-15T15:39:53.463011+0000","last_undegraded":"2024-05-15T15:39:53.463011+0000","last_fullsized":"2024-05-15T15:39:53.463011+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:14:39.340114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057249+0000","last_change":"2024-05-15T15:39:52.464074+0000","last_active":"2024-05-15T15:39:54.057249+0000","last_peered":"2024-05-15T15:39:54.057249+0000","last_clean":"2024-05-15T15:39:54.057249+0000","last_became_active":"2024-05-15T15:39:52.463738+0000","last_became_peered":"2024-05-15T15:39:52.463738+0000","last_unstale":"2024-05-15T15:39:54.057249+0000","last_undegraded":"2024-05-15T15:39:54.057249+0000","last_fullsized":"2024-05-15T15:39:54.057249+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:29:47.569993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.056270+0000","last_change":"2024-05-15T15:39:51.456266+0000","last_active":"2024-05-15T15:39:54.056270+0000","last_peered":"2024-05-15T15:39:54.056270+0000","last_clean":"2024-05-15T15:39:54.056270+0000","last_became_active":"2024-05-15T15:39:51.455914+0000","last_became_peered":"2024-05-15T15:39:51.455914+0000","last_unstale":"2024-05-15T15:39:54.056270+0000","last_undegraded":"2024-05-15T15:39:54.056270+0000","last_fullsized":"2024-05-15T15:39:54.056270+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:18:35.801621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.463115+0000","last_change":"2024-05-15T15:39:52.462843+0000","last_active":"2024-05-15T15:39:53.463115+0000","last_peered":"2024-05-15T15:39:53.463115+0000","last_clean":"2024-05-15T15:39:53.463115+0000","last_became_active":"2024-05-15T15:39:52.459592+0000","last_became_peered":"2024-05-15T15:39:52.459592+0000","last_unstale":"2024-05-15T15:39:53.463115+0000","last_undegraded":"2024-05-15T15:39:53.463115+0000","last_fullsized":"2024-05-15T15:39:53.463115+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:19:16.899508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.056705+0000","last_change":"2024-05-15T15:39:51.456133+0000","last_active":"2024-05-15T15:39:54.056705+0000","last_peered":"2024-05-15T15:39:54.056705+0000","last_clean":"2024-05-15T15:39:54.056705+0000","last_became_active":"2024-05-15T15:39:51.455602+0000","last_became_peered":"2024-05-15T15:39:51.455602+0000","last_unstale":"2024-05-15T15:39:54.056705+0000","last_undegraded":"2024-05-15T15:39:54.056705+0000","last_fullsized":"2024-05-15T15:39:54.056705+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:17:38.370348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.056952+0000","last_change":"2024-05-15T15:39:52.462939+0000","last_active":"2024-05-15T15:39:54.056952+0000","last_peered":"2024-05-15T15:39:54.056952+0000","last_clean":"2024-05-15T15:39:54.056952+0000","last_became_active":"2024-05-15T15:39:52.462611+0000","last_became_peered":"2024-05-15T15:39:52.462611+0000","last_unstale":"2024-05-15T15:39:54.056952+0000","last_undegraded":"2024-05-15T15:39:54.056952+0000","last_fullsized":"2024-05-15T15:39:54.056952+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:03:58.144604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.464110+0000","last_change":"2024-05-15T15:39:51.453591+0000","last_active":"2024-05-15T15:39:53.464110+0000","last_peered":"2024-05-15T15:39:53.464110+0000","last_clean":"2024-05-15T15:39:53.464110+0000","last_became_active":"2024-05-15T15:39:51.453250+0000","last_became_peered":"2024-05-15T15:39:51.453250+0000","last_unstale":"2024-05-15T15:39:53.464110+0000","last_undegraded":"2024-05-15T15:39:53.464110+0000","last_fullsized":"2024-05-15T15:39:53.464110+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:15:32.911265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057214+0000","last_change":"2024-05-15T15:39:52.469345+0000","last_active":"2024-05-15T15:39:54.057214+0000","last_peered":"2024-05-15T15:39:54.057214+0000","last_clean":"2024-05-15T15:39:54.057214+0000","last_became_active":"2024-05-15T15:39:52.469041+0000","last_became_peered":"2024-05-15T15:39:52.469041+0000","last_unstale":"2024-05-15T15:39:54.057214+0000","last_undegraded":"2024-05-15T15:39:54.057214+0000","last_fullsized":"2024-05-15T15:39:54.057214+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:52:27.027535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.462608+0000","last_change":"2024-05-15T15:39:51.450991+0000","last_active":"2024-05-15T15:39:53.462608+0000","last_peered":"2024-05-15T15:39:53.462608+0000","last_clean":"2024-05-15T15:39:53.462608+0000","last_became_active":"2024-05-15T15:39:51.450600+0000","last_became_peered":"2024-05-15T15:39:51.450600+0000","last_unstale":"2024-05-15T15:39:53.462608+0000","last_undegraded":"2024-05-15T15:39:53.462608+0000","last_fullsized":"2024-05-15T15:39:53.462608+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:49:26.650770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.462903+0000","last_change":"2024-05-15T15:39:52.462106+0000","last_active":"2024-05-15T15:39:53.462903+0000","last_peered":"2024-05-15T15:39:53.462903+0000","last_clean":"2024-05-15T15:39:53.462903+0000","last_became_active":"2024-05-15T15:39:52.461217+0000","last_became_peered":"2024-05-15T15:39:52.461217+0000","last_unstale":"2024-05-15T15:39:53.462903+0000","last_undegraded":"2024-05-15T15:39:53.462903+0000","last_fullsized":"2024-05-15T15:39:53.462903+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:41:33.947325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.462652+0000","last_change":"2024-05-15T15:39:52.473917+0000","last_active":"2024-05-15T15:39:53.462652+0000","last_peered":"2024-05-15T15:39:53.462652+0000","last_clean":"2024-05-15T15:39:53.462652+0000","last_became_active":"2024-05-15T15:39:52.472408+0000","last_became_peered":"2024-05-15T15:39:52.472408+0000","last_unstale":"2024-05-15T15:39:53.462652+0000","last_undegraded":"2024-05-15T15:39:53.462652+0000","last_fullsized":"2024-05-15T15:39:53.462652+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:39:30.074726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057634+0000","last_change":"2024-05-15T15:39:51.458878+0000","last_active":"2024-05-15T15:39:54.057634+0000","last_peered":"2024-05-15T15:39:54.057634+0000","last_clean":"2024-05-15T15:39:54.057634+0000","last_became_active":"2024-05-15T15:39:51.458527+0000","last_became_peered":"2024-05-15T15:39:51.458527+0000","last_unstale":"2024-05-15T15:39:54.057634+0000","last_undegraded":"2024-05-15T15:39:54.057634+0000","last_fullsized":"2024-05-15T15:39:54.057634+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:14:39.340114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.506342+0000","last_change":"2024-05-15T15:39:52.479684+0000","last_active":"2024-05-15T15:39:53.506342+0000","last_peered":"2024-05-15T15:39:53.506342+0000","last_clean":"2024-05-15T15:39:53.506342+0000","last_became_active":"2024-05-15T15:39:52.479359+0000","last_became_peered":"2024-05-15T15:39:52.479359+0000","last_unstale":"2024-05-15T15:39:53.506342+0000","last_undegraded":"2024-05-15T15:39:53.506342+0000","last_fullsized":"2024-05-15T15:39:53.506342+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:14:40.347641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057324+0000","last_change":"2024-05-15T15:39:51.459312+0000","last_active":"2024-05-15T15:39:54.057324+0000","last_peered":"2024-05-15T15:39:54.057324+0000","last_clean":"2024-05-15T15:39:54.057324+0000","last_became_active":"2024-05-15T15:39:51.458739+0000","last_became_peered":"2024-05-15T15:39:51.458739+0000","last_unstale":"2024-05-15T15:39:54.057324+0000","last_undegraded":"2024-05-15T15:39:54.057324+0000","last_fullsized":"2024-05-15T15:39:54.057324+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:17:33.373439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.464791+0000","last_change":"2024-05-15T15:39:52.472300+0000","last_active":"2024-05-15T15:39:53.464791+0000","last_peered":"2024-05-15T15:39:53.464791+0000","last_clean":"2024-05-15T15:39:53.464791+0000","last_became_active":"2024-05-15T15:39:52.472005+0000","last_became_peered":"2024-05-15T15:39:52.472005+0000","last_unstale":"2024-05-15T15:39:53.464791+0000","last_undegraded":"2024-05-15T15:39:53.464791+0000","last_fullsized":"2024-05-15T15:39:53.464791+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:18:51.904529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.465122+0000","last_change":"2024-05-15T15:39:51.451702+0000","last_active":"2024-05-15T15:39:53.465122+0000","last_peered":"2024-05-15T15:39:53.465122+0000","last_clean":"2024-05-15T15:39:53.465122+0000","last_became_active":"2024-05-15T15:39:51.451387+0000","last_became_peered":"2024-05-15T15:39:51.451387+0000","last_unstale":"2024-05-15T15:39:53.465122+0000","last_undegraded":"2024-05-15T15:39:53.465122+0000","last_fullsized":"2024-05-15T15:39:53.465122+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:23:00.828647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.465209+0000","last_change":"2024-05-15T15:39:52.473199+0000","last_active":"2024-05-15T15:39:53.465209+0000","last_peered":"2024-05-15T15:39:53.465209+0000","last_clean":"2024-05-15T15:39:53.465209+0000","last_became_active":"2024-05-15T15:39:52.472848+0000","last_became_peered":"2024-05-15T15:39:52.472848+0000","last_unstale":"2024-05-15T15:39:53.465209+0000","last_undegraded":"2024-05-15T15:39:53.465209+0000","last_fullsized":"2024-05-15T15:39:53.465209+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:39:30.074726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"22'4","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057222+0000","last_change":"2024-05-15T15:39:51.445161+0000","last_active":"2024-05-15T15:39:54.057222+0000","last_peered":"2024-05-15T15:39:54.057222+0000","last_clean":"2024-05-15T15:39:54.057222+0000","last_became_active":"2024-05-15T15:39:51.444855+0000","last_became_peered":"2024-05-15T15:39:51.444855+0000","last_unstale":"2024-05-15T15:39:54.057222+0000","last_undegraded":"2024-05-15T15:39:54.057222+0000","last_fullsized":"2024-05-15T15:39:54.057222+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:36:50.322584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509448,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":241664,"data_stored":81359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509448,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":233472,"data_stored":81235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509449,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27836,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":835584,"data_stored":671695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509448,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":237568,"data_stored":81817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509448,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":245760,"data_stored":82847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509449,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":831488,"data_stored":671673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509448,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":241664,"data_stored":81291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":253952,"data_stored":83519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-15T15:40:07.492 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-15T15:40:07.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.637+0000 7f0954b5f640 1 Processor -- start 2024-05-15T15:40:07.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.637+0000 7f0954b5f640 1 -- start start 2024-05-15T15:40:07.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.638+0000 7f0954b5f640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0950148770 0x7f09500c0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:07.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.638+0000 7f0954b5f640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09500c0620 con 0x7f09500bf9b0 2024-05-15T15:40:07.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.638+0000 7f0954b5f640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0950151ad0 con 0x7f095014e360 2024-05-15T15:40:07.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.638+0000 7f0954b5f640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f0950151e40 con 0x7f0950148770 2024-05-15T15:40:07.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.638+0000 7f094ed9d640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f09500bf9b0 0x7f09500bfdc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:43790/0 (socket says 172.21.15.12:43790) 2024-05-15T15:40:07.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.638+0000 7f094ed9d640 1 -- 172.21.15.12:0/2841871331 learned_addr learned my addr 172.21.15.12:0/2841871331 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-05-15T15:40:07.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.639+0000 7f094dd9b640 1 --2- 172.21.15.12:0/2841871331 >> v2:172.21.15.84:3300/0 conn(0x7f0950148770 0x7f09500c0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:07.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.639+0000 7f094d59a640 1 -- 172.21.15.12:0/2841871331 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 259771434 0 0) 0x7f09500c0620 con 0x7f09500bf9b0 2024-05-15T15:40:07.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.639+0000 7f094d59a640 1 -- 172.21.15.12:0/2841871331 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0938003520 con 0x7f09500bf9b0 2024-05-15T15:40:07.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.639+0000 7f094dd9b640 1 -- 172.21.15.12:0/2841871331 >> v1:172.21.15.84:6789/0 conn(0x7f095014e360 legacy=0x7f09501522d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:07.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.639+0000 7f094dd9b640 1 -- 172.21.15.12:0/2841871331 >> v1:172.21.15.12:6789/0 conn(0x7f09500bf9b0 legacy=0x7f09500bfdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:07.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.639+0000 7f094dd9b640 1 -- 172.21.15.12:0/2841871331 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09500c11c0 con 0x7f0950148770 2024-05-15T15:40:07.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.640+0000 7f094dd9b640 1 --2- 172.21.15.12:0/2841871331 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0950148770 0x7f09500c0c80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f09440097d0 tx=0x7f094402a300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=922a923589220570 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:07.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.640+0000 7f094d59a640 1 -- 172.21.15.12:0/2841871331 <== mon.1 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0944037070 con 0x7f0950148770 2024-05-15T15:40:07.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.640+0000 7f094d59a640 1 -- 172.21.15.12:0/2841871331 <== mon.1 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0944032640 con 0x7f0950148770 2024-05-15T15:40:07.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.640+0000 7f094d59a640 1 -- 172.21.15.12:0/2841871331 <== mon.1 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09440329f0 con 0x7f0950148770 2024-05-15T15:40:07.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.640+0000 7f0954b5f640 1 -- 172.21.15.12:0/2841871331 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0950148770 msgr2=0x7f09500c0c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:07.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.640+0000 7f0954b5f640 1 --2- 172.21.15.12:0/2841871331 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0950148770 0x7f09500c0c80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f09440097d0 tx=0x7f094402a300 comp rx=0 tx=0).stop 2024-05-15T15:40:07.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.641+0000 7f0954b5f640 1 -- 172.21.15.12:0/2841871331 shutdown_connections 2024-05-15T15:40:07.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.641+0000 7f0954b5f640 1 --2- 172.21.15.12:0/2841871331 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0950148770 0x7f09500c0c80 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:07.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.641+0000 7f0954b5f640 1 -- 172.21.15.12:0/2841871331 >> 172.21.15.12:0/2841871331 conn(0x7f09500c17c0 msgr2=0x7f09500c1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:07.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.641+0000 7f0954b5f640 1 -- 172.21.15.12:0/2841871331 shutdown_connections 2024-05-15T15:40:07.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.641+0000 7f0954b5f640 1 -- 172.21.15.12:0/2841871331 wait complete. 2024-05-15T15:40:07.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.642+0000 7f0954b5f640 1 Processor -- start 2024-05-15T15:40:07.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.642+0000 7f0954b5f640 1 -- start start 2024-05-15T15:40:07.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.643+0000 7f0954b5f640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f09500bf9b0 0x7f09500712b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:07.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.643+0000 7f0954b5f640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f0950148770 0x7f09500b8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:07.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.643+0000 7f0954b5f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f095014e360 0x7f0950139cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:07.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.643+0000 7f0954b5f640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f095015a060 con 0x7f095014e360 2024-05-15T15:40:07.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.643+0000 7f0954b5f640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f0950159ee0 con 0x7f09500bf9b0 2024-05-15T15:40:07.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.643+0000 7f0954b5f640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f095015a1e0 con 0x7f0950148770 2024-05-15T15:40:07.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.643+0000 7f094ed9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f095014e360 0x7f0950139cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:07.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.644+0000 7f094ed9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f095014e360 0x7f0950139cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52588/0 (socket says 172.21.15.12:52588) 2024-05-15T15:40:07.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.644+0000 7f094ed9d640 1 -- 172.21.15.12:0/2450342626 learned_addr learned my addr 172.21.15.12:0/2450342626 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:07.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.644+0000 7f094dd9b640 1 --2- 172.21.15.12:0/2450342626 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f0950148770 0x7f09500b8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:07.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.644+0000 7f094e59c640 1 --2- 172.21.15.12:0/2450342626 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f09500bf9b0 0x7f09500712b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:07.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.644+0000 7f094ed9d640 1 -- 172.21.15.12:0/2450342626 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f0950148770 msgr2=0x7f09500b8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:07.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.644+0000 7f094ed9d640 1 --2- 172.21.15.12:0/2450342626 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f0950148770 0x7f09500b8190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:07.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.644+0000 7f094ed9d640 1 -- 172.21.15.12:0/2450342626 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f09500bf9b0 msgr2=0x7f09500712b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:07.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.644+0000 7f094ed9d640 1 --2- 172.21.15.12:0/2450342626 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f09500bf9b0 0x7f09500712b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:07.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.644+0000 7f094ed9d640 1 -- 172.21.15.12:0/2450342626 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09500717f0 con 0x7f095014e360 2024-05-15T15:40:07.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.644+0000 7f094ed9d640 1 --2- 172.21.15.12:0/2450342626 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f095014e360 0x7f0950139cb0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f094800ca70 tx=0x7f094800cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:07.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.644+0000 7f093effd640 1 -- 172.21.15.12:0/2450342626 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f094800abd0 con 0x7f095014e360 2024-05-15T15:40:07.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.644+0000 7f093effd640 1 -- 172.21.15.12:0/2450342626 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f094800ad70 con 0x7f095014e360 2024-05-15T15:40:07.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.644+0000 7f0954b5f640 1 -- 172.21.15.12:0/2450342626 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0950071d80 con 0x7f095014e360 2024-05-15T15:40:07.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.644+0000 7f093effd640 1 -- 172.21.15.12:0/2450342626 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0948012620 con 0x7f095014e360 2024-05-15T15:40:07.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.644+0000 7f0954b5f640 1 -- 172.21.15.12:0/2450342626 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0950072460 con 0x7f095014e360 2024-05-15T15:40:07.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.645+0000 7f0954b5f640 1 -- 172.21.15.12:0/2450342626 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09500c1bd0 con 0x7f095014e360 2024-05-15T15:40:07.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.646+0000 7f093effd640 1 -- 172.21.15.12:0/2450342626 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f09480127c0 con 0x7f095014e360 2024-05-15T15:40:07.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.647+0000 7f093effd640 1 --2- 172.21.15.12:0/2450342626 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f09300762d0 0x7f09300787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:07.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.647+0000 7f093effd640 1 -- 172.21.15.12:0/2450342626 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f0948097ab0 con 0x7f095014e360 2024-05-15T15:40:07.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.647+0000 7f094e59c640 1 --2- 172.21.15.12:0/2450342626 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f09300762d0 0x7f09300787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:07.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.647+0000 7f094e59c640 1 --2- 172.21.15.12:0/2450342626 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f09300762d0 0x7f09300787e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0940000f60 tx=0x7f0940009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:07.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.651+0000 7f093effd640 1 -- 172.21.15.12:0/2450342626 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f09500c1bd0 con 0x7f095014e360 2024-05-15T15:40:07.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.837+0000 7f0954b5f640 1 -- 172.21.15.12:0/2450342626 --> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0950071fb0 con 0x7f09300762d0 2024-05-15T15:40:07.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.844+0000 7f093effd640 1 -- 172.21.15.12:0/2450342626 <== mgr.4106 v2:172.21.15.84:6832/4173299311 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251822 (secure 0 0 0) 0x7f0950071fb0 con 0x7f09300762d0 2024-05-15T15:40:07.848 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-05-15T15:40:07.850 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-05-15T15:40:07.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.847+0000 7f0954b5f640 1 -- 172.21.15.12:0/2450342626 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f09300762d0 msgr2=0x7f09300787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:07.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.847+0000 7f0954b5f640 1 --2- 172.21.15.12:0/2450342626 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f09300762d0 0x7f09300787e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0940000f60 tx=0x7f0940009040 comp rx=0 tx=0).stop 2024-05-15T15:40:07.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.847+0000 7f0954b5f640 1 -- 172.21.15.12:0/2450342626 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f095014e360 msgr2=0x7f0950139cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:07.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.847+0000 7f0954b5f640 1 --2- 172.21.15.12:0/2450342626 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f095014e360 0x7f0950139cb0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f094800ca70 tx=0x7f094800cf30 comp rx=0 tx=0).stop 2024-05-15T15:40:07.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.847+0000 7f0954b5f640 1 -- 172.21.15.12:0/2450342626 shutdown_connections 2024-05-15T15:40:07.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.847+0000 7f0954b5f640 1 --2- 172.21.15.12:0/2450342626 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f09300762d0 0x7f09300787e0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:07.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.847+0000 7f0954b5f640 1 --2- 172.21.15.12:0/2450342626 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f095014e360 0x7f0950139cb0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:07.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.847+0000 7f0954b5f640 1 --2- 172.21.15.12:0/2450342626 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f0950148770 0x7f09500b8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:07.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.847+0000 7f0954b5f640 1 --2- 172.21.15.12:0/2450342626 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f09500bf9b0 0x7f09500712b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:07.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.847+0000 7f0954b5f640 1 -- 172.21.15.12:0/2450342626 >> 172.21.15.12:0/2450342626 conn(0x7f09500c17c0 msgr2=0x7f09500be660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:07.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.847+0000 7f0954b5f640 1 -- 172.21.15.12:0/2450342626 shutdown_connections 2024-05-15T15:40:07.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:07.847+0000 7f0954b5f640 1 -- 172.21.15.12:0/2450342626 wait complete. 2024-05-15T15:40:07.861 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":31,"stamp":"2024-05-15T15:40:06.704082+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219212,"kb_used_data":3048,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755508,"statfs":{"total":773094113280,"available":772869640192,"internally_reserved":0,"allocated":3121152,"data_stored":1835436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003502"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057108+0000","last_change":"2024-05-15T15:39:52.474245+0000","last_active":"2024-05-15T15:39:54.057108+0000","last_peered":"2024-05-15T15:39:54.057108+0000","last_clean":"2024-05-15T15:39:54.057108+0000","last_became_active":"2024-05-15T15:39:52.473919+0000","last_became_peered":"2024-05-15T15:39:52.473919+0000","last_unstale":"2024-05-15T15:39:54.057108+0000","last_undegraded":"2024-05-15T15:39:54.057108+0000","last_fullsized":"2024-05-15T15:39:54.057108+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:35:07.996967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.464974+0000","last_change":"2024-05-15T15:39:52.472587+0000","last_active":"2024-05-15T15:39:53.464974+0000","last_peered":"2024-05-15T15:39:53.464974+0000","last_clean":"2024-05-15T15:39:53.464974+0000","last_became_active":"2024-05-15T15:39:52.472268+0000","last_became_peered":"2024-05-15T15:39:52.472268+0000","last_unstale":"2024-05-15T15:39:53.464974+0000","last_undegraded":"2024-05-15T15:39:53.464974+0000","last_fullsized":"2024-05-15T15:39:53.464974+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:39:07.633570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.464154+0000","last_change":"2024-05-15T15:39:52.474404+0000","last_active":"2024-05-15T15:39:53.464154+0000","last_peered":"2024-05-15T15:39:53.464154+0000","last_clean":"2024-05-15T15:39:53.464154+0000","last_became_active":"2024-05-15T15:39:52.474102+0000","last_became_peered":"2024-05-15T15:39:52.474102+0000","last_unstale":"2024-05-15T15:39:53.464154+0000","last_undegraded":"2024-05-15T15:39:53.464154+0000","last_fullsized":"2024-05-15T15:39:53.464154+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:13:19.570085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.056856+0000","last_change":"2024-05-15T15:39:52.462504+0000","last_active":"2024-05-15T15:39:54.056856+0000","last_peered":"2024-05-15T15:39:54.056856+0000","last_clean":"2024-05-15T15:39:54.056856+0000","last_became_active":"2024-05-15T15:39:52.462135+0000","last_became_peered":"2024-05-15T15:39:52.462135+0000","last_unstale":"2024-05-15T15:39:54.056856+0000","last_undegraded":"2024-05-15T15:39:54.056856+0000","last_fullsized":"2024-05-15T15:39:54.056856+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:53:35.715007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057365+0000","last_change":"2024-05-15T15:39:52.477733+0000","last_active":"2024-05-15T15:39:54.057365+0000","last_peered":"2024-05-15T15:39:54.057365+0000","last_clean":"2024-05-15T15:39:54.057365+0000","last_became_active":"2024-05-15T15:39:52.474778+0000","last_became_peered":"2024-05-15T15:39:52.474778+0000","last_unstale":"2024-05-15T15:39:54.057365+0000","last_undegraded":"2024-05-15T15:39:54.057365+0000","last_fullsized":"2024-05-15T15:39:54.057365+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:18:51.904529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057477+0000","last_change":"2024-05-15T15:39:52.458241+0000","last_active":"2024-05-15T15:39:54.057477+0000","last_peered":"2024-05-15T15:39:54.057477+0000","last_clean":"2024-05-15T15:39:54.057477+0000","last_became_active":"2024-05-15T15:39:52.457883+0000","last_became_peered":"2024-05-15T15:39:52.457883+0000","last_unstale":"2024-05-15T15:39:54.057477+0000","last_undegraded":"2024-05-15T15:39:54.057477+0000","last_fullsized":"2024-05-15T15:39:54.057477+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:19:06.288701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.056535+0000","last_change":"2024-05-15T15:39:52.474619+0000","last_active":"2024-05-15T15:39:54.056535+0000","last_peered":"2024-05-15T15:39:54.056535+0000","last_clean":"2024-05-15T15:39:54.056535+0000","last_became_active":"2024-05-15T15:39:52.474314+0000","last_became_peered":"2024-05-15T15:39:52.474314+0000","last_unstale":"2024-05-15T15:39:54.056535+0000","last_undegraded":"2024-05-15T15:39:54.056535+0000","last_fullsized":"2024-05-15T15:39:54.056535+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:07:46.287281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.463913+0000","last_change":"2024-05-15T15:39:52.468997+0000","last_active":"2024-05-15T15:39:53.463913+0000","last_peered":"2024-05-15T15:39:53.463913+0000","last_clean":"2024-05-15T15:39:53.463913+0000","last_became_active":"2024-05-15T15:39:52.468155+0000","last_became_peered":"2024-05-15T15:39:52.468155+0000","last_unstale":"2024-05-15T15:39:53.463913+0000","last_undegraded":"2024-05-15T15:39:53.463913+0000","last_fullsized":"2024-05-15T15:39:53.463913+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:07:46.287281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.506277+0000","last_change":"2024-05-15T15:39:52.468077+0000","last_active":"2024-05-15T15:39:53.506277+0000","last_peered":"2024-05-15T15:39:53.506277+0000","last_clean":"2024-05-15T15:39:53.506277+0000","last_became_active":"2024-05-15T15:39:52.467754+0000","last_became_peered":"2024-05-15T15:39:52.467754+0000","last_unstale":"2024-05-15T15:39:53.506277+0000","last_undegraded":"2024-05-15T15:39:53.506277+0000","last_fullsized":"2024-05-15T15:39:53.506277+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:46:06.269771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057388+0000","last_change":"2024-05-15T15:39:52.480897+0000","last_active":"2024-05-15T15:39:54.057388+0000","last_peered":"2024-05-15T15:39:54.057388+0000","last_clean":"2024-05-15T15:39:54.057388+0000","last_became_active":"2024-05-15T15:39:52.479910+0000","last_became_peered":"2024-05-15T15:39:52.479910+0000","last_unstale":"2024-05-15T15:39:54.057388+0000","last_undegraded":"2024-05-15T15:39:54.057388+0000","last_fullsized":"2024-05-15T15:39:54.057388+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:13:19.570085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057782+0000","last_change":"2024-05-15T15:39:52.473167+0000","last_active":"2024-05-15T15:39:54.057782+0000","last_peered":"2024-05-15T15:39:54.057782+0000","last_clean":"2024-05-15T15:39:54.057782+0000","last_became_active":"2024-05-15T15:39:52.472835+0000","last_became_peered":"2024-05-15T15:39:52.472835+0000","last_unstale":"2024-05-15T15:39:54.057782+0000","last_undegraded":"2024-05-15T15:39:54.057782+0000","last_fullsized":"2024-05-15T15:39:54.057782+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:39:30.074726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057803+0000","last_change":"2024-05-15T15:39:52.467676+0000","last_active":"2024-05-15T15:39:54.057803+0000","last_peered":"2024-05-15T15:39:54.057803+0000","last_clean":"2024-05-15T15:39:54.057803+0000","last_became_active":"2024-05-15T15:39:52.467064+0000","last_became_peered":"2024-05-15T15:39:52.467064+0000","last_unstale":"2024-05-15T15:39:54.057803+0000","last_undegraded":"2024-05-15T15:39:54.057803+0000","last_fullsized":"2024-05-15T15:39:54.057803+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:58:23.539973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.463567+0000","last_change":"2024-05-15T15:39:52.472464+0000","last_active":"2024-05-15T15:39:53.463567+0000","last_peered":"2024-05-15T15:39:53.463567+0000","last_clean":"2024-05-15T15:39:53.463567+0000","last_became_active":"2024-05-15T15:39:52.472129+0000","last_became_peered":"2024-05-15T15:39:52.472129+0000","last_unstale":"2024-05-15T15:39:53.463567+0000","last_undegraded":"2024-05-15T15:39:53.463567+0000","last_fullsized":"2024-05-15T15:39:53.463567+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:14:40.347641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.463905+0000","last_change":"2024-05-15T15:39:52.465747+0000","last_active":"2024-05-15T15:39:53.463905+0000","last_peered":"2024-05-15T15:39:53.463905+0000","last_clean":"2024-05-15T15:39:53.463905+0000","last_became_active":"2024-05-15T15:39:52.465239+0000","last_became_peered":"2024-05-15T15:39:52.465239+0000","last_unstale":"2024-05-15T15:39:53.463905+0000","last_undegraded":"2024-05-15T15:39:53.463905+0000","last_fullsized":"2024-05-15T15:39:53.463905+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:56:24.242548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.463549+0000","last_change":"2024-05-15T15:39:52.467317+0000","last_active":"2024-05-15T15:39:53.463549+0000","last_peered":"2024-05-15T15:39:53.463549+0000","last_clean":"2024-05-15T15:39:53.463549+0000","last_became_active":"2024-05-15T15:39:52.466968+0000","last_became_peered":"2024-05-15T15:39:52.466968+0000","last_unstale":"2024-05-15T15:39:53.463549+0000","last_undegraded":"2024-05-15T15:39:53.463549+0000","last_fullsized":"2024-05-15T15:39:53.463549+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:36:37.195191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.462383+0000","last_change":"2024-05-15T15:39:52.469584+0000","last_active":"2024-05-15T15:39:53.462383+0000","last_peered":"2024-05-15T15:39:53.462383+0000","last_clean":"2024-05-15T15:39:53.462383+0000","last_became_active":"2024-05-15T15:39:52.469257+0000","last_became_peered":"2024-05-15T15:39:52.469257+0000","last_unstale":"2024-05-15T15:39:53.462383+0000","last_undegraded":"2024-05-15T15:39:53.462383+0000","last_fullsized":"2024-05-15T15:39:53.462383+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:52:43.064362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.463038+0000","last_change":"2024-05-15T15:39:52.473647+0000","last_active":"2024-05-15T15:39:53.463038+0000","last_peered":"2024-05-15T15:39:53.463038+0000","last_clean":"2024-05-15T15:39:53.463038+0000","last_became_active":"2024-05-15T15:39:52.472719+0000","last_became_peered":"2024-05-15T15:39:52.472719+0000","last_unstale":"2024-05-15T15:39:53.463038+0000","last_undegraded":"2024-05-15T15:39:53.463038+0000","last_fullsized":"2024-05-15T15:39:53.463038+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:48:23.434946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.056800+0000","last_change":"2024-05-15T15:39:52.465815+0000","last_active":"2024-05-15T15:39:54.056800+0000","last_peered":"2024-05-15T15:39:54.056800+0000","last_clean":"2024-05-15T15:39:54.056800+0000","last_became_active":"2024-05-15T15:39:52.465471+0000","last_became_peered":"2024-05-15T15:39:52.465471+0000","last_unstale":"2024-05-15T15:39:54.056800+0000","last_undegraded":"2024-05-15T15:39:54.056800+0000","last_fullsized":"2024-05-15T15:39:54.056800+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:53:35.715007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.463021+0000","last_change":"2024-05-15T15:39:52.463837+0000","last_active":"2024-05-15T15:39:53.463021+0000","last_peered":"2024-05-15T15:39:53.463021+0000","last_clean":"2024-05-15T15:39:53.463021+0000","last_became_active":"2024-05-15T15:39:52.459388+0000","last_became_peered":"2024-05-15T15:39:52.459388+0000","last_unstale":"2024-05-15T15:39:53.463021+0000","last_undegraded":"2024-05-15T15:39:53.463021+0000","last_fullsized":"2024-05-15T15:39:53.463021+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:55:50.961472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057274+0000","last_change":"2024-05-15T15:39:52.467411+0000","last_active":"2024-05-15T15:39:54.057274+0000","last_peered":"2024-05-15T15:39:54.057274+0000","last_clean":"2024-05-15T15:39:54.057274+0000","last_became_active":"2024-05-15T15:39:52.466666+0000","last_became_peered":"2024-05-15T15:39:52.466666+0000","last_unstale":"2024-05-15T15:39:54.057274+0000","last_undegraded":"2024-05-15T15:39:54.057274+0000","last_fullsized":"2024-05-15T15:39:54.057274+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:22:17.968105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.056682+0000","last_change":"2024-05-15T15:39:52.459193+0000","last_active":"2024-05-15T15:39:54.056682+0000","last_peered":"2024-05-15T15:39:54.056682+0000","last_clean":"2024-05-15T15:39:54.056682+0000","last_became_active":"2024-05-15T15:39:52.458872+0000","last_became_peered":"2024-05-15T15:39:52.458872+0000","last_unstale":"2024-05-15T15:39:54.056682+0000","last_undegraded":"2024-05-15T15:39:54.056682+0000","last_fullsized":"2024-05-15T15:39:54.056682+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:57:04.417030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.506016+0000","last_change":"2024-05-15T15:39:52.477675+0000","last_active":"2024-05-15T15:39:53.506016+0000","last_peered":"2024-05-15T15:39:53.506016+0000","last_clean":"2024-05-15T15:39:53.506016+0000","last_became_active":"2024-05-15T15:39:52.477314+0000","last_became_peered":"2024-05-15T15:39:52.477314+0000","last_unstale":"2024-05-15T15:39:53.506016+0000","last_undegraded":"2024-05-15T15:39:53.506016+0000","last_fullsized":"2024-05-15T15:39:53.506016+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:49:27.658296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.463806+0000","last_change":"2024-05-15T15:39:52.471743+0000","last_active":"2024-05-15T15:39:53.463806+0000","last_peered":"2024-05-15T15:39:53.463806+0000","last_clean":"2024-05-15T15:39:53.463806+0000","last_became_active":"2024-05-15T15:39:52.471382+0000","last_became_peered":"2024-05-15T15:39:52.471382+0000","last_unstale":"2024-05-15T15:39:53.463806+0000","last_undegraded":"2024-05-15T15:39:53.463806+0000","last_fullsized":"2024-05-15T15:39:53.463806+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:01:48.794566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.462381+0000","last_change":"2024-05-15T15:39:52.463540+0000","last_active":"2024-05-15T15:39:53.462381+0000","last_peered":"2024-05-15T15:39:53.462381+0000","last_clean":"2024-05-15T15:39:53.462381+0000","last_became_active":"2024-05-15T15:39:52.463162+0000","last_became_peered":"2024-05-15T15:39:52.463162+0000","last_unstale":"2024-05-15T15:39:53.462381+0000","last_undegraded":"2024-05-15T15:39:53.462381+0000","last_fullsized":"2024-05-15T15:39:53.462381+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:18:51.904529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.464627+0000","last_change":"2024-05-15T15:39:52.474224+0000","last_active":"2024-05-15T15:39:53.464627+0000","last_peered":"2024-05-15T15:39:53.464627+0000","last_clean":"2024-05-15T15:39:53.464627+0000","last_became_active":"2024-05-15T15:39:52.473890+0000","last_became_peered":"2024-05-15T15:39:52.473890+0000","last_unstale":"2024-05-15T15:39:53.464627+0000","last_undegraded":"2024-05-15T15:39:53.464627+0000","last_fullsized":"2024-05-15T15:39:53.464627+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:22:17.968105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057129+0000","last_change":"2024-05-15T15:39:52.466971+0000","last_active":"2024-05-15T15:39:54.057129+0000","last_peered":"2024-05-15T15:39:54.057129+0000","last_clean":"2024-05-15T15:39:54.057129+0000","last_became_active":"2024-05-15T15:39:52.466656+0000","last_became_peered":"2024-05-15T15:39:52.466656+0000","last_unstale":"2024-05-15T15:39:54.057129+0000","last_undegraded":"2024-05-15T15:39:54.057129+0000","last_fullsized":"2024-05-15T15:39:54.057129+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:52:27.027535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.464322+0000","last_change":"2024-05-15T15:39:52.470364+0000","last_active":"2024-05-15T15:39:53.464322+0000","last_peered":"2024-05-15T15:39:53.464322+0000","last_clean":"2024-05-15T15:39:53.464322+0000","last_became_active":"2024-05-15T15:39:52.470067+0000","last_became_peered":"2024-05-15T15:39:52.470067+0000","last_unstale":"2024-05-15T15:39:53.464322+0000","last_undegraded":"2024-05-15T15:39:53.464322+0000","last_fullsized":"2024-05-15T15:39:53.464322+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:07:28.350502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.463525+0000","last_change":"2024-05-15T15:39:52.473274+0000","last_active":"2024-05-15T15:39:53.463525+0000","last_peered":"2024-05-15T15:39:53.463525+0000","last_clean":"2024-05-15T15:39:53.463525+0000","last_became_active":"2024-05-15T15:39:52.472954+0000","last_became_peered":"2024-05-15T15:39:52.472954+0000","last_unstale":"2024-05-15T15:39:53.463525+0000","last_undegraded":"2024-05-15T15:39:53.463525+0000","last_fullsized":"2024-05-15T15:39:53.463525+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:46:06.269771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.464564+0000","last_change":"2024-05-15T15:39:52.473238+0000","last_active":"2024-05-15T15:39:53.464564+0000","last_peered":"2024-05-15T15:39:53.464564+0000","last_clean":"2024-05-15T15:39:53.464564+0000","last_became_active":"2024-05-15T15:39:52.472848+0000","last_became_peered":"2024-05-15T15:39:52.472848+0000","last_unstale":"2024-05-15T15:39:53.464564+0000","last_undegraded":"2024-05-15T15:39:53.464564+0000","last_fullsized":"2024-05-15T15:39:53.464564+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:48:53.088055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.462876+0000","last_change":"2024-05-15T15:39:52.464689+0000","last_active":"2024-05-15T15:39:53.462876+0000","last_peered":"2024-05-15T15:39:53.462876+0000","last_clean":"2024-05-15T15:39:53.462876+0000","last_became_active":"2024-05-15T15:39:52.462649+0000","last_became_peered":"2024-05-15T15:39:52.462649+0000","last_unstale":"2024-05-15T15:39:53.462876+0000","last_undegraded":"2024-05-15T15:39:53.462876+0000","last_fullsized":"2024-05-15T15:39:53.462876+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:17:05.581127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.056464+0000","last_change":"2024-05-15T15:39:52.465485+0000","last_active":"2024-05-15T15:39:54.056464+0000","last_peered":"2024-05-15T15:39:54.056464+0000","last_clean":"2024-05-15T15:39:54.056464+0000","last_became_active":"2024-05-15T15:39:52.464733+0000","last_became_peered":"2024-05-15T15:39:52.464733+0000","last_unstale":"2024-05-15T15:39:54.056464+0000","last_undegraded":"2024-05-15T15:39:54.056464+0000","last_fullsized":"2024-05-15T15:39:54.056464+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:17:34.380965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057300+0000","last_change":"2024-05-15T15:39:52.465924+0000","last_active":"2024-05-15T15:39:54.057300+0000","last_peered":"2024-05-15T15:39:54.057300+0000","last_clean":"2024-05-15T15:39:54.057300+0000","last_became_active":"2024-05-15T15:39:52.464704+0000","last_became_peered":"2024-05-15T15:39:52.464704+0000","last_unstale":"2024-05-15T15:39:54.057300+0000","last_undegraded":"2024-05-15T15:39:54.057300+0000","last_fullsized":"2024-05-15T15:39:54.057300+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:49:27.658296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.506001+0000","last_change":"2024-05-15T15:39:52.465099+0000","last_active":"2024-05-15T15:39:53.506001+0000","last_peered":"2024-05-15T15:39:53.506001+0000","last_clean":"2024-05-15T15:39:53.506001+0000","last_became_active":"2024-05-15T15:39:52.464775+0000","last_became_peered":"2024-05-15T15:39:52.464775+0000","last_unstale":"2024-05-15T15:39:53.506001+0000","last_undegraded":"2024-05-15T15:39:53.506001+0000","last_fullsized":"2024-05-15T15:39:53.506001+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:52:27.027535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.464681+0000","last_change":"2024-05-15T15:39:51.443546+0000","last_active":"2024-05-15T15:39:53.464681+0000","last_peered":"2024-05-15T15:39:53.464681+0000","last_clean":"2024-05-15T15:39:53.464681+0000","last_became_active":"2024-05-15T15:39:51.443177+0000","last_became_peered":"2024-05-15T15:39:51.443177+0000","last_unstale":"2024-05-15T15:39:53.464681+0000","last_undegraded":"2024-05-15T15:39:53.464681+0000","last_fullsized":"2024-05-15T15:39:53.464681+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:18:35.801621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.056878+0000","last_change":"2024-05-15T15:39:52.470469+0000","last_active":"2024-05-15T15:39:54.056878+0000","last_peered":"2024-05-15T15:39:54.056878+0000","last_clean":"2024-05-15T15:39:54.056878+0000","last_became_active":"2024-05-15T15:39:52.468716+0000","last_became_peered":"2024-05-15T15:39:52.468716+0000","last_unstale":"2024-05-15T15:39:54.056878+0000","last_undegraded":"2024-05-15T15:39:54.056878+0000","last_fullsized":"2024-05-15T15:39:54.056878+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:58:08.602086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.462997+0000","last_change":"2024-05-15T15:39:51.451403+0000","last_active":"2024-05-15T15:39:53.462997+0000","last_peered":"2024-05-15T15:39:53.462997+0000","last_clean":"2024-05-15T15:39:53.462997+0000","last_became_active":"2024-05-15T15:39:51.451074+0000","last_became_peered":"2024-05-15T15:39:51.451074+0000","last_unstale":"2024-05-15T15:39:53.462997+0000","last_undegraded":"2024-05-15T15:39:53.462997+0000","last_fullsized":"2024-05-15T15:39:53.462997+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:52:26.020009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.463548+0000","last_change":"2024-05-15T15:39:51.457243+0000","last_active":"2024-05-15T15:39:53.463548+0000","last_peered":"2024-05-15T15:39:53.463548+0000","last_clean":"2024-05-15T15:39:53.463548+0000","last_became_active":"2024-05-15T15:39:51.456904+0000","last_became_peered":"2024-05-15T15:39:51.456904+0000","last_unstale":"2024-05-15T15:39:53.463548+0000","last_undegraded":"2024-05-15T15:39:53.463548+0000","last_fullsized":"2024-05-15T15:39:53.463548+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:45:30.896866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.464271+0000","last_change":"2024-05-15T15:39:52.461438+0000","last_active":"2024-05-15T15:39:53.464271+0000","last_peered":"2024-05-15T15:39:53.464271+0000","last_clean":"2024-05-15T15:39:53.464271+0000","last_became_active":"2024-05-15T15:39:52.460666+0000","last_became_peered":"2024-05-15T15:39:52.460666+0000","last_unstale":"2024-05-15T15:39:53.464271+0000","last_undegraded":"2024-05-15T15:39:53.464271+0000","last_fullsized":"2024-05-15T15:39:53.464271+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:35:07.996967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.462502+0000","last_change":"2024-05-15T15:39:51.444590+0000","last_active":"2024-05-15T15:39:53.462502+0000","last_peered":"2024-05-15T15:39:53.462502+0000","last_clean":"2024-05-15T15:39:53.462502+0000","last_became_active":"2024-05-15T15:39:51.444114+0000","last_became_peered":"2024-05-15T15:39:51.444114+0000","last_unstale":"2024-05-15T15:39:53.462502+0000","last_undegraded":"2024-05-15T15:39:53.462502+0000","last_fullsized":"2024-05-15T15:39:53.462502+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:17:33.373439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.056759+0000","last_change":"2024-05-15T15:39:52.463132+0000","last_active":"2024-05-15T15:39:54.056759+0000","last_peered":"2024-05-15T15:39:54.056759+0000","last_clean":"2024-05-15T15:39:54.056759+0000","last_became_active":"2024-05-15T15:39:52.462785+0000","last_became_peered":"2024-05-15T15:39:52.462785+0000","last_unstale":"2024-05-15T15:39:54.056759+0000","last_undegraded":"2024-05-15T15:39:54.056759+0000","last_fullsized":"2024-05-15T15:39:54.056759+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:08:58.790860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.506255+0000","last_change":"2024-05-15T15:39:51.453203+0000","last_active":"2024-05-15T15:39:53.506255+0000","last_peered":"2024-05-15T15:39:53.506255+0000","last_clean":"2024-05-15T15:39:53.506255+0000","last_became_active":"2024-05-15T15:39:51.452835+0000","last_became_peered":"2024-05-15T15:39:51.452835+0000","last_unstale":"2024-05-15T15:39:53.506255+0000","last_undegraded":"2024-05-15T15:39:53.506255+0000","last_fullsized":"2024-05-15T15:39:53.506255+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:00:28.591473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057390+0000","last_change":"2024-05-15T15:39:52.467091+0000","last_active":"2024-05-15T15:39:54.057390+0000","last_peered":"2024-05-15T15:39:54.057390+0000","last_clean":"2024-05-15T15:39:54.057390+0000","last_became_active":"2024-05-15T15:39:52.465260+0000","last_became_peered":"2024-05-15T15:39:52.465260+0000","last_unstale":"2024-05-15T15:39:54.057390+0000","last_undegraded":"2024-05-15T15:39:54.057390+0000","last_fullsized":"2024-05-15T15:39:54.057390+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:46:06.269771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057238+0000","last_change":"2024-05-15T15:39:51.459005+0000","last_active":"2024-05-15T15:39:54.057238+0000","last_peered":"2024-05-15T15:39:54.057238+0000","last_clean":"2024-05-15T15:39:54.057238+0000","last_became_active":"2024-05-15T15:39:51.458484+0000","last_became_peered":"2024-05-15T15:39:51.458484+0000","last_unstale":"2024-05-15T15:39:54.057238+0000","last_undegraded":"2024-05-15T15:39:54.057238+0000","last_fullsized":"2024-05-15T15:39:54.057238+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:53:34.707481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.464984+0000","last_change":"2024-05-15T15:39:52.470997+0000","last_active":"2024-05-15T15:39:53.464984+0000","last_peered":"2024-05-15T15:39:53.464984+0000","last_clean":"2024-05-15T15:39:53.464984+0000","last_became_active":"2024-05-15T15:39:52.470669+0000","last_became_peered":"2024-05-15T15:39:52.470669+0000","last_unstale":"2024-05-15T15:39:53.464984+0000","last_undegraded":"2024-05-15T15:39:53.464984+0000","last_fullsized":"2024-05-15T15:39:53.464984+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:52:43.064362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.056727+0000","last_change":"2024-05-15T15:39:51.448163+0000","last_active":"2024-05-15T15:39:54.056727+0000","last_peered":"2024-05-15T15:39:54.056727+0000","last_clean":"2024-05-15T15:39:54.056727+0000","last_became_active":"2024-05-15T15:39:51.447878+0000","last_became_peered":"2024-05-15T15:39:51.447878+0000","last_unstale":"2024-05-15T15:39:54.056727+0000","last_undegraded":"2024-05-15T15:39:54.056727+0000","last_fullsized":"2024-05-15T15:39:54.056727+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:45:30.896866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.463183+0000","last_change":"2024-05-15T15:39:52.471719+0000","last_active":"2024-05-15T15:39:53.463183+0000","last_peered":"2024-05-15T15:39:53.463183+0000","last_clean":"2024-05-15T15:39:53.463183+0000","last_became_active":"2024-05-15T15:39:52.471352+0000","last_became_peered":"2024-05-15T15:39:52.471352+0000","last_unstale":"2024-05-15T15:39:53.463183+0000","last_undegraded":"2024-05-15T15:39:53.463183+0000","last_fullsized":"2024-05-15T15:39:53.463183+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:09:35.247678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"22'6","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.056826+0000","last_change":"2024-05-15T15:39:51.449551+0000","last_active":"2024-05-15T15:39:54.056826+0000","last_peered":"2024-05-15T15:39:54.056826+0000","last_clean":"2024-05-15T15:39:54.056826+0000","last_became_active":"2024-05-15T15:39:51.449185+0000","last_became_peered":"2024-05-15T15:39:51.449185+0000","last_unstale":"2024-05-15T15:39:54.056826+0000","last_undegraded":"2024-05-15T15:39:54.056826+0000","last_fullsized":"2024-05-15T15:39:54.056826+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:56:40.086761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057182+0000","last_change":"2024-05-15T15:39:52.477094+0000","last_active":"2024-05-15T15:39:54.057182+0000","last_peered":"2024-05-15T15:39:54.057182+0000","last_clean":"2024-05-15T15:39:54.057182+0000","last_became_active":"2024-05-15T15:39:52.476694+0000","last_became_peered":"2024-05-15T15:39:52.476694+0000","last_unstale":"2024-05-15T15:39:54.057182+0000","last_undegraded":"2024-05-15T15:39:54.057182+0000","last_fullsized":"2024-05-15T15:39:54.057182+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:48:53.088055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057190+0000","last_change":"2024-05-15T15:39:51.455537+0000","last_active":"2024-05-15T15:39:54.057190+0000","last_peered":"2024-05-15T15:39:54.057190+0000","last_clean":"2024-05-15T15:39:54.057190+0000","last_became_active":"2024-05-15T15:39:51.455169+0000","last_became_peered":"2024-05-15T15:39:51.455169+0000","last_unstale":"2024-05-15T15:39:54.057190+0000","last_undegraded":"2024-05-15T15:39:54.057190+0000","last_fullsized":"2024-05-15T15:39:54.057190+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:15:32.911265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.464093+0000","last_change":"2024-05-15T15:39:52.464580+0000","last_active":"2024-05-15T15:39:53.464093+0000","last_peered":"2024-05-15T15:39:53.464093+0000","last_clean":"2024-05-15T15:39:53.464093+0000","last_became_active":"2024-05-15T15:39:52.464252+0000","last_became_peered":"2024-05-15T15:39:52.464252+0000","last_unstale":"2024-05-15T15:39:53.464093+0000","last_undegraded":"2024-05-15T15:39:53.464093+0000","last_fullsized":"2024-05-15T15:39:53.464093+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:00:28.874513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.463192+0000","last_change":"2024-05-15T15:39:51.456191+0000","last_active":"2024-05-15T15:39:53.463192+0000","last_peered":"2024-05-15T15:39:53.463192+0000","last_clean":"2024-05-15T15:39:53.463192+0000","last_became_active":"2024-05-15T15:39:51.455844+0000","last_became_peered":"2024-05-15T15:39:51.455844+0000","last_unstale":"2024-05-15T15:39:53.463192+0000","last_undegraded":"2024-05-15T15:39:53.463192+0000","last_fullsized":"2024-05-15T15:39:53.463192+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:19:05.281175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.462897+0000","last_change":"2024-05-15T15:39:52.473375+0000","last_active":"2024-05-15T15:39:53.462897+0000","last_peered":"2024-05-15T15:39:53.462897+0000","last_clean":"2024-05-15T15:39:53.462897+0000","last_became_active":"2024-05-15T15:39:52.473046+0000","last_became_peered":"2024-05-15T15:39:52.473046+0000","last_unstale":"2024-05-15T15:39:53.462897+0000","last_undegraded":"2024-05-15T15:39:53.462897+0000","last_fullsized":"2024-05-15T15:39:53.462897+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:15:12.564736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.056485+0000","last_change":"2024-05-15T15:39:51.461928+0000","last_active":"2024-05-15T15:39:54.056485+0000","last_peered":"2024-05-15T15:39:54.056485+0000","last_clean":"2024-05-15T15:39:54.056485+0000","last_became_active":"2024-05-15T15:39:51.461604+0000","last_became_peered":"2024-05-15T15:39:51.461604+0000","last_unstale":"2024-05-15T15:39:54.056485+0000","last_undegraded":"2024-05-15T15:39:54.056485+0000","last_fullsized":"2024-05-15T15:39:54.056485+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:13:01.291506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.505919+0000","last_change":"2024-05-15T15:39:52.474668+0000","last_active":"2024-05-15T15:39:53.505919+0000","last_peered":"2024-05-15T15:39:53.505919+0000","last_clean":"2024-05-15T15:39:53.505919+0000","last_became_active":"2024-05-15T15:39:52.474222+0000","last_became_peered":"2024-05-15T15:39:52.474222+0000","last_unstale":"2024-05-15T15:39:53.505919+0000","last_undegraded":"2024-05-15T15:39:53.505919+0000","last_fullsized":"2024-05-15T15:39:53.505919+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:53:35.715007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.056855+0000","last_change":"2024-05-15T15:39:51.446711+0000","last_active":"2024-05-15T15:39:54.056855+0000","last_peered":"2024-05-15T15:39:54.056855+0000","last_clean":"2024-05-15T15:39:54.056855+0000","last_became_active":"2024-05-15T15:39:51.446392+0000","last_became_peered":"2024-05-15T15:39:51.446392+0000","last_unstale":"2024-05-15T15:39:54.056855+0000","last_undegraded":"2024-05-15T15:39:54.056855+0000","last_fullsized":"2024-05-15T15:39:54.056855+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:02:03.970482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.462447+0000","last_change":"2024-05-15T15:39:52.468710+0000","last_active":"2024-05-15T15:39:53.462447+0000","last_peered":"2024-05-15T15:39:53.462447+0000","last_clean":"2024-05-15T15:39:53.462447+0000","last_became_active":"2024-05-15T15:39:52.468364+0000","last_became_peered":"2024-05-15T15:39:52.468364+0000","last_unstale":"2024-05-15T15:39:53.462447+0000","last_undegraded":"2024-05-15T15:39:53.462447+0000","last_fullsized":"2024-05-15T15:39:53.462447+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:39:07.633570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057781+0000","last_change":"2024-05-15T15:39:51.454815+0000","last_active":"2024-05-15T15:39:54.057781+0000","last_peered":"2024-05-15T15:39:54.057781+0000","last_clean":"2024-05-15T15:39:54.057781+0000","last_became_active":"2024-05-15T15:39:51.454302+0000","last_became_peered":"2024-05-15T15:39:51.454302+0000","last_unstale":"2024-05-15T15:39:54.057781+0000","last_undegraded":"2024-05-15T15:39:54.057781+0000","last_fullsized":"2024-05-15T15:39:54.057781+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:52:26.020009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057590+0000","last_change":"2024-05-15T15:39:52.478397+0000","last_active":"2024-05-15T15:39:54.057590+0000","last_peered":"2024-05-15T15:39:54.057590+0000","last_clean":"2024-05-15T15:39:54.057590+0000","last_became_active":"2024-05-15T15:39:52.477855+0000","last_became_peered":"2024-05-15T15:39:52.477855+0000","last_unstale":"2024-05-15T15:39:54.057590+0000","last_undegraded":"2024-05-15T15:39:54.057590+0000","last_fullsized":"2024-05-15T15:39:54.057590+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:43:53.153262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057138+0000","last_change":"2024-05-15T15:39:51.451802+0000","last_active":"2024-05-15T15:39:54.057138+0000","last_peered":"2024-05-15T15:39:54.057138+0000","last_clean":"2024-05-15T15:39:54.057138+0000","last_became_active":"2024-05-15T15:39:51.451413+0000","last_became_peered":"2024-05-15T15:39:51.451413+0000","last_unstale":"2024-05-15T15:39:54.057138+0000","last_undegraded":"2024-05-15T15:39:54.057138+0000","last_fullsized":"2024-05-15T15:39:54.057138+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:13:11.699438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057652+0000","last_change":"2024-05-15T15:39:52.477925+0000","last_active":"2024-05-15T15:39:54.057652+0000","last_peered":"2024-05-15T15:39:54.057652+0000","last_clean":"2024-05-15T15:39:54.057652+0000","last_became_active":"2024-05-15T15:39:52.477255+0000","last_became_peered":"2024-05-15T15:39:52.477255+0000","last_unstale":"2024-05-15T15:39:54.057652+0000","last_undegraded":"2024-05-15T15:39:54.057652+0000","last_fullsized":"2024-05-15T15:39:54.057652+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:39:07.633570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.464272+0000","last_change":"2024-05-15T15:39:51.450383+0000","last_active":"2024-05-15T15:39:53.464272+0000","last_peered":"2024-05-15T15:39:53.464272+0000","last_clean":"2024-05-15T15:39:53.464272+0000","last_became_active":"2024-05-15T15:39:51.449318+0000","last_became_peered":"2024-05-15T15:39:51.449318+0000","last_unstale":"2024-05-15T15:39:53.464272+0000","last_undegraded":"2024-05-15T15:39:53.464272+0000","last_fullsized":"2024-05-15T15:39:53.464272+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:17:33.373439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057489+0000","last_change":"2024-05-15T15:39:52.471316+0000","last_active":"2024-05-15T15:39:54.057489+0000","last_peered":"2024-05-15T15:39:54.057489+0000","last_clean":"2024-05-15T15:39:54.057489+0000","last_became_active":"2024-05-15T15:39:52.471014+0000","last_became_peered":"2024-05-15T15:39:52.471014+0000","last_unstale":"2024-05-15T15:39:54.057489+0000","last_undegraded":"2024-05-15T15:39:54.057489+0000","last_fullsized":"2024-05-15T15:39:54.057489+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:52:43.064362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.463830+0000","last_change":"2024-05-15T15:39:51.454584+0000","last_active":"2024-05-15T15:39:53.463830+0000","last_peered":"2024-05-15T15:39:53.463830+0000","last_clean":"2024-05-15T15:39:53.463830+0000","last_became_active":"2024-05-15T15:39:51.454260+0000","last_became_peered":"2024-05-15T15:39:51.454260+0000","last_unstale":"2024-05-15T15:39:53.463830+0000","last_undegraded":"2024-05-15T15:39:53.463830+0000","last_fullsized":"2024-05-15T15:39:53.463830+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:17:48.368852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.462838+0000","last_change":"2024-05-15T15:39:52.464130+0000","last_active":"2024-05-15T15:39:53.462838+0000","last_peered":"2024-05-15T15:39:53.462838+0000","last_clean":"2024-05-15T15:39:53.462838+0000","last_became_active":"2024-05-15T15:39:52.463486+0000","last_became_peered":"2024-05-15T15:39:52.463486+0000","last_unstale":"2024-05-15T15:39:53.462838+0000","last_undegraded":"2024-05-15T15:39:53.462838+0000","last_fullsized":"2024-05-15T15:39:53.462838+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:58:23.539973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":110,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.505802+0000","last_change":"2024-05-15T15:39:42.584601+0000","last_active":"2024-05-15T15:39:53.505802+0000","last_peered":"2024-05-15T15:39:53.505802+0000","last_clean":"2024-05-15T15:39:53.505802+0000","last_became_active":"2024-05-15T15:39:42.584129+0000","last_became_peered":"2024-05-15T15:39:42.584129+0000","last_unstale":"2024-05-15T15:39:53.505802+0000","last_undegraded":"2024-05-15T15:39:53.505802+0000","last_fullsized":"2024-05-15T15:39:53.505802+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:41.378107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:41.378107+0000","last_clean_scrub_stamp":"2024-05-15T15:39:41.378107+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:23:25.285669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.462726+0000","last_change":"2024-05-15T15:39:51.451749+0000","last_active":"2024-05-15T15:39:53.462726+0000","last_peered":"2024-05-15T15:39:53.462726+0000","last_clean":"2024-05-15T15:39:53.462726+0000","last_became_active":"2024-05-15T15:39:51.451438+0000","last_became_peered":"2024-05-15T15:39:51.451438+0000","last_unstale":"2024-05-15T15:39:53.462726+0000","last_undegraded":"2024-05-15T15:39:53.462726+0000","last_fullsized":"2024-05-15T15:39:53.462726+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:46:05.262245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057001+0000","last_change":"2024-05-15T15:39:52.462888+0000","last_active":"2024-05-15T15:39:54.057001+0000","last_peered":"2024-05-15T15:39:54.057001+0000","last_clean":"2024-05-15T15:39:54.057001+0000","last_became_active":"2024-05-15T15:39:52.462435+0000","last_became_peered":"2024-05-15T15:39:52.462435+0000","last_unstale":"2024-05-15T15:39:54.057001+0000","last_undegraded":"2024-05-15T15:39:54.057001+0000","last_fullsized":"2024-05-15T15:39:54.057001+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:49:18.132410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.462612+0000","last_change":"2024-05-15T15:39:51.457051+0000","last_active":"2024-05-15T15:39:53.462612+0000","last_peered":"2024-05-15T15:39:53.462612+0000","last_clean":"2024-05-15T15:39:53.462612+0000","last_became_active":"2024-05-15T15:39:51.456748+0000","last_became_peered":"2024-05-15T15:39:51.456748+0000","last_unstale":"2024-05-15T15:39:53.462612+0000","last_undegraded":"2024-05-15T15:39:53.462612+0000","last_fullsized":"2024-05-15T15:39:53.462612+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:53:34.707481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.463666+0000","last_change":"2024-05-15T15:39:52.467728+0000","last_active":"2024-05-15T15:39:53.463666+0000","last_peered":"2024-05-15T15:39:53.463666+0000","last_clean":"2024-05-15T15:39:53.463666+0000","last_became_active":"2024-05-15T15:39:52.467352+0000","last_became_peered":"2024-05-15T15:39:52.467352+0000","last_unstale":"2024-05-15T15:39:53.463666+0000","last_undegraded":"2024-05-15T15:39:53.463666+0000","last_fullsized":"2024-05-15T15:39:53.463666+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:19:06.288701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.056496+0000","last_change":"2024-05-15T15:39:51.454058+0000","last_active":"2024-05-15T15:39:54.056496+0000","last_peered":"2024-05-15T15:39:54.056496+0000","last_clean":"2024-05-15T15:39:54.056496+0000","last_became_active":"2024-05-15T15:39:51.453765+0000","last_became_peered":"2024-05-15T15:39:51.453765+0000","last_unstale":"2024-05-15T15:39:54.056496+0000","last_undegraded":"2024-05-15T15:39:54.056496+0000","last_fullsized":"2024-05-15T15:39:54.056496+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:17:48.368852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.464095+0000","last_change":"2024-05-15T15:39:52.474812+0000","last_active":"2024-05-15T15:39:53.464095+0000","last_peered":"2024-05-15T15:39:53.464095+0000","last_clean":"2024-05-15T15:39:53.464095+0000","last_became_active":"2024-05-15T15:39:52.472883+0000","last_became_peered":"2024-05-15T15:39:52.472883+0000","last_unstale":"2024-05-15T15:39:53.464095+0000","last_undegraded":"2024-05-15T15:39:53.464095+0000","last_fullsized":"2024-05-15T15:39:53.464095+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:00:05.496148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.463124+0000","last_change":"2024-05-15T15:39:51.449647+0000","last_active":"2024-05-15T15:39:53.463124+0000","last_peered":"2024-05-15T15:39:53.463124+0000","last_clean":"2024-05-15T15:39:53.463124+0000","last_became_active":"2024-05-15T15:39:51.449332+0000","last_became_peered":"2024-05-15T15:39:51.449332+0000","last_unstale":"2024-05-15T15:39:53.463124+0000","last_undegraded":"2024-05-15T15:39:53.463124+0000","last_fullsized":"2024-05-15T15:39:53.463124+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:43:52.145736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.056740+0000","last_change":"2024-05-15T15:39:52.479896+0000","last_active":"2024-05-15T15:39:54.056740+0000","last_peered":"2024-05-15T15:39:54.056740+0000","last_clean":"2024-05-15T15:39:54.056740+0000","last_became_active":"2024-05-15T15:39:52.479462+0000","last_became_peered":"2024-05-15T15:39:52.479462+0000","last_unstale":"2024-05-15T15:39:54.056740+0000","last_undegraded":"2024-05-15T15:39:54.056740+0000","last_fullsized":"2024-05-15T15:39:54.056740+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:00:05.496148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.463525+0000","last_change":"2024-05-15T15:39:51.450193+0000","last_active":"2024-05-15T15:39:53.463525+0000","last_peered":"2024-05-15T15:39:53.463525+0000","last_clean":"2024-05-15T15:39:53.463525+0000","last_became_active":"2024-05-15T15:39:51.449868+0000","last_became_peered":"2024-05-15T15:39:51.449868+0000","last_unstale":"2024-05-15T15:39:53.463525+0000","last_undegraded":"2024-05-15T15:39:53.463525+0000","last_fullsized":"2024-05-15T15:39:53.463525+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:13:01.291506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057411+0000","last_change":"2024-05-15T15:39:52.466700+0000","last_active":"2024-05-15T15:39:54.057411+0000","last_peered":"2024-05-15T15:39:54.057411+0000","last_clean":"2024-05-15T15:39:54.057411+0000","last_became_active":"2024-05-15T15:39:52.464696+0000","last_became_peered":"2024-05-15T15:39:52.464696+0000","last_unstale":"2024-05-15T15:39:54.057411+0000","last_undegraded":"2024-05-15T15:39:54.057411+0000","last_fullsized":"2024-05-15T15:39:54.057411+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:14:40.347641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.463133+0000","last_change":"2024-05-15T15:39:51.449690+0000","last_active":"2024-05-15T15:39:53.463133+0000","last_peered":"2024-05-15T15:39:53.463133+0000","last_clean":"2024-05-15T15:39:53.463133+0000","last_became_active":"2024-05-15T15:39:51.448404+0000","last_became_peered":"2024-05-15T15:39:51.448404+0000","last_unstale":"2024-05-15T15:39:53.463133+0000","last_undegraded":"2024-05-15T15:39:53.463133+0000","last_fullsized":"2024-05-15T15:39:53.463133+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:56:23.235022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.463699+0000","last_change":"2024-05-15T15:39:52.475321+0000","last_active":"2024-05-15T15:39:53.463699+0000","last_peered":"2024-05-15T15:39:53.463699+0000","last_clean":"2024-05-15T15:39:53.463699+0000","last_became_active":"2024-05-15T15:39:52.475018+0000","last_became_peered":"2024-05-15T15:39:52.475018+0000","last_unstale":"2024-05-15T15:39:53.463699+0000","last_undegraded":"2024-05-15T15:39:53.463699+0000","last_fullsized":"2024-05-15T15:39:53.463699+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:43:53.153262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057301+0000","last_change":"2024-05-15T15:39:51.455435+0000","last_active":"2024-05-15T15:39:54.057301+0000","last_peered":"2024-05-15T15:39:54.057301+0000","last_clean":"2024-05-15T15:39:54.057301+0000","last_became_active":"2024-05-15T15:39:51.455047+0000","last_became_peered":"2024-05-15T15:39:51.455047+0000","last_unstale":"2024-05-15T15:39:54.057301+0000","last_undegraded":"2024-05-15T15:39:54.057301+0000","last_fullsized":"2024-05-15T15:39:54.057301+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:49:40.863334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057303+0000","last_change":"2024-05-15T15:39:52.459873+0000","last_active":"2024-05-15T15:39:54.057303+0000","last_peered":"2024-05-15T15:39:54.057303+0000","last_clean":"2024-05-15T15:39:54.057303+0000","last_became_active":"2024-05-15T15:39:52.459582+0000","last_became_peered":"2024-05-15T15:39:52.459582+0000","last_unstale":"2024-05-15T15:39:54.057303+0000","last_undegraded":"2024-05-15T15:39:54.057303+0000","last_fullsized":"2024-05-15T15:39:54.057303+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:54:18.294364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.463011+0000","last_change":"2024-05-15T15:39:51.456218+0000","last_active":"2024-05-15T15:39:53.463011+0000","last_peered":"2024-05-15T15:39:53.463011+0000","last_clean":"2024-05-15T15:39:53.463011+0000","last_became_active":"2024-05-15T15:39:51.455592+0000","last_became_peered":"2024-05-15T15:39:51.455592+0000","last_unstale":"2024-05-15T15:39:53.463011+0000","last_undegraded":"2024-05-15T15:39:53.463011+0000","last_fullsized":"2024-05-15T15:39:53.463011+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:14:39.340114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057249+0000","last_change":"2024-05-15T15:39:52.464074+0000","last_active":"2024-05-15T15:39:54.057249+0000","last_peered":"2024-05-15T15:39:54.057249+0000","last_clean":"2024-05-15T15:39:54.057249+0000","last_became_active":"2024-05-15T15:39:52.463738+0000","last_became_peered":"2024-05-15T15:39:52.463738+0000","last_unstale":"2024-05-15T15:39:54.057249+0000","last_undegraded":"2024-05-15T15:39:54.057249+0000","last_fullsized":"2024-05-15T15:39:54.057249+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:29:47.569993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.056270+0000","last_change":"2024-05-15T15:39:51.456266+0000","last_active":"2024-05-15T15:39:54.056270+0000","last_peered":"2024-05-15T15:39:54.056270+0000","last_clean":"2024-05-15T15:39:54.056270+0000","last_became_active":"2024-05-15T15:39:51.455914+0000","last_became_peered":"2024-05-15T15:39:51.455914+0000","last_unstale":"2024-05-15T15:39:54.056270+0000","last_undegraded":"2024-05-15T15:39:54.056270+0000","last_fullsized":"2024-05-15T15:39:54.056270+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:18:35.801621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.463115+0000","last_change":"2024-05-15T15:39:52.462843+0000","last_active":"2024-05-15T15:39:53.463115+0000","last_peered":"2024-05-15T15:39:53.463115+0000","last_clean":"2024-05-15T15:39:53.463115+0000","last_became_active":"2024-05-15T15:39:52.459592+0000","last_became_peered":"2024-05-15T15:39:52.459592+0000","last_unstale":"2024-05-15T15:39:53.463115+0000","last_undegraded":"2024-05-15T15:39:53.463115+0000","last_fullsized":"2024-05-15T15:39:53.463115+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:19:16.899508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.056705+0000","last_change":"2024-05-15T15:39:51.456133+0000","last_active":"2024-05-15T15:39:54.056705+0000","last_peered":"2024-05-15T15:39:54.056705+0000","last_clean":"2024-05-15T15:39:54.056705+0000","last_became_active":"2024-05-15T15:39:51.455602+0000","last_became_peered":"2024-05-15T15:39:51.455602+0000","last_unstale":"2024-05-15T15:39:54.056705+0000","last_undegraded":"2024-05-15T15:39:54.056705+0000","last_fullsized":"2024-05-15T15:39:54.056705+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:17:38.370348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.056952+0000","last_change":"2024-05-15T15:39:52.462939+0000","last_active":"2024-05-15T15:39:54.056952+0000","last_peered":"2024-05-15T15:39:54.056952+0000","last_clean":"2024-05-15T15:39:54.056952+0000","last_became_active":"2024-05-15T15:39:52.462611+0000","last_became_peered":"2024-05-15T15:39:52.462611+0000","last_unstale":"2024-05-15T15:39:54.056952+0000","last_undegraded":"2024-05-15T15:39:54.056952+0000","last_fullsized":"2024-05-15T15:39:54.056952+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:03:58.144604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.464110+0000","last_change":"2024-05-15T15:39:51.453591+0000","last_active":"2024-05-15T15:39:53.464110+0000","last_peered":"2024-05-15T15:39:53.464110+0000","last_clean":"2024-05-15T15:39:53.464110+0000","last_became_active":"2024-05-15T15:39:51.453250+0000","last_became_peered":"2024-05-15T15:39:51.453250+0000","last_unstale":"2024-05-15T15:39:53.464110+0000","last_undegraded":"2024-05-15T15:39:53.464110+0000","last_fullsized":"2024-05-15T15:39:53.464110+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:15:32.911265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057214+0000","last_change":"2024-05-15T15:39:52.469345+0000","last_active":"2024-05-15T15:39:54.057214+0000","last_peered":"2024-05-15T15:39:54.057214+0000","last_clean":"2024-05-15T15:39:54.057214+0000","last_became_active":"2024-05-15T15:39:52.469041+0000","last_became_peered":"2024-05-15T15:39:52.469041+0000","last_unstale":"2024-05-15T15:39:54.057214+0000","last_undegraded":"2024-05-15T15:39:54.057214+0000","last_fullsized":"2024-05-15T15:39:54.057214+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:52:27.027535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.462608+0000","last_change":"2024-05-15T15:39:51.450991+0000","last_active":"2024-05-15T15:39:53.462608+0000","last_peered":"2024-05-15T15:39:53.462608+0000","last_clean":"2024-05-15T15:39:53.462608+0000","last_became_active":"2024-05-15T15:39:51.450600+0000","last_became_peered":"2024-05-15T15:39:51.450600+0000","last_unstale":"2024-05-15T15:39:53.462608+0000","last_undegraded":"2024-05-15T15:39:53.462608+0000","last_fullsized":"2024-05-15T15:39:53.462608+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:49:26.650770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.462903+0000","last_change":"2024-05-15T15:39:52.462106+0000","last_active":"2024-05-15T15:39:53.462903+0000","last_peered":"2024-05-15T15:39:53.462903+0000","last_clean":"2024-05-15T15:39:53.462903+0000","last_became_active":"2024-05-15T15:39:52.461217+0000","last_became_peered":"2024-05-15T15:39:52.461217+0000","last_unstale":"2024-05-15T15:39:53.462903+0000","last_undegraded":"2024-05-15T15:39:53.462903+0000","last_fullsized":"2024-05-15T15:39:53.462903+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:41:33.947325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.462652+0000","last_change":"2024-05-15T15:39:52.473917+0000","last_active":"2024-05-15T15:39:53.462652+0000","last_peered":"2024-05-15T15:39:53.462652+0000","last_clean":"2024-05-15T15:39:53.462652+0000","last_became_active":"2024-05-15T15:39:52.472408+0000","last_became_peered":"2024-05-15T15:39:52.472408+0000","last_unstale":"2024-05-15T15:39:53.462652+0000","last_undegraded":"2024-05-15T15:39:53.462652+0000","last_fullsized":"2024-05-15T15:39:53.462652+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:39:30.074726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057634+0000","last_change":"2024-05-15T15:39:51.458878+0000","last_active":"2024-05-15T15:39:54.057634+0000","last_peered":"2024-05-15T15:39:54.057634+0000","last_clean":"2024-05-15T15:39:54.057634+0000","last_became_active":"2024-05-15T15:39:51.458527+0000","last_became_peered":"2024-05-15T15:39:51.458527+0000","last_unstale":"2024-05-15T15:39:54.057634+0000","last_undegraded":"2024-05-15T15:39:54.057634+0000","last_fullsized":"2024-05-15T15:39:54.057634+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:14:39.340114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.506342+0000","last_change":"2024-05-15T15:39:52.479684+0000","last_active":"2024-05-15T15:39:53.506342+0000","last_peered":"2024-05-15T15:39:53.506342+0000","last_clean":"2024-05-15T15:39:53.506342+0000","last_became_active":"2024-05-15T15:39:52.479359+0000","last_became_peered":"2024-05-15T15:39:52.479359+0000","last_unstale":"2024-05-15T15:39:53.506342+0000","last_undegraded":"2024-05-15T15:39:53.506342+0000","last_fullsized":"2024-05-15T15:39:53.506342+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:14:40.347641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057324+0000","last_change":"2024-05-15T15:39:51.459312+0000","last_active":"2024-05-15T15:39:54.057324+0000","last_peered":"2024-05-15T15:39:54.057324+0000","last_clean":"2024-05-15T15:39:54.057324+0000","last_became_active":"2024-05-15T15:39:51.458739+0000","last_became_peered":"2024-05-15T15:39:51.458739+0000","last_unstale":"2024-05-15T15:39:54.057324+0000","last_undegraded":"2024-05-15T15:39:54.057324+0000","last_fullsized":"2024-05-15T15:39:54.057324+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:17:33.373439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.464791+0000","last_change":"2024-05-15T15:39:52.472300+0000","last_active":"2024-05-15T15:39:53.464791+0000","last_peered":"2024-05-15T15:39:53.464791+0000","last_clean":"2024-05-15T15:39:53.464791+0000","last_became_active":"2024-05-15T15:39:52.472005+0000","last_became_peered":"2024-05-15T15:39:52.472005+0000","last_unstale":"2024-05-15T15:39:53.464791+0000","last_undegraded":"2024-05-15T15:39:53.464791+0000","last_fullsized":"2024-05-15T15:39:53.464791+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:18:51.904529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.465122+0000","last_change":"2024-05-15T15:39:51.451702+0000","last_active":"2024-05-15T15:39:53.465122+0000","last_peered":"2024-05-15T15:39:53.465122+0000","last_clean":"2024-05-15T15:39:53.465122+0000","last_became_active":"2024-05-15T15:39:51.451387+0000","last_became_peered":"2024-05-15T15:39:51.451387+0000","last_unstale":"2024-05-15T15:39:53.465122+0000","last_undegraded":"2024-05-15T15:39:53.465122+0000","last_fullsized":"2024-05-15T15:39:53.465122+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:23:00.828647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:53.465209+0000","last_change":"2024-05-15T15:39:52.473199+0000","last_active":"2024-05-15T15:39:53.465209+0000","last_peered":"2024-05-15T15:39:53.465209+0000","last_clean":"2024-05-15T15:39:53.465209+0000","last_became_active":"2024-05-15T15:39:52.472848+0000","last_became_peered":"2024-05-15T15:39:52.472848+0000","last_unstale":"2024-05-15T15:39:53.465209+0000","last_undegraded":"2024-05-15T15:39:53.465209+0000","last_fullsized":"2024-05-15T15:39:53.465209+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:51.428802+0000","last_clean_scrub_stamp":"2024-05-15T15:39:51.428802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:39:30.074726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"22'4","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-15T15:39:54.057222+0000","last_change":"2024-05-15T15:39:51.445161+0000","last_active":"2024-05-15T15:39:54.057222+0000","last_peered":"2024-05-15T15:39:54.057222+0000","last_clean":"2024-05-15T15:39:54.057222+0000","last_became_active":"2024-05-15T15:39:51.444855+0000","last_became_peered":"2024-05-15T15:39:51.444855+0000","last_unstale":"2024-05-15T15:39:54.057222+0000","last_undegraded":"2024-05-15T15:39:54.057222+0000","last_fullsized":"2024-05-15T15:39:54.057222+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:50.421276+0000","last_clean_scrub_stamp":"2024-05-15T15:39:50.421276+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:36:50.322584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509448,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":241664,"data_stored":81359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509448,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":233472,"data_stored":81235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509449,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27836,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":835584,"data_stored":671695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509448,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":237568,"data_stored":81817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509448,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":245760,"data_stored":82847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509449,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":831488,"data_stored":671673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509448,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":241664,"data_stored":81291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":253952,"data_stored":83519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-15T15:40:07.865 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-15T15:40:07.865 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-05-15T15:40:07.865 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-05-15T15:40:07.865 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-05-15T15:40:08.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.009+0000 7f43f5bce640 1 Processor -- start 2024-05-15T15:40:08.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.009+0000 7f43f5bce640 1 -- start start 2024-05-15T15:40:08.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.010+0000 7f43f5bce640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f43f014e530 0x7f43f00ba320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:08.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.010+0000 7f43f5bce640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f43f00b8d70 0x7f43f00b9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:08.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.010+0000 7f43f5bce640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43f00ba860 con 0x7f43f00bd440 2024-05-15T15:40:08.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.010+0000 7f43f5bce640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f43f00b88e0 con 0x7f43f00b8d70 2024-05-15T15:40:08.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.010+0000 7f43f5bce640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f43f014ece0 con 0x7f43f014e530 2024-05-15T15:40:08.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.010+0000 7f43effff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f43f00b8d70 0x7f43f00b9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:08.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.010+0000 7f43effff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f43f00b8d70 0x7f43f00b9180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52594/0 (socket says 172.21.15.12:52594) 2024-05-15T15:40:08.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.010+0000 7f43effff640 1 -- 172.21.15.12:0/1087886013 learned_addr learned my addr 172.21.15.12:0/1087886013 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:08.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.010+0000 7f43ef7fe640 1 --2- 172.21.15.12:0/1087886013 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f43f014e530 0x7f43f00ba320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:08.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.010+0000 7f43effff640 1 -- 172.21.15.12:0/1087886013 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f43f014e530 msgr2=0x7f43f00ba320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:40:08.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.010+0000 7f43effff640 1 --2- 172.21.15.12:0/1087886013 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f43f014e530 0x7f43f00ba320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:08.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.010+0000 7f43effff640 1 -- 172.21.15.12:0/1087886013 >> v1:172.21.15.84:6789/0 conn(0x7f43f00bd440 legacy=0x7f43f00bd850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:08.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.010+0000 7f43effff640 1 -- 172.21.15.12:0/1087886013 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43f014efc0 con 0x7f43f00b8d70 2024-05-15T15:40:08.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.011+0000 7f43effff640 1 --2- 172.21.15.12:0/1087886013 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f43f00b8d70 0x7f43f00b9180 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f43e8009e50 tx=0x7f43e802a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1980d1544a8de23 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:08.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.011+0000 7f43ee7fc640 1 -- 172.21.15.12:0/1087886013 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43e8036070 con 0x7f43f00b8d70 2024-05-15T15:40:08.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.011+0000 7f43ee7fc640 1 -- 172.21.15.12:0/1087886013 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43e8031600 con 0x7f43f00b8d70 2024-05-15T15:40:08.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.011+0000 7f43ee7fc640 1 -- 172.21.15.12:0/1087886013 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43e80319d0 con 0x7f43f00b8d70 2024-05-15T15:40:08.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.012+0000 7f43f5bce640 1 -- 172.21.15.12:0/1087886013 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f43f00b8d70 msgr2=0x7f43f00b9180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:08.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.012+0000 7f43f5bce640 1 --2- 172.21.15.12:0/1087886013 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f43f00b8d70 0x7f43f00b9180 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f43e8009e50 tx=0x7f43e802a710 comp rx=0 tx=0).stop 2024-05-15T15:40:08.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.012+0000 7f43f5bce640 1 -- 172.21.15.12:0/1087886013 shutdown_connections 2024-05-15T15:40:08.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.012+0000 7f43f5bce640 1 --2- 172.21.15.12:0/1087886013 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f43f00b8d70 0x7f43f00b9180 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:08.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.012+0000 7f43f5bce640 1 --2- 172.21.15.12:0/1087886013 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f43f014e530 0x7f43f00ba320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:08.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.012+0000 7f43f5bce640 1 -- 172.21.15.12:0/1087886013 >> 172.21.15.12:0/1087886013 conn(0x7f43f00c0570 msgr2=0x7f43f00c0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:08.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.012+0000 7f43f5bce640 1 -- 172.21.15.12:0/1087886013 shutdown_connections 2024-05-15T15:40:08.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.012+0000 7f43f5bce640 1 -- 172.21.15.12:0/1087886013 wait complete. 2024-05-15T15:40:08.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.014+0000 7f43f5bce640 1 Processor -- start 2024-05-15T15:40:08.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.014+0000 7f43f5bce640 1 -- start start 2024-05-15T15:40:08.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.015+0000 7f43f5bce640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f43f00b8d70 0x7f43f01462f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:08.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.015+0000 7f43f5bce640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f43f00bd440 0x7f43f0143e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:08.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.015+0000 7f43f5bce640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f43f014e530 0x7f43f013f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:08.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.015+0000 7f43f5bce640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f43f00b96c0 con 0x7f43f00bd440 2024-05-15T15:40:08.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.015+0000 7f43f5bce640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f43f00bbb70 con 0x7f43f00b8d70 2024-05-15T15:40:08.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.015+0000 7f43f5bce640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f43f014e940 con 0x7f43f014e530 2024-05-15T15:40:08.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.015+0000 7f43eeffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f43f00bd440 0x7f43f0143e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:08.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.015+0000 7f43eeffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f43f00bd440 0x7f43f0143e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52604/0 (socket says 172.21.15.12:52604) 2024-05-15T15:40:08.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.015+0000 7f43eeffd640 1 -- 172.21.15.12:0/3358422212 learned_addr learned my addr 172.21.15.12:0/3358422212 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:08.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.015+0000 7f43effff640 1 --2- 172.21.15.12:0/3358422212 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f43f014e530 0x7f43f013f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:08.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.015+0000 7f43ef7fe640 1 --2- 172.21.15.12:0/3358422212 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f43f00b8d70 0x7f43f01462f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:08.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.015+0000 7f43eeffd640 1 -- 172.21.15.12:0/3358422212 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f43f014e530 msgr2=0x7f43f013f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:08.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.015+0000 7f43eeffd640 1 --2- 172.21.15.12:0/3358422212 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f43f014e530 0x7f43f013f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:08.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.015+0000 7f43eeffd640 1 -- 172.21.15.12:0/3358422212 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f43f00b8d70 msgr2=0x7f43f01462f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:08.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.015+0000 7f43eeffd640 1 --2- 172.21.15.12:0/3358422212 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f43f00b8d70 0x7f43f01462f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:08.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.015+0000 7f43eeffd640 1 -- 172.21.15.12:0/3358422212 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43f01da5a0 con 0x7f43f00bd440 2024-05-15T15:40:08.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.015+0000 7f43effff640 1 --2- 172.21.15.12:0/3358422212 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f43f014e530 0x7f43f013f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-15T15:40:08.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.016+0000 7f43eeffd640 1 --2- 172.21.15.12:0/3358422212 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f43f00bd440 0x7f43f0143e50 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f43e400c3a0 tx=0x7f43e400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:08.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.016+0000 7f43d7fff640 1 -- 172.21.15.12:0/3358422212 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43e4017070 con 0x7f43f00bd440 2024-05-15T15:40:08.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.016+0000 7f43d7fff640 1 -- 172.21.15.12:0/3358422212 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43e40052d0 con 0x7f43f00bd440 2024-05-15T15:40:08.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.016+0000 7f43d7fff640 1 -- 172.21.15.12:0/3358422212 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43e4003830 con 0x7f43f00bd440 2024-05-15T15:40:08.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.016+0000 7f43f5bce640 1 -- 172.21.15.12:0/3358422212 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43f0146830 con 0x7f43f00bd440 2024-05-15T15:40:08.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.016+0000 7f43f5bce640 1 -- 172.21.15.12:0/3358422212 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43f01e7b50 con 0x7f43f00bd440 2024-05-15T15:40:08.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.017+0000 7f43f5bce640 1 -- 172.21.15.12:0/3358422212 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43f0050940 con 0x7f43f00bd440 2024-05-15T15:40:08.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.017+0000 7f43d7fff640 1 -- 172.21.15.12:0/3358422212 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f43e401a070 con 0x7f43f00bd440 2024-05-15T15:40:08.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.018+0000 7f43d7fff640 1 --2- 172.21.15.12:0/3358422212 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f43dc076300 0x7f43dc078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:08.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.018+0000 7f43d7fff640 1 -- 172.21.15.12:0/3358422212 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f43e4096990 con 0x7f43f00bd440 2024-05-15T15:40:08.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.018+0000 7f43ef7fe640 1 --2- 172.21.15.12:0/3358422212 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f43dc076300 0x7f43dc078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:08.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.019+0000 7f43ef7fe640 1 --2- 172.21.15.12:0/3358422212 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f43dc076300 0x7f43dc078810 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f43e000b9f0 tx=0x7f43e0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:08.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.023+0000 7f43d7fff640 1 -- 172.21.15.12:0/3358422212 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f43e4060260 con 0x7f43f00bd440 2024-05-15T15:40:08.252 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.250+0000 7f43f5bce640 1 -- 172.21.15.12:0/3358422212 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f43f01403c0 con 0x7f43f00bd440 2024-05-15T15:40:08.252 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.250+0000 7f43d7fff640 1 -- 172.21.15.12:0/3358422212 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f43e405fb60 con 0x7f43f00bd440 2024-05-15T15:40:08.253 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-05-15T15:40:08.253 INFO:teuthology.orchestra.run.smithi012.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-05-15T15:40:08.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.252+0000 7f43f5bce640 1 -- 172.21.15.12:0/3358422212 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f43dc076300 msgr2=0x7f43dc078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:08.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.252+0000 7f43f5bce640 1 --2- 172.21.15.12:0/3358422212 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f43dc076300 0x7f43dc078810 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f43e000b9f0 tx=0x7f43e0008040 comp rx=0 tx=0).stop 2024-05-15T15:40:08.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.252+0000 7f43f5bce640 1 -- 172.21.15.12:0/3358422212 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f43f00bd440 msgr2=0x7f43f0143e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:08.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.252+0000 7f43f5bce640 1 --2- 172.21.15.12:0/3358422212 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f43f00bd440 0x7f43f0143e50 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f43e400c3a0 tx=0x7f43e400c860 comp rx=0 tx=0).stop 2024-05-15T15:40:08.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.252+0000 7f43f5bce640 1 -- 172.21.15.12:0/3358422212 shutdown_connections 2024-05-15T15:40:08.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.252+0000 7f43f5bce640 1 --2- 172.21.15.12:0/3358422212 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f43f014e530 0x7f43f013f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:08.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.252+0000 7f43f5bce640 1 --2- 172.21.15.12:0/3358422212 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f43dc076300 0x7f43dc078810 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:08.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.252+0000 7f43f5bce640 1 --2- 172.21.15.12:0/3358422212 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f43f00bd440 0x7f43f0143e50 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:08.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.252+0000 7f43f5bce640 1 --2- 172.21.15.12:0/3358422212 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f43f00b8d70 0x7f43f01462f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:08.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.252+0000 7f43f5bce640 1 -- 172.21.15.12:0/3358422212 >> 172.21.15.12:0/3358422212 conn(0x7f43f00c0570 msgr2=0x7f43f00bdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:08.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.252+0000 7f43f5bce640 1 -- 172.21.15.12:0/3358422212 shutdown_connections 2024-05-15T15:40:08.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.253+0000 7f43f5bce640 1 -- 172.21.15.12:0/3358422212 wait complete. 2024-05-15T15:40:08.266 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-05-15T15:40:08.266 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-15T15:40:08.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.375+0000 7f2d608f0640 1 Processor -- start 2024-05-15T15:40:08.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.375+0000 7f2d608f0640 1 -- start start 2024-05-15T15:40:08.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.376+0000 7f2d608f0640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f2d5c151fc0 0x7f2d5c0bd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:08.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.376+0000 7f2d608f0640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d5c0c36f0 con 0x7f2d5c0bf050 2024-05-15T15:40:08.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.376+0000 7f2d608f0640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d5c152530 con 0x7f2d5c06da30 2024-05-15T15:40:08.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.376+0000 7f2d608f0640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f2d5c0bdc10 con 0x7f2d5c151fc0 2024-05-15T15:40:08.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.376+0000 7f2d5ad9d640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f2d5c0bf050 0x7f2d5c158e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:43798/0 (socket says 172.21.15.12:43798) 2024-05-15T15:40:08.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.376+0000 7f2d5ad9d640 1 -- 172.21.15.12:0/1984654159 learned_addr learned my addr 172.21.15.12:0/1984654159 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-05-15T15:40:08.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.377+0000 7f2d5a59c640 1 --2- 172.21.15.12:0/1984654159 >> v2:172.21.15.84:3300/0 conn(0x7f2d5c151fc0 0x7f2d5c0bd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:08.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.377+0000 7f2d5959a640 1 -- 172.21.15.12:0/1984654159 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1238188808 0 0) 0x7f2d5c0c36f0 con 0x7f2d5c0bf050 2024-05-15T15:40:08.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.377+0000 7f2d5959a640 1 -- 172.21.15.12:0/1984654159 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2d48003520 con 0x7f2d5c0bf050 2024-05-15T15:40:08.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.377+0000 7f2d5959a640 1 -- 172.21.15.12:0/1984654159 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1715896315 0 0) 0x7f2d48003520 con 0x7f2d5c0bf050 2024-05-15T15:40:08.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.377+0000 7f2d5a59c640 1 -- 172.21.15.12:0/1984654159 >> v1:172.21.15.84:6789/0 conn(0x7f2d5c06da30 legacy=0x7f2d5c0be940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:08.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.377+0000 7f2d5a59c640 1 -- 172.21.15.12:0/1984654159 >> v1:172.21.15.12:6789/0 conn(0x7f2d5c0bf050 legacy=0x7f2d5c158e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:08.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.377+0000 7f2d5a59c640 1 -- 172.21.15.12:0/1984654159 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d5c152810 con 0x7f2d5c151fc0 2024-05-15T15:40:08.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.378+0000 7f2d5a59c640 1 --2- 172.21.15.12:0/1984654159 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d5c151fc0 0x7f2d5c0bd6d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2d540097a0 tx=0x7f2d5402a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=390b8168608c9f85 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:08.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.378+0000 7f2d5959a640 1 -- 172.21.15.12:0/1984654159 <== mon.1 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d54037070 con 0x7f2d5c151fc0 2024-05-15T15:40:08.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.378+0000 7f2d5959a640 1 -- 172.21.15.12:0/1984654159 <== mon.1 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d5402ac50 con 0x7f2d5c151fc0 2024-05-15T15:40:08.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.378+0000 7f2d5959a640 1 -- 172.21.15.12:0/1984654159 <== mon.1 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d4c001a90 con 0x7f2d5c151fc0 2024-05-15T15:40:08.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.379+0000 7f2d608f0640 1 -- 172.21.15.12:0/1984654159 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d5c151fc0 msgr2=0x7f2d5c0bd6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:08.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.379+0000 7f2d608f0640 1 --2- 172.21.15.12:0/1984654159 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d5c151fc0 0x7f2d5c0bd6d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2d540097a0 tx=0x7f2d5402a1c0 comp rx=0 tx=0).stop 2024-05-15T15:40:08.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.379+0000 7f2d608f0640 1 -- 172.21.15.12:0/1984654159 shutdown_connections 2024-05-15T15:40:08.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.379+0000 7f2d608f0640 1 --2- 172.21.15.12:0/1984654159 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d5c151fc0 0x7f2d5c0bd6d0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:08.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.379+0000 7f2d608f0640 1 -- 172.21.15.12:0/1984654159 >> 172.21.15.12:0/1984654159 conn(0x7f2d5c0c3d20 msgr2=0x7f2d5c0c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:08.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.379+0000 7f2d608f0640 1 -- 172.21.15.12:0/1984654159 shutdown_connections 2024-05-15T15:40:08.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.379+0000 7f2d608f0640 1 -- 172.21.15.12:0/1984654159 wait complete. 2024-05-15T15:40:08.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.380+0000 7f2d608f0640 1 Processor -- start 2024-05-15T15:40:08.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.381+0000 7f2d608f0640 1 -- start start 2024-05-15T15:40:08.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.381+0000 7f2d608f0640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d5c06da30 0x7f2d5c0a25d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:08.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.381+0000 7f2d608f0640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f2d5c0bf050 0x7f2d5c0b89b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:08.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.382+0000 7f2d608f0640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d5c151fc0 0x7f2d5c1e4c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:08.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.382+0000 7f2d608f0640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f2d5c0a3050 con 0x7f2d5c06da30 2024-05-15T15:40:08.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.382+0000 7f2d608f0640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f2d5c0a2ed0 con 0x7f2d5c151fc0 2024-05-15T15:40:08.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.382+0000 7f2d608f0640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f2d5c06de40 con 0x7f2d5c0bf050 2024-05-15T15:40:08.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.382+0000 7f2d5a59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d5c06da30 0x7f2d5c0a25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:08.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.382+0000 7f2d5a59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d5c06da30 0x7f2d5c0a25d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52610/0 (socket says 172.21.15.12:52610) 2024-05-15T15:40:08.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.382+0000 7f2d5a59c640 1 -- 172.21.15.12:0/4103197721 learned_addr learned my addr 172.21.15.12:0/4103197721 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:08.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.382+0000 7f2d5ad9d640 1 --2- 172.21.15.12:0/4103197721 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d5c151fc0 0x7f2d5c1e4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:08.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.382+0000 7f2d5a59c640 1 -- 172.21.15.12:0/4103197721 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f2d5c0bf050 msgr2=0x7f2d5c0b89b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:08.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.382+0000 7f2d59d9b640 1 --2- 172.21.15.12:0/4103197721 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f2d5c0bf050 0x7f2d5c0b89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:08.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.382+0000 7f2d5a59c640 1 --2- 172.21.15.12:0/4103197721 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f2d5c0bf050 0x7f2d5c0b89b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:08.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.382+0000 7f2d5a59c640 1 -- 172.21.15.12:0/4103197721 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d5c151fc0 msgr2=0x7f2d5c1e4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:08.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.382+0000 7f2d5a59c640 1 --2- 172.21.15.12:0/4103197721 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d5c151fc0 0x7f2d5c1e4c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:08.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.382+0000 7f2d5a59c640 1 -- 172.21.15.12:0/4103197721 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d5c0a2b10 con 0x7f2d5c06da30 2024-05-15T15:40:08.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.382+0000 7f2d5ad9d640 1 --2- 172.21.15.12:0/4103197721 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d5c151fc0 0x7f2d5c1e4c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-15T15:40:08.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.382+0000 7f2d59d9b640 1 --2- 172.21.15.12:0/4103197721 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f2d5c0bf050 0x7f2d5c0b89b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-15T15:40:08.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.382+0000 7f2d5a59c640 1 --2- 172.21.15.12:0/4103197721 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d5c06da30 0x7f2d5c0a25d0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2d540097a0 tx=0x7f2d540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:08.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.382+0000 7f2d52ffd640 1 -- 172.21.15.12:0/4103197721 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d54041020 con 0x7f2d5c06da30 2024-05-15T15:40:08.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.382+0000 7f2d52ffd640 1 -- 172.21.15.12:0/4103197721 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d540044c0 con 0x7f2d5c06da30 2024-05-15T15:40:08.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.382+0000 7f2d608f0640 1 -- 172.21.15.12:0/4103197721 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d5c1e4680 con 0x7f2d5c06da30 2024-05-15T15:40:08.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.382+0000 7f2d52ffd640 1 -- 172.21.15.12:0/4103197721 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d54037040 con 0x7f2d5c06da30 2024-05-15T15:40:08.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.382+0000 7f2d608f0640 1 -- 172.21.15.12:0/4103197721 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d5c0b7d30 con 0x7f2d5c06da30 2024-05-15T15:40:08.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.383+0000 7f2d608f0640 1 -- 172.21.15.12:0/4103197721 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d5c1e4850 con 0x7f2d5c06da30 2024-05-15T15:40:08.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.384+0000 7f2d52ffd640 1 -- 172.21.15.12:0/4103197721 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2d54044020 con 0x7f2d5c06da30 2024-05-15T15:40:08.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.385+0000 7f2d52ffd640 1 --2- 172.21.15.12:0/4103197721 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f2d3c0762d0 0x7f2d3c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:08.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.385+0000 7f2d52ffd640 1 -- 172.21.15.12:0/4103197721 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f2d540b7720 con 0x7f2d5c06da30 2024-05-15T15:40:08.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.385+0000 7f2d59d9b640 1 --2- 172.21.15.12:0/4103197721 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f2d3c0762d0 0x7f2d3c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:08.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.385+0000 7f2d59d9b640 1 --2- 172.21.15.12:0/4103197721 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f2d3c0762d0 0x7f2d3c0787e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f2d5c0b7130 tx=0x7f2d44009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:08.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.390+0000 7f2d52ffd640 1 -- 172.21.15.12:0/4103197721 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f2d5404b070 con 0x7f2d5c06da30 2024-05-15T15:40:08.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.619+0000 7f2d608f0640 1 -- 172.21.15.12:0/4103197721 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2d5c0c10e0 con 0x7f2d5c06da30 2024-05-15T15:40:08.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.619+0000 7f2d52ffd640 1 -- 172.21.15.12:0/4103197721 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+4351 (secure 0 0 0) 0x7f2d5c0c10e0 con 0x7f2d5c06da30 2024-05-15T15:40:08.622 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-05-15T15:40:08.622 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6834/1290912681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":1290912681},{"type":"v1","addr":"172.21.15.12:6834","nonce":1290912681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/2920770671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6833","nonce":2920770671},{"type":"v1","addr":"172.21.15.12:6835","nonce":2920770671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-15T15:39:51.829483+0000","modified":"2024-05-15T15:39:54.852086+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6835/3699736653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3699736653},{"type":"v1","addr":"172.21.15.84:6835","nonce":3699736653}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4288,"qdb_cluster":[4288]},"id":1}]} 2024-05-15T15:40:08.622 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 7 2024-05-15T15:40:08.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.622+0000 7f2d608f0640 1 -- 172.21.15.12:0/4103197721 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f2d3c0762d0 msgr2=0x7f2d3c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:08.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.622+0000 7f2d608f0640 1 --2- 172.21.15.12:0/4103197721 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f2d3c0762d0 0x7f2d3c0787e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f2d5c0b7130 tx=0x7f2d44009040 comp rx=0 tx=0).stop 2024-05-15T15:40:08.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.622+0000 7f2d608f0640 1 -- 172.21.15.12:0/4103197721 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d5c06da30 msgr2=0x7f2d5c0a25d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:08.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.622+0000 7f2d608f0640 1 --2- 172.21.15.12:0/4103197721 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d5c06da30 0x7f2d5c0a25d0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2d540097a0 tx=0x7f2d540046c0 comp rx=0 tx=0).stop 2024-05-15T15:40:08.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.622+0000 7f2d608f0640 1 -- 172.21.15.12:0/4103197721 shutdown_connections 2024-05-15T15:40:08.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.622+0000 7f2d608f0640 1 --2- 172.21.15.12:0/4103197721 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d5c151fc0 0x7f2d5c1e4c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:08.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.622+0000 7f2d608f0640 1 --2- 172.21.15.12:0/4103197721 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f2d5c0bf050 0x7f2d5c0b89b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:08.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.622+0000 7f2d608f0640 1 --2- 172.21.15.12:0/4103197721 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f2d3c0762d0 0x7f2d3c0787e0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:08.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.622+0000 7f2d608f0640 1 --2- 172.21.15.12:0/4103197721 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d5c06da30 0x7f2d5c0a25d0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:08.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.622+0000 7f2d608f0640 1 -- 172.21.15.12:0/4103197721 >> 172.21.15.12:0/4103197721 conn(0x7f2d5c0c3d20 msgr2=0x7f2d5c0c09d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:08.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.622+0000 7f2d608f0640 1 -- 172.21.15.12:0/4103197721 shutdown_connections 2024-05-15T15:40:08.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.622+0000 7f2d608f0640 1 -- 172.21.15.12:0/4103197721 wait complete. 2024-05-15T15:40:08.635 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-15T15:40:08.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.745+0000 7fe553205640 1 Processor -- start 2024-05-15T15:40:08.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.745+0000 7fe553205640 1 -- start start 2024-05-15T15:40:08.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.747+0000 7fe553205640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe54c0b4500 0x7fe54c0b57f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:08.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.747+0000 7fe553205640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe54c0bba80 con 0x7fe54c0b9ee0 2024-05-15T15:40:08.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.747+0000 7fe553205640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe54c0b4ff0 con 0x7fe54c0bb490 2024-05-15T15:40:08.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.747+0000 7fe553205640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fe54c0bbd60 con 0x7fe54c0b4500 2024-05-15T15:40:08.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.747+0000 7fe5517a2640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fe54c0b9ee0 0x7fe54c0a4080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:43810/0 (socket says 172.21.15.12:43810) 2024-05-15T15:40:08.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.747+0000 7fe5517a2640 1 -- 172.21.15.12:0/2836108892 learned_addr learned my addr 172.21.15.12:0/2836108892 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-05-15T15:40:08.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.747+0000 7fe54bfff640 1 --2- 172.21.15.12:0/2836108892 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe54c0b4500 0x7fe54c0b57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:08.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.747+0000 7fe54b7fe640 1 -- 172.21.15.12:0/2836108892 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 546640545 0 0) 0x7fe54c0bba80 con 0x7fe54c0b9ee0 2024-05-15T15:40:08.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.747+0000 7fe54b7fe640 1 -- 172.21.15.12:0/2836108892 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe538003520 con 0x7fe54c0b9ee0 2024-05-15T15:40:08.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.747+0000 7fe54b7fe640 1 -- 172.21.15.12:0/2836108892 <== mon.1 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3330760656 0 0) 0x7fe54c0b4ff0 con 0x7fe54c0bb490 2024-05-15T15:40:08.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.747+0000 7fe54b7fe640 1 -- 172.21.15.12:0/2836108892 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe54c0bba80 con 0x7fe54c0bb490 2024-05-15T15:40:08.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.747+0000 7fe54b7fe640 1 -- 172.21.15.12:0/2836108892 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1416286578 0 0) 0x7fe538003520 con 0x7fe54c0b9ee0 2024-05-15T15:40:08.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.747+0000 7fe54b7fe640 1 -- 172.21.15.12:0/2836108892 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe54c0b4500 msgr2=0x7fe54c0b57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:40:08.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.747+0000 7fe54b7fe640 1 --2- 172.21.15.12:0/2836108892 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe54c0b4500 0x7fe54c0b57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:08.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.747+0000 7fe54b7fe640 1 -- 172.21.15.12:0/2836108892 >> v1:172.21.15.84:6789/0 conn(0x7fe54c0bb490 legacy=0x7fe54c06faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:08.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.747+0000 7fe54b7fe640 1 -- 172.21.15.12:0/2836108892 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe54c0b52d0 con 0x7fe54c0b9ee0 2024-05-15T15:40:08.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.747+0000 7fe54b7fe640 1 -- 172.21.15.12:0/2836108892 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 38171736 0 0) 0x7fe5340016f0 con 0x7fe54c0b9ee0 2024-05-15T15:40:08.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.747+0000 7fe54b7fe640 1 -- 172.21.15.12:0/2836108892 >> v1:172.21.15.12:6789/0 conn(0x7fe54c0b9ee0 legacy=0x7fe54c0a4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:08.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.747+0000 7fe54b7fe640 1 --2- 172.21.15.12:0/2836108892 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe538003c60 0x7fe5380040b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:08.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.747+0000 7fe54b7fe640 1 --2- 172.21.15.12:0/2836108892 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe538004800 0x7fe538004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:08.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.747+0000 7fe54b7fe640 1 --2- 172.21.15.12:0/2836108892 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe54c0b4500 0x7fe53800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:08.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.748+0000 7fe54b7fe640 1 -- 172.21.15.12:0/2836108892 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fe54c0bbd60 con 0x7fe538004800 2024-05-15T15:40:08.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.748+0000 7fe54b7fe640 1 -- 172.21.15.12:0/2836108892 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fe5380055c0 con 0x7fe538003c60 2024-05-15T15:40:08.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.748+0000 7fe54b7fe640 1 -- 172.21.15.12:0/2836108892 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fe53800bf00 con 0x7fe54c0b4500 2024-05-15T15:40:08.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.748+0000 7fe54bfff640 1 --2- 172.21.15.12:0/2836108892 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe538004800 0x7fe538004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:08.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.748+0000 7fe550fa1640 1 --2- 172.21.15.12:0/2836108892 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe538003c60 0x7fe5380040b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:08.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.748+0000 7fe5517a2640 1 --2- 172.21.15.12:0/2836108892 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe54c0b4500 0x7fe53800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:08.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.748+0000 7fe54bfff640 1 -- 172.21.15.12:0/2836108892 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe54c0b4500 msgr2=0x7fe53800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:40:08.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.748+0000 7fe54bfff640 1 --2- 172.21.15.12:0/2836108892 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe54c0b4500 0x7fe53800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:08.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.748+0000 7fe54bfff640 1 -- 172.21.15.12:0/2836108892 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe538003c60 msgr2=0x7fe5380040b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:40:08.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.748+0000 7fe54bfff640 1 --2- 172.21.15.12:0/2836108892 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe538003c60 0x7fe5380040b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:08.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.748+0000 7fe54bfff640 1 -- 172.21.15.12:0/2836108892 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe538003520 con 0x7fe538004800 2024-05-15T15:40:08.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.749+0000 7fe54bfff640 1 --2- 172.21.15.12:0/2836108892 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe538004800 0x7fe538004c50 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe53c009ac0 tx=0x7fe538005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d3c8980eddf2f1e server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:08.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.749+0000 7fe54b7fe640 1 -- 172.21.15.12:0/2836108892 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe53c036070 con 0x7fe538004800 2024-05-15T15:40:08.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.749+0000 7fe54b7fe640 1 -- 172.21.15.12:0/2836108892 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe53c031400 con 0x7fe538004800 2024-05-15T15:40:08.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.749+0000 7fe54b7fe640 1 -- 172.21.15.12:0/2836108892 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe53c009690 con 0x7fe538004800 2024-05-15T15:40:08.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.749+0000 7fe553205640 1 -- 172.21.15.12:0/2836108892 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe538004800 msgr2=0x7fe538004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:08.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.749+0000 7fe553205640 1 --2- 172.21.15.12:0/2836108892 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe538004800 0x7fe538004c50 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe53c009ac0 tx=0x7fe538005830 comp rx=0 tx=0).stop 2024-05-15T15:40:08.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.749+0000 7fe5517a2640 1 -- 172.21.15.12:0/2836108892 reap_dead start 2024-05-15T15:40:08.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.749+0000 7fe553205640 1 -- 172.21.15.12:0/2836108892 shutdown_connections 2024-05-15T15:40:08.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.749+0000 7fe553205640 1 -- 172.21.15.12:0/2836108892 >> 172.21.15.12:0/2836108892 conn(0x7fe54c0a1ac0 msgr2=0x7fe54c0bbfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:08.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.750+0000 7fe553205640 1 -- 172.21.15.12:0/2836108892 shutdown_connections 2024-05-15T15:40:08.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.750+0000 7fe553205640 1 -- 172.21.15.12:0/2836108892 wait complete. 2024-05-15T15:40:08.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.751+0000 7fe553205640 1 Processor -- start 2024-05-15T15:40:08.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.751+0000 7fe553205640 1 -- start start 2024-05-15T15:40:08.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.752+0000 7fe553205640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe538004800 0x7fe54c1e6430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:08.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.752+0000 7fe553205640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe54c06e990 0x7fe54c09fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:08.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.752+0000 7fe553205640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe54c0a0180 0x7fe54c072720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:08.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.752+0000 7fe553205640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fe54c0ba2f0 con 0x7fe54c06e990 2024-05-15T15:40:08.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.752+0000 7fe553205640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fe54c0a4790 con 0x7fe538004800 2024-05-15T15:40:08.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.752+0000 7fe553205640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fe54c0b57f0 con 0x7fe54c0a0180 2024-05-15T15:40:08.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.752+0000 7fe54bfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe54c06e990 0x7fe54c09fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:08.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.752+0000 7fe54bfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe54c06e990 0x7fe54c09fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52620/0 (socket says 172.21.15.12:52620) 2024-05-15T15:40:08.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.752+0000 7fe54bfff640 1 -- 172.21.15.12:0/209245243 learned_addr learned my addr 172.21.15.12:0/209245243 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:08.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.753+0000 7fe550fa1640 1 --2- 172.21.15.12:0/209245243 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe538004800 0x7fe54c1e6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:08.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.753+0000 7fe5517a2640 1 --2- 172.21.15.12:0/209245243 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe54c0a0180 0x7fe54c072720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:08.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.753+0000 7fe54bfff640 1 -- 172.21.15.12:0/209245243 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe54c0a0180 msgr2=0x7fe54c072720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:08.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.753+0000 7fe54bfff640 1 --2- 172.21.15.12:0/209245243 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe54c0a0180 0x7fe54c072720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:08.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.753+0000 7fe54bfff640 1 -- 172.21.15.12:0/209245243 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe538004800 msgr2=0x7fe54c1e6430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:08.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.753+0000 7fe54bfff640 1 --2- 172.21.15.12:0/209245243 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe538004800 0x7fe54c1e6430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:08.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.753+0000 7fe54bfff640 1 -- 172.21.15.12:0/209245243 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe54c0b7d10 con 0x7fe54c06e990 2024-05-15T15:40:08.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.753+0000 7fe54bfff640 1 --2- 172.21.15.12:0/209245243 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe54c06e990 0x7fe54c09fc40 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe53c034040 tx=0x7fe53c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:08.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.753+0000 7fe5497fa640 1 -- 172.21.15.12:0/209245243 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe53c040020 con 0x7fe54c06e990 2024-05-15T15:40:08.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.753+0000 7fe5497fa640 1 -- 172.21.15.12:0/209245243 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe53c003bc0 con 0x7fe54c06e990 2024-05-15T15:40:08.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.753+0000 7fe5497fa640 1 -- 172.21.15.12:0/209245243 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe53c036040 con 0x7fe54c06e990 2024-05-15T15:40:08.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.753+0000 7fe553205640 1 -- 172.21.15.12:0/209245243 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe54c0b7ff0 con 0x7fe54c06e990 2024-05-15T15:40:08.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.753+0000 7fe553205640 1 -- 172.21.15.12:0/209245243 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe54c1e5c30 con 0x7fe54c06e990 2024-05-15T15:40:08.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.754+0000 7fe553205640 1 -- 172.21.15.12:0/209245243 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe54c0a2690 con 0x7fe54c06e990 2024-05-15T15:40:08.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.755+0000 7fe5497fa640 1 -- 172.21.15.12:0/209245243 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe53c043020 con 0x7fe54c06e990 2024-05-15T15:40:08.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.756+0000 7fe5497fa640 1 --2- 172.21.15.12:0/209245243 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fe52c0762d0 0x7fe52c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:08.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.756+0000 7fe5497fa640 1 -- 172.21.15.12:0/209245243 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fe53c0b7b10 con 0x7fe54c06e990 2024-05-15T15:40:08.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.756+0000 7fe550fa1640 1 --2- 172.21.15.12:0/209245243 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fe52c0762d0 0x7fe52c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:08.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.757+0000 7fe550fa1640 1 --2- 172.21.15.12:0/209245243 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fe52c0762d0 0x7fe52c0787e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe544003f50 tx=0x7fe544009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:08.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.760+0000 7fe5497fa640 1 -- 172.21.15.12:0/209245243 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fe53c04a030 con 0x7fe54c06e990 2024-05-15T15:40:08.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.990+0000 7fe553205640 1 -- 172.21.15.12:0/209245243 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe54c0b7b40 con 0x7fe54c06e990 2024-05-15T15:40:08.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.991+0000 7fe5497fa640 1 -- 172.21.15.12:0/209245243 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+4351 (secure 0 0 0) 0x7fe53c0044e0 con 0x7fe54c06e990 2024-05-15T15:40:08.993 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-05-15T15:40:08.994 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6834/1290912681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":1290912681},{"type":"v1","addr":"172.21.15.12:6834","nonce":1290912681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/2920770671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6833","nonce":2920770671},{"type":"v1","addr":"172.21.15.12:6835","nonce":2920770671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-15T15:39:51.829483+0000","modified":"2024-05-15T15:39:54.852086+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6835/3699736653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3699736653},{"type":"v1","addr":"172.21.15.84:6835","nonce":3699736653}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4288,"qdb_cluster":[4288]},"id":1}]} 2024-05-15T15:40:08.994 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 7 2024-05-15T15:40:08.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.993+0000 7fe553205640 1 -- 172.21.15.12:0/209245243 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fe52c0762d0 msgr2=0x7fe52c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:08.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.993+0000 7fe553205640 1 --2- 172.21.15.12:0/209245243 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fe52c0762d0 0x7fe52c0787e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe544003f50 tx=0x7fe544009040 comp rx=0 tx=0).stop 2024-05-15T15:40:08.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.993+0000 7fe553205640 1 -- 172.21.15.12:0/209245243 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe54c06e990 msgr2=0x7fe54c09fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:08.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.993+0000 7fe553205640 1 --2- 172.21.15.12:0/209245243 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe54c06e990 0x7fe54c09fc40 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe53c034040 tx=0x7fe53c004730 comp rx=0 tx=0).stop 2024-05-15T15:40:08.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.993+0000 7fe553205640 1 -- 172.21.15.12:0/209245243 shutdown_connections 2024-05-15T15:40:08.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.993+0000 7fe553205640 1 --2- 172.21.15.12:0/209245243 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe54c0a0180 0x7fe54c072720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:08.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.993+0000 7fe553205640 1 --2- 172.21.15.12:0/209245243 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fe52c0762d0 0x7fe52c0787e0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:08.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.993+0000 7fe553205640 1 --2- 172.21.15.12:0/209245243 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe54c06e990 0x7fe54c09fc40 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:08.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.993+0000 7fe553205640 1 --2- 172.21.15.12:0/209245243 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe538004800 0x7fe54c1e6430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:08.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.993+0000 7fe553205640 1 -- 172.21.15.12:0/209245243 >> 172.21.15.12:0/209245243 conn(0x7fe54c0a1ac0 msgr2=0x7fe54c0bd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:08.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.993+0000 7fe553205640 1 -- 172.21.15.12:0/209245243 shutdown_connections 2024-05-15T15:40:08.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:08.993+0000 7fe553205640 1 -- 172.21.15.12:0/209245243 wait complete. 2024-05-15T15:40:09.007 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-15T15:40:09.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.115+0000 7fa9054f9640 1 Processor -- start 2024-05-15T15:40:09.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.115+0000 7fa9054f9640 1 -- start start 2024-05-15T15:40:09.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.117+0000 7fa9054f9640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa900145580 0x7fa9000bcb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:09.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.117+0000 7fa9054f9640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa9000baff0 0x7fa90014b650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:09.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.117+0000 7fa9054f9640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa9000bb400 0x7fa90014bb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:09.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.117+0000 7fa9054f9640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fa9000a5b60 con 0x7fa9000bb400 2024-05-15T15:40:09.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.117+0000 7fa9054f9640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7fa90014eef0 con 0x7fa9000baff0 2024-05-15T15:40:09.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.117+0000 7fa9054f9640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fa90014f1d0 con 0x7fa900145580 2024-05-15T15:40:09.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.117+0000 7fa8ff7fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa9000bb400 0x7fa90014bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:09.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.117+0000 7fa8ff7fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa9000bb400 0x7fa90014bb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52626/0 (socket says 172.21.15.12:52626) 2024-05-15T15:40:09.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.117+0000 7fa8ff7fe640 1 -- 172.21.15.12:0/999064370 learned_addr learned my addr 172.21.15.12:0/999064370 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:09.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.117+0000 7fa8fe7fc640 1 --2- 172.21.15.12:0/999064370 >> v2:172.21.15.84:3300/0 conn(0x7fa9000baff0 0x7fa90014b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:09.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.117+0000 7fa8feffd640 1 --2- 172.21.15.12:0/999064370 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa900145580 0x7fa9000bcb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:09.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.117+0000 7fa8ff7fe640 1 -- 172.21.15.12:0/999064370 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa900145580 msgr2=0x7fa9000bcb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:40:09.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.117+0000 7fa8ff7fe640 1 --2- 172.21.15.12:0/999064370 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa900145580 0x7fa9000bcb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:09.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.117+0000 7fa8ff7fe640 1 -- 172.21.15.12:0/999064370 >> v2:172.21.15.84:3300/0 conn(0x7fa9000baff0 msgr2=0x7fa90014b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:40:09.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.117+0000 7fa8ff7fe640 1 --2- 172.21.15.12:0/999064370 >> v2:172.21.15.84:3300/0 conn(0x7fa9000baff0 0x7fa90014b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:09.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.117+0000 7fa8ff7fe640 1 -- 172.21.15.12:0/999064370 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa90014f4b0 con 0x7fa9000bb400 2024-05-15T15:40:09.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.118+0000 7fa8ff7fe640 1 --2- 172.21.15.12:0/999064370 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa9000bb400 0x7fa90014bb90 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa8f0009e50 tx=0x7fa8f002a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4214b1a730e519a7 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:09.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.118+0000 7fa8fdffb640 1 -- 172.21.15.12:0/999064370 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8f0036070 con 0x7fa9000bb400 2024-05-15T15:40:09.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.118+0000 7fa8fdffb640 1 -- 172.21.15.12:0/999064370 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8f0031600 con 0x7fa9000bb400 2024-05-15T15:40:09.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.118+0000 7fa8fdffb640 1 -- 172.21.15.12:0/999064370 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8f00319d0 con 0x7fa9000bb400 2024-05-15T15:40:09.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.119+0000 7fa9054f9640 1 -- 172.21.15.12:0/999064370 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa9000bb400 msgr2=0x7fa90014bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:09.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.119+0000 7fa9054f9640 1 --2- 172.21.15.12:0/999064370 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa9000bb400 0x7fa90014bb90 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa8f0009e50 tx=0x7fa8f002a6c0 comp rx=0 tx=0).stop 2024-05-15T15:40:09.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.119+0000 7fa9054f9640 1 -- 172.21.15.12:0/999064370 shutdown_connections 2024-05-15T15:40:09.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.119+0000 7fa9054f9640 1 --2- 172.21.15.12:0/999064370 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa9000bb400 0x7fa90014bb90 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:09.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.119+0000 7fa9054f9640 1 --2- 172.21.15.12:0/999064370 >> v2:172.21.15.84:3300/0 conn(0x7fa9000baff0 0x7fa90014b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:09.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.119+0000 7fa9054f9640 1 --2- 172.21.15.12:0/999064370 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa900145580 0x7fa9000bcb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:09.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.119+0000 7fa9054f9640 1 -- 172.21.15.12:0/999064370 >> 172.21.15.12:0/999064370 conn(0x7fa9000bd0f0 msgr2=0x7fa9000bd500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:09.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.119+0000 7fa9054f9640 1 -- 172.21.15.12:0/999064370 shutdown_connections 2024-05-15T15:40:09.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.119+0000 7fa9054f9640 1 -- 172.21.15.12:0/999064370 wait complete. 2024-05-15T15:40:09.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.120+0000 7fa9054f9640 1 Processor -- start 2024-05-15T15:40:09.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.120+0000 7fa9054f9640 1 -- start start 2024-05-15T15:40:09.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.121+0000 7fa9054f9640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa9000baff0 0x7fa900070220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:09.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.121+0000 7fa9054f9640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa9000bb400 0x7fa900071230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:09.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.121+0000 7fa9054f9640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa900145580 0x7fa9001e3850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:09.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.121+0000 7fa9054f9640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa9000becd0 con 0x7fa9000baff0 2024-05-15T15:40:09.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.121+0000 7fa9054f9640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa90014eb90 con 0x7fa900145580 2024-05-15T15:40:09.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.121+0000 7fa9054f9640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fa9000bee50 con 0x7fa9000bb400 2024-05-15T15:40:09.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.121+0000 7fa8feffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa9000baff0 0x7fa900070220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:09.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.122+0000 7fa8feffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa9000baff0 0x7fa900070220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52642/0 (socket says 172.21.15.12:52642) 2024-05-15T15:40:09.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.122+0000 7fa8feffd640 1 -- 172.21.15.12:0/1880700355 learned_addr learned my addr 172.21.15.12:0/1880700355 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:09.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.122+0000 7fa8fe7fc640 1 --2- 172.21.15.12:0/1880700355 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa9000bb400 0x7fa900071230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:09.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.122+0000 7fa8ff7fe640 1 --2- 172.21.15.12:0/1880700355 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa900145580 0x7fa9001e3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:09.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.122+0000 7fa8feffd640 1 -- 172.21.15.12:0/1880700355 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa9000bb400 msgr2=0x7fa900071230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:09.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.122+0000 7fa8feffd640 1 --2- 172.21.15.12:0/1880700355 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa9000bb400 0x7fa900071230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:09.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.122+0000 7fa8feffd640 1 -- 172.21.15.12:0/1880700355 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa900145580 msgr2=0x7fa9001e3850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:09.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.122+0000 7fa8feffd640 1 --2- 172.21.15.12:0/1880700355 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa900145580 0x7fa9001e3850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:09.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.122+0000 7fa8feffd640 1 -- 172.21.15.12:0/1880700355 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa900071770 con 0x7fa9000baff0 2024-05-15T15:40:09.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.122+0000 7fa8feffd640 1 --2- 172.21.15.12:0/1880700355 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa9000baff0 0x7fa900070220 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa8f800d620 tx=0x7fa8f800dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:09.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.122+0000 7fa8f77fe640 1 -- 172.21.15.12:0/1880700355 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8f800b620 con 0x7fa9000baff0 2024-05-15T15:40:09.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.122+0000 7fa8f77fe640 1 -- 172.21.15.12:0/1880700355 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8f8019070 con 0x7fa9000baff0 2024-05-15T15:40:09.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.122+0000 7fa9054f9640 1 -- 172.21.15.12:0/1880700355 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa900143d30 con 0x7fa9000baff0 2024-05-15T15:40:09.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.122+0000 7fa8f77fe640 1 -- 172.21.15.12:0/1880700355 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8f800ba00 con 0x7fa9000baff0 2024-05-15T15:40:09.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.122+0000 7fa9054f9640 1 -- 172.21.15.12:0/1880700355 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9000a5200 con 0x7fa9000baff0 2024-05-15T15:40:09.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.123+0000 7fa9054f9640 1 -- 172.21.15.12:0/1880700355 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa900069b50 con 0x7fa9000baff0 2024-05-15T15:40:09.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.124+0000 7fa8f77fe640 1 -- 172.21.15.12:0/1880700355 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa8f800bba0 con 0x7fa9000baff0 2024-05-15T15:40:09.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.124+0000 7fa8f77fe640 1 --2- 172.21.15.12:0/1880700355 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fa8e00762d0 0x7fa8e00787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:09.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.124+0000 7fa8f77fe640 1 -- 172.21.15.12:0/1880700355 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fa8f8097860 con 0x7fa9000baff0 2024-05-15T15:40:09.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.124+0000 7fa8fe7fc640 1 --2- 172.21.15.12:0/1880700355 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fa8e00762d0 0x7fa8e00787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:09.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.125+0000 7fa8fe7fc640 1 --2- 172.21.15.12:0/1880700355 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fa8e00762d0 0x7fa8e00787e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa9000746a0 tx=0x7fa8e8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:09.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.129+0000 7fa8f77fe640 1 -- 172.21.15.12:0/1880700355 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fa8f8060c00 con 0x7fa9000baff0 2024-05-15T15:40:09.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.318+0000 7fa9054f9640 1 -- 172.21.15.12:0/1880700355 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa900050940 con 0x7fa9000baff0 2024-05-15T15:40:09.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.320+0000 7fa8f77fe640 1 -- 172.21.15.12:0/1880700355 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16573 (secure 0 0 0) 0x7fa8f8097020 con 0x7fa9000baff0 2024-05-15T15:40:09.322 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-05-15T15:40:09.322 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":23,"fsid":"3b7fc4b2-b85c-49b5-a5de-38444eeed40d","created":"2024-05-15T15:39:28.392476+0000","modified":"2024-05-15T15:39:53.451332+0000","last_up_change":"2024-05-15T15:39:39.363983+0000","last_in_change":"2024-05-15T15:39:30.591216+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-15T15:39:40.715999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-15T15:39:49.598723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-15T15:39:50.783054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0d06a12a-866a-418e-9776-704d74354579","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":3943681952},{"type":"v1","addr":"172.21.15.12:6809","nonce":3943681952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":3943681952},{"type":"v1","addr":"172.21.15.12:6812","nonce":3943681952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":3943681952},{"type":"v1","addr":"172.21.15.12:6821","nonce":3943681952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":3943681952},{"type":"v1","addr":"172.21.15.12:6816","nonce":3943681952}]},"public_addr":"172.21.15.12:6809/3943681952","cluster_addr":"172.21.15.12:6812/3943681952","heartbeat_back_addr":"172.21.15.12:6821/3943681952","heartbeat_front_addr":"172.21.15.12:6816/3943681952","state":["exists","up"]},{"osd":1,"uuid":"09d0fa19-9ef8-4f35-bf99-6e86658c6f10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6811","nonce":1763752148},{"type":"v1","addr":"172.21.15.12:6813","nonce":1763752148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":1763752148},{"type":"v1","addr":"172.21.15.12:6817","nonce":1763752148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":1763752148},{"type":"v1","addr":"172.21.15.12:6827","nonce":1763752148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6819","nonce":1763752148},{"type":"v1","addr":"172.21.15.12:6822","nonce":1763752148}]},"public_addr":"172.21.15.12:6813/1763752148","cluster_addr":"172.21.15.12:6817/1763752148","heartbeat_back_addr":"172.21.15.12:6827/1763752148","heartbeat_front_addr":"172.21.15.12:6822/1763752148","state":["exists","up"]},{"osd":2,"uuid":"b204c6ad-f431-40a5-ba27-9844294f0ece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":2173702802},{"type":"v1","addr":"172.21.15.12:6823","nonce":2173702802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":2173702802},{"type":"v1","addr":"172.21.15.12:6826","nonce":2173702802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":2173702802},{"type":"v1","addr":"172.21.15.12:6831","nonce":2173702802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":2173702802},{"type":"v1","addr":"172.21.15.12:6829","nonce":2173702802}]},"public_addr":"172.21.15.12:6823/2173702802","cluster_addr":"172.21.15.12:6826/2173702802","heartbeat_back_addr":"172.21.15.12:6831/2173702802","heartbeat_front_addr":"172.21.15.12:6829/2173702802","state":["exists","up"]},{"osd":3,"uuid":"660a9ccb-2ee5-42d8-8481-0835047a8260","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":3956443113},{"type":"v1","addr":"172.21.15.12:6801","nonce":3956443113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":3956443113},{"type":"v1","addr":"172.21.15.12:6803","nonce":3956443113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":3956443113},{"type":"v1","addr":"172.21.15.12:6807","nonce":3956443113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":3956443113},{"type":"v1","addr":"172.21.15.12:6805","nonce":3956443113}]},"public_addr":"172.21.15.12:6801/3956443113","cluster_addr":"172.21.15.12:6803/3956443113","heartbeat_back_addr":"172.21.15.12:6807/3956443113","heartbeat_front_addr":"172.21.15.12:6805/3956443113","state":["exists","up"]},{"osd":4,"uuid":"9eef1461-a961-457c-9a78-43b5098a46a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":1021092792},{"type":"v1","addr":"172.21.15.84:6809","nonce":1021092792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":1021092792},{"type":"v1","addr":"172.21.15.84:6811","nonce":1021092792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":1021092792},{"type":"v1","addr":"172.21.15.84:6815","nonce":1021092792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":1021092792},{"type":"v1","addr":"172.21.15.84:6813","nonce":1021092792}]},"public_addr":"172.21.15.84:6809/1021092792","cluster_addr":"172.21.15.84:6811/1021092792","heartbeat_back_addr":"172.21.15.84:6815/1021092792","heartbeat_front_addr":"172.21.15.84:6813/1021092792","state":["exists","up"]},{"osd":5,"uuid":"5f924e2f-6c71-4741-a727-d3710c438431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":3173527851},{"type":"v1","addr":"172.21.15.84:6801","nonce":3173527851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":3173527851},{"type":"v1","addr":"172.21.15.84:6803","nonce":3173527851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":3173527851},{"type":"v1","addr":"172.21.15.84:6807","nonce":3173527851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":3173527851},{"type":"v1","addr":"172.21.15.84:6805","nonce":3173527851}]},"public_addr":"172.21.15.84:6801/3173527851","cluster_addr":"172.21.15.84:6803/3173527851","heartbeat_back_addr":"172.21.15.84:6807/3173527851","heartbeat_front_addr":"172.21.15.84:6805/3173527851","state":["exists","up"]},{"osd":6,"uuid":"efae9975-8c16-4ad3-892f-71f3c59718d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3029180670},{"type":"v1","addr":"172.21.15.84:6817","nonce":3029180670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3029180670},{"type":"v1","addr":"172.21.15.84:6819","nonce":3029180670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3029180670},{"type":"v1","addr":"172.21.15.84:6823","nonce":3029180670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3029180670},{"type":"v1","addr":"172.21.15.84:6821","nonce":3029180670}]},"public_addr":"172.21.15.84:6817/3029180670","cluster_addr":"172.21.15.84:6819/3029180670","heartbeat_back_addr":"172.21.15.84:6823/3029180670","heartbeat_front_addr":"172.21.15.84:6821/3029180670","state":["exists","up"]},{"osd":7,"uuid":"6426efba-ee4d-4e44-83d1-c76c75aec30c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3067620602},{"type":"v1","addr":"172.21.15.84:6825","nonce":3067620602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3067620602},{"type":"v1","addr":"172.21.15.84:6827","nonce":3067620602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":3067620602},{"type":"v1","addr":"172.21.15.84:6831","nonce":3067620602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":3067620602},{"type":"v1","addr":"172.21.15.84:6829","nonce":3067620602}]},"public_addr":"172.21.15.84:6825/3067620602","cluster_addr":"172.21.15.84:6827/3067620602","heartbeat_back_addr":"172.21.15.84:6831/3067620602","heartbeat_front_addr":"172.21.15.84:6829/3067620602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.809514+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.845364+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.762733+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.688597+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.699228+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.747865+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.712415+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.820683+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-15T15:40:09.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.322+0000 7fa9054f9640 1 -- 172.21.15.12:0/1880700355 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fa8e00762d0 msgr2=0x7fa8e00787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:09.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.322+0000 7fa9054f9640 1 --2- 172.21.15.12:0/1880700355 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fa8e00762d0 0x7fa8e00787e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa9000746a0 tx=0x7fa8e8008040 comp rx=0 tx=0).stop 2024-05-15T15:40:09.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.322+0000 7fa9054f9640 1 -- 172.21.15.12:0/1880700355 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa9000baff0 msgr2=0x7fa900070220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:09.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.322+0000 7fa9054f9640 1 --2- 172.21.15.12:0/1880700355 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa9000baff0 0x7fa900070220 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa8f800d620 tx=0x7fa8f800dae0 comp rx=0 tx=0).stop 2024-05-15T15:40:09.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.322+0000 7fa9054f9640 1 -- 172.21.15.12:0/1880700355 shutdown_connections 2024-05-15T15:40:09.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.322+0000 7fa9054f9640 1 --2- 172.21.15.12:0/1880700355 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa900145580 0x7fa9001e3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:09.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.322+0000 7fa9054f9640 1 --2- 172.21.15.12:0/1880700355 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa9000bb400 0x7fa900071230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:09.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.322+0000 7fa9054f9640 1 --2- 172.21.15.12:0/1880700355 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fa8e00762d0 0x7fa8e00787e0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:09.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.322+0000 7fa9054f9640 1 --2- 172.21.15.12:0/1880700355 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa9000baff0 0x7fa900070220 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:09.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.322+0000 7fa9054f9640 1 -- 172.21.15.12:0/1880700355 >> 172.21.15.12:0/1880700355 conn(0x7fa9000bd0f0 msgr2=0x7fa9000a1560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:09.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.322+0000 7fa9054f9640 1 -- 172.21.15.12:0/1880700355 shutdown_connections 2024-05-15T15:40:09.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.322+0000 7fa9054f9640 1 -- 172.21.15.12:0/1880700355 wait complete. 2024-05-15T15:40:09.336 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-15T15:40:09.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.445+0000 7f5be3915640 1 Processor -- start 2024-05-15T15:40:09.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.445+0000 7f5be3915640 1 -- start start 2024-05-15T15:40:09.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.446+0000 7f5be3915640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5bdc151fc0 0x7f5bdc0bd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:09.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.446+0000 7f5be3915640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5bdc0bf050 0x7f5bdc158e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:09.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.446+0000 7f5be3915640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5bdc0c36f0 con 0x7f5bdc06da30 2024-05-15T15:40:09.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.446+0000 7f5be3915640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f5bdc0bdc10 con 0x7f5bdc151fc0 2024-05-15T15:40:09.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.446+0000 7f5be3915640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f5bdc152530 con 0x7f5bdc0bf050 2024-05-15T15:40:09.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.447+0000 7f5be16b1640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5bdc151fc0 0x7f5bdc0bd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:09.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.447+0000 7f5be16b1640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5bdc151fc0 0x7f5bdc0bd6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52654/0 (socket says 172.21.15.12:52654) 2024-05-15T15:40:09.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.447+0000 7f5be16b1640 1 -- 172.21.15.12:0/3862012346 learned_addr learned my addr 172.21.15.12:0/3862012346 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:09.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.447+0000 7f5be1eb2640 1 --2- 172.21.15.12:0/3862012346 >> v2:172.21.15.84:3300/0 conn(0x7f5bdc0bf050 0x7f5bdc158e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:09.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.447+0000 7f5be16b1640 1 -- 172.21.15.12:0/3862012346 >> v2:172.21.15.84:3300/0 conn(0x7f5bdc0bf050 msgr2=0x7f5bdc158e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:40:09.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.447+0000 7f5be16b1640 1 --2- 172.21.15.12:0/3862012346 >> v2:172.21.15.84:3300/0 conn(0x7f5bdc0bf050 0x7f5bdc158e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:09.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.447+0000 7f5be16b1640 1 -- 172.21.15.12:0/3862012346 >> v1:172.21.15.84:6789/0 conn(0x7f5bdc06da30 legacy=0x7f5bdc0be940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:40:09.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.447+0000 7f5be16b1640 1 -- 172.21.15.12:0/3862012346 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bdc152810 con 0x7f5bdc151fc0 2024-05-15T15:40:09.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.448+0000 7f5be16b1640 1 --2- 172.21.15.12:0/3862012346 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5bdc151fc0 0x7f5bdc0bd6d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc08d300 tx=0x7f5bd402a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfeb4918e06dbe47 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:09.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.448+0000 7f5bdbfff640 1 -- 172.21.15.12:0/3862012346 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bd4037070 con 0x7f5bdc151fc0 2024-05-15T15:40:09.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.448+0000 7f5bdbfff640 1 -- 172.21.15.12:0/3862012346 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bd4032440 con 0x7f5bdc151fc0 2024-05-15T15:40:09.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.448+0000 7f5bdbfff640 1 -- 172.21.15.12:0/3862012346 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bd4032810 con 0x7f5bdc151fc0 2024-05-15T15:40:09.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.449+0000 7f5be3915640 1 -- 172.21.15.12:0/3862012346 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5bdc151fc0 msgr2=0x7f5bdc0bd6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:09.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.449+0000 7f5be3915640 1 --2- 172.21.15.12:0/3862012346 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5bdc151fc0 0x7f5bdc0bd6d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc08d300 tx=0x7f5bd402a1c0 comp rx=0 tx=0).stop 2024-05-15T15:40:09.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.449+0000 7f5be3915640 1 -- 172.21.15.12:0/3862012346 shutdown_connections 2024-05-15T15:40:09.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.449+0000 7f5be3915640 1 --2- 172.21.15.12:0/3862012346 >> v2:172.21.15.84:3300/0 conn(0x7f5bdc0bf050 0x7f5bdc158e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:09.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.449+0000 7f5be3915640 1 --2- 172.21.15.12:0/3862012346 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5bdc151fc0 0x7f5bdc0bd6d0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:09.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.449+0000 7f5be3915640 1 -- 172.21.15.12:0/3862012346 >> 172.21.15.12:0/3862012346 conn(0x7f5bdc0c3d20 msgr2=0x7f5bdc0c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:09.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.449+0000 7f5be3915640 1 -- 172.21.15.12:0/3862012346 shutdown_connections 2024-05-15T15:40:09.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.449+0000 7f5be3915640 1 -- 172.21.15.12:0/3862012346 wait complete. 2024-05-15T15:40:09.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.450+0000 7f5be3915640 1 Processor -- start 2024-05-15T15:40:09.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.450+0000 7f5be3915640 1 -- start start 2024-05-15T15:40:09.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.451+0000 7f5be3915640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f5bdc06da30 0x7f5bdc1e4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:09.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.451+0000 7f5be3915640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5bdc0bf050 0x7f5bdc0b7610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:09.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.451+0000 7f5be3915640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5bdc151fc0 0x7f5bdc0a1d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:09.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.451+0000 7f5be3915640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f5bdc0a3050 con 0x7f5bdc151fc0 2024-05-15T15:40:09.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.451+0000 7f5be3915640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f5bdc0a2ed0 con 0x7f5bdc0bf050 2024-05-15T15:40:09.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.451+0000 7f5be3915640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f5bdc06de40 con 0x7f5bdc06da30 2024-05-15T15:40:09.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.451+0000 7f5be1eb2640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5bdc151fc0 0x7f5bdc0a1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:09.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.451+0000 7f5be1eb2640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5bdc151fc0 0x7f5bdc0a1d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52662/0 (socket says 172.21.15.12:52662) 2024-05-15T15:40:09.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.451+0000 7f5be1eb2640 1 -- 172.21.15.12:0/1618580294 learned_addr learned my addr 172.21.15.12:0/1618580294 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:09.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.451+0000 7f5be0eb0640 1 --2- 172.21.15.12:0/1618580294 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5bdc0bf050 0x7f5bdc0b7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:09.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.451+0000 7f5be16b1640 1 --2- 172.21.15.12:0/1618580294 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f5bdc06da30 0x7f5bdc1e4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:09.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.452+0000 7f5be1eb2640 1 -- 172.21.15.12:0/1618580294 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f5bdc06da30 msgr2=0x7f5bdc1e4fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:09.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.452+0000 7f5be1eb2640 1 --2- 172.21.15.12:0/1618580294 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f5bdc06da30 0x7f5bdc1e4fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:09.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.452+0000 7f5be1eb2640 1 -- 172.21.15.12:0/1618580294 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5bdc0bf050 msgr2=0x7f5bdc0b7610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:09.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.452+0000 7f5be1eb2640 1 --2- 172.21.15.12:0/1618580294 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5bdc0bf050 0x7f5bdc0b7610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:09.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.452+0000 7f5be1eb2640 1 -- 172.21.15.12:0/1618580294 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bdc14dc80 con 0x7f5bdc151fc0 2024-05-15T15:40:09.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.452+0000 7f5be1eb2640 1 --2- 172.21.15.12:0/1618580294 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5bdc151fc0 0x7f5bdc0a1d50 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f5bcc007e60 tx=0x7f5bcc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:09.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.452+0000 7f5bd9ffb640 1 -- 172.21.15.12:0/1618580294 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bcc014420 con 0x7f5bdc151fc0 2024-05-15T15:40:09.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.452+0000 7f5bd9ffb640 1 -- 172.21.15.12:0/1618580294 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bcc019070 con 0x7f5bdc151fc0 2024-05-15T15:40:09.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.452+0000 7f5be3915640 1 -- 172.21.15.12:0/1618580294 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5bdc0b7b50 con 0x7f5bdc151fc0 2024-05-15T15:40:09.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.452+0000 7f5bd9ffb640 1 -- 172.21.15.12:0/1618580294 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bcc014820 con 0x7f5bdc151fc0 2024-05-15T15:40:09.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.452+0000 7f5be3915640 1 -- 172.21.15.12:0/1618580294 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5bdc1e44e0 con 0x7f5bdc151fc0 2024-05-15T15:40:09.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.453+0000 7f5be3915640 1 -- 172.21.15.12:0/1618580294 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5bdc0a2b50 con 0x7f5bdc151fc0 2024-05-15T15:40:09.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.454+0000 7f5bd9ffb640 1 -- 172.21.15.12:0/1618580294 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f5bcc0149c0 con 0x7f5bdc151fc0 2024-05-15T15:40:09.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.454+0000 7f5bd9ffb640 1 --2- 172.21.15.12:0/1618580294 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f5bc80762d0 0x7f5bc80787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:09.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.455+0000 7f5bd9ffb640 1 -- 172.21.15.12:0/1618580294 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f5bcc097da0 con 0x7f5bdc151fc0 2024-05-15T15:40:09.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.455+0000 7f5be16b1640 1 --2- 172.21.15.12:0/1618580294 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f5bc80762d0 0x7f5bc80787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:09.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.455+0000 7f5be16b1640 1 --2- 172.21.15.12:0/1618580294 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f5bc80762d0 0x7f5bc80787e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f5bd4034000 tx=0x7f5bd402e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:09.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.459+0000 7f5bd9ffb640 1 -- 172.21.15.12:0/1618580294 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f5bcc061020 con 0x7f5bdc151fc0 2024-05-15T15:40:09.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.692+0000 7f5be3915640 1 -- 172.21.15.12:0/1618580294 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5bdc050940 con 0x7f5bdc151fc0 2024-05-15T15:40:09.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.693+0000 7f5bd9ffb640 1 -- 172.21.15.12:0/1618580294 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+4351 (secure 0 0 0) 0x7f5bcc065320 con 0x7f5bdc151fc0 2024-05-15T15:40:09.695 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-05-15T15:40:09.695 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6834/1290912681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":1290912681},{"type":"v1","addr":"172.21.15.12:6834","nonce":1290912681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/2920770671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6833","nonce":2920770671},{"type":"v1","addr":"172.21.15.12:6835","nonce":2920770671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-15T15:39:51.829483+0000","modified":"2024-05-15T15:39:54.852086+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6835/3699736653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3699736653},{"type":"v1","addr":"172.21.15.84:6835","nonce":3699736653}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4288,"qdb_cluster":[4288]},"id":1}]} 2024-05-15T15:40:09.696 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 7 2024-05-15T15:40:09.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.695+0000 7f5be3915640 1 -- 172.21.15.12:0/1618580294 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f5bc80762d0 msgr2=0x7f5bc80787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:09.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.695+0000 7f5be3915640 1 --2- 172.21.15.12:0/1618580294 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f5bc80762d0 0x7f5bc80787e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f5bd4034000 tx=0x7f5bd402e000 comp rx=0 tx=0).stop 2024-05-15T15:40:09.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.695+0000 7f5be3915640 1 -- 172.21.15.12:0/1618580294 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5bdc151fc0 msgr2=0x7f5bdc0a1d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:09.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.695+0000 7f5be3915640 1 --2- 172.21.15.12:0/1618580294 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5bdc151fc0 0x7f5bdc0a1d50 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f5bcc007e60 tx=0x7f5bcc00e4b0 comp rx=0 tx=0).stop 2024-05-15T15:40:09.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.695+0000 7f5be3915640 1 -- 172.21.15.12:0/1618580294 shutdown_connections 2024-05-15T15:40:09.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.695+0000 7f5be3915640 1 --2- 172.21.15.12:0/1618580294 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f5bc80762d0 0x7f5bc80787e0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:09.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.695+0000 7f5be3915640 1 --2- 172.21.15.12:0/1618580294 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5bdc151fc0 0x7f5bdc0a1d50 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:09.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.695+0000 7f5be3915640 1 --2- 172.21.15.12:0/1618580294 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5bdc0bf050 0x7f5bdc0b7610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:09.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.695+0000 7f5be3915640 1 --2- 172.21.15.12:0/1618580294 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f5bdc06da30 0x7f5bdc1e4fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:09.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.695+0000 7f5be3915640 1 -- 172.21.15.12:0/1618580294 >> 172.21.15.12:0/1618580294 conn(0x7f5bdc0c3d20 msgr2=0x7f5bdc0c09d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:09.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.695+0000 7f5be3915640 1 -- 172.21.15.12:0/1618580294 shutdown_connections 2024-05-15T15:40:09.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:09.695+0000 7f5be3915640 1 -- 172.21.15.12:0/1618580294 wait complete. 2024-05-15T15:40:10.012 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-15T15:39:51.829483+0000', 'modified': '2024-05-15T15:39:54.852086+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4288}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4288': {'gid': 4288, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.84:6835/3699736653', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6834', 'nonce': 3699736653}, {'type': 'v1', 'addr': '172.21.15.84:6835', 'nonce': 3699736653}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4288, 'qdb_cluster': [4288]} 2024-05-15T15:40:10.013 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-15T15:40:10.013 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-05-15T15:40:10.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.124+0000 7fcf62300640 1 Processor -- start 2024-05-15T15:40:10.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.124+0000 7fcf62300640 1 -- start start 2024-05-15T15:40:10.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.125+0000 7fcf62300640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fcf5c151fc0 0x7fcf5c0bd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:10.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.125+0000 7fcf62300640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fcf5c06da30 0x7fcf5c0be940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:10.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.125+0000 7fcf62300640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fcf5c06de40 0x7fcf5c0bee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:10.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.125+0000 7fcf62300640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fcf5c0bdc10 con 0x7fcf5c151fc0 2024-05-15T15:40:10.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.125+0000 7fcf62300640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7fcf5c0c36f0 con 0x7fcf5c06da30 2024-05-15T15:40:10.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.125+0000 7fcf62300640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fcf5c152530 con 0x7fcf5c06de40 2024-05-15T15:40:10.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.125+0000 7fcf5bfff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fcf5c151fc0 0x7fcf5c0bd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:10.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.125+0000 7fcf5bfff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fcf5c151fc0 0x7fcf5c0bd6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52672/0 (socket says 172.21.15.12:52672) 2024-05-15T15:40:10.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.125+0000 7fcf5bfff640 1 -- 172.21.15.12:0/4180747147 learned_addr learned my addr 172.21.15.12:0/4180747147 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:10.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.125+0000 7fcf5b7fe640 1 --2- 172.21.15.12:0/4180747147 >> v2:172.21.15.84:3300/0 conn(0x7fcf5c06da30 0x7fcf5c0be940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:10.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.125+0000 7fcf6089d640 1 --2- 172.21.15.12:0/4180747147 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fcf5c06de40 0x7fcf5c0bee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:10.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.126+0000 7fcf5bfff640 1 -- 172.21.15.12:0/4180747147 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fcf5c06de40 msgr2=0x7fcf5c0bee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:40:10.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.126+0000 7fcf5bfff640 1 --2- 172.21.15.12:0/4180747147 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fcf5c06de40 0x7fcf5c0bee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:10.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.126+0000 7fcf5bfff640 1 -- 172.21.15.12:0/4180747147 >> v2:172.21.15.84:3300/0 conn(0x7fcf5c06da30 msgr2=0x7fcf5c0be940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:40:10.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.126+0000 7fcf5bfff640 1 --2- 172.21.15.12:0/4180747147 >> v2:172.21.15.84:3300/0 conn(0x7fcf5c06da30 0x7fcf5c0be940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:10.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.126+0000 7fcf5bfff640 1 -- 172.21.15.12:0/4180747147 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf5c152810 con 0x7fcf5c151fc0 2024-05-15T15:40:10.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.126+0000 7fcf5bfff640 1 --2- 172.21.15.12:0/4180747147 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf5c151fc0 0x7fcf5c0bd6d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c0c38d0 tx=0x7fcf4402a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75f413147e52c2a9 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:10.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.127+0000 7fcf5affd640 1 -- 172.21.15.12:0/4180747147 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf44037070 con 0x7fcf5c151fc0 2024-05-15T15:40:10.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.127+0000 7fcf5affd640 1 -- 172.21.15.12:0/4180747147 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf44032440 con 0x7fcf5c151fc0 2024-05-15T15:40:10.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.127+0000 7fcf5affd640 1 -- 172.21.15.12:0/4180747147 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf44032810 con 0x7fcf5c151fc0 2024-05-15T15:40:10.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.127+0000 7fcf62300640 1 -- 172.21.15.12:0/4180747147 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf5c151fc0 msgr2=0x7fcf5c0bd6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:10.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.127+0000 7fcf62300640 1 --2- 172.21.15.12:0/4180747147 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf5c151fc0 0x7fcf5c0bd6d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c0c38d0 tx=0x7fcf4402a1c0 comp rx=0 tx=0).stop 2024-05-15T15:40:10.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.127+0000 7fcf62300640 1 -- 172.21.15.12:0/4180747147 shutdown_connections 2024-05-15T15:40:10.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.127+0000 7fcf62300640 1 --2- 172.21.15.12:0/4180747147 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fcf5c06de40 0x7fcf5c0bee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:10.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.127+0000 7fcf62300640 1 --2- 172.21.15.12:0/4180747147 >> v2:172.21.15.84:3300/0 conn(0x7fcf5c06da30 0x7fcf5c0be940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:10.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.127+0000 7fcf62300640 1 --2- 172.21.15.12:0/4180747147 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf5c151fc0 0x7fcf5c0bd6d0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:10.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.127+0000 7fcf62300640 1 -- 172.21.15.12:0/4180747147 >> 172.21.15.12:0/4180747147 conn(0x7fcf5c0c3d20 msgr2=0x7fcf5c0c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:10.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.127+0000 7fcf62300640 1 -- 172.21.15.12:0/4180747147 shutdown_connections 2024-05-15T15:40:10.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.127+0000 7fcf62300640 1 -- 172.21.15.12:0/4180747147 wait complete. 2024-05-15T15:40:10.134 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.129+0000 7fcf62300640 1 Processor -- start 2024-05-15T15:40:10.134 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.129+0000 7fcf62300640 1 -- start start 2024-05-15T15:40:10.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.130+0000 7fcf62300640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fcf5c06da30 0x7fcf5c0b7c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:10.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.130+0000 7fcf62300640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf5c06de40 0x7fcf5c1e78e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:10.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.130+0000 7fcf62300640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf5c151fc0 0x7fcf5c14b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:10.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.130+0000 7fcf62300640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fcf5c0a3050 con 0x7fcf5c151fc0 2024-05-15T15:40:10.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.130+0000 7fcf62300640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fcf5c0a2ed0 con 0x7fcf5c06de40 2024-05-15T15:40:10.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.130+0000 7fcf62300640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fcf5c14e570 con 0x7fcf5c06da30 2024-05-15T15:40:10.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.130+0000 7fcf6089d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf5c151fc0 0x7fcf5c14b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:10.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.130+0000 7fcf6089d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf5c151fc0 0x7fcf5c14b0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52682/0 (socket says 172.21.15.12:52682) 2024-05-15T15:40:10.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.130+0000 7fcf6089d640 1 -- 172.21.15.12:0/1483527050 learned_addr learned my addr 172.21.15.12:0/1483527050 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:10.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.130+0000 7fcf5b7fe640 1 --2- 172.21.15.12:0/1483527050 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf5c06de40 0x7fcf5c1e78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:10.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.130+0000 7fcf5bfff640 1 --2- 172.21.15.12:0/1483527050 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fcf5c06da30 0x7fcf5c0b7c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:10.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.131+0000 7fcf6089d640 1 -- 172.21.15.12:0/1483527050 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fcf5c06da30 msgr2=0x7fcf5c0b7c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:10.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.131+0000 7fcf6089d640 1 --2- 172.21.15.12:0/1483527050 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fcf5c06da30 0x7fcf5c0b7c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:10.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.131+0000 7fcf6089d640 1 -- 172.21.15.12:0/1483527050 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf5c06de40 msgr2=0x7fcf5c1e78e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:10.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.131+0000 7fcf6089d640 1 --2- 172.21.15.12:0/1483527050 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf5c06de40 0x7fcf5c1e78e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:10.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.131+0000 7fcf6089d640 1 -- 172.21.15.12:0/1483527050 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf5c14bad0 con 0x7fcf5c151fc0 2024-05-15T15:40:10.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.131+0000 7fcf6089d640 1 --2- 172.21.15.12:0/1483527050 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf5c151fc0 0x7fcf5c14b0c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fcf54009d30 tx=0x7fcf5400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:10.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.131+0000 7fcf58ff9640 1 -- 172.21.15.12:0/1483527050 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf54018020 con 0x7fcf5c151fc0 2024-05-15T15:40:10.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.131+0000 7fcf58ff9640 1 -- 172.21.15.12:0/1483527050 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf54014480 con 0x7fcf5c151fc0 2024-05-15T15:40:10.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.131+0000 7fcf62300640 1 -- 172.21.15.12:0/1483527050 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf5c1d92a0 con 0x7fcf5c151fc0 2024-05-15T15:40:10.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.131+0000 7fcf58ff9640 1 -- 172.21.15.12:0/1483527050 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf54014870 con 0x7fcf5c151fc0 2024-05-15T15:40:10.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.131+0000 7fcf62300640 1 -- 172.21.15.12:0/1483527050 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf5c1e8550 con 0x7fcf5c151fc0 2024-05-15T15:40:10.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.133+0000 7fcf58ff9640 1 -- 172.21.15.12:0/1483527050 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fcf54005d10 con 0x7fcf5c151fc0 2024-05-15T15:40:10.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.133+0000 7fcf58ff9640 1 --2- 172.21.15.12:0/1483527050 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fcf3c0762d0 0x7fcf3c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:10.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.133+0000 7fcf58ff9640 1 -- 172.21.15.12:0/1483527050 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fcf54098130 con 0x7fcf5c151fc0 2024-05-15T15:40:10.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.133+0000 7fcf5bfff640 1 --2- 172.21.15.12:0/1483527050 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fcf3c0762d0 0x7fcf3c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:10.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.134+0000 7fcf691bc740 1 Processor -- start 2024-05-15T15:40:10.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.134+0000 7fcf691bc740 1 -- start start 2024-05-15T15:40:10.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.134+0000 7fcf5bfff640 1 --2- 172.21.15.12:0/1483527050 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fcf3c0762d0 0x7fcf3c0787e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fcf44034000 tx=0x7fcf4402e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:10.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.135+0000 7fcf691bc740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5654c15ea270 0x5654c19c31b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:10.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.135+0000 7fcf691bc740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5654c15c13b0 0x5654c1987670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:10.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.135+0000 7fcf691bc740 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x5654c15c9590 0x5654c19b82a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:10.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.135+0000 7fcf691bc740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5654c18fdf10 con 0x5654c15c13b0 2024-05-15T15:40:10.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.135+0000 7fcf691bc740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5654c18edab0 con 0x5654c15ea270 2024-05-15T15:40:10.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.135+0000 7fcf691bc740 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x5654c18f1af0 con 0x5654c15c9590 2024-05-15T15:40:10.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.135+0000 7fcf5b7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5654c15c13b0 0x5654c1987670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:10.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.135+0000 7fcf5b7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5654c15c13b0 0x5654c1987670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52696/0 (socket says 172.21.15.12:52696) 2024-05-15T15:40:10.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.135+0000 7fcf5b7fe640 1 -- 172.21.15.12:0/1911714410 learned_addr learned my addr 172.21.15.12:0/1911714410 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:10.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.135+0000 7fcf5bfff640 1 --2- 172.21.15.12:0/1911714410 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5654c15ea270 0x5654c19c31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:10.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.135+0000 7fcf6089d640 1 --2- 172.21.15.12:0/1911714410 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x5654c15c9590 0x5654c19b82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:10.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.135+0000 7fcf5b7fe640 1 -- 172.21.15.12:0/1911714410 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x5654c15c9590 msgr2=0x5654c19b82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:40:10.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.135+0000 7fcf5b7fe640 1 --2- 172.21.15.12:0/1911714410 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x5654c15c9590 0x5654c19b82a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:10.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.135+0000 7fcf5b7fe640 1 -- 172.21.15.12:0/1911714410 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5654c15ea270 msgr2=0x5654c19c31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:40:10.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.135+0000 7fcf5b7fe640 1 --2- 172.21.15.12:0/1911714410 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5654c15ea270 0x5654c19c31b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:10.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.135+0000 7fcf5b7fe640 1 -- 172.21.15.12:0/1911714410 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5654c18b15d0 con 0x5654c15c13b0 2024-05-15T15:40:10.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.135+0000 7fcf6089d640 1 --2- 172.21.15.12:0/1911714410 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x5654c15c9590 0x5654c19b82a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-15T15:40:10.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.136+0000 7fcf5b7fe640 1 --2- 172.21.15.12:0/1911714410 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5654c15c13b0 0x5654c1987670 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c009aa0 tx=0x7fcf4c009f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f06e183dd640d39 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:10.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.136+0000 7fcf51ffb640 1 -- 172.21.15.12:0/1911714410 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf4c019070 con 0x5654c15c13b0 2024-05-15T15:40:10.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.136+0000 7fcf51ffb640 1 -- 172.21.15.12:0/1911714410 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf4c004300 con 0x5654c15c13b0 2024-05-15T15:40:10.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.136+0000 7fcf51ffb640 1 -- 172.21.15.12:0/1911714410 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf4c011bf0 con 0x5654c15c13b0 2024-05-15T15:40:10.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.136+0000 7fcf691bc740 1 -- 172.21.15.12:0/1911714410 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5654c15c13b0 msgr2=0x5654c1987670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:10.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.136+0000 7fcf691bc740 1 --2- 172.21.15.12:0/1911714410 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5654c15c13b0 0x5654c1987670 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c009aa0 tx=0x7fcf4c009f60 comp rx=0 tx=0).stop 2024-05-15T15:40:10.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.136+0000 7fcf691bc740 1 -- 172.21.15.12:0/1911714410 shutdown_connections 2024-05-15T15:40:10.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.136+0000 7fcf691bc740 1 --2- 172.21.15.12:0/1911714410 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x5654c15c9590 0x5654c19b82a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:10.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.136+0000 7fcf691bc740 1 --2- 172.21.15.12:0/1911714410 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5654c15c13b0 0x5654c1987670 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:10.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.136+0000 7fcf691bc740 1 --2- 172.21.15.12:0/1911714410 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5654c15ea270 0x5654c19c31b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:10.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.137+0000 7fcf691bc740 1 -- 172.21.15.12:0/1911714410 >> 172.21.15.12:0/1911714410 conn(0x5654c15de3c0 msgr2=0x5654c19c28b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:10.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.137+0000 7fcf691bc740 1 -- 172.21.15.12:0/1911714410 shutdown_connections 2024-05-15T15:40:10.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.137+0000 7fcf691bc740 1 -- 172.21.15.12:0/1911714410 wait complete. 2024-05-15T15:40:10.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.137+0000 7fcf691bc740 1 -- start start 2024-05-15T15:40:10.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.138+0000 7fcf691bc740 1 Processor -- start 2024-05-15T15:40:10.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.139+0000 7fcf691bc740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5654c15c13b0 0x5654c19cedf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:10.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.139+0000 7fcf691bc740 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x5654c15c9590 0x5654c19b9b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:10.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.139+0000 7fcf691bc740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5654c15ea270 0x5654c19a9a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:10.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.139+0000 7fcf691bc740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5654c15d3850 con 0x5654c15ea270 2024-05-15T15:40:10.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.139+0000 7fcf691bc740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5654c18a9c10 con 0x5654c15c13b0 2024-05-15T15:40:10.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.139+0000 7fcf691bc740 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x5654c1988080 con 0x5654c15c9590 2024-05-15T15:40:10.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.139+0000 7fcf691bc740 10 client.0 _ll_register_callbacks cb 0x5654c18ad150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-15T15:40:10.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.139+0000 7fcf6089d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5654c15ea270 0x5654c19a9a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:10.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.139+0000 7fcf6089d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5654c15ea270 0x5654c19a9a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52708/0 (socket says 172.21.15.12:52708) 2024-05-15T15:40:10.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.139+0000 7fcf6089d640 1 -- 172.21.15.12:0/2484390824 learned_addr learned my addr 172.21.15.12:0/2484390824 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:10.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.139+0000 7fcf5b7fe640 1 --2- 172.21.15.12:0/2484390824 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x5654c15c9590 0x5654c19b9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:10.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.139+0000 7fcf5bfff640 1 --2- 172.21.15.12:0/2484390824 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5654c15c13b0 0x5654c19cedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:10.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.139+0000 7fcf6089d640 1 -- 172.21.15.12:0/2484390824 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x5654c15c9590 msgr2=0x5654c19b9b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:40:10.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.139+0000 7fcf6089d640 1 --2- 172.21.15.12:0/2484390824 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x5654c15c9590 0x5654c19b9b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:10.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.139+0000 7fcf6089d640 1 -- 172.21.15.12:0/2484390824 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5654c15c13b0 msgr2=0x5654c19cedf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:40:10.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.139+0000 7fcf6089d640 1 --2- 172.21.15.12:0/2484390824 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5654c15c13b0 0x5654c19cedf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:10.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.139+0000 7fcf6089d640 1 -- 172.21.15.12:0/2484390824 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5654c16022d0 con 0x5654c15ea270 2024-05-15T15:40:10.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.139+0000 7fcf6089d640 1 --2- 172.21.15.12:0/2484390824 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5654c15ea270 0x5654c19a9a40 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fcf540613d0 tx=0x7fcf54061a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=315ec579c4733935 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:10.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.139+0000 7fcf3affd640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-05-15T15:40:10.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.139+0000 7fcf3affd640 1 -- 172.21.15.12:0/2484390824 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf54065740 con 0x5654c15ea270 2024-05-15T15:40:10.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.139+0000 7fcf3affd640 1 -- 172.21.15.12:0/2484390824 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fcf5405cdb0 con 0x5654c15ea270 2024-05-15T15:40:10.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.139+0000 7fcf691bc740 1 -- 172.21.15.12:0/2484390824 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcf4c004300 con 0x5654c15ea270 2024-05-15T15:40:10.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.139+0000 7fcf3affd640 1 -- 172.21.15.12:0/2484390824 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7fcf54096050 con 0x5654c15ea270 2024-05-15T15:40:10.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.140+0000 7fcf691bc740 10 client.4629 fetch_fsmap learned FSMap version 7 2024-05-15T15:40:10.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.140+0000 7fcf691bc740 1 -- 172.21.15.12:0/2484390824 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x5654c16cc6b0 con 0x5654c15ea270 2024-05-15T15:40:10.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.140+0000 7fcf3affd640 1 -- 172.21.15.12:0/2484390824 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf4c004300 con 0x5654c15ea270 2024-05-15T15:40:10.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.140+0000 7fcf3affd640 1 -- 172.21.15.12:0/2484390824 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 7) ==== 2889+0+0 (secure 0 0 0) 0x7fcf5405cfb0 con 0x5654c15ea270 2024-05-15T15:40:10.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.140+0000 7fcf691bc740 10 client.4629 fetch_fsmap finished waiting for FSMap version 7 2024-05-15T15:40:10.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.140+0000 7fcf691bc740 10 client.4629 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-15T15:40:10.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.140+0000 7fcf691bc740 20 client.4629 populate_metadata read hostname 'smithi012' 2024-05-15T15:40:10.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.140+0000 7fcf691bc740 1 --2- 172.21.15.12:0/2484390824 >> [v2:172.21.15.84:6834/3699736653,v1:172.21.15.84:6835/3699736653] conn(0x5654c15a8e40 0x5654c19d2b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:10.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.140+0000 7fcf691bc740 4 client.4629 mds_command: new command op to 4288 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-15T15:40:10.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.140+0000 7fcf691bc740 1 -- 172.21.15.12:0/2484390824 --> [v2:172.21.15.84:6834/3699736653,v1:172.21.15.84:6835/3699736653] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5654c18ffe60 con 0x5654c15a8e40 2024-05-15T15:40:10.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.140+0000 7fcf5bfff640 1 --2- 172.21.15.12:0/2484390824 >> [v2:172.21.15.84:6834/3699736653,v1:172.21.15.84:6835/3699736653] conn(0x5654c15a8e40 0x5654c19d2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:10.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.140+0000 7fcf5bfff640 1 --2- 172.21.15.12:0/2484390824 >> [v2:172.21.15.84:6834/3699736653,v1:172.21.15.84:6835/3699736653] conn(0x5654c15a8e40 0x5654c19d2b90 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1b957875f5d9920e server_cookie=ec97b7270697ab18 in_seq=0 out_seq=0 2024-05-15T15:40:10.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.140+0000 7fcf3affd640 10 client.4629 ms_handle_connect on v2:172.21.15.84:6834/3699736653 2024-05-15T15:40:10.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.141+0000 7fcf3affd640 1 -- 172.21.15.12:0/2484390824 <== mds.0 v2:172.21.15.84:6834/3699736653 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5654c18ffe60 con 0x5654c15a8e40 2024-05-15T15:40:10.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.141+0000 7fcf3affd640 10 client.4629 handle_command_reply: tid=0 2024-05-15T15:40:10.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.141+0000 7fcf691bc740 1 client.4629 shutdown 2024-05-15T15:40:10.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.142+0000 7fcf691bc740 1 -- 172.21.15.12:0/2484390824 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5654c15ea270 msgr2=0x5654c19a9a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:10.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.142+0000 7fcf691bc740 1 --2- 172.21.15.12:0/2484390824 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5654c15ea270 0x5654c19a9a40 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fcf540613d0 tx=0x7fcf54061a10 comp rx=0 tx=0).stop 2024-05-15T15:40:10.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.142+0000 7fcf691bc740 1 -- 172.21.15.12:0/2484390824 shutdown_connections 2024-05-15T15:40:10.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.142+0000 7fcf691bc740 1 --2- 172.21.15.12:0/2484390824 >> [v2:172.21.15.84:6834/3699736653,v1:172.21.15.84:6835/3699736653] conn(0x5654c15a8e40 0x5654c19d2b90 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:10.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.142+0000 7fcf691bc740 1 --2- 172.21.15.12:0/2484390824 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5654c15ea270 0x5654c19a9a40 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:10.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.142+0000 7fcf691bc740 1 --2- 172.21.15.12:0/2484390824 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x5654c15c9590 0x5654c19b9b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:10.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.142+0000 7fcf3affd640 0 client.4629 ms_handle_reset on v2:172.21.15.84:6834/3699736653 2024-05-15T15:40:10.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.142+0000 7fcf691bc740 1 --2- 172.21.15.12:0/2484390824 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5654c15c13b0 0x5654c19cedf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:10.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.142+0000 7fcf691bc740 1 -- 172.21.15.12:0/2484390824 >> 172.21.15.12:0/2484390824 conn(0x5654c15de3c0 msgr2=0x5654c198b170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:10.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.142+0000 7fcf691bc740 1 -- 172.21.15.12:0/2484390824 shutdown_connections 2024-05-15T15:40:10.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.142+0000 7fcf691bc740 1 -- 172.21.15.12:0/2484390824 wait complete. 2024-05-15T15:40:10.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.142+0000 7fcf691bc740 20 client.4629 trim_cache size 0 max 16384 2024-05-15T15:40:10.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.161+0000 7fcf691bc740 1 Processor -- start 2024-05-15T15:40:10.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.161+0000 7fcf691bc740 1 -- start start 2024-05-15T15:40:10.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.162+0000 7fcf691bc740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5654c15c13b0 0x5654c19a9840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:10.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.162+0000 7fcf691bc740 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x5654c15c9590 0x5654c19c1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:10.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.162+0000 7fcf691bc740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5654c15ea270 0x5654c19c1e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:10.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.162+0000 7fcf691bc740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fcf5c1f1170 con 0x5654c15c13b0 2024-05-15T15:40:10.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.162+0000 7fcf691bc740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fcf5c1e5150 con 0x5654c15ea270 2024-05-15T15:40:10.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.162+0000 7fcf691bc740 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fcf5c1f01d0 con 0x5654c15c9590 2024-05-15T15:40:10.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.162+0000 7fcf5bfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5654c15c13b0 0x5654c19a9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:10.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.162+0000 7fcf5bfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5654c15c13b0 0x5654c19a9840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52718/0 (socket says 172.21.15.12:52718) 2024-05-15T15:40:10.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.162+0000 7fcf5bfff640 1 -- 172.21.15.12:0/1107443247 learned_addr learned my addr 172.21.15.12:0/1107443247 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:10.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.162+0000 7fcf5bfff640 1 -- 172.21.15.12:0/1107443247 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x5654c15c9590 msgr2=0x5654c19c1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:40:10.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.162+0000 7fcf5bfff640 1 --2- 172.21.15.12:0/1107443247 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x5654c15c9590 0x5654c19c1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:10.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.162+0000 7fcf5bfff640 1 -- 172.21.15.12:0/1107443247 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5654c15ea270 msgr2=0x5654c19c1e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:40:10.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.162+0000 7fcf5bfff640 1 --2- 172.21.15.12:0/1107443247 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5654c15ea270 0x5654c19c1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:10.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.162+0000 7fcf5bfff640 1 -- 172.21.15.12:0/1107443247 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5654c198c280 con 0x5654c15c13b0 2024-05-15T15:40:10.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.162+0000 7fcf5bfff640 1 --2- 172.21.15.12:0/1107443247 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5654c15c13b0 0x5654c19a9840 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fcf44009930 tx=0x7fcf4402c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4343f89139d95882 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:10.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.162+0000 7fcf517fa640 1 -- 172.21.15.12:0/1107443247 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf44037040 con 0x5654c15c13b0 2024-05-15T15:40:10.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.162+0000 7fcf517fa640 1 -- 172.21.15.12:0/1107443247 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf44054070 con 0x5654c15c13b0 2024-05-15T15:40:10.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.162+0000 7fcf517fa640 1 -- 172.21.15.12:0/1107443247 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf44032e60 con 0x5654c15c13b0 2024-05-15T15:40:10.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.163+0000 7fcf691bc740 1 -- 172.21.15.12:0/1107443247 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5654c15c13b0 msgr2=0x5654c19a9840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:10.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.163+0000 7fcf691bc740 1 --2- 172.21.15.12:0/1107443247 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5654c15c13b0 0x5654c19a9840 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fcf44009930 tx=0x7fcf4402c000 comp rx=0 tx=0).stop 2024-05-15T15:40:10.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.163+0000 7fcf691bc740 1 -- 172.21.15.12:0/1107443247 shutdown_connections 2024-05-15T15:40:10.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.163+0000 7fcf691bc740 1 --2- 172.21.15.12:0/1107443247 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5654c15ea270 0x5654c19c1e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:10.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.163+0000 7fcf691bc740 1 --2- 172.21.15.12:0/1107443247 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x5654c15c9590 0x5654c19c1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:10.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.163+0000 7fcf691bc740 1 --2- 172.21.15.12:0/1107443247 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5654c15c13b0 0x5654c19a9840 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:10.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.163+0000 7fcf691bc740 1 -- 172.21.15.12:0/1107443247 >> 172.21.15.12:0/1107443247 conn(0x5654c15de3c0 msgr2=0x5654c19d8e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:10.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.163+0000 7fcf691bc740 1 -- 172.21.15.12:0/1107443247 shutdown_connections 2024-05-15T15:40:10.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.163+0000 7fcf691bc740 1 -- 172.21.15.12:0/1107443247 wait complete. 2024-05-15T15:40:10.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.164+0000 7fcf691bc740 1 -- start start 2024-05-15T15:40:10.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.164+0000 7fcf691bc740 1 Processor -- start 2024-05-15T15:40:10.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.165+0000 7fcf691bc740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5654c15c13b0 0x5654c1a39f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:10.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.165+0000 7fcf691bc740 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x5654c15c9590 0x5654c1a3a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:10.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.165+0000 7fcf691bc740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5654c15ea270 0x5654c19cadd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:10.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.165+0000 7fcf691bc740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5654c19cf410 con 0x5654c15c13b0 2024-05-15T15:40:10.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.165+0000 7fcf691bc740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5654c19ab970 con 0x5654c15ea270 2024-05-15T15:40:10.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.165+0000 7fcf691bc740 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x5654c19d25c0 con 0x5654c15c9590 2024-05-15T15:40:10.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.165+0000 7fcf691bc740 10 client.0 _ll_register_callbacks cb 0x7fcf54060d90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-15T15:40:10.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.165+0000 7fcf5bfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5654c15c13b0 0x5654c1a39f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:10.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.165+0000 7fcf5bfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5654c15c13b0 0x5654c1a39f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52728/0 (socket says 172.21.15.12:52728) 2024-05-15T15:40:10.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.165+0000 7fcf5bfff640 1 -- 172.21.15.12:0/4093309011 learned_addr learned my addr 172.21.15.12:0/4093309011 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:10.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.165+0000 7fcf5b7fe640 1 --2- 172.21.15.12:0/4093309011 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x5654c15c9590 0x5654c1a3a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:10.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.165+0000 7fcf6089d640 1 --2- 172.21.15.12:0/4093309011 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5654c15ea270 0x5654c19cadd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:10.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.166+0000 7fcf5bfff640 1 -- 172.21.15.12:0/4093309011 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x5654c15c9590 msgr2=0x5654c1a3a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:40:10.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.166+0000 7fcf5bfff640 1 --2- 172.21.15.12:0/4093309011 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x5654c15c9590 0x5654c1a3a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:10.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.166+0000 7fcf5bfff640 1 -- 172.21.15.12:0/4093309011 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5654c15ea270 msgr2=0x5654c19cadd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:40:10.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.166+0000 7fcf5bfff640 1 --2- 172.21.15.12:0/4093309011 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5654c15ea270 0x5654c19cadd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:10.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.166+0000 7fcf5bfff640 1 -- 172.21.15.12:0/4093309011 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5654c19cc630 con 0x5654c15c13b0 2024-05-15T15:40:10.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.166+0000 7fcf5bfff640 1 --2- 172.21.15.12:0/4093309011 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5654c15c13b0 0x5654c1a39f60 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fcf440043b0 tx=0x7fcf44004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c56d4b77ff3b1da server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:10.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.166+0000 7fcf3affd640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-05-15T15:40:10.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.166+0000 7fcf3affd640 1 -- 172.21.15.12:0/4093309011 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf44037040 con 0x5654c15c13b0 2024-05-15T15:40:10.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.166+0000 7fcf3affd640 1 -- 172.21.15.12:0/4093309011 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fcf4404f420 con 0x5654c15c13b0 2024-05-15T15:40:10.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.166+0000 7fcf691bc740 1 -- 172.21.15.12:0/4093309011 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcf44054070 con 0x5654c15c13b0 2024-05-15T15:40:10.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.166+0000 7fcf3affd640 1 -- 172.21.15.12:0/4093309011 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7fcf4405f050 con 0x5654c15c13b0 2024-05-15T15:40:10.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.166+0000 7fcf691bc740 10 client.4635 fetch_fsmap learned FSMap version 7 2024-05-15T15:40:10.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.166+0000 7fcf691bc740 1 -- 172.21.15.12:0/4093309011 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x5654c1a40780 con 0x5654c15c13b0 2024-05-15T15:40:10.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.166+0000 7fcf3affd640 1 -- 172.21.15.12:0/4093309011 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf44054070 con 0x5654c15c13b0 2024-05-15T15:40:10.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.166+0000 7fcf3affd640 1 -- 172.21.15.12:0/4093309011 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 7) ==== 2889+0+0 (secure 0 0 0) 0x7fcf44062020 con 0x5654c15c13b0 2024-05-15T15:40:10.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.166+0000 7fcf691bc740 10 client.4635 fetch_fsmap finished waiting for FSMap version 7 2024-05-15T15:40:10.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.166+0000 7fcf691bc740 10 client.4635 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-15T15:40:10.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.166+0000 7fcf691bc740 20 client.4635 populate_metadata read hostname 'smithi012' 2024-05-15T15:40:10.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.166+0000 7fcf691bc740 1 --2- 172.21.15.12:0/4093309011 >> [v2:172.21.15.84:6834/3699736653,v1:172.21.15.84:6835/3699736653] conn(0x5654c19e2da0 0x5654c19cb310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:10.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.166+0000 7fcf691bc740 4 client.4635 mds_command: new command op to 4288 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-15T15:40:10.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.166+0000 7fcf691bc740 1 -- 172.21.15.12:0/4093309011 --> [v2:172.21.15.84:6834/3699736653,v1:172.21.15.84:6835/3699736653] -- command(tid 0: {"prefix": "status"}) -- 0x5654c19ac100 con 0x5654c19e2da0 2024-05-15T15:40:10.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.166+0000 7fcf5b7fe640 1 --2- 172.21.15.12:0/4093309011 >> [v2:172.21.15.84:6834/3699736653,v1:172.21.15.84:6835/3699736653] conn(0x5654c19e2da0 0x5654c19cb310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:10.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.167+0000 7fcf5b7fe640 1 --2- 172.21.15.12:0/4093309011 >> [v2:172.21.15.84:6834/3699736653,v1:172.21.15.84:6835/3699736653] conn(0x5654c19e2da0 0x5654c19cb310 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d02f0548bd4f067d server_cookie=8f40f47ba5e43caf in_seq=0 out_seq=0 2024-05-15T15:40:10.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.167+0000 7fcf3affd640 10 client.4635 ms_handle_connect on v2:172.21.15.84:6834/3699736653 2024-05-15T15:40:10.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.167+0000 7fcf3affd640 1 -- 172.21.15.12:0/4093309011 <== mds.0 v2:172.21.15.84:6834/3699736653 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x5654c19ac100 con 0x5654c19e2da0 2024-05-15T15:40:10.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.167+0000 7fcf3affd640 10 client.4635 handle_command_reply: tid=0 2024-05-15T15:40:10.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.167+0000 7fcf691bc740 1 client.4635 shutdown 2024-05-15T15:40:10.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.167+0000 7fcf691bc740 1 -- 172.21.15.12:0/4093309011 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5654c15c13b0 msgr2=0x5654c1a39f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:10.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.167+0000 7fcf691bc740 1 --2- 172.21.15.12:0/4093309011 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5654c15c13b0 0x5654c1a39f60 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fcf440043b0 tx=0x7fcf44004730 comp rx=0 tx=0).stop 2024-05-15T15:40:10.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.167+0000 7fcf691bc740 1 -- 172.21.15.12:0/4093309011 shutdown_connections 2024-05-15T15:40:10.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.167+0000 7fcf691bc740 1 --2- 172.21.15.12:0/4093309011 >> [v2:172.21.15.84:6834/3699736653,v1:172.21.15.84:6835/3699736653] conn(0x5654c19e2da0 0x5654c19cb310 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:10.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.167+0000 7fcf691bc740 1 --2- 172.21.15.12:0/4093309011 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5654c15ea270 0x5654c19cadd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:10.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.167+0000 7fcf691bc740 1 --2- 172.21.15.12:0/4093309011 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x5654c15c9590 0x5654c1a3a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:10.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.167+0000 7fcf3affd640 0 client.4635 ms_handle_reset on v2:172.21.15.84:6834/3699736653 2024-05-15T15:40:10.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.167+0000 7fcf691bc740 1 --2- 172.21.15.12:0/4093309011 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5654c15c13b0 0x5654c1a39f60 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:10.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.167+0000 7fcf691bc740 1 -- 172.21.15.12:0/4093309011 >> 172.21.15.12:0/4093309011 conn(0x5654c15de3c0 msgr2=0x5654c19a9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:10.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.167+0000 7fcf691bc740 1 -- 172.21.15.12:0/4093309011 shutdown_connections 2024-05-15T15:40:10.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.167+0000 7fcf691bc740 1 -- 172.21.15.12:0/4093309011 wait complete. 2024-05-15T15:40:10.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.167+0000 7fcf691bc740 20 client.4635 trim_cache size 0 max 16384 2024-05-15T15:40:10.180 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-05-15T15:40:10.180 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_fsid": "3b7fc4b2-b85c-49b5-a5de-38444eeed40d", 2024-05-15T15:40:10.180 INFO:teuthology.orchestra.run.smithi012.stdout: "whoami": 0, 2024-05-15T15:40:10.180 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 4288, 2024-05-15T15:40:10.180 INFO:teuthology.orchestra.run.smithi012.stdout: "want_state": "up:active", 2024-05-15T15:40:10.181 INFO:teuthology.orchestra.run.smithi012.stdout: "state": "up:active", 2024-05-15T15:40:10.181 INFO:teuthology.orchestra.run.smithi012.stdout: "fs_name": "cephfs", 2024-05-15T15:40:10.181 INFO:teuthology.orchestra.run.smithi012.stdout: "rank_uptime": 17.724256352000001, 2024-05-15T15:40:10.181 INFO:teuthology.orchestra.run.smithi012.stdout: "mdsmap_epoch": 7, 2024-05-15T15:40:10.181 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch": 23, 2024-05-15T15:40:10.181 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch_barrier": 23, 2024-05-15T15:40:10.181 INFO:teuthology.orchestra.run.smithi012.stdout: "uptime": 23.892084612000001 2024-05-15T15:40:10.181 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-05-15T15:40:10.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.168+0000 7fcf62300640 1 -- 172.21.15.12:0/1483527050 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fcf3c0762d0 msgr2=0x7fcf3c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:10.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.168+0000 7fcf62300640 1 --2- 172.21.15.12:0/1483527050 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fcf3c0762d0 0x7fcf3c0787e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fcf44034000 tx=0x7fcf4402e000 comp rx=0 tx=0).stop 2024-05-15T15:40:10.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.168+0000 7fcf62300640 1 -- 172.21.15.12:0/1483527050 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf5c151fc0 msgr2=0x7fcf5c14b0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:10.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.168+0000 7fcf62300640 1 --2- 172.21.15.12:0/1483527050 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf5c151fc0 0x7fcf5c14b0c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fcf54009d30 tx=0x7fcf5400c490 comp rx=0 tx=0).stop 2024-05-15T15:40:10.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.168+0000 7fcf62300640 1 -- 172.21.15.12:0/1483527050 shutdown_connections 2024-05-15T15:40:10.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.168+0000 7fcf62300640 1 --2- 172.21.15.12:0/1483527050 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fcf3c0762d0 0x7fcf3c0787e0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:10.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.168+0000 7fcf62300640 1 --2- 172.21.15.12:0/1483527050 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf5c151fc0 0x7fcf5c14b0c0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:10.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.168+0000 7fcf62300640 1 --2- 172.21.15.12:0/1483527050 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf5c06de40 0x7fcf5c1e78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:10.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.168+0000 7fcf62300640 1 --2- 172.21.15.12:0/1483527050 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fcf5c06da30 0x7fcf5c0b7c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:10.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.168+0000 7fcf62300640 1 -- 172.21.15.12:0/1483527050 >> 172.21.15.12:0/1483527050 conn(0x7fcf5c0c3d20 msgr2=0x7fcf5c0a3380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:10.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.168+0000 7fcf62300640 1 -- 172.21.15.12:0/1483527050 shutdown_connections 2024-05-15T15:40:10.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.168+0000 7fcf62300640 1 -- 172.21.15.12:0/1483527050 wait complete. 2024-05-15T15:40:10.185 INFO:teuthology.run_tasks:Running task sequential... 2024-05-15T15:40:10.211 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-05-15T15:40:10.212 INFO:teuthology.task.sequential:In sequential, running task print... 2024-05-15T15:40:10.221 INFO:teuthology.task.print:Enabling mgr modules 2024-05-15T15:40:10.221 INFO:teuthology.run_tasks:Running task kclient... 2024-05-15T15:40:10.317 INFO:tasks.kclient:Mounting kernel clients... 2024-05-15T15:40:10.317 INFO:tasks.kclient:config is {'client.0': {}} 2024-05-15T15:40:10.318 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-15T15:40:10.318 DEBUG:teuthology.orchestra.run.smithi104:> ip netns list 2024-05-15T15:40:10.378 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-15T15:40:10.378 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip link delete ceph-brx 2024-05-15T15:40:10.472 INFO:teuthology.orchestra.run.smithi104.stderr:Cannot find device "ceph-brx" 2024-05-15T15:40:10.476 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-15T15:40:10.477 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2024-05-15T15:40:10.477 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-15T15:40:10.477 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-15T15:40:10.477 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-15T15:40:10.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.591+0000 7f32e34af640 1 Processor -- start 2024-05-15T15:40:10.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.591+0000 7f32e34af640 1 -- start start 2024-05-15T15:40:10.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.592+0000 7f32e34af640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f32dc0bd6d0 0x7f32dc0be940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:10.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.592+0000 7f32e34af640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32dc06e140 con 0x7f32dc0bee80 2024-05-15T15:40:10.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.592+0000 7f32e34af640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32dc0c36f0 con 0x7f32dc151fc0 2024-05-15T15:40:10.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.592+0000 7f32e34af640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f32dc152530 con 0x7f32dc0bd6d0 2024-05-15T15:40:10.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.592+0000 7f32e1a4c640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f32dc0bee80 0x7f32dc158e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:43820/0 (socket says 172.21.15.12:43820) 2024-05-15T15:40:10.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.592+0000 7f32e1a4c640 1 -- 172.21.15.12:0/1617977396 learned_addr learned my addr 172.21.15.12:0/1617977396 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-05-15T15:40:10.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.593+0000 7f32e0a4a640 1 --2- 172.21.15.12:0/1617977396 >> v2:172.21.15.84:3300/0 conn(0x7f32dc0bd6d0 0x7f32dc0be940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:10.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.593+0000 7f32cffff640 1 -- 172.21.15.12:0/1617977396 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2475050324 0 0) 0x7f32d4001490 con 0x7f32dc0bee80 2024-05-15T15:40:10.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.593+0000 7f32cffff640 1 -- 172.21.15.12:0/1617977396 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f32c8003520 con 0x7f32dc0bee80 2024-05-15T15:40:10.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.593+0000 7f32e0a4a640 1 -- 172.21.15.12:0/1617977396 >> v1:172.21.15.84:6789/0 conn(0x7f32dc151fc0 legacy=0x7f32dc06da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:10.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.593+0000 7f32e0a4a640 1 -- 172.21.15.12:0/1617977396 >> v1:172.21.15.12:6789/0 conn(0x7f32dc0bee80 legacy=0x7f32dc158e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:10.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.593+0000 7f32cffff640 1 -- 172.21.15.12:0/1617977396 <== mon.1 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2627127268 0 0) 0x7f32dc0c36f0 con 0x7f32dc151fc0 2024-05-15T15:40:10.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.593+0000 7f32e0a4a640 1 -- 172.21.15.12:0/1617977396 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32dc152810 con 0x7f32dc0bd6d0 2024-05-15T15:40:10.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.594+0000 7f32e0a4a640 1 --2- 172.21.15.12:0/1617977396 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f32dc0bd6d0 0x7f32dc0be940 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f32d80097a0 tx=0x7f32d802a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fd5a2e4e61c9717 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:10.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.594+0000 7f32cffff640 1 -- 172.21.15.12:0/1617977396 <== mon.1 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32d8037070 con 0x7f32dc0bd6d0 2024-05-15T15:40:10.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.594+0000 7f32cffff640 1 -- 172.21.15.12:0/1617977396 <== mon.1 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32d802ab90 con 0x7f32dc0bd6d0 2024-05-15T15:40:10.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.594+0000 7f32cffff640 1 -- 172.21.15.12:0/1617977396 <== mon.1 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32d4001be0 con 0x7f32dc0bd6d0 2024-05-15T15:40:10.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.595+0000 7f32e34af640 1 -- 172.21.15.12:0/1617977396 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f32dc0bd6d0 msgr2=0x7f32dc0be940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:10.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.595+0000 7f32e34af640 1 --2- 172.21.15.12:0/1617977396 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f32dc0bd6d0 0x7f32dc0be940 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f32d80097a0 tx=0x7f32d802a100 comp rx=0 tx=0).stop 2024-05-15T15:40:10.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.595+0000 7f32e34af640 1 -- 172.21.15.12:0/1617977396 shutdown_connections 2024-05-15T15:40:10.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.595+0000 7f32e34af640 1 --2- 172.21.15.12:0/1617977396 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f32dc0bd6d0 0x7f32dc0be940 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:10.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.595+0000 7f32e34af640 1 -- 172.21.15.12:0/1617977396 >> 172.21.15.12:0/1617977396 conn(0x7f32dc0c3d20 msgr2=0x7f32dc0c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:10.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.595+0000 7f32e34af640 1 -- 172.21.15.12:0/1617977396 shutdown_connections 2024-05-15T15:40:10.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.595+0000 7f32e34af640 1 -- 172.21.15.12:0/1617977396 wait complete. 2024-05-15T15:40:10.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.596+0000 7f32e34af640 1 Processor -- start 2024-05-15T15:40:10.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.596+0000 7f32e34af640 1 -- start start 2024-05-15T15:40:10.600 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.597+0000 7f32e34af640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f32dc0bd6d0 0x7f32dc1e7b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:10.601 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.598+0000 7f32e34af640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f32dc0bee80 0x7f32dc14e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:10.601 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.598+0000 7f32e34af640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f32dc151fc0 0x7f32dc14af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:10.601 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.598+0000 7f32e34af640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f32dc0bdae0 con 0x7f32dc151fc0 2024-05-15T15:40:10.601 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.598+0000 7f32e34af640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f32dc0c0070 con 0x7f32dc0bee80 2024-05-15T15:40:10.601 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.598+0000 7f32e34af640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f32dc0a2ed0 con 0x7f32dc0bd6d0 2024-05-15T15:40:10.601 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.598+0000 7f32e1a4c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f32dc151fc0 0x7f32dc14af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:10.601 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.598+0000 7f32e1a4c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f32dc151fc0 0x7f32dc14af10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52736/0 (socket says 172.21.15.12:52736) 2024-05-15T15:40:10.601 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.598+0000 7f32e1a4c640 1 -- 172.21.15.12:0/2407421215 learned_addr learned my addr 172.21.15.12:0/2407421215 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:10.601 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.598+0000 7f32e0a4a640 1 --2- 172.21.15.12:0/2407421215 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f32dc0bee80 0x7f32dc14e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:10.601 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.598+0000 7f32e124b640 1 --2- 172.21.15.12:0/2407421215 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f32dc0bd6d0 0x7f32dc1e7b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:10.601 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.598+0000 7f32e1a4c640 1 -- 172.21.15.12:0/2407421215 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f32dc0bd6d0 msgr2=0x7f32dc1e7b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:10.601 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.598+0000 7f32e1a4c640 1 --2- 172.21.15.12:0/2407421215 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f32dc0bd6d0 0x7f32dc1e7b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:10.601 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.598+0000 7f32e1a4c640 1 -- 172.21.15.12:0/2407421215 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f32dc0bee80 msgr2=0x7f32dc14e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:10.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.598+0000 7f32e1a4c640 1 --2- 172.21.15.12:0/2407421215 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f32dc0bee80 0x7f32dc14e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:10.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.598+0000 7f32e1a4c640 1 -- 172.21.15.12:0/2407421215 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32dc14f430 con 0x7f32dc151fc0 2024-05-15T15:40:10.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.598+0000 7f32e124b640 1 --2- 172.21.15.12:0/2407421215 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f32dc0bd6d0 0x7f32dc1e7b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-15T15:40:10.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.598+0000 7f32e1a4c640 1 --2- 172.21.15.12:0/2407421215 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f32dc151fc0 0x7f32dc14af10 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f32d4001790 tx=0x7f32d400cf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:10.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.598+0000 7f32cdffb640 1 -- 172.21.15.12:0/2407421215 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32d4018070 con 0x7f32dc151fc0 2024-05-15T15:40:10.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.598+0000 7f32cdffb640 1 -- 172.21.15.12:0/2407421215 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32d400a610 con 0x7f32dc151fc0 2024-05-15T15:40:10.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.598+0000 7f32e34af640 1 -- 172.21.15.12:0/2407421215 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32dc1e8040 con 0x7f32dc151fc0 2024-05-15T15:40:10.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.598+0000 7f32cdffb640 1 -- 172.21.15.12:0/2407421215 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32d400aa00 con 0x7f32dc151fc0 2024-05-15T15:40:10.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.599+0000 7f32e34af640 1 -- 172.21.15.12:0/2407421215 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32dc14f150 con 0x7f32dc151fc0 2024-05-15T15:40:10.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.599+0000 7f32e34af640 1 -- 172.21.15.12:0/2407421215 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32dc050940 con 0x7f32dc151fc0 2024-05-15T15:40:10.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.600+0000 7f32cdffb640 1 -- 172.21.15.12:0/2407421215 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f32d401b070 con 0x7f32dc151fc0 2024-05-15T15:40:10.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.601+0000 7f32cdffb640 1 --2- 172.21.15.12:0/2407421215 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f32c0076300 0x7f32c0078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:10.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.601+0000 7f32cdffb640 1 -- 172.21.15.12:0/2407421215 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f32d4096e30 con 0x7f32dc151fc0 2024-05-15T15:40:10.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.601+0000 7f32e124b640 1 --2- 172.21.15.12:0/2407421215 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f32c0076300 0x7f32c0078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:10.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.601+0000 7f32e124b640 1 --2- 172.21.15.12:0/2407421215 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f32c0076300 0x7f32c0078810 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f32d0000f60 tx=0x7f32d0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:10.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.606+0000 7f32cdffb640 1 -- 172.21.15.12:0/2407421215 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f32dc06e140 con 0x7f32dc151fc0 2024-05-15T15:40:10.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.839+0000 7f32e34af640 1 -- 172.21.15.12:0/2407421215 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f32dc0c4480 con 0x7f32dc151fc0 2024-05-15T15:40:10.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.839+0000 7f32cdffb640 1 -- 172.21.15.12:0/2407421215 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) ==== 53+0+73 (secure 0 0 0) 0x7f32d40600b0 con 0x7f32dc151fc0 2024-05-15T15:40:10.842 INFO:teuthology.orchestra.run.smithi012.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-15T15:40:10.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.842+0000 7f32e34af640 1 -- 172.21.15.12:0/2407421215 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f32c0076300 msgr2=0x7f32c0078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:10.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.842+0000 7f32e34af640 1 --2- 172.21.15.12:0/2407421215 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f32c0076300 0x7f32c0078810 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f32d0000f60 tx=0x7f32d0009040 comp rx=0 tx=0).stop 2024-05-15T15:40:10.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.842+0000 7f32e34af640 1 -- 172.21.15.12:0/2407421215 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f32dc151fc0 msgr2=0x7f32dc14af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:10.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.842+0000 7f32e34af640 1 --2- 172.21.15.12:0/2407421215 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f32dc151fc0 0x7f32dc14af10 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f32d4001790 tx=0x7f32d400cf00 comp rx=0 tx=0).stop 2024-05-15T15:40:10.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.842+0000 7f32e34af640 1 -- 172.21.15.12:0/2407421215 shutdown_connections 2024-05-15T15:40:10.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.842+0000 7f32e34af640 1 --2- 172.21.15.12:0/2407421215 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f32c0076300 0x7f32c0078810 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:10.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.842+0000 7f32e34af640 1 --2- 172.21.15.12:0/2407421215 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f32dc151fc0 0x7f32dc14af10 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:10.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.842+0000 7f32e34af640 1 --2- 172.21.15.12:0/2407421215 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f32dc0bee80 0x7f32dc14e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:10.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.842+0000 7f32e34af640 1 --2- 172.21.15.12:0/2407421215 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f32dc0bd6d0 0x7f32dc1e7b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:10.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.842+0000 7f32e34af640 1 -- 172.21.15.12:0/2407421215 >> 172.21.15.12:0/2407421215 conn(0x7f32dc0c3d20 msgr2=0x7f32dc0c0940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:10.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.842+0000 7f32e34af640 1 -- 172.21.15.12:0/2407421215 shutdown_connections 2024-05-15T15:40:10.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:10.842+0000 7f32e34af640 1 -- 172.21.15.12:0/2407421215 wait complete. 2024-05-15T15:40:10.855 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-15T15:40:10.856 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-15T15:40:10.856 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi104.front.sepia.ceph.com 2024-05-15T15:40:10.856 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-15T15:40:10.856 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-15T15:40:10.856 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-15T15:40:10.856 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-15T15:40:10.856 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-15T15:40:10.857 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-15T15:40:10.857 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-15T15:40:10.857 DEBUG:teuthology.orchestra.run.smithi104:> ip addr 2024-05-15T15:40:10.909 INFO:teuthology.orchestra.run.smithi104.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-15T15:40:10.909 INFO:teuthology.orchestra.run.smithi104.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-15T15:40:10.909 INFO:teuthology.orchestra.run.smithi104.stdout: inet 127.0.0.1/8 scope host lo 2024-05-15T15:40:10.909 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-05-15T15:40:10.909 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 ::1/128 scope host 2024-05-15T15:40:10.909 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-05-15T15:40:10.909 INFO:teuthology.orchestra.run.smithi104.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-15T15:40:10.909 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 0c:c4:7a:d8:a1:1c brd ff:ff:ff:ff:ff:ff 2024-05-15T15:40:10.909 INFO:teuthology.orchestra.run.smithi104.stdout: altname enp7s0f0 2024-05-15T15:40:10.910 INFO:teuthology.orchestra.run.smithi104.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-15T15:40:10.910 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 0c:c4:7a:d8:a1:1d brd ff:ff:ff:ff:ff:ff 2024-05-15T15:40:10.910 INFO:teuthology.orchestra.run.smithi104.stdout: altname enp7s0f1 2024-05-15T15:40:10.910 INFO:teuthology.orchestra.run.smithi104.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-15T15:40:10.910 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 0c:c4:7a:8f:ce:88 brd ff:ff:ff:ff:ff:ff 2024-05-15T15:40:10.910 INFO:teuthology.orchestra.run.smithi104.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-15T15:40:10.910 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 0c:c4:7a:8f:ce:89 brd ff:ff:ff:ff:ff:ff 2024-05-15T15:40:10.910 INFO:teuthology.orchestra.run.smithi104.stdout: inet 172.21.15.104/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-05-15T15:40:10.910 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft 42626sec preferred_lft 42626sec 2024-05-15T15:40:10.910 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 fe80::ec4:7aff:fe8f:ce89/64 scope link 2024-05-15T15:40:10.910 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-05-15T15:40:10.912 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-15T15:40:10.912 DEBUG:teuthology.orchestra.run.smithi104:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-15T15:40:10.913 DEBUG:teuthology.orchestra.run.smithi104:> set -e 2024-05-15T15:40:10.913 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip link add name ceph-brx type bridge 2024-05-15T15:40:10.913 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip addr flush dev ceph-brx 2024-05-15T15:40:10.913 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip link set ceph-brx up 2024-05-15T15:40:10.913 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-15T15:40:10.913 DEBUG:teuthology.orchestra.run.smithi104:> ') 2024-05-15T15:40:11.008 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-15T15:40:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-15T15:40:11.388 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-15T15:40:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-15T15:40:11.398 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-15T15:40:11.398 DEBUG:teuthology.orchestra.run.smithi104:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-15T15:40:11.462 INFO:teuthology.orchestra.run.smithi104.stdout:1 2024-05-15T15:40:11.466 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-15T15:40:11.466 DEBUG:teuthology.orchestra.run.smithi104:> route 2024-05-15T15:40:11.523 INFO:teuthology.orchestra.run.smithi104.stdout:Kernel IP routing table 2024-05-15T15:40:11.523 INFO:teuthology.orchestra.run.smithi104.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-15T15:40:11.523 INFO:teuthology.orchestra.run.smithi104.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-15T15:40:11.523 INFO:teuthology.orchestra.run.smithi104.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-15T15:40:11.523 INFO:teuthology.orchestra.run.smithi104.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-15T15:40:11.524 DEBUG:teuthology.orchestra.run.smithi104:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-15T15:40:11.524 DEBUG:teuthology.orchestra.run.smithi104:> set -e 2024-05-15T15:40:11.524 DEBUG:teuthology.orchestra.run.smithi104:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-15T15:40:11.524 DEBUG:teuthology.orchestra.run.smithi104:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-15T15:40:11.524 DEBUG:teuthology.orchestra.run.smithi104:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-15T15:40:11.524 DEBUG:teuthology.orchestra.run.smithi104:> ') 2024-05-15T15:40:11.627 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-15T15:40:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-15T15:40:12.243 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-15T15:40:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-15T15:40:12.253 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-15T15:40:12.254 DEBUG:teuthology.orchestra.run.smithi104:> ip netns list 2024-05-15T15:40:12.305 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-15T15:40:12.305 DEBUG:teuthology.orchestra.run.smithi104:> ip netns list-id 2024-05-15T15:40:12.355 DEBUG:teuthology.orchestra.run.smithi104:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-15T15:40:12.355 DEBUG:teuthology.orchestra.run.smithi104:> set -e 2024-05-15T15:40:12.355 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-15T15:40:12.355 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-05-15T15:40:12.355 DEBUG:teuthology.orchestra.run.smithi104:> ') 2024-05-15T15:40:12.455 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-15T15:40:12 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-15T15:40:12.526 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-15T15:40:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-15T15:40:12.537 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-05-15T15:40:12.537 DEBUG:teuthology.orchestra.run.smithi104:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-15T15:40:12.537 DEBUG:teuthology.orchestra.run.smithi104:> set -e 2024-05-15T15:40:12.537 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-05-15T15:40:12.537 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-15T15:40:12.537 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-05-15T15:40:12.537 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-05-15T15:40:12.537 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-05-15T15:40:12.537 DEBUG:teuthology.orchestra.run.smithi104:> ') 2024-05-15T15:40:12.632 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-15T15:40:12 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-15T15:40:12.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-15T15:40:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-15T15:40:12.821 DEBUG:teuthology.orchestra.run.smithi104:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-15T15:40:12.821 DEBUG:teuthology.orchestra.run.smithi104:> set -e 2024-05-15T15:40:12.822 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip link set brx.0 up 2024-05-15T15:40:12.822 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip link set dev brx.0 master ceph-brx 2024-05-15T15:40:12.822 DEBUG:teuthology.orchestra.run.smithi104:> ') 2024-05-15T15:40:12.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-15T15:40:12 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-15T15:40:13.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-15T15:40:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-15T15:40:13.021 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-15T15:40:13.022 DEBUG:teuthology.orchestra.run.smithi104:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-15T15:40:13.064 INFO:teuthology.orchestra.run.smithi104.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-15T15:40:13.065 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-15T15:40:13.065 DEBUG:teuthology.orchestra.run.smithi104:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-15T15:40:13.157 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-05-15T15:40:13.158 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-15T15:40:13.158 DEBUG:teuthology.orchestra.run.smithi104:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-15T15:40:13.372 INFO:teuthology.orchestra.run.smithi104.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-15T15:40:13.372 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-15T15:40:13.372 INFO:teuthology.orchestra.run.smithi104.stdout:invalid new device string format 2024-05-15T15:40:14.094 INFO:teuthology.orchestra.run.smithi104.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-15T15:40:14.094 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-15T15:40:14.095 INFO:teuthology.orchestra.run.smithi104.stdout:invalid new device string format 2024-05-15T15:40:14.095 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: resolved to: "172.21.15.12:3300,172.21.15.84:3300,172.21.15.84:3301" 2024-05-15T15:40:14.095 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-15T15:40:14.150 INFO:teuthology.orchestra.run.smithi104.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-15T15:40:14.150 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-15T15:40:14.150 INFO:teuthology.orchestra.run.smithi104.stdout:invalid new device string format 2024-05-15T15:40:14.151 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: resolved to: "172.21.15.12:3300,172.21.15.84:3300,172.21.15.84:3301" 2024-05-15T15:40:14.151 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-15T15:40:14.151 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: resolved to: "172.21.15.12:6789,172.21.15.84:6789,172.21.15.84:6790" 2024-05-15T15:40:14.151 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.12:6789,172.21.15.84:6789,172.21.15.84:6790:/ 2024-05-15T15:40:14.151 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=3b7fc4b2-b85c-49b5-a5de-38444eeed40d" will pass to kernel 2024-05-15T15:40:14.157 INFO:teuthology.orchestra.run.smithi104.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-05-15T15:40:14.157 INFO:teuthology.orchestra.run.smithi104.stdout: You just mounted a file system that supports labels which does not 2024-05-15T15:40:14.157 INFO:teuthology.orchestra.run.smithi104.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-15T15:40:14.157 INFO:teuthology.orchestra.run.smithi104.stdout: applications will generate AVC messages and not be allowed access to 2024-05-15T15:40:14.157 INFO:teuthology.orchestra.run.smithi104.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-15T15:40:14.162 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-15T15:40:14.163 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-15T15:40:14.163 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-15T15:40:14.247 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-15T15:40:14.353 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-15T15:40:14 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-15T15:40:14.366 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-15T15:40:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-15T15:40:14.376 INFO:teuthology.orchestra.run.smithi104.stdout:client4648 2024-05-15T15:40:14.376 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-05-15T15:40:14.376 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-15T15:40:14.428 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-15T15:40:14.538 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-15T15:40:14 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-15T15:40:14.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-15T15:40:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-15T15:40:14.559 INFO:teuthology.orchestra.run.smithi104.stdout:client4648 2024-05-15T15:40:14.559 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-15T15:40:14.669 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-15T15:40:14 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-15T15:40:14.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-15T15:40:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-15T15:40:14.692 INFO:teuthology.orchestra.run.smithi104.stdout:client4648 2024-05-15T15:40:14.692 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/3b7fc4b2-b85c-49b5-a5de-38444eeed40d.client4648/status') 2024-05-15T15:40:14.796 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-15T15:40:14 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-15T15:40:14.831 INFO:teuthology.orchestra.run.smithi104.stdout:instance: client.4648 (3)172.21.15.104:0/2242784731 2024-05-15T15:40:14.831 INFO:teuthology.orchestra.run.smithi104.stdout:blocklisted: false 2024-05-15T15:40:14.831 INFO:teuthology.orchestra.run.smithi104.stderr:0+1 records in 2024-05-15T15:40:14.832 INFO:teuthology.orchestra.run.smithi104.stderr:0+1 records out 2024-05-15T15:40:14.832 INFO:teuthology.orchestra.run.smithi104.stderr:71 bytes copied, 0.000141211 s, 503 kB/s 2024-05-15T15:40:14.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-15T15:40:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-15T15:40:14.846 INFO:teuthology.run_tasks:Running task full_sequential_finally... 2024-05-15T15:40:14.879 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-05-15T15:40:15.034 INFO:tasks.cephfs_test_runner:Starting test: test_fscrypt_basic_mount (tasks.cephfs.test_fscrypt.TestFSCrypt) That fscrypt can be setup and ingest files. 2024-05-15T15:40:15.034 INFO:tasks.cephfs_test_runner:test_fscrypt_basic_mount (tasks.cephfs.test_fscrypt.TestFSCrypt) 2024-05-15T15:40:15.034 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-15T15:40:15.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.158+0000 7f34d4b72640 1 Processor -- start 2024-05-15T15:40:15.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.159+0000 7f34d4b72640 1 -- start start 2024-05-15T15:40:15.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.160+0000 7f34d4b72640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f34d014e530 0x7f34d00ba320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:15.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.160+0000 7f34d4b72640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f34d00bd440 0x7f34d00bd850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:15.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.160+0000 7f34d4b72640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34d00ba860 con 0x7f34d00b8d70 2024-05-15T15:40:15.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.160+0000 7f34d4b72640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f34d00b88e0 con 0x7f34d014e530 2024-05-15T15:40:15.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.160+0000 7f34d4b72640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f34d014ece0 con 0x7f34d00bd440 2024-05-15T15:40:15.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.160+0000 7f34ce59c640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f34d014e530 0x7f34d00ba320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:15.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.160+0000 7f34ced9d640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f34d00b8d70 0x7f34d00b9180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:43828/0 (socket says 172.21.15.12:43828) 2024-05-15T15:40:15.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.160+0000 7f34ced9d640 1 -- 172.21.15.12:0/877571002 learned_addr learned my addr 172.21.15.12:0/877571002 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-05-15T15:40:15.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.160+0000 7f34cdd9b640 1 --2- 172.21.15.12:0/877571002 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f34d00bd440 0x7f34d00bd850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:15.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.160+0000 7f34ce59c640 1 -- 172.21.15.12:0/877571002 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f34d00bd440 msgr2=0x7f34d00bd850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:40:15.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.160+0000 7f34ce59c640 1 --2- 172.21.15.12:0/877571002 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f34d00bd440 0x7f34d00bd850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:15.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.160+0000 7f34ce59c640 1 -- 172.21.15.12:0/877571002 >> v1:172.21.15.12:6789/0 conn(0x7f34d00b8d70 legacy=0x7f34d00b9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:15.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.160+0000 7f34ce59c640 1 -- 172.21.15.12:0/877571002 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34d00bdd90 con 0x7f34d014e530 2024-05-15T15:40:15.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.161+0000 7f34ce59c640 1 --2- 172.21.15.12:0/877571002 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f34d014e530 0x7f34d00ba320 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f34c8009790 tx=0x7f34c802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55d7ca243cd27ab4 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:15.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.161+0000 7f34cd59a640 1 -- 172.21.15.12:0/877571002 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34c8037070 con 0x7f34d014e530 2024-05-15T15:40:15.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.161+0000 7f34cd59a640 1 -- 172.21.15.12:0/877571002 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34c8032440 con 0x7f34d014e530 2024-05-15T15:40:15.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.161+0000 7f34cd59a640 1 -- 172.21.15.12:0/877571002 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34c8032810 con 0x7f34d014e530 2024-05-15T15:40:15.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.162+0000 7f34d4b72640 1 -- 172.21.15.12:0/877571002 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f34d014e530 msgr2=0x7f34d00ba320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:15.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.162+0000 7f34d4b72640 1 --2- 172.21.15.12:0/877571002 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f34d014e530 0x7f34d00ba320 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f34c8009790 tx=0x7f34c802a180 comp rx=0 tx=0).stop 2024-05-15T15:40:15.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.162+0000 7f34d4b72640 1 -- 172.21.15.12:0/877571002 shutdown_connections 2024-05-15T15:40:15.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.162+0000 7f34d4b72640 1 --2- 172.21.15.12:0/877571002 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f34d00bd440 0x7f34d00bd850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:15.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.162+0000 7f34d4b72640 1 --2- 172.21.15.12:0/877571002 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f34d014e530 0x7f34d00ba320 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:15.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.162+0000 7f34d4b72640 1 -- 172.21.15.12:0/877571002 >> 172.21.15.12:0/877571002 conn(0x7f34d00c0570 msgr2=0x7f34d00c0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:15.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.162+0000 7f34d4b72640 1 -- 172.21.15.12:0/877571002 shutdown_connections 2024-05-15T15:40:15.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.162+0000 7f34d4b72640 1 -- 172.21.15.12:0/877571002 wait complete. 2024-05-15T15:40:15.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.164+0000 7f34d4b72640 1 Processor -- start 2024-05-15T15:40:15.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.164+0000 7f34d4b72640 1 -- start start 2024-05-15T15:40:15.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.165+0000 7f34d4b72640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34d00b8d70 0x7f34d014b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:15.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.165+0000 7f34d4b72640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f34d00bd440 0x7f34d01e7930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:15.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.165+0000 7f34d4b72640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f34d014e530 0x7f34d01435b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:15.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.165+0000 7f34d4b72640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f34d00bbb70 con 0x7f34d00bd440 2024-05-15T15:40:15.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.165+0000 7f34d4b72640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f34d014f2a0 con 0x7f34d00b8d70 2024-05-15T15:40:15.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.165+0000 7f34d4b72640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f34d014e940 con 0x7f34d014e530 2024-05-15T15:40:15.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.165+0000 7f34cdd9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f34d00bd440 0x7f34d01e7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:15.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.165+0000 7f34cdd9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f34d00bd440 0x7f34d01e7930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52754/0 (socket says 172.21.15.12:52754) 2024-05-15T15:40:15.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.165+0000 7f34cdd9b640 1 -- 172.21.15.12:0/950465839 learned_addr learned my addr 172.21.15.12:0/950465839 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:15.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.165+0000 7f34ced9d640 1 --2- 172.21.15.12:0/950465839 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f34d014e530 0x7f34d01435b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:15.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.165+0000 7f34ce59c640 1 --2- 172.21.15.12:0/950465839 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34d00b8d70 0x7f34d014b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:15.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.165+0000 7f34cdd9b640 1 -- 172.21.15.12:0/950465839 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f34d014e530 msgr2=0x7f34d01435b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:15.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.165+0000 7f34cdd9b640 1 --2- 172.21.15.12:0/950465839 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f34d014e530 0x7f34d01435b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:15.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.165+0000 7f34cdd9b640 1 -- 172.21.15.12:0/950465839 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34d00b8d70 msgr2=0x7f34d014b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:15.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.165+0000 7f34cdd9b640 1 --2- 172.21.15.12:0/950465839 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34d00b8d70 0x7f34d014b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:15.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.165+0000 7f34cdd9b640 1 -- 172.21.15.12:0/950465839 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34d014bba0 con 0x7f34d00bd440 2024-05-15T15:40:15.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.165+0000 7f34ce59c640 1 --2- 172.21.15.12:0/950465839 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34d00b8d70 0x7f34d014b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-15T15:40:15.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.166+0000 7f34cdd9b640 1 --2- 172.21.15.12:0/950465839 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f34d00bd440 0x7f34d01e7930 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f34b800d5f0 tx=0x7f34b800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:15.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.166+0000 7f34c6ffd640 1 -- 172.21.15.12:0/950465839 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34b80125f0 con 0x7f34d00bd440 2024-05-15T15:40:15.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.166+0000 7f34c6ffd640 1 -- 172.21.15.12:0/950465839 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34b8019070 con 0x7f34d00bd440 2024-05-15T15:40:15.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.166+0000 7f34d4b72640 1 -- 172.21.15.12:0/950465839 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34d01e7e70 con 0x7f34d00bd440 2024-05-15T15:40:15.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.166+0000 7f34c6ffd640 1 -- 172.21.15.12:0/950465839 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34b80129d0 con 0x7f34d00bd440 2024-05-15T15:40:15.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.166+0000 7f34d4b72640 1 -- 172.21.15.12:0/950465839 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34d01d9b00 con 0x7f34d00bd440 2024-05-15T15:40:15.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.167+0000 7f34d4b72640 1 -- 172.21.15.12:0/950465839 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34d0148e40 con 0x7f34d00bd440 2024-05-15T15:40:15.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.168+0000 7f34c6ffd640 1 -- 172.21.15.12:0/950465839 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f34b8012b70 con 0x7f34d00bd440 2024-05-15T15:40:15.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.168+0000 7f34c6ffd640 1 --2- 172.21.15.12:0/950465839 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f34b0076300 0x7f34b0078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:15.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.168+0000 7f34c6ffd640 1 -- 172.21.15.12:0/950465839 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f34b80979e0 con 0x7f34d00bd440 2024-05-15T15:40:15.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.168+0000 7f34ce59c640 1 --2- 172.21.15.12:0/950465839 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f34b0076300 0x7f34b0078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:15.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.169+0000 7f34ce59c640 1 --2- 172.21.15.12:0/950465839 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f34b0076300 0x7f34b0078810 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f34c8034000 tx=0x7f34c802e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:15.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.173+0000 7f34c6ffd640 1 -- 172.21.15.12:0/950465839 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f34d0148e40 con 0x7f34d00bd440 2024-05-15T15:40:15.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.364+0000 7f34d4b72640 1 -- 172.21.15.12:0/950465839 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f34d0050940 con 0x7f34d00bd440 2024-05-15T15:40:15.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.366+0000 7f34c6ffd640 1 -- 172.21.15.12:0/950465839 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16573 (secure 0 0 0) 0x7f34b80612b0 con 0x7f34d00bd440 2024-05-15T15:40:15.368 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-05-15T15:40:15.368 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":23,"fsid":"3b7fc4b2-b85c-49b5-a5de-38444eeed40d","created":"2024-05-15T15:39:28.392476+0000","modified":"2024-05-15T15:39:53.451332+0000","last_up_change":"2024-05-15T15:39:39.363983+0000","last_in_change":"2024-05-15T15:39:30.591216+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-15T15:39:40.715999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-15T15:39:49.598723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-15T15:39:50.783054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0d06a12a-866a-418e-9776-704d74354579","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":3943681952},{"type":"v1","addr":"172.21.15.12:6809","nonce":3943681952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":3943681952},{"type":"v1","addr":"172.21.15.12:6812","nonce":3943681952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":3943681952},{"type":"v1","addr":"172.21.15.12:6821","nonce":3943681952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":3943681952},{"type":"v1","addr":"172.21.15.12:6816","nonce":3943681952}]},"public_addr":"172.21.15.12:6809/3943681952","cluster_addr":"172.21.15.12:6812/3943681952","heartbeat_back_addr":"172.21.15.12:6821/3943681952","heartbeat_front_addr":"172.21.15.12:6816/3943681952","state":["exists","up"]},{"osd":1,"uuid":"09d0fa19-9ef8-4f35-bf99-6e86658c6f10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6811","nonce":1763752148},{"type":"v1","addr":"172.21.15.12:6813","nonce":1763752148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":1763752148},{"type":"v1","addr":"172.21.15.12:6817","nonce":1763752148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":1763752148},{"type":"v1","addr":"172.21.15.12:6827","nonce":1763752148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6819","nonce":1763752148},{"type":"v1","addr":"172.21.15.12:6822","nonce":1763752148}]},"public_addr":"172.21.15.12:6813/1763752148","cluster_addr":"172.21.15.12:6817/1763752148","heartbeat_back_addr":"172.21.15.12:6827/1763752148","heartbeat_front_addr":"172.21.15.12:6822/1763752148","state":["exists","up"]},{"osd":2,"uuid":"b204c6ad-f431-40a5-ba27-9844294f0ece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":2173702802},{"type":"v1","addr":"172.21.15.12:6823","nonce":2173702802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":2173702802},{"type":"v1","addr":"172.21.15.12:6826","nonce":2173702802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":2173702802},{"type":"v1","addr":"172.21.15.12:6831","nonce":2173702802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":2173702802},{"type":"v1","addr":"172.21.15.12:6829","nonce":2173702802}]},"public_addr":"172.21.15.12:6823/2173702802","cluster_addr":"172.21.15.12:6826/2173702802","heartbeat_back_addr":"172.21.15.12:6831/2173702802","heartbeat_front_addr":"172.21.15.12:6829/2173702802","state":["exists","up"]},{"osd":3,"uuid":"660a9ccb-2ee5-42d8-8481-0835047a8260","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":3956443113},{"type":"v1","addr":"172.21.15.12:6801","nonce":3956443113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":3956443113},{"type":"v1","addr":"172.21.15.12:6803","nonce":3956443113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":3956443113},{"type":"v1","addr":"172.21.15.12:6807","nonce":3956443113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":3956443113},{"type":"v1","addr":"172.21.15.12:6805","nonce":3956443113}]},"public_addr":"172.21.15.12:6801/3956443113","cluster_addr":"172.21.15.12:6803/3956443113","heartbeat_back_addr":"172.21.15.12:6807/3956443113","heartbeat_front_addr":"172.21.15.12:6805/3956443113","state":["exists","up"]},{"osd":4,"uuid":"9eef1461-a961-457c-9a78-43b5098a46a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":1021092792},{"type":"v1","addr":"172.21.15.84:6809","nonce":1021092792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":1021092792},{"type":"v1","addr":"172.21.15.84:6811","nonce":1021092792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":1021092792},{"type":"v1","addr":"172.21.15.84:6815","nonce":1021092792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":1021092792},{"type":"v1","addr":"172.21.15.84:6813","nonce":1021092792}]},"public_addr":"172.21.15.84:6809/1021092792","cluster_addr":"172.21.15.84:6811/1021092792","heartbeat_back_addr":"172.21.15.84:6815/1021092792","heartbeat_front_addr":"172.21.15.84:6813/1021092792","state":["exists","up"]},{"osd":5,"uuid":"5f924e2f-6c71-4741-a727-d3710c438431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":3173527851},{"type":"v1","addr":"172.21.15.84:6801","nonce":3173527851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":3173527851},{"type":"v1","addr":"172.21.15.84:6803","nonce":3173527851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":3173527851},{"type":"v1","addr":"172.21.15.84:6807","nonce":3173527851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":3173527851},{"type":"v1","addr":"172.21.15.84:6805","nonce":3173527851}]},"public_addr":"172.21.15.84:6801/3173527851","cluster_addr":"172.21.15.84:6803/3173527851","heartbeat_back_addr":"172.21.15.84:6807/3173527851","heartbeat_front_addr":"172.21.15.84:6805/3173527851","state":["exists","up"]},{"osd":6,"uuid":"efae9975-8c16-4ad3-892f-71f3c59718d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3029180670},{"type":"v1","addr":"172.21.15.84:6817","nonce":3029180670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3029180670},{"type":"v1","addr":"172.21.15.84:6819","nonce":3029180670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3029180670},{"type":"v1","addr":"172.21.15.84:6823","nonce":3029180670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3029180670},{"type":"v1","addr":"172.21.15.84:6821","nonce":3029180670}]},"public_addr":"172.21.15.84:6817/3029180670","cluster_addr":"172.21.15.84:6819/3029180670","heartbeat_back_addr":"172.21.15.84:6823/3029180670","heartbeat_front_addr":"172.21.15.84:6821/3029180670","state":["exists","up"]},{"osd":7,"uuid":"6426efba-ee4d-4e44-83d1-c76c75aec30c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3067620602},{"type":"v1","addr":"172.21.15.84:6825","nonce":3067620602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3067620602},{"type":"v1","addr":"172.21.15.84:6827","nonce":3067620602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":3067620602},{"type":"v1","addr":"172.21.15.84:6831","nonce":3067620602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":3067620602},{"type":"v1","addr":"172.21.15.84:6829","nonce":3067620602}]},"public_addr":"172.21.15.84:6825/3067620602","cluster_addr":"172.21.15.84:6827/3067620602","heartbeat_back_addr":"172.21.15.84:6831/3067620602","heartbeat_front_addr":"172.21.15.84:6829/3067620602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.809514+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.845364+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.762733+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.688597+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.699228+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.747865+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.712415+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.820683+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-15T15:40:15.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.368+0000 7f34d4b72640 1 -- 172.21.15.12:0/950465839 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f34b0076300 msgr2=0x7f34b0078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:15.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.368+0000 7f34d4b72640 1 --2- 172.21.15.12:0/950465839 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f34b0076300 0x7f34b0078810 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f34c8034000 tx=0x7f34c802e000 comp rx=0 tx=0).stop 2024-05-15T15:40:15.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.368+0000 7f34d4b72640 1 -- 172.21.15.12:0/950465839 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f34d00bd440 msgr2=0x7f34d01e7930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:15.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.368+0000 7f34d4b72640 1 --2- 172.21.15.12:0/950465839 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f34d00bd440 0x7f34d01e7930 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f34b800d5f0 tx=0x7f34b800dab0 comp rx=0 tx=0).stop 2024-05-15T15:40:15.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.368+0000 7f34d4b72640 1 -- 172.21.15.12:0/950465839 shutdown_connections 2024-05-15T15:40:15.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.368+0000 7f34d4b72640 1 --2- 172.21.15.12:0/950465839 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f34d014e530 0x7f34d01435b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:15.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.368+0000 7f34d4b72640 1 --2- 172.21.15.12:0/950465839 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f34b0076300 0x7f34b0078810 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:15.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.368+0000 7f34d4b72640 1 --2- 172.21.15.12:0/950465839 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f34d00bd440 0x7f34d01e7930 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:15.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.368+0000 7f34d4b72640 1 --2- 172.21.15.12:0/950465839 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34d00b8d70 0x7f34d014b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:15.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.368+0000 7f34d4b72640 1 -- 172.21.15.12:0/950465839 >> 172.21.15.12:0/950465839 conn(0x7f34d00c0570 msgr2=0x7f34d00a8ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:15.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.368+0000 7f34d4b72640 1 -- 172.21.15.12:0/950465839 shutdown_connections 2024-05-15T15:40:15.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.368+0000 7f34d4b72640 1 -- 172.21.15.12:0/950465839 wait complete. 2024-05-15T15:40:15.382 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-15T15:39:40.715999+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-15T15:39:49.598723+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-15T15:39:50.783054+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-15T15:40:15.382 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-15T15:40:15.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.496+0000 7fcf7f772640 1 Processor -- start 2024-05-15T15:40:15.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.496+0000 7fcf7f772640 1 -- start start 2024-05-15T15:40:15.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.497+0000 7fcf7f772640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fcf780a9060 0x7fcf78148910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:15.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.497+0000 7fcf7f772640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf780b8a30 con 0x7fcf780ba0f0 2024-05-15T15:40:15.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.497+0000 7fcf7f772640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf780b8d10 con 0x7fcf7814ed70 2024-05-15T15:40:15.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.497+0000 7fcf7f772640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fcf780b8ff0 con 0x7fcf780a9060 2024-05-15T15:40:15.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.497+0000 7fcf7d50e640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fcf780a9060 0x7fcf78148910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:15.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.497+0000 7fcf7cd0d640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fcf780ba0f0 0x7fcf7814e660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:43832/0 (socket says 172.21.15.12:43832) 2024-05-15T15:40:15.500 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.497+0000 7fcf7d50e640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fcf780a9060 0x7fcf78148910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52770/0 (socket says 172.21.15.12:52770) 2024-05-15T15:40:15.500 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.497+0000 7fcf7cd0d640 1 -- 172.21.15.12:0/2031672521 learned_addr learned my addr 172.21.15.12:0/2031672521 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-05-15T15:40:15.500 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.497+0000 7fcf7d50e640 1 -- 172.21.15.12:0/2031672521 >> v1:172.21.15.84:6789/0 conn(0x7fcf7814ed70 legacy=0x7fcf78158db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:15.500 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.497+0000 7fcf7d50e640 1 -- 172.21.15.12:0/2031672521 >> v1:172.21.15.12:6789/0 conn(0x7fcf780ba0f0 legacy=0x7fcf7814e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:15.500 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.497+0000 7fcf6ffff640 1 -- 172.21.15.12:0/2031672521 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1713628890 0 0) 0x7fcf780b8a30 con 0x7fcf780ba0f0 2024-05-15T15:40:15.500 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.497+0000 7fcf7d50e640 1 -- 172.21.15.12:0/2031672521 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf780b92d0 con 0x7fcf780a9060 2024-05-15T15:40:15.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.498+0000 7fcf7d50e640 1 --2- 172.21.15.12:0/2031672521 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf780a9060 0x7fcf78148910 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fcf740097a0 tx=0x7fcf7402a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c7d0a49386b01cf server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:15.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.498+0000 7fcf6ffff640 1 -- 172.21.15.12:0/2031672521 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf74037070 con 0x7fcf780a9060 2024-05-15T15:40:15.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.498+0000 7fcf6ffff640 1 -- 172.21.15.12:0/2031672521 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf74032640 con 0x7fcf780a9060 2024-05-15T15:40:15.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.498+0000 7fcf6ffff640 1 -- 172.21.15.12:0/2031672521 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf74032a10 con 0x7fcf780a9060 2024-05-15T15:40:15.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.499+0000 7fcf7f772640 1 -- 172.21.15.12:0/2031672521 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf780a9060 msgr2=0x7fcf78148910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:15.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.499+0000 7fcf7f772640 1 --2- 172.21.15.12:0/2031672521 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf780a9060 0x7fcf78148910 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fcf740097a0 tx=0x7fcf7402a2c0 comp rx=0 tx=0).stop 2024-05-15T15:40:15.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.499+0000 7fcf7f772640 1 -- 172.21.15.12:0/2031672521 shutdown_connections 2024-05-15T15:40:15.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.499+0000 7fcf7f772640 1 --2- 172.21.15.12:0/2031672521 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf780a9060 0x7fcf78148910 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:15.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.499+0000 7fcf7f772640 1 -- 172.21.15.12:0/2031672521 >> 172.21.15.12:0/2031672521 conn(0x7fcf780c07c0 msgr2=0x7fcf780c0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:15.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.499+0000 7fcf7f772640 1 -- 172.21.15.12:0/2031672521 shutdown_connections 2024-05-15T15:40:15.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.499+0000 7fcf7f772640 1 -- 172.21.15.12:0/2031672521 wait complete. 2024-05-15T15:40:15.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.501+0000 7fcf7f772640 1 Processor -- start 2024-05-15T15:40:15.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.501+0000 7fcf7f772640 1 -- start start 2024-05-15T15:40:15.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.502+0000 7fcf7f772640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf780a9060 0x7fcf780c1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:15.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.502+0000 7fcf7f772640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fcf780ba0f0 0x7fcf78140fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:15.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.502+0000 7fcf7f772640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf7814ed70 0x7fcf78141500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:15.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.502+0000 7fcf7f772640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fcf7808dbb0 con 0x7fcf7814ed70 2024-05-15T15:40:15.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.502+0000 7fcf7f772640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fcf7808da30 con 0x7fcf780a9060 2024-05-15T15:40:15.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.502+0000 7fcf7f772640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fcf780ba500 con 0x7fcf780ba0f0 2024-05-15T15:40:15.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.502+0000 7fcf7dd0f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf7814ed70 0x7fcf78141500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:15.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.502+0000 7fcf7dd0f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf7814ed70 0x7fcf78141500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52784/0 (socket says 172.21.15.12:52784) 2024-05-15T15:40:15.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.502+0000 7fcf7dd0f640 1 -- 172.21.15.12:0/577559703 learned_addr learned my addr 172.21.15.12:0/577559703 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:15.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.502+0000 7fcf7d50e640 1 --2- 172.21.15.12:0/577559703 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf780a9060 0x7fcf780c1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:15.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.502+0000 7fcf7cd0d640 1 --2- 172.21.15.12:0/577559703 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fcf780ba0f0 0x7fcf78140fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:15.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.502+0000 7fcf7dd0f640 1 -- 172.21.15.12:0/577559703 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fcf780ba0f0 msgr2=0x7fcf78140fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:15.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.502+0000 7fcf7dd0f640 1 --2- 172.21.15.12:0/577559703 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fcf780ba0f0 0x7fcf78140fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:15.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.502+0000 7fcf7dd0f640 1 -- 172.21.15.12:0/577559703 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf780a9060 msgr2=0x7fcf780c1ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:15.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.502+0000 7fcf7dd0f640 1 --2- 172.21.15.12:0/577559703 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf780a9060 0x7fcf780c1ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:15.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.502+0000 7fcf7dd0f640 1 -- 172.21.15.12:0/577559703 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf780c21e0 con 0x7fcf7814ed70 2024-05-15T15:40:15.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.502+0000 7fcf7cd0d640 1 --2- 172.21.15.12:0/577559703 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fcf780ba0f0 0x7fcf78140fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-15T15:40:15.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.502+0000 7fcf7dd0f640 1 --2- 172.21.15.12:0/577559703 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf7814ed70 0x7fcf78141500 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fcf7000c700 tx=0x7fcf7000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:15.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.502+0000 7fcf6dffb640 1 -- 172.21.15.12:0/577559703 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf70003b70 con 0x7fcf7814ed70 2024-05-15T15:40:15.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.502+0000 7fcf6dffb640 1 -- 172.21.15.12:0/577559703 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf70003d10 con 0x7fcf7814ed70 2024-05-15T15:40:15.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.502+0000 7fcf7f772640 1 -- 172.21.15.12:0/577559703 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf7814c170 con 0x7fcf7814ed70 2024-05-15T15:40:15.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.502+0000 7fcf6dffb640 1 -- 172.21.15.12:0/577559703 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf7000aa50 con 0x7fcf7814ed70 2024-05-15T15:40:15.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.503+0000 7fcf7f772640 1 -- 172.21.15.12:0/577559703 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf78144280 con 0x7fcf7814ed70 2024-05-15T15:40:15.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.504+0000 7fcf7f772640 1 -- 172.21.15.12:0/577559703 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf780ba9e0 con 0x7fcf7814ed70 2024-05-15T15:40:15.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.504+0000 7fcf6dffb640 1 -- 172.21.15.12:0/577559703 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fcf7000abf0 con 0x7fcf7814ed70 2024-05-15T15:40:15.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.505+0000 7fcf6dffb640 1 --2- 172.21.15.12:0/577559703 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fcf5c0762d0 0x7fcf5c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:15.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.505+0000 7fcf6dffb640 1 -- 172.21.15.12:0/577559703 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fcf700973d0 con 0x7fcf7814ed70 2024-05-15T15:40:15.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.505+0000 7fcf7d50e640 1 --2- 172.21.15.12:0/577559703 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fcf5c0762d0 0x7fcf5c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:15.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.505+0000 7fcf7d50e640 1 --2- 172.21.15.12:0/577559703 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fcf5c0762d0 0x7fcf5c0787e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fcf74034000 tx=0x7fcf7402e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:15.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.509+0000 7fcf6dffb640 1 -- 172.21.15.12:0/577559703 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fcf70060d30 con 0x7fcf7814ed70 2024-05-15T15:40:15.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.700+0000 7fcf7f772640 1 -- 172.21.15.12:0/577559703 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fcf78050940 con 0x7fcf7814ed70 2024-05-15T15:40:15.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.700+0000 7fcf6dffb640 1 -- 172.21.15.12:0/577559703 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) ==== 93+0+10 (secure 0 0 0) 0x7fcf70060630 con 0x7fcf7814ed70 2024-05-15T15:40:15.703 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2024-05-15T15:40:15.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.703+0000 7fcf7f772640 1 -- 172.21.15.12:0/577559703 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fcf5c0762d0 msgr2=0x7fcf5c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:15.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.703+0000 7fcf7f772640 1 --2- 172.21.15.12:0/577559703 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fcf5c0762d0 0x7fcf5c0787e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fcf74034000 tx=0x7fcf7402e000 comp rx=0 tx=0).stop 2024-05-15T15:40:15.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.703+0000 7fcf7f772640 1 -- 172.21.15.12:0/577559703 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf7814ed70 msgr2=0x7fcf78141500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:15.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.703+0000 7fcf7f772640 1 --2- 172.21.15.12:0/577559703 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf7814ed70 0x7fcf78141500 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fcf7000c700 tx=0x7fcf7000cbc0 comp rx=0 tx=0).stop 2024-05-15T15:40:15.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.703+0000 7fcf7f772640 1 -- 172.21.15.12:0/577559703 shutdown_connections 2024-05-15T15:40:15.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.703+0000 7fcf7f772640 1 --2- 172.21.15.12:0/577559703 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fcf5c0762d0 0x7fcf5c0787e0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:15.706 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.703+0000 7fcf7f772640 1 --2- 172.21.15.12:0/577559703 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf7814ed70 0x7fcf78141500 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:15.706 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.703+0000 7fcf7f772640 1 --2- 172.21.15.12:0/577559703 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fcf780ba0f0 0x7fcf78140fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:15.706 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.703+0000 7fcf7f772640 1 --2- 172.21.15.12:0/577559703 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf780a9060 0x7fcf780c1ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:15.706 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.703+0000 7fcf7f772640 1 -- 172.21.15.12:0/577559703 >> 172.21.15.12:0/577559703 conn(0x7fcf780c07c0 msgr2=0x7fcf78074560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:15.706 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.703+0000 7fcf7f772640 1 -- 172.21.15.12:0/577559703 shutdown_connections 2024-05-15T15:40:15.706 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.703+0000 7fcf7f772640 1 -- 172.21.15.12:0/577559703 wait complete. 2024-05-15T15:40:15.717 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-15T15:40:15.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.831+0000 7f7f7869f640 1 Processor -- start 2024-05-15T15:40:15.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.831+0000 7f7f7869f640 1 -- start start 2024-05-15T15:40:15.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.832+0000 7f7f7869f640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f7f70151fc0 0x7f7f700bd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:15.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.832+0000 7f7f7869f640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f700c36f0 con 0x7f7f7006da30 2024-05-15T15:40:15.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.832+0000 7f7f7869f640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f70152530 con 0x7f7f700bf050 2024-05-15T15:40:15.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.832+0000 7f7f7869f640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f7f700bdc10 con 0x7f7f70151fc0 2024-05-15T15:40:15.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.832+0000 7f7f7643b640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f7f70151fc0 0x7f7f700bd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:15.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.832+0000 7f7f75c3a640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f7f7006da30 0x7f7f700be940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:43838/0 (socket says 172.21.15.12:43838) 2024-05-15T15:40:15.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.832+0000 7f7f75c3a640 1 -- 172.21.15.12:0/2927580810 learned_addr learned my addr 172.21.15.12:0/2927580810 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-05-15T15:40:15.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.833+0000 7f7f7643b640 1 -- 172.21.15.12:0/2927580810 >> v1:172.21.15.84:6789/0 conn(0x7f7f700bf050 legacy=0x7f7f70158e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:15.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.833+0000 7f7f7643b640 1 -- 172.21.15.12:0/2927580810 >> v1:172.21.15.12:6789/0 conn(0x7f7f7006da30 legacy=0x7f7f700be940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:15.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.833+0000 7f7f7643b640 1 -- 172.21.15.12:0/2927580810 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f70152810 con 0x7f7f70151fc0 2024-05-15T15:40:15.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.833+0000 7f7f75439640 1 -- 172.21.15.12:0/2927580810 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1251234594 0 0) 0x7f7f700c36f0 con 0x7f7f7006da30 2024-05-15T15:40:15.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.833+0000 7f7f7643b640 1 --2- 172.21.15.12:0/2927580810 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7f70151fc0 0x7f7f700bd6d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f7f60009d90 tx=0x7f7f6002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1903a57218f2c11 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:15.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.834+0000 7f7f75439640 1 -- 172.21.15.12:0/2927580810 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f60007740 con 0x7f7f70151fc0 2024-05-15T15:40:15.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.834+0000 7f7f75439640 1 -- 172.21.15.12:0/2927580810 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f600078e0 con 0x7f7f70151fc0 2024-05-15T15:40:15.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.834+0000 7f7f75439640 1 -- 172.21.15.12:0/2927580810 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f60007cb0 con 0x7f7f70151fc0 2024-05-15T15:40:15.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.834+0000 7f7f7869f640 1 -- 172.21.15.12:0/2927580810 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7f70151fc0 msgr2=0x7f7f700bd6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:15.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.834+0000 7f7f7869f640 1 --2- 172.21.15.12:0/2927580810 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7f70151fc0 0x7f7f700bd6d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f7f60009d90 tx=0x7f7f6002a6f0 comp rx=0 tx=0).stop 2024-05-15T15:40:15.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.834+0000 7f7f7869f640 1 -- 172.21.15.12:0/2927580810 shutdown_connections 2024-05-15T15:40:15.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.834+0000 7f7f7869f640 1 --2- 172.21.15.12:0/2927580810 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7f70151fc0 0x7f7f700bd6d0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:15.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.834+0000 7f7f7869f640 1 -- 172.21.15.12:0/2927580810 >> 172.21.15.12:0/2927580810 conn(0x7f7f700c3d20 msgr2=0x7f7f700c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:15.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.834+0000 7f7f7869f640 1 -- 172.21.15.12:0/2927580810 shutdown_connections 2024-05-15T15:40:15.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.834+0000 7f7f7869f640 1 -- 172.21.15.12:0/2927580810 wait complete. 2024-05-15T15:40:15.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.836+0000 7f7f7869f640 1 Processor -- start 2024-05-15T15:40:15.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.836+0000 7f7f7869f640 1 -- start start 2024-05-15T15:40:15.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.837+0000 7f7f7869f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7f7006da30 0x7f7f700b7610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:15.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.837+0000 7f7f7869f640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f7f700bf050 0x7f7f701e4b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:15.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.837+0000 7f7f7869f640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f70151fc0 0x7f7f7014b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:15.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.837+0000 7f7f7869f640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f7f700a3050 con 0x7f7f7006da30 2024-05-15T15:40:15.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.837+0000 7f7f7869f640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f7f700a2ed0 con 0x7f7f70151fc0 2024-05-15T15:40:15.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.837+0000 7f7f7869f640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f7f7006de40 con 0x7f7f700bf050 2024-05-15T15:40:15.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.837+0000 7f7f7643b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7f7006da30 0x7f7f700b7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:15.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.837+0000 7f7f7643b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7f7006da30 0x7f7f700b7610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52808/0 (socket says 172.21.15.12:52808) 2024-05-15T15:40:15.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.837+0000 7f7f7643b640 1 -- 172.21.15.12:0/1842469082 learned_addr learned my addr 172.21.15.12:0/1842469082 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:15.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.837+0000 7f7f76c3c640 1 --2- 172.21.15.12:0/1842469082 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f70151fc0 0x7f7f7014b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:15.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.837+0000 7f7f75c3a640 1 --2- 172.21.15.12:0/1842469082 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f7f700bf050 0x7f7f701e4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:15.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.837+0000 7f7f7643b640 1 -- 172.21.15.12:0/1842469082 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f7f700bf050 msgr2=0x7f7f701e4b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:15.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.838+0000 7f7f7643b640 1 --2- 172.21.15.12:0/1842469082 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f7f700bf050 0x7f7f701e4b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:15.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.838+0000 7f7f7643b640 1 -- 172.21.15.12:0/1842469082 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f70151fc0 msgr2=0x7f7f7014b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:15.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.838+0000 7f7f7643b640 1 --2- 172.21.15.12:0/1842469082 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f70151fc0 0x7f7f7014b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:15.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.838+0000 7f7f7643b640 1 -- 172.21.15.12:0/1842469082 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f700b7b50 con 0x7f7f7006da30 2024-05-15T15:40:15.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.838+0000 7f7f75c3a640 1 --2- 172.21.15.12:0/1842469082 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f7f700bf050 0x7f7f701e4b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-15T15:40:15.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.838+0000 7f7f7643b640 1 --2- 172.21.15.12:0/1842469082 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7f7006da30 0x7f7f700b7610 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7f60009d90 tx=0x7f7f60004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:15.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.838+0000 7f7f6effd640 1 -- 172.21.15.12:0/1842469082 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f60040070 con 0x7f7f7006da30 2024-05-15T15:40:15.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.838+0000 7f7f6effd640 1 -- 172.21.15.12:0/1842469082 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f60031d00 con 0x7f7f7006da30 2024-05-15T15:40:15.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.838+0000 7f7f7869f640 1 -- 172.21.15.12:0/1842469082 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f701e5060 con 0x7f7f7006da30 2024-05-15T15:40:15.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.838+0000 7f7f6effd640 1 -- 172.21.15.12:0/1842469082 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f60045660 con 0x7f7f7006da30 2024-05-15T15:40:15.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.838+0000 7f7f7869f640 1 -- 172.21.15.12:0/1842469082 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f700ba580 con 0x7f7f7006da30 2024-05-15T15:40:15.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.839+0000 7f7f7869f640 1 -- 172.21.15.12:0/1842469082 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f701e5230 con 0x7f7f7006da30 2024-05-15T15:40:15.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.840+0000 7f7f6effd640 1 -- 172.21.15.12:0/1842469082 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7f60039040 con 0x7f7f7006da30 2024-05-15T15:40:15.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.840+0000 7f7f6effd640 1 --2- 172.21.15.12:0/1842469082 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f7f5c0762d0 0x7f7f5c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:15.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.840+0000 7f7f6effd640 1 -- 172.21.15.12:0/1842469082 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f7f600b9010 con 0x7f7f7006da30 2024-05-15T15:40:15.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.840+0000 7f7f75c3a640 1 --2- 172.21.15.12:0/1842469082 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f7f5c0762d0 0x7f7f5c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:15.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.841+0000 7f7f75c3a640 1 --2- 172.21.15.12:0/1842469082 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f7f5c0762d0 0x7f7f5c0787e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f7f700b7d90 tx=0x7f7f64009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:15.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:15.845+0000 7f7f6effd640 1 -- 172.21.15.12:0/1842469082 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f7f701e5230 con 0x7f7f7006da30 2024-05-15T15:40:16.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.036+0000 7f7f7869f640 1 -- 172.21.15.12:0/1842469082 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f7f70050940 con 0x7f7f7006da30 2024-05-15T15:40:16.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.036+0000 7f7f6effd640 1 -- 172.21.15.12:0/1842469082 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) ==== 104+0+11 (secure 0 0 0) 0x7f7f60082970 con 0x7f7f7006da30 2024-05-15T15:40:16.039 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 32 2024-05-15T15:40:16.040 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.038+0000 7f7f7869f640 1 -- 172.21.15.12:0/1842469082 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f7f5c0762d0 msgr2=0x7f7f5c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:16.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.038+0000 7f7f7869f640 1 --2- 172.21.15.12:0/1842469082 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f7f5c0762d0 0x7f7f5c0787e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f7f700b7d90 tx=0x7f7f64009040 comp rx=0 tx=0).stop 2024-05-15T15:40:16.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.038+0000 7f7f7869f640 1 -- 172.21.15.12:0/1842469082 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7f7006da30 msgr2=0x7f7f700b7610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:16.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.038+0000 7f7f7869f640 1 --2- 172.21.15.12:0/1842469082 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7f7006da30 0x7f7f700b7610 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7f60009d90 tx=0x7f7f60004a40 comp rx=0 tx=0).stop 2024-05-15T15:40:16.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.038+0000 7f7f7869f640 1 -- 172.21.15.12:0/1842469082 shutdown_connections 2024-05-15T15:40:16.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.038+0000 7f7f7869f640 1 --2- 172.21.15.12:0/1842469082 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f70151fc0 0x7f7f7014b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:16.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.038+0000 7f7f7869f640 1 --2- 172.21.15.12:0/1842469082 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f7f700bf050 0x7f7f701e4b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:16.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.038+0000 7f7f7869f640 1 --2- 172.21.15.12:0/1842469082 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f7f5c0762d0 0x7f7f5c0787e0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:16.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.038+0000 7f7f7869f640 1 --2- 172.21.15.12:0/1842469082 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7f7006da30 0x7f7f700b7610 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:16.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.038+0000 7f7f7869f640 1 -- 172.21.15.12:0/1842469082 >> 172.21.15.12:0/1842469082 conn(0x7f7f700c3d20 msgr2=0x7f7f700be940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:16.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.038+0000 7f7f7869f640 1 -- 172.21.15.12:0/1842469082 shutdown_connections 2024-05-15T15:40:16.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.038+0000 7f7f7869f640 1 -- 172.21.15.12:0/1842469082 wait complete. 2024-05-15T15:40:16.051 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-15T15:40:16.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.163+0000 7f32bfd00640 1 Processor -- start 2024-05-15T15:40:16.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.163+0000 7f32bfd00640 1 -- start start 2024-05-15T15:40:16.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.165+0000 7f32bfd00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f32b814d0f0 0x7f32b8157cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:16.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.165+0000 7f32bfd00640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32b80720d0 con 0x7f32b814cce0 2024-05-15T15:40:16.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.165+0000 7f32bfd00640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32b80bf6f0 con 0x7f32b80be4f0 2024-05-15T15:40:16.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.165+0000 7f32bfd00640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f32b80bfa60 con 0x7f32b814d0f0 2024-05-15T15:40:16.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.165+0000 7f32bd29b640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f32b814cce0 0x7f32b80716a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:43840/0 (socket says 172.21.15.12:43840) 2024-05-15T15:40:16.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.165+0000 7f32bd29b640 1 -- 172.21.15.12:0/1048735223 learned_addr learned my addr 172.21.15.12:0/1048735223 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-05-15T15:40:16.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.165+0000 7f32be29d640 1 --2- 172.21.15.12:0/1048735223 >> v2:172.21.15.84:3300/0 conn(0x7f32b814d0f0 0x7f32b8157cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:16.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.165+0000 7f32bca9a640 1 -- 172.21.15.12:0/1048735223 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 43755990 0 0) 0x7f32b80720d0 con 0x7f32b814cce0 2024-05-15T15:40:16.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.165+0000 7f32bca9a640 1 -- 172.21.15.12:0/1048735223 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f32a0003520 con 0x7f32b814cce0 2024-05-15T15:40:16.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.165+0000 7f32bca9a640 1 -- 172.21.15.12:0/1048735223 <== mon.1 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1119579248 0 0) 0x7f32b80bf6f0 con 0x7f32b80be4f0 2024-05-15T15:40:16.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.165+0000 7f32bca9a640 1 -- 172.21.15.12:0/1048735223 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f32b80720d0 con 0x7f32b80be4f0 2024-05-15T15:40:16.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.165+0000 7f32be29d640 1 -- 172.21.15.12:0/1048735223 >> v1:172.21.15.84:6789/0 conn(0x7f32b80be4f0 legacy=0x7f32b80bfef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:16.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.165+0000 7f32be29d640 1 -- 172.21.15.12:0/1048735223 >> v1:172.21.15.12:6789/0 conn(0x7f32b814cce0 legacy=0x7f32b80716a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:16.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.165+0000 7f32bca9a640 1 -- 172.21.15.12:0/1048735223 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2863246457 0 0) 0x7f32a0003520 con 0x7f32b814cce0 2024-05-15T15:40:16.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.165+0000 7f32be29d640 1 -- 172.21.15.12:0/1048735223 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32b80be900 con 0x7f32b814d0f0 2024-05-15T15:40:16.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.166+0000 7f32be29d640 1 --2- 172.21.15.12:0/1048735223 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f32b814d0f0 0x7f32b8157cc0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f32b80bfbe0 tx=0x7f32b002a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5693296954bc5466 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:16.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.166+0000 7f32bca9a640 1 -- 172.21.15.12:0/1048735223 <== mon.1 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32b0037070 con 0x7f32b814d0f0 2024-05-15T15:40:16.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.166+0000 7f32bca9a640 1 -- 172.21.15.12:0/1048735223 <== mon.1 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32b002aba0 con 0x7f32b814d0f0 2024-05-15T15:40:16.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.166+0000 7f32bca9a640 1 -- 172.21.15.12:0/1048735223 <== mon.1 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32ac0016f0 con 0x7f32b814d0f0 2024-05-15T15:40:16.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.167+0000 7f32bfd00640 1 -- 172.21.15.12:0/1048735223 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f32b814d0f0 msgr2=0x7f32b8157cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:16.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.167+0000 7f32bfd00640 1 --2- 172.21.15.12:0/1048735223 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f32b814d0f0 0x7f32b8157cc0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f32b80bfbe0 tx=0x7f32b002a110 comp rx=0 tx=0).stop 2024-05-15T15:40:16.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.167+0000 7f32bfd00640 1 -- 172.21.15.12:0/1048735223 shutdown_connections 2024-05-15T15:40:16.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.167+0000 7f32bfd00640 1 --2- 172.21.15.12:0/1048735223 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f32b814d0f0 0x7f32b8157cc0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:16.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.167+0000 7f32bfd00640 1 -- 172.21.15.12:0/1048735223 >> 172.21.15.12:0/1048735223 conn(0x7f32b80c17c0 msgr2=0x7f32b80c1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:16.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.167+0000 7f32bfd00640 1 -- 172.21.15.12:0/1048735223 shutdown_connections 2024-05-15T15:40:16.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.167+0000 7f32bfd00640 1 -- 172.21.15.12:0/1048735223 wait complete. 2024-05-15T15:40:16.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.168+0000 7f32bfd00640 1 Processor -- start 2024-05-15T15:40:16.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.169+0000 7f32bfd00640 1 -- start start 2024-05-15T15:40:16.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.170+0000 7f32bfd00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f32b80be4f0 0x7f32b81426d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:16.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.170+0000 7f32bfd00640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f32b814cce0 0x7f32b8143b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:16.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.170+0000 7f32bfd00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f32b814d0f0 0x7f32b809f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:16.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.170+0000 7f32bfd00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f32b80723b0 con 0x7f32b80be4f0 2024-05-15T15:40:16.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.170+0000 7f32bfd00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f32b8071310 con 0x7f32b814d0f0 2024-05-15T15:40:16.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.170+0000 7f32bfd00640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f32b80a6c90 con 0x7f32b814cce0 2024-05-15T15:40:16.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.170+0000 7f32bda9c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f32b80be4f0 0x7f32b81426d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:16.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.170+0000 7f32bda9c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f32b80be4f0 0x7f32b81426d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52812/0 (socket says 172.21.15.12:52812) 2024-05-15T15:40:16.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.170+0000 7f32bda9c640 1 -- 172.21.15.12:0/162787659 learned_addr learned my addr 172.21.15.12:0/162787659 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:16.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.170+0000 7f32be29d640 1 --2- 172.21.15.12:0/162787659 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f32b814d0f0 0x7f32b809f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:16.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.170+0000 7f32bd29b640 1 --2- 172.21.15.12:0/162787659 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f32b814cce0 0x7f32b8143b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:16.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.170+0000 7f32bda9c640 1 -- 172.21.15.12:0/162787659 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f32b814cce0 msgr2=0x7f32b8143b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:16.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.170+0000 7f32bda9c640 1 --2- 172.21.15.12:0/162787659 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f32b814cce0 0x7f32b8143b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:16.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.170+0000 7f32bda9c640 1 -- 172.21.15.12:0/162787659 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f32b814d0f0 msgr2=0x7f32b809f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:16.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.170+0000 7f32bda9c640 1 --2- 172.21.15.12:0/162787659 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f32b814d0f0 0x7f32b809f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:16.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.170+0000 7f32bda9c640 1 -- 172.21.15.12:0/162787659 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32b81e1fd0 con 0x7f32b80be4f0 2024-05-15T15:40:16.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.170+0000 7f32bda9c640 1 --2- 172.21.15.12:0/162787659 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f32b80be4f0 0x7f32b81426d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f32a800c7a0 tx=0x7f32a800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:16.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.170+0000 7f32b67fc640 1 -- 172.21.15.12:0/162787659 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32a8003b70 con 0x7f32b80be4f0 2024-05-15T15:40:16.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.170+0000 7f32b67fc640 1 -- 172.21.15.12:0/162787659 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32a8003d10 con 0x7f32b80be4f0 2024-05-15T15:40:16.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.170+0000 7f32bfd00640 1 -- 172.21.15.12:0/162787659 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32b81e22b0 con 0x7f32b80be4f0 2024-05-15T15:40:16.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.170+0000 7f32b67fc640 1 -- 172.21.15.12:0/162787659 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32a800aa90 con 0x7f32b80be4f0 2024-05-15T15:40:16.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.170+0000 7f32bfd00640 1 -- 172.21.15.12:0/162787659 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32b81e2870 con 0x7f32b80be4f0 2024-05-15T15:40:16.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.171+0000 7f32bfd00640 1 -- 172.21.15.12:0/162787659 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32b80bf020 con 0x7f32b80be4f0 2024-05-15T15:40:16.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.172+0000 7f32b67fc640 1 -- 172.21.15.12:0/162787659 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f32a800ac30 con 0x7f32b80be4f0 2024-05-15T15:40:16.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.173+0000 7f32b67fc640 1 --2- 172.21.15.12:0/162787659 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f32a40762d0 0x7f32a40787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:16.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.173+0000 7f32b67fc640 1 -- 172.21.15.12:0/162787659 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f32a80976f0 con 0x7f32b80be4f0 2024-05-15T15:40:16.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.173+0000 7f32bd29b640 1 --2- 172.21.15.12:0/162787659 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f32a40762d0 0x7f32a40787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:16.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.173+0000 7f32bd29b640 1 --2- 172.21.15.12:0/162787659 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f32a40762d0 0x7f32a40787e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f32ac0013c0 tx=0x7f32ac009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:16.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.178+0000 7f32b67fc640 1 -- 172.21.15.12:0/162787659 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f32a8060ea0 con 0x7f32b80be4f0 2024-05-15T15:40:16.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.372+0000 7f32bfd00640 1 -- 172.21.15.12:0/162787659 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f32b8050940 con 0x7f32b80be4f0 2024-05-15T15:40:16.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.373+0000 7f32b67fc640 1 -- 172.21.15.12:0/162787659 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) ==== 100+0+11 (secure 0 0 0) 0x7f32a80607a0 con 0x7f32b80be4f0 2024-05-15T15:40:16.375 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 64 2024-05-15T15:40:16.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.375+0000 7f32bfd00640 1 -- 172.21.15.12:0/162787659 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f32a40762d0 msgr2=0x7f32a40787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:16.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.375+0000 7f32bfd00640 1 --2- 172.21.15.12:0/162787659 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f32a40762d0 0x7f32a40787e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f32ac0013c0 tx=0x7f32ac009040 comp rx=0 tx=0).stop 2024-05-15T15:40:16.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.375+0000 7f32bfd00640 1 -- 172.21.15.12:0/162787659 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f32b80be4f0 msgr2=0x7f32b81426d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:16.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.375+0000 7f32bfd00640 1 --2- 172.21.15.12:0/162787659 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f32b80be4f0 0x7f32b81426d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f32a800c7a0 tx=0x7f32a800cc60 comp rx=0 tx=0).stop 2024-05-15T15:40:16.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.375+0000 7f32bfd00640 1 -- 172.21.15.12:0/162787659 shutdown_connections 2024-05-15T15:40:16.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.375+0000 7f32bfd00640 1 --2- 172.21.15.12:0/162787659 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f32b814d0f0 0x7f32b809f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:16.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.375+0000 7f32bfd00640 1 --2- 172.21.15.12:0/162787659 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f32b814cce0 0x7f32b8143b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:16.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.375+0000 7f32bfd00640 1 --2- 172.21.15.12:0/162787659 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f32a40762d0 0x7f32a40787e0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:16.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.375+0000 7f32bfd00640 1 --2- 172.21.15.12:0/162787659 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f32b80be4f0 0x7f32b81426d0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:16.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.375+0000 7f32bfd00640 1 -- 172.21.15.12:0/162787659 >> 172.21.15.12:0/162787659 conn(0x7f32b80c17c0 msgr2=0x7f32b80bb950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:16.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.375+0000 7f32bfd00640 1 -- 172.21.15.12:0/162787659 shutdown_connections 2024-05-15T15:40:16.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.375+0000 7f32bfd00640 1 -- 172.21.15.12:0/162787659 wait complete. 2024-05-15T15:40:16.388 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_fscrypt.TestFSCrypt.test_fscrypt_basic_mount' 2024-05-15T15:40:16.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.500+0000 7fce771b2640 1 Processor -- start 2024-05-15T15:40:16.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.500+0000 7fce771b2640 1 -- start start 2024-05-15T15:40:16.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.501+0000 7fce771b2640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fce700bc1c0 0x7fce700a0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:16.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.501+0000 7fce771b2640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fce70146380 0x7fce70070a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:16.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.501+0000 7fce771b2640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fce7014c8e0 0x7fce7014ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:16.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.501+0000 7fce771b2640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fce7014c450 con 0x7fce700bc1c0 2024-05-15T15:40:16.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.501+0000 7fce771b2640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7fce7014c120 con 0x7fce7014c8e0 2024-05-15T15:40:16.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.501+0000 7fce771b2640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fce70071e40 con 0x7fce70146380 2024-05-15T15:40:16.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.501+0000 7fce74f4e640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fce700bc1c0 0x7fce700a0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:16.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.501+0000 7fce74f4e640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fce700bc1c0 0x7fce700a0ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52828/0 (socket says 172.21.15.12:52828) 2024-05-15T15:40:16.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.501+0000 7fce74f4e640 1 -- 172.21.15.12:0/1389133112 learned_addr learned my addr 172.21.15.12:0/1389133112 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:16.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.501+0000 7fce7574f640 1 --2- 172.21.15.12:0/1389133112 >> v2:172.21.15.84:3300/0 conn(0x7fce7014c8e0 0x7fce7014ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:16.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.501+0000 7fce67fff640 1 --2- 172.21.15.12:0/1389133112 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fce70146380 0x7fce70070a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:16.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.501+0000 7fce74f4e640 1 -- 172.21.15.12:0/1389133112 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fce70146380 msgr2=0x7fce70070a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:40:16.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.501+0000 7fce74f4e640 1 --2- 172.21.15.12:0/1389133112 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fce70146380 0x7fce70070a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:16.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.501+0000 7fce74f4e640 1 -- 172.21.15.12:0/1389133112 >> v2:172.21.15.84:3300/0 conn(0x7fce7014c8e0 msgr2=0x7fce7014ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:40:16.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.501+0000 7fce74f4e640 1 --2- 172.21.15.12:0/1389133112 >> v2:172.21.15.84:3300/0 conn(0x7fce7014c8e0 0x7fce7014ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:16.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.501+0000 7fce74f4e640 1 -- 172.21.15.12:0/1389133112 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce700713d0 con 0x7fce700bc1c0 2024-05-15T15:40:16.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.502+0000 7fce74f4e640 1 --2- 172.21.15.12:0/1389133112 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce700bc1c0 0x7fce700a0ba0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fce700a7b30 tx=0x7fce6c02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59a99907b456b6e2 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:16.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.502+0000 7fce677fe640 1 -- 172.21.15.12:0/1389133112 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce6c037070 con 0x7fce700bc1c0 2024-05-15T15:40:16.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.502+0000 7fce677fe640 1 -- 172.21.15.12:0/1389133112 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce6c032440 con 0x7fce700bc1c0 2024-05-15T15:40:16.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.502+0000 7fce677fe640 1 -- 172.21.15.12:0/1389133112 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce6c032810 con 0x7fce700bc1c0 2024-05-15T15:40:16.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.503+0000 7fce771b2640 1 -- 172.21.15.12:0/1389133112 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce700bc1c0 msgr2=0x7fce700a0ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:16.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.503+0000 7fce771b2640 1 --2- 172.21.15.12:0/1389133112 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce700bc1c0 0x7fce700a0ba0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fce700a7b30 tx=0x7fce6c02a140 comp rx=0 tx=0).stop 2024-05-15T15:40:16.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.503+0000 7fce771b2640 1 -- 172.21.15.12:0/1389133112 shutdown_connections 2024-05-15T15:40:16.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.503+0000 7fce771b2640 1 --2- 172.21.15.12:0/1389133112 >> v2:172.21.15.84:3300/0 conn(0x7fce7014c8e0 0x7fce7014ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:16.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.503+0000 7fce771b2640 1 --2- 172.21.15.12:0/1389133112 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fce70146380 0x7fce70070a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:16.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.503+0000 7fce771b2640 1 --2- 172.21.15.12:0/1389133112 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce700bc1c0 0x7fce700a0ba0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:16.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.503+0000 7fce771b2640 1 -- 172.21.15.12:0/1389133112 >> 172.21.15.12:0/1389133112 conn(0x7fce700c17c0 msgr2=0x7fce700c1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:16.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.503+0000 7fce771b2640 1 -- 172.21.15.12:0/1389133112 shutdown_connections 2024-05-15T15:40:16.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.503+0000 7fce771b2640 1 -- 172.21.15.12:0/1389133112 wait complete. 2024-05-15T15:40:16.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.504+0000 7fce771b2640 1 Processor -- start 2024-05-15T15:40:16.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.504+0000 7fce771b2640 1 -- start start 2024-05-15T15:40:16.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.506+0000 7fce771b2640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fce700bc1c0 0x7fce701e5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:16.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.506+0000 7fce771b2640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce70146380 0x7fce70149090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:16.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.506+0000 7fce771b2640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fce7014c8e0 0x7fce700a6950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:16.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.506+0000 7fce771b2640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fce700bd5f0 con 0x7fce70146380 2024-05-15T15:40:16.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.506+0000 7fce771b2640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fce70146790 con 0x7fce7014c8e0 2024-05-15T15:40:16.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.506+0000 7fce771b2640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fce700bd770 con 0x7fce700bc1c0 2024-05-15T15:40:16.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.506+0000 7fce67fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce70146380 0x7fce70149090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:16.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.506+0000 7fce67fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce70146380 0x7fce70149090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52836/0 (socket says 172.21.15.12:52836) 2024-05-15T15:40:16.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.506+0000 7fce67fff640 1 -- 172.21.15.12:0/329291998 learned_addr learned my addr 172.21.15.12:0/329291998 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:16.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.506+0000 7fce74f4e640 1 --2- 172.21.15.12:0/329291998 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fce700bc1c0 0x7fce701e5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:16.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.506+0000 7fce7574f640 1 --2- 172.21.15.12:0/329291998 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fce7014c8e0 0x7fce700a6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:16.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.506+0000 7fce67fff640 1 -- 172.21.15.12:0/329291998 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fce700bc1c0 msgr2=0x7fce701e5a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:16.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.506+0000 7fce67fff640 1 --2- 172.21.15.12:0/329291998 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fce700bc1c0 0x7fce701e5a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:16.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.506+0000 7fce67fff640 1 -- 172.21.15.12:0/329291998 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fce7014c8e0 msgr2=0x7fce700a6950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:16.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.506+0000 7fce67fff640 1 --2- 172.21.15.12:0/329291998 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fce7014c8e0 0x7fce700a6950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:16.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.506+0000 7fce67fff640 1 -- 172.21.15.12:0/329291998 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce701495d0 con 0x7fce70146380 2024-05-15T15:40:16.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.506+0000 7fce67fff640 1 --2- 172.21.15.12:0/329291998 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce70146380 0x7fce70149090 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fce6000d5f0 tx=0x7fce6000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:16.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.506+0000 7fce657fa640 1 -- 172.21.15.12:0/329291998 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce60018020 con 0x7fce70146380 2024-05-15T15:40:16.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.506+0000 7fce657fa640 1 -- 172.21.15.12:0/329291998 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce60014620 con 0x7fce70146380 2024-05-15T15:40:16.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.506+0000 7fce771b2640 1 -- 172.21.15.12:0/329291998 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce700a6e90 con 0x7fce70146380 2024-05-15T15:40:16.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.506+0000 7fce657fa640 1 -- 172.21.15.12:0/329291998 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce60014a10 con 0x7fce70146380 2024-05-15T15:40:16.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.506+0000 7fce771b2640 1 -- 172.21.15.12:0/329291998 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce701e2960 con 0x7fce70146380 2024-05-15T15:40:16.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.507+0000 7fce771b2640 1 -- 172.21.15.12:0/329291998 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce700a7780 con 0x7fce70146380 2024-05-15T15:40:16.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.508+0000 7fce657fa640 1 -- 172.21.15.12:0/329291998 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fce6001b020 con 0x7fce70146380 2024-05-15T15:40:16.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.509+0000 7fce657fa640 1 --2- 172.21.15.12:0/329291998 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fce5c0762d0 0x7fce5c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:16.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.509+0000 7fce657fa640 1 -- 172.21.15.12:0/329291998 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fce60097740 con 0x7fce70146380 2024-05-15T15:40:16.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.509+0000 7fce74f4e640 1 --2- 172.21.15.12:0/329291998 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fce5c0762d0 0x7fce5c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:16.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.509+0000 7fce74f4e640 1 --2- 172.21.15.12:0/329291998 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fce5c0762d0 0x7fce5c0787e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fce6c034000 tx=0x7fce6c02e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:16.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.513+0000 7fce657fa640 1 -- 172.21.15.12:0/329291998 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fce60022030 con 0x7fce70146380 2024-05-15T15:40:16.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:16.778+0000 7fce771b2640 1 -- 172.21.15.12:0/329291998 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_fscrypt.TestFSCrypt.test_fscrypt_basic_mount"]} v 0) -- 0x7fce70050940 con 0x7fce70146380 2024-05-15T15:40:17.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:17.785+0000 7fce657fa640 1 -- 172.21.15.12:0/329291998 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_fscrypt.TestFSCrypt.test_fscrypt_basic_mount"]}]=0 v45) ==== 144+0+0 (secure 0 0 0) 0x7fce600609c0 con 0x7fce70146380 2024-05-15T15:40:17.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:17.788+0000 7fce771b2640 1 -- 172.21.15.12:0/329291998 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fce5c0762d0 msgr2=0x7fce5c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:17.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:17.788+0000 7fce771b2640 1 --2- 172.21.15.12:0/329291998 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fce5c0762d0 0x7fce5c0787e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fce6c034000 tx=0x7fce6c02e000 comp rx=0 tx=0).stop 2024-05-15T15:40:17.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:17.788+0000 7fce771b2640 1 -- 172.21.15.12:0/329291998 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce70146380 msgr2=0x7fce70149090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:17.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:17.788+0000 7fce771b2640 1 --2- 172.21.15.12:0/329291998 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce70146380 0x7fce70149090 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fce6000d5f0 tx=0x7fce6000dab0 comp rx=0 tx=0).stop 2024-05-15T15:40:17.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:17.788+0000 7fce771b2640 1 -- 172.21.15.12:0/329291998 shutdown_connections 2024-05-15T15:40:17.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:17.788+0000 7fce771b2640 1 --2- 172.21.15.12:0/329291998 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fce7014c8e0 0x7fce700a6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:17.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:17.788+0000 7fce771b2640 1 --2- 172.21.15.12:0/329291998 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fce5c0762d0 0x7fce5c0787e0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:17.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:17.788+0000 7fce771b2640 1 --2- 172.21.15.12:0/329291998 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce70146380 0x7fce70149090 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:17.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:17.788+0000 7fce771b2640 1 --2- 172.21.15.12:0/329291998 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fce700bc1c0 0x7fce701e5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:17.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:17.788+0000 7fce771b2640 1 -- 172.21.15.12:0/329291998 >> 172.21.15.12:0/329291998 conn(0x7fce700c17c0 msgr2=0x7fce7014a9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:17.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:17.788+0000 7fce771b2640 1 -- 172.21.15.12:0/329291998 shutdown_connections 2024-05-15T15:40:17.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:17.788+0000 7fce771b2640 1 -- 172.21.15.12:0/329291998 wait complete. 2024-05-15T15:40:17.804 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-05-15T15:40:17.925 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:17.923+0000 7f31ff9f3640 1 Processor -- start 2024-05-15T15:40:17.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:17.924+0000 7f31ff9f3640 1 -- start start 2024-05-15T15:40:17.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:17.925+0000 7f31ff9f3640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f31f814c220 0x7f31f80730f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:17.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:17.925+0000 7f31ff9f3640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f31f8154af0 0x7f31f8156f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:17.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:17.925+0000 7f31ff9f3640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31f806cdf0 con 0x7f31f80bfe60 2024-05-15T15:40:17.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:17.925+0000 7f31ff9f3640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f31f8074900 con 0x7f31f814c220 2024-05-15T15:40:17.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:17.925+0000 7f31ff9f3640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f31f8074be0 con 0x7f31f8154af0 2024-05-15T15:40:17.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:17.925+0000 7f31fcf8e640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f31f80bfe60 0x7f31f806c6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:47142/0 (socket says 172.21.15.12:47142) 2024-05-15T15:40:17.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:17.925+0000 7f31fcf8e640 1 -- 172.21.15.12:0/3870196067 learned_addr learned my addr 172.21.15.12:0/3870196067 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-05-15T15:40:17.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:17.925+0000 7f31fdf90640 1 --2- 172.21.15.12:0/3870196067 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f31f8154af0 0x7f31f8156f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:17.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:17.925+0000 7f31fd78f640 1 --2- 172.21.15.12:0/3870196067 >> v2:172.21.15.84:3300/0 conn(0x7f31f814c220 0x7f31f80730f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:17.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:17.925+0000 7f31f7fff640 1 -- 172.21.15.12:0/3870196067 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3354330170 0 0) 0x7f31ec001110 con 0x7f31f80bfe60 2024-05-15T15:40:17.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:17.925+0000 7f31f7fff640 1 -- 172.21.15.12:0/3870196067 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f31e0003520 con 0x7f31f80bfe60 2024-05-15T15:40:17.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:17.925+0000 7f31fdf90640 1 -- 172.21.15.12:0/3870196067 >> v2:172.21.15.84:3300/0 conn(0x7f31f814c220 msgr2=0x7f31f80730f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:40:17.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:17.925+0000 7f31fdf90640 1 --2- 172.21.15.12:0/3870196067 >> v2:172.21.15.84:3300/0 conn(0x7f31f814c220 0x7f31f80730f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:17.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:17.925+0000 7f31fdf90640 1 -- 172.21.15.12:0/3870196067 >> v1:172.21.15.12:6789/0 conn(0x7f31f80bfe60 legacy=0x7f31f806c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:17.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:17.925+0000 7f31f7fff640 1 -- 172.21.15.12:0/3870196067 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2536448459 0 0) 0x7f31e0003520 con 0x7f31f80bfe60 2024-05-15T15:40:17.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:17.925+0000 7f31fdf90640 1 -- 172.21.15.12:0/3870196067 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31f80bf630 con 0x7f31f8154af0 2024-05-15T15:40:17.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:17.926+0000 7f31fdf90640 1 --2- 172.21.15.12:0/3870196067 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f31f8154af0 0x7f31f8156f10 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f31e8009d90 tx=0x7f31e802a5f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8c4b49101428aa13 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:17.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:17.926+0000 7f31f7fff640 1 -- 172.21.15.12:0/3870196067 <== mon.2 v2:172.21.15.84:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31ec0018c0 con 0x7f31f8154af0 2024-05-15T15:40:17.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:17.926+0000 7f31f7fff640 1 -- 172.21.15.12:0/3870196067 <== mon.2 v2:172.21.15.84:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31e8007540 con 0x7f31f8154af0 2024-05-15T15:40:17.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:17.926+0000 7f31f7fff640 1 -- 172.21.15.12:0/3870196067 <== mon.2 v2:172.21.15.84:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31e80078f0 con 0x7f31f8154af0 2024-05-15T15:40:17.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:17.927+0000 7f31ff9f3640 1 -- 172.21.15.12:0/3870196067 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f31f8154af0 msgr2=0x7f31f8156f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:17.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:17.927+0000 7f31ff9f3640 1 --2- 172.21.15.12:0/3870196067 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f31f8154af0 0x7f31f8156f10 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f31e8009d90 tx=0x7f31e802a5f0 comp rx=0 tx=0).stop 2024-05-15T15:40:17.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:17.927+0000 7f31ff9f3640 1 -- 172.21.15.12:0/3870196067 shutdown_connections 2024-05-15T15:40:17.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:17.927+0000 7f31ff9f3640 1 --2- 172.21.15.12:0/3870196067 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f31f8154af0 0x7f31f8156f10 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:17.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:17.927+0000 7f31ff9f3640 1 --2- 172.21.15.12:0/3870196067 >> v2:172.21.15.84:3300/0 conn(0x7f31f814c220 0x7f31f80730f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:17.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:17.927+0000 7f31ff9f3640 1 -- 172.21.15.12:0/3870196067 >> 172.21.15.12:0/3870196067 conn(0x7f31f80bd160 msgr2=0x7f31f80bd570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:17.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:17.927+0000 7f31ff9f3640 1 -- 172.21.15.12:0/3870196067 shutdown_connections 2024-05-15T15:40:17.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:17.927+0000 7f31ff9f3640 1 -- 172.21.15.12:0/3870196067 wait complete. 2024-05-15T15:40:17.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:17.929+0000 7f31ff9f3640 1 Processor -- start 2024-05-15T15:40:17.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:17.929+0000 7f31ff9f3640 1 -- start start 2024-05-15T15:40:17.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:17.930+0000 7f31ff9f3640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f31f80bfe60 0x7f31f80a42e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:17.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:17.930+0000 7f31ff9f3640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31f814c220 0x7f31f80a52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:17.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:17.930+0000 7f31ff9f3640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f31f8154af0 0x7f31f81e2830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:17.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:17.930+0000 7f31ff9f3640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f31f80c03f0 con 0x7f31f8154af0 2024-05-15T15:40:17.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:17.930+0000 7f31ff9f3640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f31f80c0270 con 0x7f31f814c220 2024-05-15T15:40:17.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:17.930+0000 7f31ff9f3640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f31f8074540 con 0x7f31f80bfe60 2024-05-15T15:40:17.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:17.930+0000 7f31fdf90640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f31f8154af0 0x7f31f81e2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:17.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:17.930+0000 7f31fdf90640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f31f8154af0 0x7f31f81e2830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38120/0 (socket says 172.21.15.12:38120) 2024-05-15T15:40:17.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:17.930+0000 7f31fdf90640 1 -- 172.21.15.12:0/2866368361 learned_addr learned my addr 172.21.15.12:0/2866368361 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:17.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:17.930+0000 7f31fd78f640 1 --2- 172.21.15.12:0/2866368361 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f31f80bfe60 0x7f31f80a42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:17.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:17.930+0000 7f31fcf8e640 1 --2- 172.21.15.12:0/2866368361 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31f814c220 0x7f31f80a52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:17.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:17.930+0000 7f31fdf90640 1 -- 172.21.15.12:0/2866368361 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f31f80bfe60 msgr2=0x7f31f80a42e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:17.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:17.930+0000 7f31fdf90640 1 --2- 172.21.15.12:0/2866368361 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f31f80bfe60 0x7f31f80a42e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:17.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:17.930+0000 7f31fdf90640 1 -- 172.21.15.12:0/2866368361 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31f814c220 msgr2=0x7f31f80a52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:17.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:17.930+0000 7f31fdf90640 1 --2- 172.21.15.12:0/2866368361 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31f814c220 0x7f31f80a52b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:17.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:17.930+0000 7f31fdf90640 1 -- 172.21.15.12:0/2866368361 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31f80a4820 con 0x7f31f8154af0 2024-05-15T15:40:17.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:17.930+0000 7f31fd78f640 1 --2- 172.21.15.12:0/2866368361 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f31f80bfe60 0x7f31f80a42e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-15T15:40:17.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:17.930+0000 7f31fdf90640 1 --2- 172.21.15.12:0/2866368361 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f31f8154af0 0x7f31f81e2830 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f31e802abe0 tx=0x7f31e8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:17.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:17.931+0000 7f31f5ffb640 1 -- 172.21.15.12:0/2866368361 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31e803f070 con 0x7f31f8154af0 2024-05-15T15:40:17.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:17.931+0000 7f31f5ffb640 1 -- 172.21.15.12:0/2866368361 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31e8031c40 con 0x7f31f8154af0 2024-05-15T15:40:17.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:17.931+0000 7f31ff9f3640 1 -- 172.21.15.12:0/2866368361 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31f80a57f0 con 0x7f31f8154af0 2024-05-15T15:40:17.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:17.931+0000 7f31f5ffb640 1 -- 172.21.15.12:0/2866368361 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31e8009450 con 0x7f31f8154af0 2024-05-15T15:40:17.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:17.931+0000 7f31ff9f3640 1 -- 172.21.15.12:0/2866368361 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31f80a5d80 con 0x7f31f8154af0 2024-05-15T15:40:17.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:17.932+0000 7f31ff9f3640 1 -- 172.21.15.12:0/2866368361 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31f80a59c0 con 0x7f31f8154af0 2024-05-15T15:40:17.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:17.933+0000 7f31f5ffb640 1 -- 172.21.15.12:0/2866368361 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f31e8043410 con 0x7f31f8154af0 2024-05-15T15:40:17.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:17.933+0000 7f31f5ffb640 1 --2- 172.21.15.12:0/2866368361 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f31e4076300 0x7f31e4078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:17.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:17.933+0000 7f31f5ffb640 1 -- 172.21.15.12:0/2866368361 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f31e80b83c0 con 0x7f31f8154af0 2024-05-15T15:40:17.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:17.933+0000 7f31fd78f640 1 --2- 172.21.15.12:0/2866368361 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f31e4076300 0x7f31e4078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:17.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:17.934+0000 7f31fd78f640 1 --2- 172.21.15.12:0/2866368361 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f31e4076300 0x7f31e4078810 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f31f0009af0 tx=0x7f31f0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:17.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:17.938+0000 7f31f5ffb640 1 -- 172.21.15.12:0/2866368361 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f31e804a070 con 0x7f31f8154af0 2024-05-15T15:40:18.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:18.129+0000 7f31ff9f3640 1 -- 172.21.15.12:0/2866368361 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f31f8069b50 con 0x7f31f8154af0 2024-05-15T15:40:18.134 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:18.133+0000 7f31f5ffb640 1 -- 172.21.15.12:0/2866368361 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7f31e8081c10 con 0x7f31f8154af0 2024-05-15T15:40:18.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:18.135+0000 7f31ff9f3640 1 -- 172.21.15.12:0/2866368361 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f31e4076300 msgr2=0x7f31e4078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:18.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:18.135+0000 7f31ff9f3640 1 --2- 172.21.15.12:0/2866368361 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f31e4076300 0x7f31e4078810 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f31f0009af0 tx=0x7f31f0008040 comp rx=0 tx=0).stop 2024-05-15T15:40:18.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:18.135+0000 7f31ff9f3640 1 -- 172.21.15.12:0/2866368361 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f31f8154af0 msgr2=0x7f31f81e2830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:18.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:18.135+0000 7f31ff9f3640 1 --2- 172.21.15.12:0/2866368361 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f31f8154af0 0x7f31f81e2830 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f31e802abe0 tx=0x7f31e8004a40 comp rx=0 tx=0).stop 2024-05-15T15:40:18.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:18.135+0000 7f31ff9f3640 1 -- 172.21.15.12:0/2866368361 shutdown_connections 2024-05-15T15:40:18.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:18.135+0000 7f31ff9f3640 1 --2- 172.21.15.12:0/2866368361 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f31e4076300 0x7f31e4078810 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:18.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:18.135+0000 7f31ff9f3640 1 --2- 172.21.15.12:0/2866368361 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f31f8154af0 0x7f31f81e2830 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:18.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:18.135+0000 7f31ff9f3640 1 --2- 172.21.15.12:0/2866368361 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31f814c220 0x7f31f80a52b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:18.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:18.135+0000 7f31ff9f3640 1 --2- 172.21.15.12:0/2866368361 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f31f80bfe60 0x7f31f80a42e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:18.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:18.135+0000 7f31ff9f3640 1 -- 172.21.15.12:0/2866368361 >> 172.21.15.12:0/2866368361 conn(0x7f31f80bd160 msgr2=0x7f31f80a1530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:18.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:18.135+0000 7f31ff9f3640 1 -- 172.21.15.12:0/2866368361 shutdown_connections 2024-05-15T15:40:18.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:18.135+0000 7f31ff9f3640 1 -- 172.21.15.12:0/2866368361 wait complete. 2024-05-15T15:40:18.149 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-05-15T15:40:18.149 DEBUG:teuthology.orchestra.run.smithi012:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-15T15:40:18.216 DEBUG:teuthology.orchestra.run.smithi084:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-15T15:40:18.296 DEBUG:teuthology.orchestra.run.smithi104:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-15T15:40:18.409 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-05-15T15:40:18.410 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-05-15T15:40:18.410 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-15T15:40:18.465 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-05-15T15:40:18.466 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-15T15:40:18.520 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-05-15T15:40:18.521 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-15T15:40:18.575 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-15T15:40:18.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:18.689+0000 7f921e613640 1 Processor -- start 2024-05-15T15:40:18.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:18.689+0000 7f921e613640 1 -- start start 2024-05-15T15:40:18.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:18.690+0000 7f921e613640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f92180b57f0 0x7f92180b9ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:18.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:18.690+0000 7f921e613640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92180bba80 con 0x7f92180bb490 2024-05-15T15:40:18.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:18.690+0000 7f921e613640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92180b4ff0 con 0x7f92180b4500 2024-05-15T15:40:18.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:18.690+0000 7f921e613640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f92180bbd60 con 0x7f92180b57f0 2024-05-15T15:40:18.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:18.690+0000 7f9217fff640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f92180bb490 0x7f921806faa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:47144/0 (socket says 172.21.15.12:47144) 2024-05-15T15:40:18.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:18.690+0000 7f9217fff640 1 -- 172.21.15.12:0/3646991435 learned_addr learned my addr 172.21.15.12:0/3646991435 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-05-15T15:40:18.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:18.690+0000 7f921cbb0640 1 --2- 172.21.15.12:0/3646991435 >> v2:172.21.15.12:3300/0 conn(0x7f92180b57f0 0x7f92180b9ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:18.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:18.691+0000 7f921cbb0640 1 -- 172.21.15.12:0/3646991435 >> v1:172.21.15.84:6789/0 conn(0x7f92180b4500 legacy=0x7f92180a4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:18.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:18.691+0000 7f921cbb0640 1 -- 172.21.15.12:0/3646991435 >> v1:172.21.15.12:6789/0 conn(0x7f92180bb490 legacy=0x7f921806faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:18.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:18.691+0000 7f9216ffd640 1 -- 172.21.15.12:0/3646991435 <== mon.1 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2319048059 0 0) 0x7f92180b4ff0 con 0x7f92180b4500 2024-05-15T15:40:18.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:18.691+0000 7f921cbb0640 1 -- 172.21.15.12:0/3646991435 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92180b52d0 con 0x7f92180b57f0 2024-05-15T15:40:18.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:18.691+0000 7f921cbb0640 1 --2- 172.21.15.12:0/3646991435 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92180b57f0 0x7f92180b9ee0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f9210009d90 tx=0x7f921002a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=807b3bf1b34e37a4 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:18.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:18.692+0000 7f9216ffd640 1 -- 172.21.15.12:0/3646991435 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9210007740 con 0x7f92180b57f0 2024-05-15T15:40:18.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:18.692+0000 7f9216ffd640 1 -- 172.21.15.12:0/3646991435 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92100078e0 con 0x7f92180b57f0 2024-05-15T15:40:18.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:18.692+0000 7f9216ffd640 1 -- 172.21.15.12:0/3646991435 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9210007cb0 con 0x7f92180b57f0 2024-05-15T15:40:18.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:18.692+0000 7f921e613640 1 -- 172.21.15.12:0/3646991435 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92180b57f0 msgr2=0x7f92180b9ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:18.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:18.692+0000 7f921e613640 1 --2- 172.21.15.12:0/3646991435 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92180b57f0 0x7f92180b9ee0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f9210009d90 tx=0x7f921002a560 comp rx=0 tx=0).stop 2024-05-15T15:40:18.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:18.692+0000 7f921e613640 1 -- 172.21.15.12:0/3646991435 shutdown_connections 2024-05-15T15:40:18.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:18.692+0000 7f921e613640 1 --2- 172.21.15.12:0/3646991435 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92180b57f0 0x7f92180b9ee0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:18.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:18.692+0000 7f921e613640 1 -- 172.21.15.12:0/3646991435 >> 172.21.15.12:0/3646991435 conn(0x7f92180a1ac0 msgr2=0x7f92180bbfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:18.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:18.692+0000 7f921e613640 1 -- 172.21.15.12:0/3646991435 shutdown_connections 2024-05-15T15:40:18.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:18.692+0000 7f921e613640 1 -- 172.21.15.12:0/3646991435 wait complete. 2024-05-15T15:40:18.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:18.694+0000 7f921e613640 1 Processor -- start 2024-05-15T15:40:18.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:18.694+0000 7f921e613640 1 -- start start 2024-05-15T15:40:18.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:18.695+0000 7f921e613640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92180b4500 0x7f921809d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:18.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:18.695+0000 7f921e613640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f92180b57f0 0x7f92180b8f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:18.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:18.695+0000 7f921e613640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f92180bb490 0x7f92181407a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:18.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:18.695+0000 7f921e613640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f92180a4790 con 0x7f92180b4500 2024-05-15T15:40:18.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:18.695+0000 7f921e613640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f92180ba420 con 0x7f92180bb490 2024-05-15T15:40:18.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:18.695+0000 7f921e613640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f9218156a80 con 0x7f92180b57f0 2024-05-15T15:40:18.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:18.695+0000 7f9217fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92180b4500 0x7f921809d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:18.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:18.695+0000 7f9217fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92180b4500 0x7f921809d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38140/0 (socket says 172.21.15.12:38140) 2024-05-15T15:40:18.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:18.695+0000 7f9217fff640 1 -- 172.21.15.12:0/40556549 learned_addr learned my addr 172.21.15.12:0/40556549 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:18.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:18.695+0000 7f92177fe640 1 --2- 172.21.15.12:0/40556549 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f92180b57f0 0x7f92180b8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:18.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:18.695+0000 7f921cbb0640 1 --2- 172.21.15.12:0/40556549 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f92180bb490 0x7f92181407a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:18.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:18.695+0000 7f9217fff640 1 -- 172.21.15.12:0/40556549 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f92180b57f0 msgr2=0x7f92180b8f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:18.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:18.695+0000 7f9217fff640 1 --2- 172.21.15.12:0/40556549 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f92180b57f0 0x7f92180b8f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:18.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:18.695+0000 7f9217fff640 1 -- 172.21.15.12:0/40556549 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f92180bb490 msgr2=0x7f92181407a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:18.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:18.695+0000 7f9217fff640 1 --2- 172.21.15.12:0/40556549 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f92180bb490 0x7f92181407a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:18.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:18.695+0000 7f9217fff640 1 -- 172.21.15.12:0/40556549 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f921809dba0 con 0x7f92180b4500 2024-05-15T15:40:18.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:18.695+0000 7f92177fe640 1 --2- 172.21.15.12:0/40556549 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f92180b57f0 0x7f92180b8f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-15T15:40:18.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:18.695+0000 7f921cbb0640 1 --2- 172.21.15.12:0/40556549 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f92180bb490 0x7f92181407a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-15T15:40:18.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:18.696+0000 7f9217fff640 1 --2- 172.21.15.12:0/40556549 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92180b4500 0x7f921809d660 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f920000c760 tx=0x7f920000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:18.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:18.696+0000 7f9214ff9640 1 -- 172.21.15.12:0/40556549 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9200018070 con 0x7f92180b4500 2024-05-15T15:40:18.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:18.696+0000 7f9214ff9640 1 -- 172.21.15.12:0/40556549 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92000072d0 con 0x7f92180b4500 2024-05-15T15:40:18.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:18.696+0000 7f921e613640 1 -- 172.21.15.12:0/40556549 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92180b9780 con 0x7f92180b4500 2024-05-15T15:40:18.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:18.696+0000 7f9214ff9640 1 -- 172.21.15.12:0/40556549 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92000047e0 con 0x7f92180b4500 2024-05-15T15:40:18.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:18.696+0000 7f921e613640 1 -- 172.21.15.12:0/40556549 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f921809c260 con 0x7f92180b4500 2024-05-15T15:40:18.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:18.697+0000 7f921e613640 1 -- 172.21.15.12:0/40556549 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92180a4560 con 0x7f92180b4500 2024-05-15T15:40:18.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:18.698+0000 7f9214ff9640 1 -- 172.21.15.12:0/40556549 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f920001b070 con 0x7f92180b4500 2024-05-15T15:40:18.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:18.698+0000 7f9214ff9640 1 --2- 172.21.15.12:0/40556549 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f91f80762d0 0x7f91f80787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:18.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:18.698+0000 7f92177fe640 1 --2- 172.21.15.12:0/40556549 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f91f80762d0 0x7f91f80787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:18.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:18.699+0000 7f9214ff9640 1 -- 172.21.15.12:0/40556549 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f9200096a70 con 0x7f92180b4500 2024-05-15T15:40:18.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:18.699+0000 7f92177fe640 1 --2- 172.21.15.12:0/40556549 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f91f80762d0 0x7f91f80787e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9218146640 tx=0x7f9208009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:18.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:18.703+0000 7f9214ff9640 1 -- 172.21.15.12:0/40556549 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f92180a4560 con 0x7f92180b4500 2024-05-15T15:40:18.910 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:18.908+0000 7f921e613640 1 -- 172.21.15.12:0/40556549 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f92180a2690 con 0x7f92180b4500 2024-05-15T15:40:18.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:18.909+0000 7f9214ff9640 1 -- 172.21.15.12:0/40556549 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) ==== 80+0+0 (secure 0 0 0) 0x7f921809dba0 con 0x7f92180b4500 2024-05-15T15:40:18.911 INFO:teuthology.orchestra.run.smithi012.stderr:listed 0 entries 2024-05-15T15:40:18.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:18.911+0000 7f921e613640 1 -- 172.21.15.12:0/40556549 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f91f80762d0 msgr2=0x7f91f80787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:18.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:18.911+0000 7f921e613640 1 --2- 172.21.15.12:0/40556549 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f91f80762d0 0x7f91f80787e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9218146640 tx=0x7f9208009040 comp rx=0 tx=0).stop 2024-05-15T15:40:18.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:18.911+0000 7f921e613640 1 -- 172.21.15.12:0/40556549 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92180b4500 msgr2=0x7f921809d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:18.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:18.911+0000 7f921e613640 1 --2- 172.21.15.12:0/40556549 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92180b4500 0x7f921809d660 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f920000c760 tx=0x7f920000cc20 comp rx=0 tx=0).stop 2024-05-15T15:40:18.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:18.911+0000 7f921e613640 1 -- 172.21.15.12:0/40556549 shutdown_connections 2024-05-15T15:40:18.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:18.911+0000 7f921e613640 1 --2- 172.21.15.12:0/40556549 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f92180bb490 0x7f92181407a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:18.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:18.911+0000 7f921e613640 1 --2- 172.21.15.12:0/40556549 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f92180b57f0 0x7f92180b8f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:18.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:18.911+0000 7f921e613640 1 --2- 172.21.15.12:0/40556549 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f91f80762d0 0x7f91f80787e0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:18.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:18.911+0000 7f921e613640 1 --2- 172.21.15.12:0/40556549 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92180b4500 0x7f921809d660 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:18.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:18.911+0000 7f921e613640 1 -- 172.21.15.12:0/40556549 >> 172.21.15.12:0/40556549 conn(0x7f92180a1ac0 msgr2=0x7f92180a3e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:18.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:18.911+0000 7f921e613640 1 -- 172.21.15.12:0/40556549 shutdown_connections 2024-05-15T15:40:18.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:18.911+0000 7f921e613640 1 -- 172.21.15.12:0/40556549 wait complete. 2024-05-15T15:40:18.924 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-05-15T15:40:18.925 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-15T15:40:18.925 DEBUG:teuthology.orchestra.run.smithi104:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-05-15T15:40:19.023 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi104.front.sepia.ceph.com 2024-05-15T15:40:19.023 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-15T15:40:19.023 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-15T15:40:19.080 INFO:tasks.cephfs.cephfs_test_case:[] 2024-05-15T15:40:19.080 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-15T15:40:19.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.190+0000 7f6c58054640 1 Processor -- start 2024-05-15T15:40:19.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.190+0000 7f6c58054640 1 -- start start 2024-05-15T15:40:19.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.191+0000 7f6c58054640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f6c500bd6d0 0x7f6c500be940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:19.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.191+0000 7f6c58054640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6c500bee80 0x7f6c50158e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:19.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.191+0000 7f6c58054640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c5006e140 con 0x7f6c50151fc0 2024-05-15T15:40:19.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.191+0000 7f6c58054640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f6c500c36f0 con 0x7f6c500bee80 2024-05-15T15:40:19.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.191+0000 7f6c58054640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f6c50152530 con 0x7f6c500bd6d0 2024-05-15T15:40:19.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.191+0000 7f6c55df0640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f6c50151fc0 0x7f6c5006da30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:47146/0 (socket says 172.21.15.12:47146) 2024-05-15T15:40:19.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.191+0000 7f6c55df0640 1 -- 172.21.15.12:0/2096251599 learned_addr learned my addr 172.21.15.12:0/2096251599 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-05-15T15:40:19.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.191+0000 7f6c565f1640 1 --2- 172.21.15.12:0/2096251599 >> v2:172.21.15.84:3300/0 conn(0x7f6c500bee80 0x7f6c50158e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:19.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.191+0000 7f6c555ef640 1 --2- 172.21.15.12:0/2096251599 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f6c500bd6d0 0x7f6c500be940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:19.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.192+0000 7f6c54dee640 1 -- 172.21.15.12:0/2096251599 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3856206286 0 0) 0x7f6c48001110 con 0x7f6c50151fc0 2024-05-15T15:40:19.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.192+0000 7f6c54dee640 1 -- 172.21.15.12:0/2096251599 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6c38003520 con 0x7f6c50151fc0 2024-05-15T15:40:19.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.192+0000 7f6c555ef640 1 -- 172.21.15.12:0/2096251599 >> v2:172.21.15.84:3300/0 conn(0x7f6c500bee80 msgr2=0x7f6c50158e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:40:19.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.192+0000 7f6c555ef640 1 --2- 172.21.15.12:0/2096251599 >> v2:172.21.15.84:3300/0 conn(0x7f6c500bee80 0x7f6c50158e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:19.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.192+0000 7f6c555ef640 1 -- 172.21.15.12:0/2096251599 >> v1:172.21.15.12:6789/0 conn(0x7f6c50151fc0 legacy=0x7f6c5006da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:19.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.192+0000 7f6c555ef640 1 -- 172.21.15.12:0/2096251599 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c50152810 con 0x7f6c500bd6d0 2024-05-15T15:40:19.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.192+0000 7f6c565f1640 1 --2- 172.21.15.12:0/2096251599 >> v2:172.21.15.84:3300/0 conn(0x7f6c500bee80 0x7f6c50158e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-15T15:40:19.196 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.193+0000 7f6c555ef640 1 --2- 172.21.15.12:0/2096251599 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f6c500bd6d0 0x7f6c500be940 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6c440097a0 tx=0x7f6c4402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c5ef4c27ab279570 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:19.196 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.193+0000 7f6c54dee640 1 -- 172.21.15.12:0/2096251599 <== mon.2 v2:172.21.15.84:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c44037070 con 0x7f6c500bd6d0 2024-05-15T15:40:19.196 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.193+0000 7f6c54dee640 1 -- 172.21.15.12:0/2096251599 <== mon.2 v2:172.21.15.84:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c44032440 con 0x7f6c500bd6d0 2024-05-15T15:40:19.196 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.193+0000 7f6c54dee640 1 -- 172.21.15.12:0/2096251599 <== mon.2 v2:172.21.15.84:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c440327f0 con 0x7f6c500bd6d0 2024-05-15T15:40:19.196 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.194+0000 7f6c58054640 1 -- 172.21.15.12:0/2096251599 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f6c500bd6d0 msgr2=0x7f6c500be940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:19.196 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.194+0000 7f6c58054640 1 --2- 172.21.15.12:0/2096251599 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f6c500bd6d0 0x7f6c500be940 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6c440097a0 tx=0x7f6c4402a180 comp rx=0 tx=0).stop 2024-05-15T15:40:19.196 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.194+0000 7f6c58054640 1 -- 172.21.15.12:0/2096251599 shutdown_connections 2024-05-15T15:40:19.197 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.194+0000 7f6c58054640 1 --2- 172.21.15.12:0/2096251599 >> v2:172.21.15.84:3300/0 conn(0x7f6c500bee80 0x7f6c50158e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:19.197 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.194+0000 7f6c58054640 1 --2- 172.21.15.12:0/2096251599 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f6c500bd6d0 0x7f6c500be940 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:19.197 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.194+0000 7f6c58054640 1 -- 172.21.15.12:0/2096251599 >> 172.21.15.12:0/2096251599 conn(0x7f6c500c3d20 msgr2=0x7f6c500c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:19.197 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.194+0000 7f6c58054640 1 -- 172.21.15.12:0/2096251599 shutdown_connections 2024-05-15T15:40:19.197 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.194+0000 7f6c58054640 1 -- 172.21.15.12:0/2096251599 wait complete. 2024-05-15T15:40:19.197 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.195+0000 7f6c58054640 1 Processor -- start 2024-05-15T15:40:19.197 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.195+0000 7f6c58054640 1 -- start start 2024-05-15T15:40:19.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.196+0000 7f6c58054640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c500bd6d0 0x7f6c500b8620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:19.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.196+0000 7f6c58054640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c500bee80 0x7f6c5014b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:19.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.196+0000 7f6c58054640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f6c50151fc0 0x7f6c5014b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:19.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.196+0000 7f6c58054640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f6c500bdae0 con 0x7f6c500bee80 2024-05-15T15:40:19.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.196+0000 7f6c58054640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f6c500c0070 con 0x7f6c500bd6d0 2024-05-15T15:40:19.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.196+0000 7f6c58054640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f6c500a2ed0 con 0x7f6c50151fc0 2024-05-15T15:40:19.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.196+0000 7f6c555ef640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c500bee80 0x7f6c5014b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:19.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.196+0000 7f6c555ef640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c500bee80 0x7f6c5014b480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38142/0 (socket says 172.21.15.12:38142) 2024-05-15T15:40:19.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.196+0000 7f6c555ef640 1 -- 172.21.15.12:0/758143230 learned_addr learned my addr 172.21.15.12:0/758143230 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:19.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.196+0000 7f6c55df0640 1 --2- 172.21.15.12:0/758143230 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c500bd6d0 0x7f6c500b8620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:19.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.196+0000 7f6c565f1640 1 --2- 172.21.15.12:0/758143230 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f6c50151fc0 0x7f6c5014b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:19.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.197+0000 7f6c555ef640 1 -- 172.21.15.12:0/758143230 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f6c50151fc0 msgr2=0x7f6c5014b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:19.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.197+0000 7f6c555ef640 1 --2- 172.21.15.12:0/758143230 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f6c50151fc0 0x7f6c5014b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:19.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.197+0000 7f6c555ef640 1 -- 172.21.15.12:0/758143230 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c500bd6d0 msgr2=0x7f6c500b8620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:19.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.197+0000 7f6c555ef640 1 --2- 172.21.15.12:0/758143230 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c500bd6d0 0x7f6c500b8620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:19.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.197+0000 7f6c555ef640 1 -- 172.21.15.12:0/758143230 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c500b8ee0 con 0x7f6c500bee80 2024-05-15T15:40:19.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.197+0000 7f6c555ef640 1 --2- 172.21.15.12:0/758143230 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c500bee80 0x7f6c5014b480 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6c440097a0 tx=0x7f6c440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:19.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.197+0000 7f6c4e7fc640 1 -- 172.21.15.12:0/758143230 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c44037050 con 0x7f6c500bee80 2024-05-15T15:40:19.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.197+0000 7f6c4e7fc640 1 -- 172.21.15.12:0/758143230 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c44038040 con 0x7f6c500bee80 2024-05-15T15:40:19.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.197+0000 7f6c58054640 1 -- 172.21.15.12:0/758143230 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c5014ebf0 con 0x7f6c500bee80 2024-05-15T15:40:19.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.197+0000 7f6c4e7fc640 1 -- 172.21.15.12:0/758143230 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c44004490 con 0x7f6c500bee80 2024-05-15T15:40:19.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.197+0000 7f6c58054640 1 -- 172.21.15.12:0/758143230 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c5014bf00 con 0x7f6c500bee80 2024-05-15T15:40:19.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.198+0000 7f6c58054640 1 -- 172.21.15.12:0/758143230 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c50050940 con 0x7f6c500bee80 2024-05-15T15:40:19.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.199+0000 7f6c4e7fc640 1 -- 172.21.15.12:0/758143230 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f6c44003610 con 0x7f6c500bee80 2024-05-15T15:40:19.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.199+0000 7f6c4e7fc640 1 --2- 172.21.15.12:0/758143230 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f6c3c076300 0x7f6c3c078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:19.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.199+0000 7f6c4e7fc640 1 -- 172.21.15.12:0/758143230 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f6c440b7d20 con 0x7f6c500bee80 2024-05-15T15:40:19.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.199+0000 7f6c55df0640 1 --2- 172.21.15.12:0/758143230 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f6c3c076300 0x7f6c3c078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:19.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.200+0000 7f6c55df0640 1 --2- 172.21.15.12:0/758143230 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f6c3c076300 0x7f6c3c078810 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6c48005880 tx=0x7f6c48009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:19.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.204+0000 7f6c4e7fc640 1 -- 172.21.15.12:0/758143230 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f6c44081710 con 0x7f6c500bee80 2024-05-15T15:40:19.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.434+0000 7f6c58054640 1 -- 172.21.15.12:0/758143230 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6c5006eb40 con 0x7f6c500bee80 2024-05-15T15:40:19.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.435+0000 7f6c4e7fc640 1 -- 172.21.15.12:0/758143230 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+4351 (secure 0 0 0) 0x7f6c44081010 con 0x7f6c500bee80 2024-05-15T15:40:19.437 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-05-15T15:40:19.437 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6834/1290912681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":1290912681},{"type":"v1","addr":"172.21.15.12:6834","nonce":1290912681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/2920770671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6833","nonce":2920770671},{"type":"v1","addr":"172.21.15.12:6835","nonce":2920770671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-15T15:39:51.829483+0000","modified":"2024-05-15T15:39:54.852086+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6835/3699736653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3699736653},{"type":"v1","addr":"172.21.15.84:6835","nonce":3699736653}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4288,"qdb_cluster":[4288]},"id":1}]} 2024-05-15T15:40:19.437 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 7 2024-05-15T15:40:19.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.437+0000 7f6c58054640 1 -- 172.21.15.12:0/758143230 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f6c3c076300 msgr2=0x7f6c3c078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:19.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.437+0000 7f6c58054640 1 --2- 172.21.15.12:0/758143230 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f6c3c076300 0x7f6c3c078810 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6c48005880 tx=0x7f6c48009040 comp rx=0 tx=0).stop 2024-05-15T15:40:19.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.437+0000 7f6c58054640 1 -- 172.21.15.12:0/758143230 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c500bee80 msgr2=0x7f6c5014b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:19.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.437+0000 7f6c58054640 1 --2- 172.21.15.12:0/758143230 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c500bee80 0x7f6c5014b480 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6c440097a0 tx=0x7f6c440046c0 comp rx=0 tx=0).stop 2024-05-15T15:40:19.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.437+0000 7f6c58054640 1 -- 172.21.15.12:0/758143230 shutdown_connections 2024-05-15T15:40:19.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.437+0000 7f6c58054640 1 --2- 172.21.15.12:0/758143230 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f6c50151fc0 0x7f6c5014b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:19.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.437+0000 7f6c58054640 1 --2- 172.21.15.12:0/758143230 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f6c3c076300 0x7f6c3c078810 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:19.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.437+0000 7f6c58054640 1 --2- 172.21.15.12:0/758143230 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c500bee80 0x7f6c5014b480 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:19.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.437+0000 7f6c58054640 1 --2- 172.21.15.12:0/758143230 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c500bd6d0 0x7f6c500b8620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:19.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.437+0000 7f6c58054640 1 -- 172.21.15.12:0/758143230 >> 172.21.15.12:0/758143230 conn(0x7f6c500c3d20 msgr2=0x7f6c500bbbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:19.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.437+0000 7f6c58054640 1 -- 172.21.15.12:0/758143230 shutdown_connections 2024-05-15T15:40:19.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.437+0000 7f6c58054640 1 -- 172.21.15.12:0/758143230 wait complete. 2024-05-15T15:40:19.451 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-15T15:40:19.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.559+0000 7f0aac357640 1 Processor -- start 2024-05-15T15:40:19.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.559+0000 7f0aac357640 1 -- start start 2024-05-15T15:40:19.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.561+0000 7f0aac357640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f0aa414e530 0x7f0aa40ba320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:19.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.561+0000 7f0aac357640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0aa40ba860 con 0x7f0aa40b8d70 2024-05-15T15:40:19.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.561+0000 7f0aac357640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0aa414ece0 con 0x7f0aa40bd440 2024-05-15T15:40:19.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.561+0000 7f0aac357640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f0aa40b88e0 con 0x7f0aa414e530 2024-05-15T15:40:19.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.561+0000 7f0aaa8f4640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f0aa40b8d70 0x7f0aa40b9180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:47162/0 (socket says 172.21.15.12:47162) 2024-05-15T15:40:19.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.561+0000 7f0aaa8f4640 1 -- 172.21.15.12:0/2034966522 learned_addr learned my addr 172.21.15.12:0/2034966522 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-05-15T15:40:19.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.561+0000 7f0aaa0f3640 1 --2- 172.21.15.12:0/2034966522 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f0aa414e530 0x7f0aa40ba320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:19.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.561+0000 7f0aa90f1640 1 -- 172.21.15.12:0/2034966522 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1060947910 0 0) 0x7f0aa40ba860 con 0x7f0aa40b8d70 2024-05-15T15:40:19.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.561+0000 7f0aa90f1640 1 -- 172.21.15.12:0/2034966522 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0a8c003520 con 0x7f0aa40b8d70 2024-05-15T15:40:19.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.561+0000 7f0aa90f1640 1 -- 172.21.15.12:0/2034966522 <== mon.1 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4041680447 0 0) 0x7f0aa414ece0 con 0x7f0aa40bd440 2024-05-15T15:40:19.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.561+0000 7f0aa90f1640 1 -- 172.21.15.12:0/2034966522 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0aa40ba860 con 0x7f0aa40bd440 2024-05-15T15:40:19.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.561+0000 7f0aa90f1640 1 -- 172.21.15.12:0/2034966522 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 648777193 0 0) 0x7f0a8c003520 con 0x7f0aa40b8d70 2024-05-15T15:40:19.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.561+0000 7f0aaa0f3640 1 -- 172.21.15.12:0/2034966522 >> v1:172.21.15.84:6789/0 conn(0x7f0aa40bd440 legacy=0x7f0aa40bd850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:19.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.561+0000 7f0aaa0f3640 1 -- 172.21.15.12:0/2034966522 >> v1:172.21.15.12:6789/0 conn(0x7f0aa40b8d70 legacy=0x7f0aa40b9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:19.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.561+0000 7f0aaa0f3640 1 -- 172.21.15.12:0/2034966522 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0aa414efc0 con 0x7f0aa414e530 2024-05-15T15:40:19.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.562+0000 7f0aaa0f3640 1 --2- 172.21.15.12:0/2034966522 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f0aa414e530 0x7f0aa40ba320 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c0097c0 tx=0x7f0a9c02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1f08151e1b2517cd server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:19.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.562+0000 7f0aa90f1640 1 -- 172.21.15.12:0/2034966522 <== mon.2 v2:172.21.15.84:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a9c037070 con 0x7f0aa414e530 2024-05-15T15:40:19.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.562+0000 7f0aa90f1640 1 -- 172.21.15.12:0/2034966522 <== mon.2 v2:172.21.15.84:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a9c02ac10 con 0x7f0aa414e530 2024-05-15T15:40:19.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.562+0000 7f0aa90f1640 1 -- 172.21.15.12:0/2034966522 <== mon.2 v2:172.21.15.84:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a94001a70 con 0x7f0aa414e530 2024-05-15T15:40:19.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.563+0000 7f0aac357640 1 -- 172.21.15.12:0/2034966522 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f0aa414e530 msgr2=0x7f0aa40ba320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:19.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.563+0000 7f0aac357640 1 --2- 172.21.15.12:0/2034966522 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f0aa414e530 0x7f0aa40ba320 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c0097c0 tx=0x7f0a9c02a180 comp rx=0 tx=0).stop 2024-05-15T15:40:19.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.563+0000 7f0aac357640 1 -- 172.21.15.12:0/2034966522 shutdown_connections 2024-05-15T15:40:19.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.563+0000 7f0aac357640 1 --2- 172.21.15.12:0/2034966522 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f0aa414e530 0x7f0aa40ba320 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:19.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.563+0000 7f0aac357640 1 -- 172.21.15.12:0/2034966522 >> 172.21.15.12:0/2034966522 conn(0x7f0aa40c0570 msgr2=0x7f0aa40c0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:19.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.563+0000 7f0aac357640 1 -- 172.21.15.12:0/2034966522 shutdown_connections 2024-05-15T15:40:19.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.563+0000 7f0aac357640 1 -- 172.21.15.12:0/2034966522 wait complete. 2024-05-15T15:40:19.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.565+0000 7f0aac357640 1 Processor -- start 2024-05-15T15:40:19.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.565+0000 7f0aac357640 1 -- start start 2024-05-15T15:40:19.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.566+0000 7f0aac357640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f0aa40b8d70 0x7f0aa41e4100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:19.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.566+0000 7f0aac357640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0aa40bd440 0x7f0aa41436e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:19.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.566+0000 7f0aac357640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0aa414e530 0x7f0aa414f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:19.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.566+0000 7f0aac357640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f0aa414e940 con 0x7f0aa40bd440 2024-05-15T15:40:19.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.566+0000 7f0aac357640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f0aa40bbb70 con 0x7f0aa414e530 2024-05-15T15:40:19.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.566+0000 7f0aac357640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f0aa414eac0 con 0x7f0aa40b8d70 2024-05-15T15:40:19.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.566+0000 7f0aa98f2640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0aa40bd440 0x7f0aa41436e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:19.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.566+0000 7f0aa98f2640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0aa40bd440 0x7f0aa41436e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38152/0 (socket says 172.21.15.12:38152) 2024-05-15T15:40:19.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.566+0000 7f0aa98f2640 1 -- 172.21.15.12:0/4248333059 learned_addr learned my addr 172.21.15.12:0/4248333059 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:19.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.566+0000 7f0aaa8f4640 1 --2- 172.21.15.12:0/4248333059 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0aa414e530 0x7f0aa414f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:19.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.566+0000 7f0aaa0f3640 1 --2- 172.21.15.12:0/4248333059 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f0aa40b8d70 0x7f0aa41e4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:19.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.566+0000 7f0aa98f2640 1 -- 172.21.15.12:0/4248333059 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f0aa40b8d70 msgr2=0x7f0aa41e4100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:19.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.566+0000 7f0aa98f2640 1 --2- 172.21.15.12:0/4248333059 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f0aa40b8d70 0x7f0aa41e4100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:19.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.566+0000 7f0aa98f2640 1 -- 172.21.15.12:0/4248333059 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0aa414e530 msgr2=0x7f0aa414f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:19.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.566+0000 7f0aa98f2640 1 --2- 172.21.15.12:0/4248333059 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0aa414e530 0x7f0aa414f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:19.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.566+0000 7f0aa98f2640 1 -- 172.21.15.12:0/4248333059 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0aa4143c20 con 0x7f0aa40bd440 2024-05-15T15:40:19.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.566+0000 7f0aa98f2640 1 --2- 172.21.15.12:0/4248333059 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0aa40bd440 0x7f0aa41436e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0a9800c460 tx=0x7f0a9800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:19.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.567+0000 7f0aa2ffd640 1 -- 172.21.15.12:0/4248333059 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a980052d0 con 0x7f0aa40bd440 2024-05-15T15:40:19.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.567+0000 7f0aa2ffd640 1 -- 172.21.15.12:0/4248333059 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a98005490 con 0x7f0aa40bd440 2024-05-15T15:40:19.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.567+0000 7f0aac357640 1 -- 172.21.15.12:0/4248333059 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0aa414fdd0 con 0x7f0aa40bd440 2024-05-15T15:40:19.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.567+0000 7f0aa2ffd640 1 -- 172.21.15.12:0/4248333059 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a98012870 con 0x7f0aa40bd440 2024-05-15T15:40:19.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.567+0000 7f0aac357640 1 -- 172.21.15.12:0/4248333059 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0aa41e7b10 con 0x7f0aa40bd440 2024-05-15T15:40:19.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.568+0000 7f0aac357640 1 -- 172.21.15.12:0/4248333059 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0aa4074520 con 0x7f0aa40bd440 2024-05-15T15:40:19.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.568+0000 7f0aa2ffd640 1 -- 172.21.15.12:0/4248333059 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0a98012a10 con 0x7f0aa40bd440 2024-05-15T15:40:19.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.569+0000 7f0aa2ffd640 1 --2- 172.21.15.12:0/4248333059 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f0a900762d0 0x7f0a900787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:19.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.569+0000 7f0aa2ffd640 1 -- 172.21.15.12:0/4248333059 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f0a98097170 con 0x7f0aa40bd440 2024-05-15T15:40:19.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.569+0000 7f0aaa0f3640 1 --2- 172.21.15.12:0/4248333059 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f0a900762d0 0x7f0a900787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:19.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.569+0000 7f0aaa0f3640 1 --2- 172.21.15.12:0/4248333059 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f0a900762d0 0x7f0a900787e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c034000 tx=0x7f0a9c02e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:19.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.573+0000 7f0aa2ffd640 1 -- 172.21.15.12:0/4248333059 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f0aa4074520 con 0x7f0aa40bd440 2024-05-15T15:40:19.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.804+0000 7f0aac357640 1 -- 172.21.15.12:0/4248333059 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0aa4050940 con 0x7f0aa40bd440 2024-05-15T15:40:19.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.805+0000 7f0aa2ffd640 1 -- 172.21.15.12:0/4248333059 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+4351 (secure 0 0 0) 0x7f0aa414fdd0 con 0x7f0aa40bd440 2024-05-15T15:40:19.807 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-05-15T15:40:19.807 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6834/1290912681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":1290912681},{"type":"v1","addr":"172.21.15.12:6834","nonce":1290912681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/2920770671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6833","nonce":2920770671},{"type":"v1","addr":"172.21.15.12:6835","nonce":2920770671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-15T15:39:51.829483+0000","modified":"2024-05-15T15:39:54.852086+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6835/3699736653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3699736653},{"type":"v1","addr":"172.21.15.84:6835","nonce":3699736653}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4288,"qdb_cluster":[4288]},"id":1}]} 2024-05-15T15:40:19.807 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 7 2024-05-15T15:40:19.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.807+0000 7f0aac357640 1 -- 172.21.15.12:0/4248333059 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f0a900762d0 msgr2=0x7f0a900787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:19.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.807+0000 7f0aac357640 1 --2- 172.21.15.12:0/4248333059 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f0a900762d0 0x7f0a900787e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c034000 tx=0x7f0a9c02e000 comp rx=0 tx=0).stop 2024-05-15T15:40:19.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.807+0000 7f0aac357640 1 -- 172.21.15.12:0/4248333059 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0aa40bd440 msgr2=0x7f0aa41436e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:19.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.807+0000 7f0aac357640 1 --2- 172.21.15.12:0/4248333059 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0aa40bd440 0x7f0aa41436e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0a9800c460 tx=0x7f0a9800c920 comp rx=0 tx=0).stop 2024-05-15T15:40:19.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.807+0000 7f0aac357640 1 -- 172.21.15.12:0/4248333059 shutdown_connections 2024-05-15T15:40:19.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.807+0000 7f0aac357640 1 --2- 172.21.15.12:0/4248333059 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0aa414e530 0x7f0aa414f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:19.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.807+0000 7f0aac357640 1 --2- 172.21.15.12:0/4248333059 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f0a900762d0 0x7f0a900787e0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:19.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.807+0000 7f0aac357640 1 --2- 172.21.15.12:0/4248333059 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0aa40bd440 0x7f0aa41436e0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:19.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.807+0000 7f0aac357640 1 --2- 172.21.15.12:0/4248333059 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f0aa40b8d70 0x7f0aa41e4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:19.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.807+0000 7f0aac357640 1 -- 172.21.15.12:0/4248333059 >> 172.21.15.12:0/4248333059 conn(0x7f0aa40c0570 msgr2=0x7f0aa4073e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:19.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.807+0000 7f0aac357640 1 -- 172.21.15.12:0/4248333059 shutdown_connections 2024-05-15T15:40:19.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.807+0000 7f0aac357640 1 -- 172.21.15.12:0/4248333059 wait complete. 2024-05-15T15:40:19.824 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-15T15:40:19.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.933+0000 7fa913134640 1 Processor -- start 2024-05-15T15:40:19.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.933+0000 7fa913134640 1 -- start start 2024-05-15T15:40:19.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.935+0000 7fa913134640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa90c0bf9b0 0x7fa90c0bfdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:19.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.935+0000 7fa913134640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa90c0c1390 con 0x7fa90c14e360 2024-05-15T15:40:19.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.935+0000 7fa913134640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa90c0c0620 con 0x7fa90c148770 2024-05-15T15:40:19.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.935+0000 7fa913134640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fa90c151e40 con 0x7fa90c0bf9b0 2024-05-15T15:40:19.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.935+0000 7fa9116d1640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa90c0bf9b0 0x7fa90c0bfdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:19.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.935+0000 7fa9116d1640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa90c0bf9b0 0x7fa90c0bfdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38164/0 (socket says 172.21.15.12:38164) 2024-05-15T15:40:19.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.935+0000 7fa9116d1640 1 -- 172.21.15.12:0/1128705577 learned_addr learned my addr 172.21.15.12:0/1128705577 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:19.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.935+0000 7fa9116d1640 1 -- 172.21.15.12:0/1128705577 >> v1:172.21.15.84:6789/0 conn(0x7fa90c148770 legacy=0x7fa90c0c0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:40:19.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.935+0000 7fa9116d1640 1 -- 172.21.15.12:0/1128705577 >> v1:172.21.15.12:6789/0 conn(0x7fa90c14e360 legacy=0x7fa90c1522d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:19.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.935+0000 7fa9116d1640 1 -- 172.21.15.12:0/1128705577 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa90c151ad0 con 0x7fa90c0bf9b0 2024-05-15T15:40:19.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.935+0000 7fa90b7fe640 1 -- 172.21.15.12:0/1128705577 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2852095878 0 0) 0x7fa8fc001110 con 0x7fa90c14e360 2024-05-15T15:40:19.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.936+0000 7fa9116d1640 1 --2- 172.21.15.12:0/1128705577 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa90c0bf9b0 0x7fa90c0bfdc0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa904009e80 tx=0x7fa90402a7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=175dd485c4e05a5b server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:19.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.936+0000 7fa90b7fe640 1 -- 172.21.15.12:0/1128705577 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa904036070 con 0x7fa90c0bf9b0 2024-05-15T15:40:19.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.936+0000 7fa90b7fe640 1 -- 172.21.15.12:0/1128705577 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa904031600 con 0x7fa90c0bf9b0 2024-05-15T15:40:19.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.936+0000 7fa90b7fe640 1 -- 172.21.15.12:0/1128705577 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9040319d0 con 0x7fa90c0bf9b0 2024-05-15T15:40:19.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.937+0000 7fa913134640 1 -- 172.21.15.12:0/1128705577 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa90c0bf9b0 msgr2=0x7fa90c0bfdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:19.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.937+0000 7fa913134640 1 --2- 172.21.15.12:0/1128705577 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa90c0bf9b0 0x7fa90c0bfdc0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa904009e80 tx=0x7fa90402a7e0 comp rx=0 tx=0).stop 2024-05-15T15:40:19.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.937+0000 7fa913134640 1 -- 172.21.15.12:0/1128705577 shutdown_connections 2024-05-15T15:40:19.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.937+0000 7fa913134640 1 --2- 172.21.15.12:0/1128705577 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa90c0bf9b0 0x7fa90c0bfdc0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:19.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.937+0000 7fa913134640 1 -- 172.21.15.12:0/1128705577 >> 172.21.15.12:0/1128705577 conn(0x7fa90c0c17c0 msgr2=0x7fa90c0c1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:19.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.937+0000 7fa913134640 1 -- 172.21.15.12:0/1128705577 shutdown_connections 2024-05-15T15:40:19.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.937+0000 7fa913134640 1 -- 172.21.15.12:0/1128705577 wait complete. 2024-05-15T15:40:19.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.938+0000 7fa913134640 1 Processor -- start 2024-05-15T15:40:19.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.938+0000 7fa913134640 1 -- start start 2024-05-15T15:40:19.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.939+0000 7fa913134640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa90c0bf9b0 0x7fa90c0713a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:19.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.939+0000 7fa913134640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa90c148770 0x7fa90c0b7720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:19.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.939+0000 7fa913134640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa90c14e360 0x7fa90c1e7f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:19.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.939+0000 7fa913134640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa90c159e50 con 0x7fa90c148770 2024-05-15T15:40:19.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.939+0000 7fa913134640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa90c159cd0 con 0x7fa90c14e360 2024-05-15T15:40:19.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.939+0000 7fa913134640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fa90c159fd0 con 0x7fa90c0bf9b0 2024-05-15T15:40:19.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.939+0000 7fa90bfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa90c148770 0x7fa90c0b7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:19.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.939+0000 7fa90bfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa90c148770 0x7fa90c0b7720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38174/0 (socket says 172.21.15.12:38174) 2024-05-15T15:40:19.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.940+0000 7fa90bfff640 1 -- 172.21.15.12:0/3471112391 learned_addr learned my addr 172.21.15.12:0/3471112391 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:19.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.940+0000 7fa910ed0640 1 --2- 172.21.15.12:0/3471112391 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa90c0bf9b0 0x7fa90c0713a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:19.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.940+0000 7fa9116d1640 1 --2- 172.21.15.12:0/3471112391 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa90c14e360 0x7fa90c1e7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:19.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.940+0000 7fa90bfff640 1 -- 172.21.15.12:0/3471112391 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa90c0bf9b0 msgr2=0x7fa90c0713a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:19.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.940+0000 7fa90bfff640 1 --2- 172.21.15.12:0/3471112391 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa90c0bf9b0 0x7fa90c0713a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:19.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.940+0000 7fa90bfff640 1 -- 172.21.15.12:0/3471112391 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa90c14e360 msgr2=0x7fa90c1e7f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:19.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.940+0000 7fa90bfff640 1 --2- 172.21.15.12:0/3471112391 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa90c14e360 0x7fa90c1e7f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:19.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.940+0000 7fa90bfff640 1 -- 172.21.15.12:0/3471112391 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa90c072660 con 0x7fa90c148770 2024-05-15T15:40:19.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.940+0000 7fa90bfff640 1 --2- 172.21.15.12:0/3471112391 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa90c148770 0x7fa90c0b7720 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa90000b3f0 tx=0x7fa90000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:19.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.940+0000 7fa9097fa640 1 -- 172.21.15.12:0/3471112391 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa900015020 con 0x7fa90c148770 2024-05-15T15:40:19.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.940+0000 7fa9097fa640 1 -- 172.21.15.12:0/3471112391 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa900011830 con 0x7fa90c148770 2024-05-15T15:40:19.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.940+0000 7fa913134640 1 -- 172.21.15.12:0/3471112391 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa90c070ba0 con 0x7fa90c148770 2024-05-15T15:40:19.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.940+0000 7fa9097fa640 1 -- 172.21.15.12:0/3471112391 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa900011c20 con 0x7fa90c148770 2024-05-15T15:40:19.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.940+0000 7fa913134640 1 -- 172.21.15.12:0/3471112391 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa90c0b7c60 con 0x7fa90c148770 2024-05-15T15:40:19.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.941+0000 7fa913134640 1 -- 172.21.15.12:0/3471112391 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa90c159ab0 con 0x7fa90c148770 2024-05-15T15:40:19.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.942+0000 7fa9097fa640 1 -- 172.21.15.12:0/3471112391 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa900018020 con 0x7fa90c148770 2024-05-15T15:40:19.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.942+0000 7fa9097fa640 1 --2- 172.21.15.12:0/3471112391 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fa8f8076300 0x7fa8f8078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:19.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.943+0000 7fa9097fa640 1 -- 172.21.15.12:0/3471112391 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fa9000974a0 con 0x7fa90c148770 2024-05-15T15:40:19.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.943+0000 7fa910ed0640 1 --2- 172.21.15.12:0/3471112391 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fa8f8076300 0x7fa8f8078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:19.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.943+0000 7fa910ed0640 1 --2- 172.21.15.12:0/3471112391 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fa8f8076300 0x7fa8f8078810 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa8fc007fd0 tx=0x7fa8fc009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:19.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:19.947+0000 7fa9097fa640 1 -- 172.21.15.12:0/3471112391 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fa90001f020 con 0x7fa90c148770 2024-05-15T15:40:20.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.138+0000 7fa913134640 1 -- 172.21.15.12:0/3471112391 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa90c050940 con 0x7fa90c148770 2024-05-15T15:40:20.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.139+0000 7fa9097fa640 1 -- 172.21.15.12:0/3471112391 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16573 (secure 0 0 0) 0x7fa900060e90 con 0x7fa90c148770 2024-05-15T15:40:20.141 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-05-15T15:40:20.141 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":23,"fsid":"3b7fc4b2-b85c-49b5-a5de-38444eeed40d","created":"2024-05-15T15:39:28.392476+0000","modified":"2024-05-15T15:39:53.451332+0000","last_up_change":"2024-05-15T15:39:39.363983+0000","last_in_change":"2024-05-15T15:39:30.591216+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-15T15:39:40.715999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-15T15:39:49.598723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-15T15:39:50.783054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0d06a12a-866a-418e-9776-704d74354579","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":3943681952},{"type":"v1","addr":"172.21.15.12:6809","nonce":3943681952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":3943681952},{"type":"v1","addr":"172.21.15.12:6812","nonce":3943681952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":3943681952},{"type":"v1","addr":"172.21.15.12:6821","nonce":3943681952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":3943681952},{"type":"v1","addr":"172.21.15.12:6816","nonce":3943681952}]},"public_addr":"172.21.15.12:6809/3943681952","cluster_addr":"172.21.15.12:6812/3943681952","heartbeat_back_addr":"172.21.15.12:6821/3943681952","heartbeat_front_addr":"172.21.15.12:6816/3943681952","state":["exists","up"]},{"osd":1,"uuid":"09d0fa19-9ef8-4f35-bf99-6e86658c6f10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6811","nonce":1763752148},{"type":"v1","addr":"172.21.15.12:6813","nonce":1763752148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":1763752148},{"type":"v1","addr":"172.21.15.12:6817","nonce":1763752148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":1763752148},{"type":"v1","addr":"172.21.15.12:6827","nonce":1763752148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6819","nonce":1763752148},{"type":"v1","addr":"172.21.15.12:6822","nonce":1763752148}]},"public_addr":"172.21.15.12:6813/1763752148","cluster_addr":"172.21.15.12:6817/1763752148","heartbeat_back_addr":"172.21.15.12:6827/1763752148","heartbeat_front_addr":"172.21.15.12:6822/1763752148","state":["exists","up"]},{"osd":2,"uuid":"b204c6ad-f431-40a5-ba27-9844294f0ece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":2173702802},{"type":"v1","addr":"172.21.15.12:6823","nonce":2173702802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":2173702802},{"type":"v1","addr":"172.21.15.12:6826","nonce":2173702802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":2173702802},{"type":"v1","addr":"172.21.15.12:6831","nonce":2173702802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":2173702802},{"type":"v1","addr":"172.21.15.12:6829","nonce":2173702802}]},"public_addr":"172.21.15.12:6823/2173702802","cluster_addr":"172.21.15.12:6826/2173702802","heartbeat_back_addr":"172.21.15.12:6831/2173702802","heartbeat_front_addr":"172.21.15.12:6829/2173702802","state":["exists","up"]},{"osd":3,"uuid":"660a9ccb-2ee5-42d8-8481-0835047a8260","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":3956443113},{"type":"v1","addr":"172.21.15.12:6801","nonce":3956443113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":3956443113},{"type":"v1","addr":"172.21.15.12:6803","nonce":3956443113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":3956443113},{"type":"v1","addr":"172.21.15.12:6807","nonce":3956443113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":3956443113},{"type":"v1","addr":"172.21.15.12:6805","nonce":3956443113}]},"public_addr":"172.21.15.12:6801/3956443113","cluster_addr":"172.21.15.12:6803/3956443113","heartbeat_back_addr":"172.21.15.12:6807/3956443113","heartbeat_front_addr":"172.21.15.12:6805/3956443113","state":["exists","up"]},{"osd":4,"uuid":"9eef1461-a961-457c-9a78-43b5098a46a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":1021092792},{"type":"v1","addr":"172.21.15.84:6809","nonce":1021092792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":1021092792},{"type":"v1","addr":"172.21.15.84:6811","nonce":1021092792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":1021092792},{"type":"v1","addr":"172.21.15.84:6815","nonce":1021092792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":1021092792},{"type":"v1","addr":"172.21.15.84:6813","nonce":1021092792}]},"public_addr":"172.21.15.84:6809/1021092792","cluster_addr":"172.21.15.84:6811/1021092792","heartbeat_back_addr":"172.21.15.84:6815/1021092792","heartbeat_front_addr":"172.21.15.84:6813/1021092792","state":["exists","up"]},{"osd":5,"uuid":"5f924e2f-6c71-4741-a727-d3710c438431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":3173527851},{"type":"v1","addr":"172.21.15.84:6801","nonce":3173527851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":3173527851},{"type":"v1","addr":"172.21.15.84:6803","nonce":3173527851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":3173527851},{"type":"v1","addr":"172.21.15.84:6807","nonce":3173527851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":3173527851},{"type":"v1","addr":"172.21.15.84:6805","nonce":3173527851}]},"public_addr":"172.21.15.84:6801/3173527851","cluster_addr":"172.21.15.84:6803/3173527851","heartbeat_back_addr":"172.21.15.84:6807/3173527851","heartbeat_front_addr":"172.21.15.84:6805/3173527851","state":["exists","up"]},{"osd":6,"uuid":"efae9975-8c16-4ad3-892f-71f3c59718d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3029180670},{"type":"v1","addr":"172.21.15.84:6817","nonce":3029180670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3029180670},{"type":"v1","addr":"172.21.15.84:6819","nonce":3029180670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3029180670},{"type":"v1","addr":"172.21.15.84:6823","nonce":3029180670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3029180670},{"type":"v1","addr":"172.21.15.84:6821","nonce":3029180670}]},"public_addr":"172.21.15.84:6817/3029180670","cluster_addr":"172.21.15.84:6819/3029180670","heartbeat_back_addr":"172.21.15.84:6823/3029180670","heartbeat_front_addr":"172.21.15.84:6821/3029180670","state":["exists","up"]},{"osd":7,"uuid":"6426efba-ee4d-4e44-83d1-c76c75aec30c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3067620602},{"type":"v1","addr":"172.21.15.84:6825","nonce":3067620602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3067620602},{"type":"v1","addr":"172.21.15.84:6827","nonce":3067620602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":3067620602},{"type":"v1","addr":"172.21.15.84:6831","nonce":3067620602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":3067620602},{"type":"v1","addr":"172.21.15.84:6829","nonce":3067620602}]},"public_addr":"172.21.15.84:6825/3067620602","cluster_addr":"172.21.15.84:6827/3067620602","heartbeat_back_addr":"172.21.15.84:6831/3067620602","heartbeat_front_addr":"172.21.15.84:6829/3067620602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.809514+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.845364+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.762733+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.688597+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.699228+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.747865+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.712415+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.820683+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-15T15:40:20.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.141+0000 7fa913134640 1 -- 172.21.15.12:0/3471112391 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fa8f8076300 msgr2=0x7fa8f8078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:20.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.141+0000 7fa913134640 1 --2- 172.21.15.12:0/3471112391 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fa8f8076300 0x7fa8f8078810 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa8fc007fd0 tx=0x7fa8fc009040 comp rx=0 tx=0).stop 2024-05-15T15:40:20.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.141+0000 7fa913134640 1 -- 172.21.15.12:0/3471112391 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa90c148770 msgr2=0x7fa90c0b7720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:20.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.141+0000 7fa913134640 1 --2- 172.21.15.12:0/3471112391 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa90c148770 0x7fa90c0b7720 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa90000b3f0 tx=0x7fa90000b8b0 comp rx=0 tx=0).stop 2024-05-15T15:40:20.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.141+0000 7fa913134640 1 -- 172.21.15.12:0/3471112391 shutdown_connections 2024-05-15T15:40:20.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.141+0000 7fa913134640 1 --2- 172.21.15.12:0/3471112391 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa90c14e360 0x7fa90c1e7f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:20.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.141+0000 7fa913134640 1 --2- 172.21.15.12:0/3471112391 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fa8f8076300 0x7fa8f8078810 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:20.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.141+0000 7fa913134640 1 --2- 172.21.15.12:0/3471112391 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa90c148770 0x7fa90c0b7720 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:20.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.141+0000 7fa913134640 1 --2- 172.21.15.12:0/3471112391 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa90c0bf9b0 0x7fa90c0713a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:20.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.141+0000 7fa913134640 1 -- 172.21.15.12:0/3471112391 >> 172.21.15.12:0/3471112391 conn(0x7fa90c0c17c0 msgr2=0x7fa90c0a5aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:20.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.141+0000 7fa913134640 1 -- 172.21.15.12:0/3471112391 shutdown_connections 2024-05-15T15:40:20.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.141+0000 7fa913134640 1 -- 172.21.15.12:0/3471112391 wait complete. 2024-05-15T15:40:20.155 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-15T15:40:20.155 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-15T15:40:20.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.264+0000 7f299f849640 1 Processor -- start 2024-05-15T15:40:20.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.264+0000 7f299f849640 1 -- start start 2024-05-15T15:40:20.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.265+0000 7f299f849640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f2998072870 0x7f2998148450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:20.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.265+0000 7f299f849640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f29980bc2a0 0x7f299806d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:20.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.265+0000 7f299f849640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f2998151a90 0x7f2998151ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:20.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.265+0000 7f299f849640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f2998073ca0 con 0x7f2998151a90 2024-05-15T15:40:20.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.265+0000 7f299f849640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f2998073370 con 0x7f2998072870 2024-05-15T15:40:20.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.265+0000 7f299f849640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f2998073650 con 0x7f29980bc2a0 2024-05-15T15:40:20.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.265+0000 7f299dde6640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f2998151a90 0x7f2998151ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:20.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.265+0000 7f299dde6640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f2998151a90 0x7f2998151ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38180/0 (socket says 172.21.15.12:38180) 2024-05-15T15:40:20.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.265+0000 7f299dde6640 1 -- 172.21.15.12:0/3934727459 learned_addr learned my addr 172.21.15.12:0/3934727459 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:20.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.266+0000 7f299cde4640 1 --2- 172.21.15.12:0/3934727459 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f29980bc2a0 0x7f299806d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:20.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.266+0000 7f299d5e5640 1 --2- 172.21.15.12:0/3934727459 >> v2:172.21.15.84:3300/0 conn(0x7f2998072870 0x7f2998148450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:20.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.266+0000 7f299dde6640 1 -- 172.21.15.12:0/3934727459 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f29980bc2a0 msgr2=0x7f299806d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:40:20.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.266+0000 7f299dde6640 1 --2- 172.21.15.12:0/3934727459 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f29980bc2a0 0x7f299806d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:20.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.266+0000 7f299dde6640 1 -- 172.21.15.12:0/3934727459 >> v2:172.21.15.84:3300/0 conn(0x7f2998072870 msgr2=0x7f2998148450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:40:20.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.266+0000 7f299dde6640 1 --2- 172.21.15.12:0/3934727459 >> v2:172.21.15.84:3300/0 conn(0x7f2998072870 0x7f2998148450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:20.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.266+0000 7f299dde6640 1 -- 172.21.15.12:0/3934727459 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2998073930 con 0x7f2998151a90 2024-05-15T15:40:20.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.266+0000 7f299d5e5640 1 --2- 172.21.15.12:0/3934727459 >> v2:172.21.15.84:3300/0 conn(0x7f2998072870 0x7f2998148450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-15T15:40:20.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.266+0000 7f299dde6640 1 --2- 172.21.15.12:0/3934727459 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2998151a90 0x7f2998151ea0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f29980a6280 tx=0x7f299002a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e05cc23cd238d343 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:20.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.267+0000 7f298ffff640 1 -- 172.21.15.12:0/3934727459 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2990036070 con 0x7f2998151a90 2024-05-15T15:40:20.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.267+0000 7f298ffff640 1 -- 172.21.15.12:0/3934727459 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2990031600 con 0x7f2998151a90 2024-05-15T15:40:20.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.267+0000 7f298ffff640 1 -- 172.21.15.12:0/3934727459 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29900319d0 con 0x7f2998151a90 2024-05-15T15:40:20.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.267+0000 7f299f849640 1 -- 172.21.15.12:0/3934727459 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2998151a90 msgr2=0x7f2998151ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:20.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.267+0000 7f299f849640 1 --2- 172.21.15.12:0/3934727459 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2998151a90 0x7f2998151ea0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f29980a6280 tx=0x7f299002a730 comp rx=0 tx=0).stop 2024-05-15T15:40:20.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.267+0000 7f299f849640 1 -- 172.21.15.12:0/3934727459 shutdown_connections 2024-05-15T15:40:20.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.267+0000 7f299f849640 1 --2- 172.21.15.12:0/3934727459 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2998151a90 0x7f2998151ea0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:20.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.267+0000 7f299f849640 1 --2- 172.21.15.12:0/3934727459 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f29980bc2a0 0x7f299806d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:20.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.267+0000 7f299f849640 1 --2- 172.21.15.12:0/3934727459 >> v2:172.21.15.84:3300/0 conn(0x7f2998072870 0x7f2998148450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:20.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.267+0000 7f299f849640 1 -- 172.21.15.12:0/3934727459 >> 172.21.15.12:0/3934727459 conn(0x7f299806f2c0 msgr2=0x7f299806f6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:20.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.268+0000 7f299f849640 1 -- 172.21.15.12:0/3934727459 shutdown_connections 2024-05-15T15:40:20.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.268+0000 7f299f849640 1 -- 172.21.15.12:0/3934727459 wait complete. 2024-05-15T15:40:20.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.269+0000 7f299f849640 1 Processor -- start 2024-05-15T15:40:20.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.269+0000 7f299f849640 1 -- start start 2024-05-15T15:40:20.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.270+0000 7f299f849640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f2998072870 0x7f29980a17f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:20.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.270+0000 7f299f849640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f29980bc2a0 0x7f29981e42a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:20.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.270+0000 7f299f849640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2998151a90 0x7f2998143ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:20.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.270+0000 7f299f849640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f29980bc830 con 0x7f29980bc2a0 2024-05-15T15:40:20.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.270+0000 7f299f849640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f29980bc6b0 con 0x7f2998151a90 2024-05-15T15:40:20.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.270+0000 7f299f849640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f299806dc30 con 0x7f2998072870 2024-05-15T15:40:20.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.270+0000 7f299cde4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f29980bc2a0 0x7f29981e42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:20.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.270+0000 7f299cde4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f29980bc2a0 0x7f29981e42a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38192/0 (socket says 172.21.15.12:38192) 2024-05-15T15:40:20.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.270+0000 7f299cde4640 1 -- 172.21.15.12:0/3975606784 learned_addr learned my addr 172.21.15.12:0/3975606784 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:20.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.270+0000 7f299dde6640 1 --2- 172.21.15.12:0/3975606784 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2998151a90 0x7f2998143ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:20.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.270+0000 7f299d5e5640 1 --2- 172.21.15.12:0/3975606784 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f2998072870 0x7f29980a17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:20.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.271+0000 7f299cde4640 1 -- 172.21.15.12:0/3975606784 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f2998072870 msgr2=0x7f29980a17f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:20.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.271+0000 7f299cde4640 1 --2- 172.21.15.12:0/3975606784 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f2998072870 0x7f29980a17f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:20.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.271+0000 7f299cde4640 1 -- 172.21.15.12:0/3975606784 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2998151a90 msgr2=0x7f2998143ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:20.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.271+0000 7f299cde4640 1 --2- 172.21.15.12:0/3975606784 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2998151a90 0x7f2998143ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:20.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.271+0000 7f299cde4640 1 -- 172.21.15.12:0/3975606784 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29980a1d30 con 0x7f29980bc2a0 2024-05-15T15:40:20.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.271+0000 7f299cde4640 1 --2- 172.21.15.12:0/3975606784 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f29980bc2a0 0x7f29981e42a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f298800e840 tx=0x7f298800ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:20.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.271+0000 7f298dffb640 1 -- 172.21.15.12:0/3975606784 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2988017020 con 0x7f29980bc2a0 2024-05-15T15:40:20.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.271+0000 7f298dffb640 1 -- 172.21.15.12:0/3975606784 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2988004240 con 0x7f29980bc2a0 2024-05-15T15:40:20.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.271+0000 7f299f849640 1 -- 172.21.15.12:0/3975606784 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29981e7870 con 0x7f29980bc2a0 2024-05-15T15:40:20.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.271+0000 7f298dffb640 1 -- 172.21.15.12:0/3975606784 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f298800c730 con 0x7f29980bc2a0 2024-05-15T15:40:20.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.271+0000 7f299f849640 1 -- 172.21.15.12:0/3975606784 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29981e7b50 con 0x7f29980bc2a0 2024-05-15T15:40:20.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.272+0000 7f299f849640 1 -- 172.21.15.12:0/3975606784 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2998050940 con 0x7f29980bc2a0 2024-05-15T15:40:20.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.273+0000 7f298dffb640 1 -- 172.21.15.12:0/3975606784 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f298801a020 con 0x7f29980bc2a0 2024-05-15T15:40:20.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.273+0000 7f298dffb640 1 --2- 172.21.15.12:0/3975606784 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f297c0762d0 0x7f297c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:20.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.273+0000 7f298dffb640 1 -- 172.21.15.12:0/3975606784 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f29880974a0 con 0x7f29980bc2a0 2024-05-15T15:40:20.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.274+0000 7f299d5e5640 1 --2- 172.21.15.12:0/3975606784 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f297c0762d0 0x7f297c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:20.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.274+0000 7f299d5e5640 1 --2- 172.21.15.12:0/3975606784 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f297c0762d0 0x7f297c0787e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f2994003610 tx=0x7f2994008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:20.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.278+0000 7f298dffb640 1 -- 172.21.15.12:0/3975606784 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f2988021030 con 0x7f29980bc2a0 2024-05-15T15:40:20.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.508+0000 7f299f849640 1 -- 172.21.15.12:0/3975606784 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f29980bbba0 con 0x7f29980bc2a0 2024-05-15T15:40:20.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.508+0000 7f298dffb640 1 -- 172.21.15.12:0/3975606784 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+4351 (secure 0 0 0) 0x7f2988060840 con 0x7f29980bc2a0 2024-05-15T15:40:20.511 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-05-15T15:40:20.511 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6834/1290912681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":1290912681},{"type":"v1","addr":"172.21.15.12:6834","nonce":1290912681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/2920770671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6833","nonce":2920770671},{"type":"v1","addr":"172.21.15.12:6835","nonce":2920770671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-15T15:39:51.829483+0000","modified":"2024-05-15T15:39:54.852086+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6835/3699736653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3699736653},{"type":"v1","addr":"172.21.15.84:6835","nonce":3699736653}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4288,"qdb_cluster":[4288]},"id":1}]} 2024-05-15T15:40:20.511 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 7 2024-05-15T15:40:20.513 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.510+0000 7f299f849640 1 -- 172.21.15.12:0/3975606784 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f297c0762d0 msgr2=0x7f297c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:20.513 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.510+0000 7f299f849640 1 --2- 172.21.15.12:0/3975606784 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f297c0762d0 0x7f297c0787e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f2994003610 tx=0x7f2994008040 comp rx=0 tx=0).stop 2024-05-15T15:40:20.513 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.510+0000 7f299f849640 1 -- 172.21.15.12:0/3975606784 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f29980bc2a0 msgr2=0x7f29981e42a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:20.513 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.510+0000 7f299f849640 1 --2- 172.21.15.12:0/3975606784 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f29980bc2a0 0x7f29981e42a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f298800e840 tx=0x7f298800ed00 comp rx=0 tx=0).stop 2024-05-15T15:40:20.513 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.511+0000 7f299f849640 1 -- 172.21.15.12:0/3975606784 shutdown_connections 2024-05-15T15:40:20.513 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.511+0000 7f299f849640 1 --2- 172.21.15.12:0/3975606784 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2998151a90 0x7f2998143ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:20.513 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.511+0000 7f299f849640 1 --2- 172.21.15.12:0/3975606784 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f297c0762d0 0x7f297c0787e0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:20.513 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.511+0000 7f299f849640 1 --2- 172.21.15.12:0/3975606784 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f29980bc2a0 0x7f29981e42a0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:20.513 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.511+0000 7f299f849640 1 --2- 172.21.15.12:0/3975606784 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f2998072870 0x7f29980a17f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:20.513 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.511+0000 7f299f849640 1 -- 172.21.15.12:0/3975606784 >> 172.21.15.12:0/3975606784 conn(0x7f299806f2c0 msgr2=0x7f2998146880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:20.513 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.511+0000 7f299f849640 1 -- 172.21.15.12:0/3975606784 shutdown_connections 2024-05-15T15:40:20.513 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.511+0000 7f299f849640 1 -- 172.21.15.12:0/3975606784 wait complete. 2024-05-15T15:40:20.524 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-15T15:40:20.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.633+0000 7fe87a227640 1 Processor -- start 2024-05-15T15:40:20.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.633+0000 7fe87a227640 1 -- start start 2024-05-15T15:40:20.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.634+0000 7fe87a227640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe8740bc1c0 0x7fe8740a0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:20.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.634+0000 7fe87a227640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe874146380 0x7fe874070a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:20.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.634+0000 7fe87a227640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe87414c120 con 0x7fe87414c8e0 2024-05-15T15:40:20.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.634+0000 7fe87a227640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fe87414c450 con 0x7fe8740bc1c0 2024-05-15T15:40:20.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.634+0000 7fe87a227640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7fe874071e40 con 0x7fe874146380 2024-05-15T15:40:20.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.634+0000 7fe8737fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe8740bc1c0 0x7fe8740a0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:20.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.634+0000 7fe8737fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe8740bc1c0 0x7fe8740a0ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38196/0 (socket says 172.21.15.12:38196) 2024-05-15T15:40:20.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.634+0000 7fe8737fe640 1 -- 172.21.15.12:0/945458024 learned_addr learned my addr 172.21.15.12:0/945458024 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:20.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.634+0000 7fe872ffd640 1 --2- 172.21.15.12:0/945458024 >> v2:172.21.15.84:3300/0 conn(0x7fe874146380 0x7fe874070a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:20.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.634+0000 7fe8737fe640 1 -- 172.21.15.12:0/945458024 >> v2:172.21.15.84:3300/0 conn(0x7fe874146380 msgr2=0x7fe874070a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:40:20.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.634+0000 7fe8737fe640 1 --2- 172.21.15.12:0/945458024 >> v2:172.21.15.84:3300/0 conn(0x7fe874146380 0x7fe874070a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:20.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.634+0000 7fe8737fe640 1 -- 172.21.15.12:0/945458024 >> v1:172.21.15.84:6789/0 conn(0x7fe87414c8e0 legacy=0x7fe87414f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:40:20.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.634+0000 7fe8737fe640 1 -- 172.21.15.12:0/945458024 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8740713d0 con 0x7fe8740bc1c0 2024-05-15T15:40:20.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.635+0000 7fe8737fe640 1 --2- 172.21.15.12:0/945458024 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe8740bc1c0 0x7fe8740a0ba0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe87414c5d0 tx=0x7fe86402a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d13db89791504969 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:20.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.635+0000 7fe8727fc640 1 -- 172.21.15.12:0/945458024 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe864037070 con 0x7fe8740bc1c0 2024-05-15T15:40:20.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.635+0000 7fe8727fc640 1 -- 172.21.15.12:0/945458024 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe864032440 con 0x7fe8740bc1c0 2024-05-15T15:40:20.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.635+0000 7fe8727fc640 1 -- 172.21.15.12:0/945458024 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe864032810 con 0x7fe8740bc1c0 2024-05-15T15:40:20.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.636+0000 7fe87a227640 1 -- 172.21.15.12:0/945458024 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe8740bc1c0 msgr2=0x7fe8740a0ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:20.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.636+0000 7fe87a227640 1 --2- 172.21.15.12:0/945458024 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe8740bc1c0 0x7fe8740a0ba0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe87414c5d0 tx=0x7fe86402a1c0 comp rx=0 tx=0).stop 2024-05-15T15:40:20.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.636+0000 7fe87a227640 1 -- 172.21.15.12:0/945458024 shutdown_connections 2024-05-15T15:40:20.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.636+0000 7fe87a227640 1 --2- 172.21.15.12:0/945458024 >> v2:172.21.15.84:3300/0 conn(0x7fe874146380 0x7fe874070a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:20.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.636+0000 7fe87a227640 1 --2- 172.21.15.12:0/945458024 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe8740bc1c0 0x7fe8740a0ba0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:20.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.636+0000 7fe87a227640 1 -- 172.21.15.12:0/945458024 >> 172.21.15.12:0/945458024 conn(0x7fe8740c17c0 msgr2=0x7fe8740c1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:20.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.636+0000 7fe87a227640 1 -- 172.21.15.12:0/945458024 shutdown_connections 2024-05-15T15:40:20.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.636+0000 7fe87a227640 1 -- 172.21.15.12:0/945458024 wait complete. 2024-05-15T15:40:20.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.638+0000 7fe87a227640 1 Processor -- start 2024-05-15T15:40:20.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.638+0000 7fe87a227640 1 -- start start 2024-05-15T15:40:20.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.639+0000 7fe87a227640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8740bc1c0 0x7fe8740a2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:20.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.639+0000 7fe87a227640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe874146380 0x7fe8741e5670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:20.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.639+0000 7fe87a227640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe87414c8e0 0x7fe8740a3a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:20.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.639+0000 7fe87a227640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fe8740bd5f0 con 0x7fe874146380 2024-05-15T15:40:20.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.639+0000 7fe87a227640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fe874146790 con 0x7fe8740bc1c0 2024-05-15T15:40:20.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.639+0000 7fe87a227640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fe8740bd770 con 0x7fe87414c8e0 2024-05-15T15:40:20.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.639+0000 7fe872ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe874146380 0x7fe8741e5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:20.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.639+0000 7fe872ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe874146380 0x7fe8741e5670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38210/0 (socket says 172.21.15.12:38210) 2024-05-15T15:40:20.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.639+0000 7fe872ffd640 1 -- 172.21.15.12:0/2867296149 learned_addr learned my addr 172.21.15.12:0/2867296149 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:20.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.639+0000 7fe8737fe640 1 --2- 172.21.15.12:0/2867296149 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8740bc1c0 0x7fe8740a2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:20.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.639+0000 7fe872ffd640 1 -- 172.21.15.12:0/2867296149 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe87414c8e0 msgr2=0x7fe8740a3a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:20.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.639+0000 7fe873fff640 1 --2- 172.21.15.12:0/2867296149 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe87414c8e0 0x7fe8740a3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:20.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.639+0000 7fe872ffd640 1 --2- 172.21.15.12:0/2867296149 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe87414c8e0 0x7fe8740a3a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:20.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.639+0000 7fe872ffd640 1 -- 172.21.15.12:0/2867296149 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8740bc1c0 msgr2=0x7fe8740a2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:20.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.639+0000 7fe872ffd640 1 --2- 172.21.15.12:0/2867296149 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8740bc1c0 0x7fe8740a2bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:20.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.639+0000 7fe872ffd640 1 -- 172.21.15.12:0/2867296149 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8740a30f0 con 0x7fe874146380 2024-05-15T15:40:20.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.639+0000 7fe8737fe640 1 --2- 172.21.15.12:0/2867296149 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8740bc1c0 0x7fe8740a2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-15T15:40:20.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.639+0000 7fe873fff640 1 --2- 172.21.15.12:0/2867296149 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe87414c8e0 0x7fe8740a3a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-15T15:40:20.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.640+0000 7fe872ffd640 1 --2- 172.21.15.12:0/2867296149 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe874146380 0x7fe8741e5670 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe86800c7f0 tx=0x7fe86800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:20.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.640+0000 7fe85bfff640 1 -- 172.21.15.12:0/2867296149 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe868015070 con 0x7fe874146380 2024-05-15T15:40:20.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.640+0000 7fe85bfff640 1 -- 172.21.15.12:0/2867296149 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe868004220 con 0x7fe874146380 2024-05-15T15:40:20.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.640+0000 7fe87a227640 1 -- 172.21.15.12:0/2867296149 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe87413db10 con 0x7fe874146380 2024-05-15T15:40:20.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.640+0000 7fe85bfff640 1 -- 172.21.15.12:0/2867296149 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe868007620 con 0x7fe874146380 2024-05-15T15:40:20.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.640+0000 7fe87a227640 1 -- 172.21.15.12:0/2867296149 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe874149660 con 0x7fe874146380 2024-05-15T15:40:20.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.641+0000 7fe87a227640 1 -- 172.21.15.12:0/2867296149 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8740a4a30 con 0x7fe874146380 2024-05-15T15:40:20.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.641+0000 7fe85bfff640 1 -- 172.21.15.12:0/2867296149 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe8680079d0 con 0x7fe874146380 2024-05-15T15:40:20.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.642+0000 7fe85bfff640 1 --2- 172.21.15.12:0/2867296149 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fe8600762d0 0x7fe8600787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:20.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.642+0000 7fe85bfff640 1 -- 172.21.15.12:0/2867296149 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fe8680978a0 con 0x7fe874146380 2024-05-15T15:40:20.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.642+0000 7fe8737fe640 1 --2- 172.21.15.12:0/2867296149 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fe8600762d0 0x7fe8600787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:20.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.642+0000 7fe8737fe640 1 --2- 172.21.15.12:0/2867296149 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fe8600762d0 0x7fe8600787e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe864034000 tx=0x7fe86402e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:20.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.647+0000 7fe85bfff640 1 -- 172.21.15.12:0/2867296149 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fe868061290 con 0x7fe874146380 2024-05-15T15:40:20.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.877+0000 7fe87a227640 1 -- 172.21.15.12:0/2867296149 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe8740a4c00 con 0x7fe874146380 2024-05-15T15:40:20.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.877+0000 7fe85bfff640 1 -- 172.21.15.12:0/2867296149 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+4351 (secure 0 0 0) 0x7fe868069280 con 0x7fe874146380 2024-05-15T15:40:20.879 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-05-15T15:40:20.880 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6834/1290912681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":1290912681},{"type":"v1","addr":"172.21.15.12:6834","nonce":1290912681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/2920770671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6833","nonce":2920770671},{"type":"v1","addr":"172.21.15.12:6835","nonce":2920770671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-15T15:39:51.829483+0000","modified":"2024-05-15T15:39:54.852086+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6835/3699736653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3699736653},{"type":"v1","addr":"172.21.15.84:6835","nonce":3699736653}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4288,"qdb_cluster":[4288]},"id":1}]} 2024-05-15T15:40:20.880 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 7 2024-05-15T15:40:20.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.879+0000 7fe87a227640 1 -- 172.21.15.12:0/2867296149 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fe8600762d0 msgr2=0x7fe8600787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:20.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.879+0000 7fe87a227640 1 --2- 172.21.15.12:0/2867296149 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fe8600762d0 0x7fe8600787e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe864034000 tx=0x7fe86402e000 comp rx=0 tx=0).stop 2024-05-15T15:40:20.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.879+0000 7fe87a227640 1 -- 172.21.15.12:0/2867296149 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe874146380 msgr2=0x7fe8741e5670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:20.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.879+0000 7fe87a227640 1 --2- 172.21.15.12:0/2867296149 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe874146380 0x7fe8741e5670 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe86800c7f0 tx=0x7fe86800ccb0 comp rx=0 tx=0).stop 2024-05-15T15:40:20.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.879+0000 7fe87a227640 1 -- 172.21.15.12:0/2867296149 shutdown_connections 2024-05-15T15:40:20.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.879+0000 7fe87a227640 1 --2- 172.21.15.12:0/2867296149 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe87414c8e0 0x7fe8740a3a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:20.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.879+0000 7fe87a227640 1 --2- 172.21.15.12:0/2867296149 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fe8600762d0 0x7fe8600787e0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:20.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.879+0000 7fe87a227640 1 --2- 172.21.15.12:0/2867296149 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe874146380 0x7fe8741e5670 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:20.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.879+0000 7fe87a227640 1 --2- 172.21.15.12:0/2867296149 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8740bc1c0 0x7fe8740a2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:20.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.879+0000 7fe87a227640 1 -- 172.21.15.12:0/2867296149 >> 172.21.15.12:0/2867296149 conn(0x7fe8740c17c0 msgr2=0x7fe8740c1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:20.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.879+0000 7fe87a227640 1 -- 172.21.15.12:0/2867296149 shutdown_connections 2024-05-15T15:40:20.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:20.879+0000 7fe87a227640 1 -- 172.21.15.12:0/2867296149 wait complete. 2024-05-15T15:40:20.893 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-15T15:40:21.004 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.002+0000 7f67ad11c640 1 Processor -- start 2024-05-15T15:40:21.004 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.002+0000 7f67ad11c640 1 -- start start 2024-05-15T15:40:21.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.003+0000 7f67ad11c640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f67a806d990 0x7f67a8145010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:21.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.003+0000 7f67ad11c640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f67a8153970 0x7f67a8155d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:21.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.003+0000 7f67ad11c640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67a80b4f30 con 0x7f67a8074580 2024-05-15T15:40:21.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.003+0000 7f67ad11c640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f67a80b66b0 con 0x7f67a8153970 2024-05-15T15:40:21.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.003+0000 7f67ad11c640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f67a8074240 con 0x7f67a806d990 2024-05-15T15:40:21.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.003+0000 7f67a6d9d640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f67a8074580 0x7f67a80b6b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:47178/0 (socket says 172.21.15.12:47178) 2024-05-15T15:40:21.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.003+0000 7f67a6d9d640 1 -- 172.21.15.12:0/1393094537 learned_addr learned my addr 172.21.15.12:0/1393094537 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-05-15T15:40:21.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.003+0000 7f67a759e640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f67a8153970 0x7f67a8155d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:21.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.004+0000 7f67a659c640 1 --2- 172.21.15.12:0/1393094537 >> v2:172.21.15.84:3300/0 conn(0x7f67a806d990 0x7f67a8145010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:21.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.004+0000 7f67a759e640 1 -- 172.21.15.12:0/1393094537 >> v2:172.21.15.84:3300/0 conn(0x7f67a806d990 msgr2=0x7f67a8145010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:40:21.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.004+0000 7f67a759e640 1 --2- 172.21.15.12:0/1393094537 >> v2:172.21.15.84:3300/0 conn(0x7f67a806d990 0x7f67a8145010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:21.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.004+0000 7f67a759e640 1 -- 172.21.15.12:0/1393094537 >> v1:172.21.15.12:6789/0 conn(0x7f67a8074580 legacy=0x7f67a80b6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:21.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.004+0000 7f67a759e640 1 -- 172.21.15.12:0/1393094537 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67a80b51d0 con 0x7f67a8153970 2024-05-15T15:40:21.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.004+0000 7f67a5d9b640 1 -- 172.21.15.12:0/1393094537 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1916577618 0 0) 0x7f67a80b4f30 con 0x7f67a8074580 2024-05-15T15:40:21.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.004+0000 7f67a759e640 1 --2- 172.21.15.12:0/1393094537 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f67a8153970 0x7f67a8155d90 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f67a8071a80 tx=0x7f679802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8b33ea47ce10349 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:21.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.005+0000 7f67a5d9b640 1 -- 172.21.15.12:0/1393094537 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6798007740 con 0x7f67a8153970 2024-05-15T15:40:21.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.005+0000 7f67a5d9b640 1 -- 172.21.15.12:0/1393094537 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67980078e0 con 0x7f67a8153970 2024-05-15T15:40:21.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.005+0000 7f67a5d9b640 1 -- 172.21.15.12:0/1393094537 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6798007cb0 con 0x7f67a8153970 2024-05-15T15:40:21.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.005+0000 7f67ad11c640 1 -- 172.21.15.12:0/1393094537 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f67a8153970 msgr2=0x7f67a8155d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:21.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.005+0000 7f67ad11c640 1 --2- 172.21.15.12:0/1393094537 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f67a8153970 0x7f67a8155d90 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f67a8071a80 tx=0x7f679802a680 comp rx=0 tx=0).stop 2024-05-15T15:40:21.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.005+0000 7f67ad11c640 1 -- 172.21.15.12:0/1393094537 shutdown_connections 2024-05-15T15:40:21.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.005+0000 7f67ad11c640 1 --2- 172.21.15.12:0/1393094537 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f67a8153970 0x7f67a8155d90 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:21.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.005+0000 7f67ad11c640 1 --2- 172.21.15.12:0/1393094537 >> v2:172.21.15.84:3300/0 conn(0x7f67a806d990 0x7f67a8145010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:21.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.005+0000 7f67ad11c640 1 -- 172.21.15.12:0/1393094537 >> 172.21.15.12:0/1393094537 conn(0x7f67a806f2c0 msgr2=0x7f67a806f6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:21.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.005+0000 7f67ad11c640 1 -- 172.21.15.12:0/1393094537 shutdown_connections 2024-05-15T15:40:21.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.005+0000 7f67ad11c640 1 -- 172.21.15.12:0/1393094537 wait complete. 2024-05-15T15:40:21.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.007+0000 7f67ad11c640 1 Processor -- start 2024-05-15T15:40:21.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.007+0000 7f67ad11c640 1 -- start start 2024-05-15T15:40:21.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.008+0000 7f67ad11c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67a806d990 0x7f67a80b74f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:21.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.008+0000 7f67ad11c640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f67a8074580 0x7f67a80b8520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:21.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.008+0000 7f67ad11c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f67a8153970 0x7f67a814e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:21.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.008+0000 7f67ad11c640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f67a80b5e60 con 0x7f67a8153970 2024-05-15T15:40:21.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.008+0000 7f67ad11c640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f67a814b020 con 0x7f67a806d990 2024-05-15T15:40:21.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.008+0000 7f67ad11c640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f67a80b8f30 con 0x7f67a8074580 2024-05-15T15:40:21.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.008+0000 7f67a759e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f67a8153970 0x7f67a814e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:21.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.008+0000 7f67a759e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f67a8153970 0x7f67a814e700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38224/0 (socket says 172.21.15.12:38224) 2024-05-15T15:40:21.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.008+0000 7f67a759e640 1 -- 172.21.15.12:0/309121267 learned_addr learned my addr 172.21.15.12:0/309121267 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:21.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.009+0000 7f67a6d9d640 1 --2- 172.21.15.12:0/309121267 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67a806d990 0x7f67a80b74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:21.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.009+0000 7f67a659c640 1 --2- 172.21.15.12:0/309121267 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f67a8074580 0x7f67a80b8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:21.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.009+0000 7f67a759e640 1 -- 172.21.15.12:0/309121267 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f67a8074580 msgr2=0x7f67a80b8520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:21.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.009+0000 7f67a759e640 1 --2- 172.21.15.12:0/309121267 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f67a8074580 0x7f67a80b8520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:21.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.009+0000 7f67a759e640 1 -- 172.21.15.12:0/309121267 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67a806d990 msgr2=0x7f67a80b74f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:21.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.009+0000 7f67a759e640 1 --2- 172.21.15.12:0/309121267 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67a806d990 0x7f67a80b74f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:21.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.009+0000 7f67a759e640 1 -- 172.21.15.12:0/309121267 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67a80b7a30 con 0x7f67a8153970 2024-05-15T15:40:21.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.009+0000 7f67a659c640 1 --2- 172.21.15.12:0/309121267 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f67a8074580 0x7f67a80b8520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-15T15:40:21.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.009+0000 7f67a759e640 1 --2- 172.21.15.12:0/309121267 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f67a8153970 0x7f67a814e700 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f679802ac70 tx=0x7f6798004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:21.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.009+0000 7f679f7fe640 1 -- 172.21.15.12:0/309121267 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f679803f070 con 0x7f67a8153970 2024-05-15T15:40:21.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.009+0000 7f679f7fe640 1 -- 172.21.15.12:0/309121267 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6798031bc0 con 0x7f67a8153970 2024-05-15T15:40:21.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.009+0000 7f67ad11c640 1 -- 172.21.15.12:0/309121267 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67a80b8a60 con 0x7f67a8153970 2024-05-15T15:40:21.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.009+0000 7f679f7fe640 1 -- 172.21.15.12:0/309121267 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6798044460 con 0x7f67a8153970 2024-05-15T15:40:21.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.009+0000 7f67ad11c640 1 -- 172.21.15.12:0/309121267 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67a81e2b30 con 0x7f67a8153970 2024-05-15T15:40:21.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.010+0000 7f67ad11c640 1 -- 172.21.15.12:0/309121267 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67a8148960 con 0x7f67a8153970 2024-05-15T15:40:21.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.011+0000 7f679f7fe640 1 -- 172.21.15.12:0/309121267 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f6798007790 con 0x7f67a8153970 2024-05-15T15:40:21.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.011+0000 7f679f7fe640 1 --2- 172.21.15.12:0/309121267 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f67880762d0 0x7f67880787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:21.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.012+0000 7f679f7fe640 1 -- 172.21.15.12:0/309121267 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f67980b8e00 con 0x7f67a8153970 2024-05-15T15:40:21.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.012+0000 7f67a6d9d640 1 --2- 172.21.15.12:0/309121267 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f67880762d0 0x7f67880787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:21.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.012+0000 7f67a6d9d640 1 --2- 172.21.15.12:0/309121267 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f67880762d0 0x7f67880787e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f67a0007fd0 tx=0x7f67a0007de0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:21.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.016+0000 7f679f7fe640 1 -- 172.21.15.12:0/309121267 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f6798082760 con 0x7f67a8153970 2024-05-15T15:40:21.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.207+0000 7f67ad11c640 1 -- 172.21.15.12:0/309121267 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f67a81e2960 con 0x7f67a8153970 2024-05-15T15:40:21.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.209+0000 7f679f7fe640 1 -- 172.21.15.12:0/309121267 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16573 (secure 0 0 0) 0x7f6798082060 con 0x7f67a8153970 2024-05-15T15:40:21.211 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-05-15T15:40:21.211 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":23,"fsid":"3b7fc4b2-b85c-49b5-a5de-38444eeed40d","created":"2024-05-15T15:39:28.392476+0000","modified":"2024-05-15T15:39:53.451332+0000","last_up_change":"2024-05-15T15:39:39.363983+0000","last_in_change":"2024-05-15T15:39:30.591216+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-15T15:39:40.715999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-15T15:39:49.598723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-15T15:39:50.783054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0d06a12a-866a-418e-9776-704d74354579","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":3943681952},{"type":"v1","addr":"172.21.15.12:6809","nonce":3943681952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":3943681952},{"type":"v1","addr":"172.21.15.12:6812","nonce":3943681952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":3943681952},{"type":"v1","addr":"172.21.15.12:6821","nonce":3943681952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":3943681952},{"type":"v1","addr":"172.21.15.12:6816","nonce":3943681952}]},"public_addr":"172.21.15.12:6809/3943681952","cluster_addr":"172.21.15.12:6812/3943681952","heartbeat_back_addr":"172.21.15.12:6821/3943681952","heartbeat_front_addr":"172.21.15.12:6816/3943681952","state":["exists","up"]},{"osd":1,"uuid":"09d0fa19-9ef8-4f35-bf99-6e86658c6f10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6811","nonce":1763752148},{"type":"v1","addr":"172.21.15.12:6813","nonce":1763752148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":1763752148},{"type":"v1","addr":"172.21.15.12:6817","nonce":1763752148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":1763752148},{"type":"v1","addr":"172.21.15.12:6827","nonce":1763752148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6819","nonce":1763752148},{"type":"v1","addr":"172.21.15.12:6822","nonce":1763752148}]},"public_addr":"172.21.15.12:6813/1763752148","cluster_addr":"172.21.15.12:6817/1763752148","heartbeat_back_addr":"172.21.15.12:6827/1763752148","heartbeat_front_addr":"172.21.15.12:6822/1763752148","state":["exists","up"]},{"osd":2,"uuid":"b204c6ad-f431-40a5-ba27-9844294f0ece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":2173702802},{"type":"v1","addr":"172.21.15.12:6823","nonce":2173702802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":2173702802},{"type":"v1","addr":"172.21.15.12:6826","nonce":2173702802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":2173702802},{"type":"v1","addr":"172.21.15.12:6831","nonce":2173702802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":2173702802},{"type":"v1","addr":"172.21.15.12:6829","nonce":2173702802}]},"public_addr":"172.21.15.12:6823/2173702802","cluster_addr":"172.21.15.12:6826/2173702802","heartbeat_back_addr":"172.21.15.12:6831/2173702802","heartbeat_front_addr":"172.21.15.12:6829/2173702802","state":["exists","up"]},{"osd":3,"uuid":"660a9ccb-2ee5-42d8-8481-0835047a8260","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":3956443113},{"type":"v1","addr":"172.21.15.12:6801","nonce":3956443113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":3956443113},{"type":"v1","addr":"172.21.15.12:6803","nonce":3956443113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":3956443113},{"type":"v1","addr":"172.21.15.12:6807","nonce":3956443113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":3956443113},{"type":"v1","addr":"172.21.15.12:6805","nonce":3956443113}]},"public_addr":"172.21.15.12:6801/3956443113","cluster_addr":"172.21.15.12:6803/3956443113","heartbeat_back_addr":"172.21.15.12:6807/3956443113","heartbeat_front_addr":"172.21.15.12:6805/3956443113","state":["exists","up"]},{"osd":4,"uuid":"9eef1461-a961-457c-9a78-43b5098a46a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":1021092792},{"type":"v1","addr":"172.21.15.84:6809","nonce":1021092792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":1021092792},{"type":"v1","addr":"172.21.15.84:6811","nonce":1021092792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":1021092792},{"type":"v1","addr":"172.21.15.84:6815","nonce":1021092792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":1021092792},{"type":"v1","addr":"172.21.15.84:6813","nonce":1021092792}]},"public_addr":"172.21.15.84:6809/1021092792","cluster_addr":"172.21.15.84:6811/1021092792","heartbeat_back_addr":"172.21.15.84:6815/1021092792","heartbeat_front_addr":"172.21.15.84:6813/1021092792","state":["exists","up"]},{"osd":5,"uuid":"5f924e2f-6c71-4741-a727-d3710c438431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":3173527851},{"type":"v1","addr":"172.21.15.84:6801","nonce":3173527851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":3173527851},{"type":"v1","addr":"172.21.15.84:6803","nonce":3173527851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":3173527851},{"type":"v1","addr":"172.21.15.84:6807","nonce":3173527851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":3173527851},{"type":"v1","addr":"172.21.15.84:6805","nonce":3173527851}]},"public_addr":"172.21.15.84:6801/3173527851","cluster_addr":"172.21.15.84:6803/3173527851","heartbeat_back_addr":"172.21.15.84:6807/3173527851","heartbeat_front_addr":"172.21.15.84:6805/3173527851","state":["exists","up"]},{"osd":6,"uuid":"efae9975-8c16-4ad3-892f-71f3c59718d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3029180670},{"type":"v1","addr":"172.21.15.84:6817","nonce":3029180670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3029180670},{"type":"v1","addr":"172.21.15.84:6819","nonce":3029180670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3029180670},{"type":"v1","addr":"172.21.15.84:6823","nonce":3029180670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3029180670},{"type":"v1","addr":"172.21.15.84:6821","nonce":3029180670}]},"public_addr":"172.21.15.84:6817/3029180670","cluster_addr":"172.21.15.84:6819/3029180670","heartbeat_back_addr":"172.21.15.84:6823/3029180670","heartbeat_front_addr":"172.21.15.84:6821/3029180670","state":["exists","up"]},{"osd":7,"uuid":"6426efba-ee4d-4e44-83d1-c76c75aec30c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3067620602},{"type":"v1","addr":"172.21.15.84:6825","nonce":3067620602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3067620602},{"type":"v1","addr":"172.21.15.84:6827","nonce":3067620602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":3067620602},{"type":"v1","addr":"172.21.15.84:6831","nonce":3067620602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":3067620602},{"type":"v1","addr":"172.21.15.84:6829","nonce":3067620602}]},"public_addr":"172.21.15.84:6825/3067620602","cluster_addr":"172.21.15.84:6827/3067620602","heartbeat_back_addr":"172.21.15.84:6831/3067620602","heartbeat_front_addr":"172.21.15.84:6829/3067620602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.809514+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.845364+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.762733+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.688597+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.699228+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.747865+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.712415+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.820683+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-15T15:40:21.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.211+0000 7f67ad11c640 1 -- 172.21.15.12:0/309121267 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f67880762d0 msgr2=0x7f67880787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:21.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.211+0000 7f67ad11c640 1 --2- 172.21.15.12:0/309121267 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f67880762d0 0x7f67880787e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f67a0007fd0 tx=0x7f67a0007de0 comp rx=0 tx=0).stop 2024-05-15T15:40:21.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.211+0000 7f67ad11c640 1 -- 172.21.15.12:0/309121267 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f67a8153970 msgr2=0x7f67a814e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:21.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.211+0000 7f67ad11c640 1 --2- 172.21.15.12:0/309121267 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f67a8153970 0x7f67a814e700 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f679802ac70 tx=0x7f6798004a40 comp rx=0 tx=0).stop 2024-05-15T15:40:21.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.211+0000 7f67ad11c640 1 -- 172.21.15.12:0/309121267 shutdown_connections 2024-05-15T15:40:21.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.211+0000 7f67ad11c640 1 --2- 172.21.15.12:0/309121267 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f67880762d0 0x7f67880787e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:21.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.211+0000 7f67ad11c640 1 --2- 172.21.15.12:0/309121267 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f67a8153970 0x7f67a814e700 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:21.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.211+0000 7f67ad11c640 1 --2- 172.21.15.12:0/309121267 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f67a8074580 0x7f67a80b8520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:21.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.211+0000 7f67ad11c640 1 --2- 172.21.15.12:0/309121267 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67a806d990 0x7f67a80b74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:21.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.211+0000 7f67ad11c640 1 -- 172.21.15.12:0/309121267 >> 172.21.15.12:0/309121267 conn(0x7f67a806f2c0 msgr2=0x7f67a8144de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:21.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.211+0000 7f67ad11c640 1 -- 172.21.15.12:0/309121267 shutdown_connections 2024-05-15T15:40:21.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.211+0000 7f67ad11c640 1 -- 172.21.15.12:0/309121267 wait complete. 2024-05-15T15:40:21.225 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-15T15:40:21.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.335+0000 7efca9bc7640 1 Processor -- start 2024-05-15T15:40:21.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.335+0000 7efca9bc7640 1 -- start start 2024-05-15T15:40:21.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.336+0000 7efca9bc7640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7efca40b4500 0x7efca40b5760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:21.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.336+0000 7efca9bc7640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7efca40bb490 0x7efca40b9ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:21.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.336+0000 7efca9bc7640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efca40bba80 con 0x7efca406faa0 2024-05-15T15:40:21.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.336+0000 7efca9bc7640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7efca40bbd20 con 0x7efca40b4500 2024-05-15T15:40:21.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.336+0000 7efca9bc7640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7efca40b4f60 con 0x7efca40bb490 2024-05-15T15:40:21.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.336+0000 7efca37fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7efca40b4500 0x7efca40b5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:21.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.336+0000 7efca3fff640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7efca406faa0 0x7efca40a3fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:47184/0 (socket says 172.21.15.12:47184) 2024-05-15T15:40:21.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.336+0000 7efca37fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7efca40b4500 0x7efca40b5760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38238/0 (socket says 172.21.15.12:38238) 2024-05-15T15:40:21.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.336+0000 7efca3fff640 1 -- 172.21.15.12:0/3921891893 learned_addr learned my addr 172.21.15.12:0/3921891893 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-05-15T15:40:21.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.337+0000 7efca2ffd640 1 --2- 172.21.15.12:0/3921891893 >> v2:172.21.15.84:3300/0 conn(0x7efca40bb490 0x7efca40b9ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:21.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.337+0000 7efca37fe640 1 -- 172.21.15.12:0/3921891893 >> v2:172.21.15.84:3300/0 conn(0x7efca40bb490 msgr2=0x7efca40b9ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:40:21.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.337+0000 7efca37fe640 1 --2- 172.21.15.12:0/3921891893 >> v2:172.21.15.84:3300/0 conn(0x7efca40bb490 0x7efca40b9ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:21.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.337+0000 7efca37fe640 1 -- 172.21.15.12:0/3921891893 >> v1:172.21.15.12:6789/0 conn(0x7efca406faa0 legacy=0x7efca40a3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:21.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.337+0000 7efca27fc640 1 -- 172.21.15.12:0/3921891893 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 404778990 0 0) 0x7efca40bba80 con 0x7efca406faa0 2024-05-15T15:40:21.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.337+0000 7efca37fe640 1 -- 172.21.15.12:0/3921891893 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efca40b5240 con 0x7efca40b4500 2024-05-15T15:40:21.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.337+0000 7efca37fe640 1 --2- 172.21.15.12:0/3921891893 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efca40b4500 0x7efca40b5760 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7efca4071430 tx=0x7efc9402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8ff29868c05a5ec server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:21.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.338+0000 7efca27fc640 1 -- 172.21.15.12:0/3921891893 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc94037070 con 0x7efca40b4500 2024-05-15T15:40:21.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.338+0000 7efca27fc640 1 -- 172.21.15.12:0/3921891893 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc94032440 con 0x7efca40b4500 2024-05-15T15:40:21.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.338+0000 7efca27fc640 1 -- 172.21.15.12:0/3921891893 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc94032810 con 0x7efca40b4500 2024-05-15T15:40:21.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.338+0000 7efca9bc7640 1 -- 172.21.15.12:0/3921891893 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efca40b4500 msgr2=0x7efca40b5760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:21.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.338+0000 7efca9bc7640 1 --2- 172.21.15.12:0/3921891893 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efca40b4500 0x7efca40b5760 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7efca4071430 tx=0x7efc9402a1a0 comp rx=0 tx=0).stop 2024-05-15T15:40:21.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.338+0000 7efca9bc7640 1 -- 172.21.15.12:0/3921891893 shutdown_connections 2024-05-15T15:40:21.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.338+0000 7efca9bc7640 1 --2- 172.21.15.12:0/3921891893 >> v2:172.21.15.84:3300/0 conn(0x7efca40bb490 0x7efca40b9ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:21.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.338+0000 7efca9bc7640 1 --2- 172.21.15.12:0/3921891893 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efca40b4500 0x7efca40b5760 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:21.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.338+0000 7efca9bc7640 1 -- 172.21.15.12:0/3921891893 >> 172.21.15.12:0/3921891893 conn(0x7efca40a1ac0 msgr2=0x7efca40bbfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:21.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.338+0000 7efca9bc7640 1 -- 172.21.15.12:0/3921891893 shutdown_connections 2024-05-15T15:40:21.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.338+0000 7efca9bc7640 1 -- 172.21.15.12:0/3921891893 wait complete. 2024-05-15T15:40:21.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.340+0000 7efca9bc7640 1 Processor -- start 2024-05-15T15:40:21.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.340+0000 7efca9bc7640 1 -- start start 2024-05-15T15:40:21.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.341+0000 7efca9bc7640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efca406faa0 0x7efca41e5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:21.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.341+0000 7efca9bc7640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7efca40b4500 0x7efca4146590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:21.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.341+0000 7efca9bc7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efca40bb490 0x7efca4143740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:21.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.341+0000 7efca9bc7640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7efca4070030 con 0x7efca40bb490 2024-05-15T15:40:21.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.341+0000 7efca9bc7640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7efca406feb0 con 0x7efca406faa0 2024-05-15T15:40:21.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.341+0000 7efca9bc7640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7efca40a46e0 con 0x7efca40b4500 2024-05-15T15:40:21.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.341+0000 7efca3fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efca40bb490 0x7efca4143740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:21.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.341+0000 7efca3fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efca40bb490 0x7efca4143740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38248/0 (socket says 172.21.15.12:38248) 2024-05-15T15:40:21.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.341+0000 7efca3fff640 1 -- 172.21.15.12:0/3460835636 learned_addr learned my addr 172.21.15.12:0/3460835636 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:21.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.341+0000 7efca2ffd640 1 --2- 172.21.15.12:0/3460835636 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7efca40b4500 0x7efca4146590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:21.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.341+0000 7efca37fe640 1 --2- 172.21.15.12:0/3460835636 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efca406faa0 0x7efca41e5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:21.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.341+0000 7efca3fff640 1 -- 172.21.15.12:0/3460835636 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7efca40b4500 msgr2=0x7efca4146590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:21.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.341+0000 7efca3fff640 1 --2- 172.21.15.12:0/3460835636 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7efca40b4500 0x7efca4146590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:21.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.341+0000 7efca3fff640 1 -- 172.21.15.12:0/3460835636 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efca406faa0 msgr2=0x7efca41e5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:21.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.341+0000 7efca3fff640 1 --2- 172.21.15.12:0/3460835636 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efca406faa0 0x7efca41e5ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:21.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.341+0000 7efca3fff640 1 -- 172.21.15.12:0/3460835636 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efca40b9980 con 0x7efca40bb490 2024-05-15T15:40:21.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.341+0000 7efca2ffd640 1 --2- 172.21.15.12:0/3460835636 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7efca40b4500 0x7efca4146590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-15T15:40:21.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.341+0000 7efca37fe640 1 --2- 172.21.15.12:0/3460835636 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efca406faa0 0x7efca41e5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-15T15:40:21.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.342+0000 7efca3fff640 1 --2- 172.21.15.12:0/3460835636 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efca40bb490 0x7efca4143740 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7efc9c00c6e0 tx=0x7efc9c00cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:21.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.342+0000 7efc8bfff640 1 -- 172.21.15.12:0/3460835636 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc9c018070 con 0x7efca40bb490 2024-05-15T15:40:21.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.342+0000 7efc8bfff640 1 -- 172.21.15.12:0/3460835636 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc9c004d60 con 0x7efca40bb490 2024-05-15T15:40:21.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.342+0000 7efca9bc7640 1 -- 172.21.15.12:0/3460835636 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efca41e6420 con 0x7efca40bb490 2024-05-15T15:40:21.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.342+0000 7efc8bfff640 1 -- 172.21.15.12:0/3460835636 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc9c00a880 con 0x7efca40bb490 2024-05-15T15:40:21.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.342+0000 7efca9bc7640 1 -- 172.21.15.12:0/3460835636 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efca41d75b0 con 0x7efca40bb490 2024-05-15T15:40:21.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.343+0000 7efca9bc7640 1 -- 172.21.15.12:0/3460835636 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efca40bdfc0 con 0x7efca40bb490 2024-05-15T15:40:21.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.343+0000 7efc8bfff640 1 -- 172.21.15.12:0/3460835636 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7efc9c01b070 con 0x7efca40bb490 2024-05-15T15:40:21.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.344+0000 7efc8bfff640 1 --2- 172.21.15.12:0/3460835636 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7efc900762d0 0x7efc900787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:21.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.344+0000 7efc8bfff640 1 -- 172.21.15.12:0/3460835636 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7efc9c096ab0 con 0x7efca40bb490 2024-05-15T15:40:21.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.344+0000 7efca37fe640 1 --2- 172.21.15.12:0/3460835636 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7efc900762d0 0x7efc900787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:21.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.345+0000 7efca37fe640 1 --2- 172.21.15.12:0/3460835636 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7efc900762d0 0x7efc900787e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7efc94034000 tx=0x7efc9402e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:21.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.349+0000 7efc8bfff640 1 -- 172.21.15.12:0/3460835636 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7efc9c060410 con 0x7efca40bb490 2024-05-15T15:40:21.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.577+0000 7efca9bc7640 1 -- 172.21.15.12:0/3460835636 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7efca4050940 con 0x7efca40bb490 2024-05-15T15:40:21.580 INFO:tasks.ceph.mon.a.smithi012.stderr:2024-05-15T15:40:21.578+0000 7faf78af7640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-15T15:40:21.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.580+0000 7efc8bfff640 1 -- 172.21.15.12:0/3460835636 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v8) ==== 161+0+0 (secure 0 0 0) 0x7efc9c05fd10 con 0x7efca40bb490 2024-05-15T15:40:21.581 INFO:teuthology.orchestra.run.smithi012.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-15T15:40:21.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.583+0000 7efca9bc7640 1 -- 172.21.15.12:0/3460835636 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7efc900762d0 msgr2=0x7efc900787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:21.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.583+0000 7efca9bc7640 1 --2- 172.21.15.12:0/3460835636 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7efc900762d0 0x7efc900787e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7efc94034000 tx=0x7efc9402e000 comp rx=0 tx=0).stop 2024-05-15T15:40:21.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.583+0000 7efca9bc7640 1 -- 172.21.15.12:0/3460835636 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efca40bb490 msgr2=0x7efca4143740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:21.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.583+0000 7efca9bc7640 1 --2- 172.21.15.12:0/3460835636 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efca40bb490 0x7efca4143740 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7efc9c00c6e0 tx=0x7efc9c00cba0 comp rx=0 tx=0).stop 2024-05-15T15:40:21.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.583+0000 7efca9bc7640 1 -- 172.21.15.12:0/3460835636 shutdown_connections 2024-05-15T15:40:21.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.583+0000 7efca9bc7640 1 --2- 172.21.15.12:0/3460835636 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7efc900762d0 0x7efc900787e0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:21.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.583+0000 7efca9bc7640 1 --2- 172.21.15.12:0/3460835636 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efca40bb490 0x7efca4143740 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:21.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.583+0000 7efca9bc7640 1 --2- 172.21.15.12:0/3460835636 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7efca40b4500 0x7efca4146590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:21.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.583+0000 7efca9bc7640 1 --2- 172.21.15.12:0/3460835636 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efca406faa0 0x7efca41e5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:21.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.583+0000 7efca9bc7640 1 -- 172.21.15.12:0/3460835636 >> 172.21.15.12:0/3460835636 conn(0x7efca40a1ac0 msgr2=0x7efca4148cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:21.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.583+0000 7efca9bc7640 1 -- 172.21.15.12:0/3460835636 shutdown_connections 2024-05-15T15:40:21.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.583+0000 7efca9bc7640 1 -- 172.21.15.12:0/3460835636 wait complete. 2024-05-15T15:40:21.588 INFO:tasks.ceph.mds.b.smithi084.stderr: -5156> 2024-05-15T15:39:57.279+0000 7f7ff087a640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-15T15:40:21.597 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-05-15T15:40:21.645 INFO:tasks.ceph.mds.b.smithi084.stdout:starting mds.b at 2024-05-15T15:40:21.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.709+0000 7ff547300640 1 Processor -- start 2024-05-15T15:40:21.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.709+0000 7ff547300640 1 -- start start 2024-05-15T15:40:21.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.710+0000 7ff547300640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff5400c10a0 0x7ff54014f770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:21.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.711+0000 7ff547300640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff54014c7e0 0x7ff54014cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:21.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.711+0000 7ff547300640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff54014ffe0 con 0x7ff540146070 2024-05-15T15:40:21.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.711+0000 7ff547300640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7ff5400a1200 con 0x7ff54014c7e0 2024-05-15T15:40:21.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.711+0000 7ff547300640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7ff54014c350 con 0x7ff5400c10a0 2024-05-15T15:40:21.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.711+0000 7ff54589d640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff54014c7e0 0x7ff54014cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:21.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.711+0000 7ff54589d640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff54014c7e0 0x7ff54014cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38258/0 (socket says 172.21.15.12:38258) 2024-05-15T15:40:21.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.711+0000 7ff54589d640 1 -- 172.21.15.12:0/1349367701 learned_addr learned my addr 172.21.15.12:0/1349367701 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:21.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.711+0000 7ff54509c640 1 --2- 172.21.15.12:0/1349367701 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff5400c10a0 0x7ff54014f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:21.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.711+0000 7ff54589d640 1 -- 172.21.15.12:0/1349367701 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff5400c10a0 msgr2=0x7ff54014f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:40:21.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.711+0000 7ff54589d640 1 --2- 172.21.15.12:0/1349367701 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff5400c10a0 0x7ff54014f770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:21.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.711+0000 7ff54589d640 1 -- 172.21.15.12:0/1349367701 >> v1:172.21.15.84:6789/0 conn(0x7ff540146070 legacy=0x7ff540146480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:21.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.711+0000 7ff54589d640 1 -- 172.21.15.12:0/1349367701 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5401502c0 con 0x7ff54014c7e0 2024-05-15T15:40:21.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.712+0000 7ff54589d640 1 --2- 172.21.15.12:0/1349367701 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff54014c7e0 0x7ff54014cbf0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff53c009e50 tx=0x7ff53c02a7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31bdf2e3143314f0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:21.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.712+0000 7ff537fff640 1 -- 172.21.15.12:0/1349367701 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff53c036070 con 0x7ff54014c7e0 2024-05-15T15:40:21.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.712+0000 7ff537fff640 1 -- 172.21.15.12:0/1349367701 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff53c031600 con 0x7ff54014c7e0 2024-05-15T15:40:21.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.712+0000 7ff537fff640 1 -- 172.21.15.12:0/1349367701 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff53c0319f0 con 0x7ff54014c7e0 2024-05-15T15:40:21.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.713+0000 7ff547300640 1 -- 172.21.15.12:0/1349367701 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff54014c7e0 msgr2=0x7ff54014cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:21.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.713+0000 7ff547300640 1 --2- 172.21.15.12:0/1349367701 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff54014c7e0 0x7ff54014cbf0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff53c009e50 tx=0x7ff53c02a7c0 comp rx=0 tx=0).stop 2024-05-15T15:40:21.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.713+0000 7ff547300640 1 -- 172.21.15.12:0/1349367701 shutdown_connections 2024-05-15T15:40:21.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.713+0000 7ff547300640 1 --2- 172.21.15.12:0/1349367701 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff54014c7e0 0x7ff54014cbf0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:21.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.713+0000 7ff547300640 1 --2- 172.21.15.12:0/1349367701 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff5400c10a0 0x7ff54014f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:21.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.713+0000 7ff547300640 1 -- 172.21.15.12:0/1349367701 >> 172.21.15.12:0/1349367701 conn(0x7ff5400c1830 msgr2=0x7ff5400c1c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:21.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.713+0000 7ff547300640 1 -- 172.21.15.12:0/1349367701 shutdown_connections 2024-05-15T15:40:21.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.713+0000 7ff547300640 1 -- 172.21.15.12:0/1349367701 wait complete. 2024-05-15T15:40:21.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.714+0000 7ff547300640 1 Processor -- start 2024-05-15T15:40:21.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.714+0000 7ff547300640 1 -- start start 2024-05-15T15:40:21.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.715+0000 7ff547300640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff5400c10a0 0x7ff5400a19c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:21.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.715+0000 7ff547300640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff540146070 0x7ff5401e5a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:21.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.715+0000 7ff547300640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff54014c7e0 0x7ff540149150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:21.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.715+0000 7ff547300640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7ff54014d130 con 0x7ff5400c10a0 2024-05-15T15:40:21.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.715+0000 7ff547300640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ff5400c14f0 con 0x7ff54014c7e0 2024-05-15T15:40:21.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.715+0000 7ff547300640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7ff54014fcb0 con 0x7ff540146070 2024-05-15T15:40:21.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.715+0000 7ff54509c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff5400c10a0 0x7ff5400a19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:21.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.715+0000 7ff54509c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff5400c10a0 0x7ff5400a19c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38270/0 (socket says 172.21.15.12:38270) 2024-05-15T15:40:21.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.715+0000 7ff54509c640 1 -- 172.21.15.12:0/2066879172 learned_addr learned my addr 172.21.15.12:0/2066879172 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:21.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.716+0000 7ff54589d640 1 --2- 172.21.15.12:0/2066879172 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff54014c7e0 0x7ff540149150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:21.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.716+0000 7ff54489b640 1 --2- 172.21.15.12:0/2066879172 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff540146070 0x7ff5401e5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:21.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.716+0000 7ff54509c640 1 -- 172.21.15.12:0/2066879172 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff540146070 msgr2=0x7ff5401e5a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:21.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.716+0000 7ff54509c640 1 --2- 172.21.15.12:0/2066879172 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff540146070 0x7ff5401e5a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:21.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.716+0000 7ff54509c640 1 -- 172.21.15.12:0/2066879172 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff54014c7e0 msgr2=0x7ff540149150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:21.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.716+0000 7ff54509c640 1 --2- 172.21.15.12:0/2066879172 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff54014c7e0 0x7ff540149150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:21.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.716+0000 7ff54509c640 1 -- 172.21.15.12:0/2066879172 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5400a1f00 con 0x7ff5400c10a0 2024-05-15T15:40:21.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.716+0000 7ff54509c640 1 --2- 172.21.15.12:0/2066879172 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff5400c10a0 0x7ff5400a19c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff53800e870 tx=0x7ff53800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:21.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.716+0000 7ff535ffb640 1 -- 172.21.15.12:0/2066879172 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff538017070 con 0x7ff5400c10a0 2024-05-15T15:40:21.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.716+0000 7ff535ffb640 1 -- 172.21.15.12:0/2066879172 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff53800c940 con 0x7ff5400c10a0 2024-05-15T15:40:21.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.716+0000 7ff547300640 1 -- 172.21.15.12:0/2066879172 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5400a7840 con 0x7ff5400c10a0 2024-05-15T15:40:21.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.716+0000 7ff535ffb640 1 -- 172.21.15.12:0/2066879172 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff53800cd30 con 0x7ff5400c10a0 2024-05-15T15:40:21.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.716+0000 7ff547300640 1 -- 172.21.15.12:0/2066879172 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5401e2630 con 0x7ff5400c10a0 2024-05-15T15:40:21.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.718+0000 7ff547300640 1 -- 172.21.15.12:0/2066879172 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff540143ae0 con 0x7ff5400c10a0 2024-05-15T15:40:21.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.718+0000 7ff535ffb640 1 -- 172.21.15.12:0/2066879172 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff53801a070 con 0x7ff5400c10a0 2024-05-15T15:40:21.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.719+0000 7ff535ffb640 1 --2- 172.21.15.12:0/2066879172 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7ff5240762d0 0x7ff5240787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:21.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.719+0000 7ff535ffb640 1 -- 172.21.15.12:0/2066879172 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5795+0+0 (secure 0 0 0) 0x7ff5380974f0 con 0x7ff5400c10a0 2024-05-15T15:40:21.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.719+0000 7ff54489b640 1 --2- 172.21.15.12:0/2066879172 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7ff5240762d0 0x7ff5240787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:21.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.719+0000 7ff54489b640 1 --2- 172.21.15.12:0/2066879172 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7ff5240762d0 0x7ff5240787e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff5400c04d0 tx=0x7ff530009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:21.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.723+0000 7ff535ffb640 1 -- 172.21.15.12:0/2066879172 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7ff538060df0 con 0x7ff5400c10a0 2024-05-15T15:40:21.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:21.957+0000 7ff547300640 1 -- 172.21.15.12:0/2066879172 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7ff540050940 con 0x7ff5400c10a0 2024-05-15T15:40:22.498 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:40:22.501 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:40:22.504 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:40:22.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:22.581+0000 7ff535ffb640 1 -- 172.21.15.12:0/2066879172 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v9) ==== 104+0+0 (secure 0 0 0) 0x7ff5380606f0 con 0x7ff5400c10a0 2024-05-15T15:40:22.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:22.584+0000 7ff547300640 1 -- 172.21.15.12:0/2066879172 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7ff5240762d0 msgr2=0x7ff5240787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:22.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:22.584+0000 7ff547300640 1 --2- 172.21.15.12:0/2066879172 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7ff5240762d0 0x7ff5240787e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff5400c04d0 tx=0x7ff530009040 comp rx=0 tx=0).stop 2024-05-15T15:40:22.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:22.584+0000 7ff547300640 1 -- 172.21.15.12:0/2066879172 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff5400c10a0 msgr2=0x7ff5400a19c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:22.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:22.584+0000 7ff547300640 1 --2- 172.21.15.12:0/2066879172 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff5400c10a0 0x7ff5400a19c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff53800e870 tx=0x7ff53800ed30 comp rx=0 tx=0).stop 2024-05-15T15:40:22.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:22.584+0000 7ff547300640 1 -- 172.21.15.12:0/2066879172 shutdown_connections 2024-05-15T15:40:22.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:22.584+0000 7ff547300640 1 --2- 172.21.15.12:0/2066879172 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff54014c7e0 0x7ff540149150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:22.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:22.584+0000 7ff547300640 1 --2- 172.21.15.12:0/2066879172 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff540146070 0x7ff5401e5a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:22.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:22.584+0000 7ff547300640 1 --2- 172.21.15.12:0/2066879172 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7ff5240762d0 0x7ff5240787e0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:22.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:22.584+0000 7ff547300640 1 --2- 172.21.15.12:0/2066879172 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff5400c10a0 0x7ff5400a19c0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:22.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:22.584+0000 7ff547300640 1 -- 172.21.15.12:0/2066879172 >> 172.21.15.12:0/2066879172 conn(0x7ff5400c1830 msgr2=0x7ff5400711d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:22.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:22.584+0000 7ff547300640 1 -- 172.21.15.12:0/2066879172 shutdown_connections 2024-05-15T15:40:22.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:22.584+0000 7ff547300640 1 -- 172.21.15.12:0/2066879172 wait complete. 2024-05-15T15:40:22.600 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-15T15:40:22.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:22.764+0000 7f584b59e640 1 Processor -- start 2024-05-15T15:40:22.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:22.764+0000 7f584b59e640 1 -- start start 2024-05-15T15:40:22.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:22.765+0000 7f584b59e640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f584c1462e0 0x7f584c06c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:22.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:22.765+0000 7f584b59e640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f584c0bc760 0x7f584c156840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:22.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:22.765+0000 7f584b59e640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f584c0bad80 con 0x7f584c0bc350 2024-05-15T15:40:22.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:22.765+0000 7f584b59e640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f584c1466f0 con 0x7f584c1462e0 2024-05-15T15:40:22.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:22.765+0000 7f584b59e640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f584c0bb6b0 con 0x7f584c0bc760 2024-05-15T15:40:22.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:22.765+0000 7f584a59c640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f584c1462e0 0x7f584c06c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:22.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:22.765+0000 7f584a59c640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f584c1462e0 0x7f584c06c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38278/0 (socket says 172.21.15.12:38278) 2024-05-15T15:40:22.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:22.765+0000 7f5843fff640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f584c0bc350 0x7f584c06f590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:47198/0 (socket says 172.21.15.12:47198) 2024-05-15T15:40:22.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:22.765+0000 7f584a59c640 1 -- 172.21.15.12:0/2455048567 learned_addr learned my addr 172.21.15.12:0/2455048567 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:22.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:22.765+0000 7f584ad9d640 1 --2- 172.21.15.12:0/2455048567 >> v2:172.21.15.84:3300/0 conn(0x7f584c0bc760 0x7f584c156840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:22.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:22.765+0000 7f584a59c640 1 -- 172.21.15.12:0/2455048567 >> v2:172.21.15.84:3300/0 conn(0x7f584c0bc760 msgr2=0x7f584c156840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:40:22.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:22.765+0000 7f584a59c640 1 --2- 172.21.15.12:0/2455048567 >> v2:172.21.15.84:3300/0 conn(0x7f584c0bc760 0x7f584c156840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:22.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:22.765+0000 7f584a59c640 1 -- 172.21.15.12:0/2455048567 >> v1:172.21.15.12:6789/0 conn(0x7f584c0bc350 legacy=0x7f584c06f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:22.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:22.765+0000 7f584a59c640 1 -- 172.21.15.12:0/2455048567 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f584c0bb060 con 0x7f584c1462e0 2024-05-15T15:40:22.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:22.765+0000 7f5849d9b640 1 -- 172.21.15.12:0/2455048567 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2523406480 0 0) 0x7f584c0bad80 con 0x7f584c0bc350 2024-05-15T15:40:22.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:22.766+0000 7f584ad9d640 1 --2- 172.21.15.12:0/2455048567 >> v2:172.21.15.84:3300/0 conn(0x7f584c0bc760 0x7f584c156840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-15T15:40:22.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:22.766+0000 7f584a59c640 1 --2- 172.21.15.12:0/2455048567 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f584c1462e0 0x7f584c06c6e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f584c070f30 tx=0x7f583c02a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b59c1871dfa42e6e server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:22.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:22.766+0000 7f5849d9b640 1 -- 172.21.15.12:0/2455048567 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f583c037070 con 0x7f584c1462e0 2024-05-15T15:40:22.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:22.766+0000 7f5849d9b640 1 -- 172.21.15.12:0/2455048567 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f583c02ae50 con 0x7f584c1462e0 2024-05-15T15:40:22.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:22.766+0000 7f5849d9b640 1 -- 172.21.15.12:0/2455048567 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f583c032860 con 0x7f584c1462e0 2024-05-15T15:40:22.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:22.767+0000 7f584b59e640 1 -- 172.21.15.12:0/2455048567 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f584c1462e0 msgr2=0x7f584c06c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:22.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:22.767+0000 7f584b59e640 1 --2- 172.21.15.12:0/2455048567 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f584c1462e0 0x7f584c06c6e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f584c070f30 tx=0x7f583c02a300 comp rx=0 tx=0).stop 2024-05-15T15:40:22.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:22.767+0000 7f584b59e640 1 -- 172.21.15.12:0/2455048567 shutdown_connections 2024-05-15T15:40:22.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:22.767+0000 7f584b59e640 1 --2- 172.21.15.12:0/2455048567 >> v2:172.21.15.84:3300/0 conn(0x7f584c0bc760 0x7f584c156840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:22.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:22.767+0000 7f584b59e640 1 --2- 172.21.15.12:0/2455048567 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f584c1462e0 0x7f584c06c6e0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:22.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:22.767+0000 7f584b59e640 1 -- 172.21.15.12:0/2455048567 >> 172.21.15.12:0/2455048567 conn(0x7f584c0bcfc0 msgr2=0x7f584c0bd3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:22.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:22.767+0000 7f584b59e640 1 -- 172.21.15.12:0/2455048567 shutdown_connections 2024-05-15T15:40:22.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:22.767+0000 7f584b59e640 1 -- 172.21.15.12:0/2455048567 wait complete. 2024-05-15T15:40:22.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:22.769+0000 7f584b59e640 1 Processor -- start 2024-05-15T15:40:22.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:22.769+0000 7f584b59e640 1 -- start start 2024-05-15T15:40:22.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:22.770+0000 7f584b59e640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f584c0bc350 0x7f584c14eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:22.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:22.770+0000 7f584b59e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f584c0bc760 0x7f584c1d7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:22.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:22.770+0000 7f584b59e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f584c1462e0 0x7f584c0c07d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:22.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:22.770+0000 7f584b59e640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f584c0a1e50 con 0x7f584c1462e0 2024-05-15T15:40:22.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:22.770+0000 7f584b59e640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f584c0a1cd0 con 0x7f584c0bc760 2024-05-15T15:40:22.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:22.770+0000 7f584b59e640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f584c06fca0 con 0x7f584c0bc350 2024-05-15T15:40:22.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:22.770+0000 7f584ad9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f584c1462e0 0x7f584c0c07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:22.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:22.770+0000 7f584ad9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f584c1462e0 0x7f584c0c07d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38282/0 (socket says 172.21.15.12:38282) 2024-05-15T15:40:22.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:22.770+0000 7f584ad9d640 1 -- 172.21.15.12:0/2541015107 learned_addr learned my addr 172.21.15.12:0/2541015107 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:22.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:22.770+0000 7f5843fff640 1 --2- 172.21.15.12:0/2541015107 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f584c0bc760 0x7f584c1d7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:22.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:22.770+0000 7f584a59c640 1 --2- 172.21.15.12:0/2541015107 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f584c0bc350 0x7f584c14eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:22.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:22.770+0000 7f584ad9d640 1 -- 172.21.15.12:0/2541015107 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f584c0bc350 msgr2=0x7f584c14eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:22.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:22.770+0000 7f584ad9d640 1 --2- 172.21.15.12:0/2541015107 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f584c0bc350 0x7f584c14eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:22.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:22.770+0000 7f584ad9d640 1 -- 172.21.15.12:0/2541015107 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f584c0bc760 msgr2=0x7f584c1d7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:22.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:22.770+0000 7f584ad9d640 1 --2- 172.21.15.12:0/2541015107 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f584c0bc760 0x7f584c1d7990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:22.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:22.770+0000 7f584ad9d640 1 -- 172.21.15.12:0/2541015107 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f584c1d7ed0 con 0x7f584c1462e0 2024-05-15T15:40:22.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:22.771+0000 7f584ad9d640 1 --2- 172.21.15.12:0/2541015107 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f584c1462e0 0x7f584c0c07d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5844007e40 tx=0x7f584400d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:22.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:22.771+0000 7f5842ffd640 1 -- 172.21.15.12:0/2541015107 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f584401a070 con 0x7f584c1462e0 2024-05-15T15:40:22.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:22.771+0000 7f5842ffd640 1 -- 172.21.15.12:0/2541015107 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5844003bb0 con 0x7f584c1462e0 2024-05-15T15:40:22.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:22.771+0000 7f5842ffd640 1 -- 172.21.15.12:0/2541015107 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5844004030 con 0x7f584c1462e0 2024-05-15T15:40:22.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:22.771+0000 7f584b59e640 1 -- 172.21.15.12:0/2541015107 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f584c0c0d10 con 0x7f584c1462e0 2024-05-15T15:40:22.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:22.771+0000 7f584b59e640 1 -- 172.21.15.12:0/2541015107 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f584c150180 con 0x7f584c1462e0 2024-05-15T15:40:22.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:22.772+0000 7f584b59e640 1 -- 172.21.15.12:0/2541015107 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f584c050860 con 0x7f584c1462e0 2024-05-15T15:40:22.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:22.773+0000 7f5842ffd640 1 -- 172.21.15.12:0/2541015107 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f584401d070 con 0x7f584c1462e0 2024-05-15T15:40:22.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:22.773+0000 7f5842ffd640 1 --2- 172.21.15.12:0/2541015107 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f582c0762d0 0x7f582c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:22.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:22.773+0000 7f5842ffd640 1 -- 172.21.15.12:0/2541015107 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5795+0+0 (secure 0 0 0) 0x7f5844097760 con 0x7f584c1462e0 2024-05-15T15:40:22.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:22.773+0000 7f584a59c640 1 --2- 172.21.15.12:0/2541015107 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f582c0762d0 0x7f582c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:22.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:22.774+0000 7f584a59c640 1 --2- 172.21.15.12:0/2541015107 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f582c0762d0 0x7f582c0787e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f583c034000 tx=0x7f583c02e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:22.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:22.778+0000 7f5842ffd640 1 -- 172.21.15.12:0/2541015107 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f5844010070 con 0x7f584c1462e0 2024-05-15T15:40:22.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:22.970+0000 7f584b59e640 1 -- 172.21.15.12:0/2541015107 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f584c0c1010 con 0x7f584c1462e0 2024-05-15T15:40:23.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:23.807+0000 7f5842ffd640 1 -- 172.21.15.12:0/2541015107 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v25) ==== 181+0+0 (secure 0 0 0) 0x7f5844060aa0 con 0x7f584c1462e0 2024-05-15T15:40:23.809 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_metadata' removed 2024-05-15T15:40:23.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:23.810+0000 7f584b59e640 1 -- 172.21.15.12:0/2541015107 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f582c0762d0 msgr2=0x7f582c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:23.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:23.810+0000 7f584b59e640 1 --2- 172.21.15.12:0/2541015107 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f582c0762d0 0x7f582c0787e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f583c034000 tx=0x7f583c02e000 comp rx=0 tx=0).stop 2024-05-15T15:40:23.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:23.810+0000 7f584b59e640 1 -- 172.21.15.12:0/2541015107 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f584c1462e0 msgr2=0x7f584c0c07d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:23.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:23.810+0000 7f584b59e640 1 --2- 172.21.15.12:0/2541015107 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f584c1462e0 0x7f584c0c07d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5844007e40 tx=0x7f584400d4a0 comp rx=0 tx=0).stop 2024-05-15T15:40:23.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:23.810+0000 7f584b59e640 1 -- 172.21.15.12:0/2541015107 shutdown_connections 2024-05-15T15:40:23.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:23.810+0000 7f584b59e640 1 --2- 172.21.15.12:0/2541015107 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f582c0762d0 0x7f582c0787e0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:23.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:23.810+0000 7f584b59e640 1 --2- 172.21.15.12:0/2541015107 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f584c1462e0 0x7f584c0c07d0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:23.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:23.810+0000 7f584b59e640 1 --2- 172.21.15.12:0/2541015107 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f584c0bc760 0x7f584c1d7990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:23.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:23.810+0000 7f584b59e640 1 --2- 172.21.15.12:0/2541015107 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f584c0bc350 0x7f584c14eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:23.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:23.810+0000 7f584b59e640 1 -- 172.21.15.12:0/2541015107 >> 172.21.15.12:0/2541015107 conn(0x7f584c0bcfc0 msgr2=0x7f584c068600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:23.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:23.810+0000 7f584b59e640 1 -- 172.21.15.12:0/2541015107 shutdown_connections 2024-05-15T15:40:23.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:23.810+0000 7f584b59e640 1 -- 172.21.15.12:0/2541015107 wait complete. 2024-05-15T15:40:23.829 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-15T15:40:23.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:23.950+0000 7f16f2e2a640 1 Processor -- start 2024-05-15T15:40:23.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:23.950+0000 7f16f2e2a640 1 -- start start 2024-05-15T15:40:23.955 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:23.951+0000 7f16f2e2a640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f16ec0bf050 0x7f16ec159ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:23.955 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:23.951+0000 7f16f2e2a640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16ec06e140 con 0x7f16ec0bd6d0 2024-05-15T15:40:23.955 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:23.951+0000 7f16f2e2a640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16ec0c36f0 con 0x7f16ec151fc0 2024-05-15T15:40:23.955 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:23.951+0000 7f16f2e2a640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f16ec152530 con 0x7f16ec0bf050 2024-05-15T15:40:23.955 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:23.951+0000 7f16ebfff640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f16ec0bd6d0 0x7f16ec0be940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:47202/0 (socket says 172.21.15.12:47202) 2024-05-15T15:40:23.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:23.951+0000 7f16ebfff640 1 -- 172.21.15.12:0/2054170728 learned_addr learned my addr 172.21.15.12:0/2054170728 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-05-15T15:40:23.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:23.951+0000 7f16f13c7640 1 --2- 172.21.15.12:0/2054170728 >> v2:172.21.15.84:3300/0 conn(0x7f16ec0bf050 0x7f16ec159ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:23.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:23.951+0000 7f16eb7fe640 1 -- 172.21.15.12:0/2054170728 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3125323008 0 0) 0x7f16d8001110 con 0x7f16ec0bd6d0 2024-05-15T15:40:23.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:23.951+0000 7f16eb7fe640 1 -- 172.21.15.12:0/2054170728 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f16dc003520 con 0x7f16ec0bd6d0 2024-05-15T15:40:23.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:23.952+0000 7f16eb7fe640 1 -- 172.21.15.12:0/2054170728 <== mon.1 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 439347520 0 0) 0x7f16ec0c36f0 con 0x7f16ec151fc0 2024-05-15T15:40:23.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:23.952+0000 7f16eb7fe640 1 -- 172.21.15.12:0/2054170728 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f16d8001110 con 0x7f16ec151fc0 2024-05-15T15:40:23.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:23.952+0000 7f16f13c7640 1 -- 172.21.15.12:0/2054170728 >> v1:172.21.15.84:6789/0 conn(0x7f16ec151fc0 legacy=0x7f16ec06da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:23.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:23.952+0000 7f16f13c7640 1 -- 172.21.15.12:0/2054170728 >> v1:172.21.15.12:6789/0 conn(0x7f16ec0bd6d0 legacy=0x7f16ec0be940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:23.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:23.952+0000 7f16f13c7640 1 -- 172.21.15.12:0/2054170728 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16ec152810 con 0x7f16ec0bf050 2024-05-15T15:40:23.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:23.952+0000 7f16f13c7640 1 --2- 172.21.15.12:0/2054170728 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f16ec0bf050 0x7f16ec159ea0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f16e4009d90 tx=0x7f16e402a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9b3bd084fb00c038 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:23.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:23.953+0000 7f16eb7fe640 1 -- 172.21.15.12:0/2054170728 <== mon.1 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16e4007740 con 0x7f16ec0bf050 2024-05-15T15:40:23.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:23.953+0000 7f16eb7fe640 1 -- 172.21.15.12:0/2054170728 <== mon.1 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16e40078e0 con 0x7f16ec0bf050 2024-05-15T15:40:23.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:23.953+0000 7f16eb7fe640 1 -- 172.21.15.12:0/2054170728 <== mon.1 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16e4007cb0 con 0x7f16ec0bf050 2024-05-15T15:40:23.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:23.953+0000 7f16f2e2a640 1 -- 172.21.15.12:0/2054170728 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f16ec0bf050 msgr2=0x7f16ec159ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:23.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:23.953+0000 7f16f2e2a640 1 --2- 172.21.15.12:0/2054170728 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f16ec0bf050 0x7f16ec159ea0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f16e4009d90 tx=0x7f16e402a6f0 comp rx=0 tx=0).stop 2024-05-15T15:40:23.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:23.953+0000 7f16f2e2a640 1 -- 172.21.15.12:0/2054170728 shutdown_connections 2024-05-15T15:40:23.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:23.953+0000 7f16f2e2a640 1 --2- 172.21.15.12:0/2054170728 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f16ec0bf050 0x7f16ec159ea0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:23.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:23.953+0000 7f16f2e2a640 1 -- 172.21.15.12:0/2054170728 >> 172.21.15.12:0/2054170728 conn(0x7f16ec0c3d20 msgr2=0x7f16ec0c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:23.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:23.953+0000 7f16f2e2a640 1 -- 172.21.15.12:0/2054170728 shutdown_connections 2024-05-15T15:40:23.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:23.953+0000 7f16f2e2a640 1 -- 172.21.15.12:0/2054170728 wait complete. 2024-05-15T15:40:23.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:23.955+0000 7f16f2e2a640 1 Processor -- start 2024-05-15T15:40:23.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:23.955+0000 7f16f2e2a640 1 -- start start 2024-05-15T15:40:23.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:23.956+0000 7f16f2e2a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f16ec0bd6d0 0x7f16ec1db290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:23.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:23.956+0000 7f16f2e2a640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f16ec0bf050 0x7f16ec0b7f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:23.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:23.956+0000 7f16f2e2a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f16ec151fc0 0x7f16ec0b5d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:23.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:23.956+0000 7f16f2e2a640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f16ec0a2ed0 con 0x7f16ec0bd6d0 2024-05-15T15:40:23.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:23.956+0000 7f16f2e2a640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f16ec0bdae0 con 0x7f16ec151fc0 2024-05-15T15:40:23.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:23.956+0000 7f16f2e2a640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f16ec0a3050 con 0x7f16ec0bf050 2024-05-15T15:40:23.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:23.956+0000 7f16f0bc6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f16ec0bd6d0 0x7f16ec1db290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:23.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:23.956+0000 7f16f0bc6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f16ec0bd6d0 0x7f16ec1db290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38294/0 (socket says 172.21.15.12:38294) 2024-05-15T15:40:23.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:23.956+0000 7f16f0bc6640 1 -- 172.21.15.12:0/1041118772 learned_addr learned my addr 172.21.15.12:0/1041118772 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:23.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:23.956+0000 7f16f13c7640 1 --2- 172.21.15.12:0/1041118772 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f16ec151fc0 0x7f16ec0b5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:23.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:23.956+0000 7f16ebfff640 1 --2- 172.21.15.12:0/1041118772 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f16ec0bf050 0x7f16ec0b7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:23.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:23.957+0000 7f16f0bc6640 1 -- 172.21.15.12:0/1041118772 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f16ec0bf050 msgr2=0x7f16ec0b7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:23.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:23.957+0000 7f16f0bc6640 1 --2- 172.21.15.12:0/1041118772 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f16ec0bf050 0x7f16ec0b7f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:23.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:23.957+0000 7f16f0bc6640 1 -- 172.21.15.12:0/1041118772 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f16ec151fc0 msgr2=0x7f16ec0b5d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:23.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:23.957+0000 7f16f0bc6640 1 --2- 172.21.15.12:0/1041118772 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f16ec151fc0 0x7f16ec0b5d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:23.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:23.957+0000 7f16f0bc6640 1 -- 172.21.15.12:0/1041118772 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16ec0b87b0 con 0x7f16ec0bd6d0 2024-05-15T15:40:23.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:23.957+0000 7f16ebfff640 1 --2- 172.21.15.12:0/1041118772 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f16ec0bf050 0x7f16ec0b7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-15T15:40:23.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:23.957+0000 7f16f0bc6640 1 --2- 172.21.15.12:0/1041118772 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f16ec0bd6d0 0x7f16ec1db290 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f16e000c430 tx=0x7f16e000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:23.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:23.957+0000 7f16e97fa640 1 -- 172.21.15.12:0/1041118772 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16e0017070 con 0x7f16ec0bd6d0 2024-05-15T15:40:23.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:23.957+0000 7f16e97fa640 1 -- 172.21.15.12:0/1041118772 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16e00052f0 con 0x7f16ec0bd6d0 2024-05-15T15:40:23.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:23.957+0000 7f16f2e2a640 1 -- 172.21.15.12:0/1041118772 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16ec1db7d0 con 0x7f16ec0bd6d0 2024-05-15T15:40:23.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:23.957+0000 7f16e97fa640 1 -- 172.21.15.12:0/1041118772 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16e0003830 con 0x7f16ec0bd6d0 2024-05-15T15:40:23.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:23.957+0000 7f16f2e2a640 1 -- 172.21.15.12:0/1041118772 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16ec0b9e20 con 0x7f16ec0bd6d0 2024-05-15T15:40:23.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:23.958+0000 7f16f2e2a640 1 -- 172.21.15.12:0/1041118772 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16ec0ba460 con 0x7f16ec0bd6d0 2024-05-15T15:40:23.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:23.959+0000 7f16e97fa640 1 -- 172.21.15.12:0/1041118772 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f16e001a070 con 0x7f16ec0bd6d0 2024-05-15T15:40:23.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:23.959+0000 7f16e97fa640 1 --2- 172.21.15.12:0/1041118772 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f16d0076300 0x7f16d0078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:23.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:23.959+0000 7f16e97fa640 1 -- 172.21.15.12:0/1041118772 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5357+0+0 (secure 0 0 0) 0x7f16e00966f0 con 0x7f16ec0bd6d0 2024-05-15T15:40:23.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:23.960+0000 7f16ebfff640 1 --2- 172.21.15.12:0/1041118772 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f16d0076300 0x7f16d0078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:23.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:23.960+0000 7f16ebfff640 1 --2- 172.21.15.12:0/1041118772 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f16d0076300 0x7f16d0078810 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f16ec1e55c0 tx=0x7f16d8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:23.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:23.964+0000 7f16e97fa640 1 -- 172.21.15.12:0/1041118772 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f16e005fbf0 con 0x7f16ec0bd6d0 2024-05-15T15:40:24.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:24.159+0000 7f16f2e2a640 1 -- 172.21.15.12:0/1041118772 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f16ec050940 con 0x7f16ec0bd6d0 2024-05-15T15:40:24.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:24.814+0000 7f16e97fa640 1 -- 172.21.15.12:0/1041118772 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v26) ==== 169+0+0 (secure 0 0 0) 0x7f16e0068230 con 0x7f16ec0bd6d0 2024-05-15T15:40:24.817 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_data' removed 2024-05-15T15:40:24.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:24.817+0000 7f16f2e2a640 1 -- 172.21.15.12:0/1041118772 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f16d0076300 msgr2=0x7f16d0078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:24.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:24.817+0000 7f16f2e2a640 1 --2- 172.21.15.12:0/1041118772 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f16d0076300 0x7f16d0078810 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f16ec1e55c0 tx=0x7f16d8009040 comp rx=0 tx=0).stop 2024-05-15T15:40:24.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:24.817+0000 7f16f2e2a640 1 -- 172.21.15.12:0/1041118772 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f16ec0bd6d0 msgr2=0x7f16ec1db290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:24.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:24.817+0000 7f16f2e2a640 1 --2- 172.21.15.12:0/1041118772 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f16ec0bd6d0 0x7f16ec1db290 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f16e000c430 tx=0x7f16e000c8f0 comp rx=0 tx=0).stop 2024-05-15T15:40:24.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:24.817+0000 7f16f2e2a640 1 -- 172.21.15.12:0/1041118772 shutdown_connections 2024-05-15T15:40:24.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:24.817+0000 7f16f2e2a640 1 --2- 172.21.15.12:0/1041118772 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f16ec151fc0 0x7f16ec0b5d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:24.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:24.817+0000 7f16f2e2a640 1 --2- 172.21.15.12:0/1041118772 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f16ec0bf050 0x7f16ec0b7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:24.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:24.817+0000 7f16f2e2a640 1 --2- 172.21.15.12:0/1041118772 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f16d0076300 0x7f16d0078810 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:24.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:24.817+0000 7f16f2e2a640 1 --2- 172.21.15.12:0/1041118772 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f16ec0bd6d0 0x7f16ec1db290 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:24.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:24.817+0000 7f16f2e2a640 1 -- 172.21.15.12:0/1041118772 >> 172.21.15.12:0/1041118772 conn(0x7f16ec0c3d20 msgr2=0x7f16ec0c0a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:24.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:24.817+0000 7f16f2e2a640 1 -- 172.21.15.12:0/1041118772 shutdown_connections 2024-05-15T15:40:24.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:24.817+0000 7f16f2e2a640 1 -- 172.21.15.12:0/1041118772 wait complete. 2024-05-15T15:40:24.836 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-15T15:40:24.836 INFO:tasks.ceph.mds.a:Stopping old one... 2024-05-15T15:40:24.837 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-15T15:40:24.837 INFO:teuthology.orchestra.run:waiting for 300 2024-05-15T15:40:24.837 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-15T15:40:24.837 INFO:tasks.ceph.mds.c:Stopping old one... 2024-05-15T15:40:24.837 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-05-15T15:40:24.838 INFO:teuthology.orchestra.run:waiting for 300 2024-05-15T15:40:24.838 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-15T15:40:24.838 INFO:tasks.ceph.mds.b:Stopping old one... 2024-05-15T15:40:24.839 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-15T15:40:24.839 INFO:teuthology.orchestra.run:waiting for 300 2024-05-15T15:40:24.848 INFO:tasks.ceph.mds.a:Stopped 2024-05-15T15:40:24.848 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-15T15:40:24.849 INFO:tasks.ceph.mds.c:Stopped 2024-05-15T15:40:24.849 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-05-15T15:40:24.851 INFO:tasks.ceph.mds.b:Stopped 2024-05-15T15:40:24.851 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-15T15:40:24.890 INFO:tasks.ceph.mds.a:Started 2024-05-15T15:40:24.891 DEBUG:teuthology.parallel:result is None 2024-05-15T15:40:24.891 INFO:tasks.ceph.mds.c:Started 2024-05-15T15:40:24.891 DEBUG:teuthology.parallel:result is None 2024-05-15T15:40:24.894 INFO:tasks.ceph.mds.b:Started 2024-05-15T15:40:24.894 DEBUG:teuthology.parallel:result is None 2024-05-15T15:40:24.894 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-05-15T15:40:24.979 INFO:tasks.ceph.mds.b.smithi084.stdout:starting mds.b at 2024-05-15T15:40:24.988 INFO:tasks.ceph.mds.a.smithi012.stdout:starting mds.a at 2024-05-15T15:40:24.989 INFO:tasks.ceph.mds.c.smithi012.stdout:starting mds.c at 2024-05-15T15:40:25.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.023+0000 7f5475cb6640 1 Processor -- start 2024-05-15T15:40:25.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.023+0000 7f5475cb6640 1 -- start start 2024-05-15T15:40:25.027 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.024+0000 7f5475cb6640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f547014e530 0x7f54700ba320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:25.027 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.024+0000 7f5475cb6640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f54700bd440 0x7f54700bd850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:25.027 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.024+0000 7f5475cb6640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54700ba860 con 0x7f54700b8d70 2024-05-15T15:40:25.027 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.024+0000 7f5475cb6640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f54700b88e0 con 0x7f547014e530 2024-05-15T15:40:25.027 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.024+0000 7f5475cb6640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f547014ece0 con 0x7f54700bd440 2024-05-15T15:40:25.027 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.024+0000 7f546f7fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f547014e530 0x7f54700ba320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:25.027 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.025+0000 7f546f7fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f547014e530 0x7f54700ba320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38334/0 (socket says 172.21.15.12:38334) 2024-05-15T15:40:25.027 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.025+0000 7f546f7fe640 1 -- 172.21.15.12:0/1101069001 learned_addr learned my addr 172.21.15.12:0/1101069001 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:25.027 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.025+0000 7f546effd640 1 --2- 172.21.15.12:0/1101069001 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f54700bd440 0x7f54700bd850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:25.027 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.025+0000 7f546f7fe640 1 -- 172.21.15.12:0/1101069001 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f54700bd440 msgr2=0x7f54700bd850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:40:25.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.025+0000 7f546f7fe640 1 --2- 172.21.15.12:0/1101069001 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f54700bd440 0x7f54700bd850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:25.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.025+0000 7f546f7fe640 1 -- 172.21.15.12:0/1101069001 >> v1:172.21.15.84:6789/0 conn(0x7f54700b8d70 legacy=0x7f54700b9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:25.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.025+0000 7f546f7fe640 1 -- 172.21.15.12:0/1101069001 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54700bdd90 con 0x7f547014e530 2024-05-15T15:40:25.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.025+0000 7f546e7fc640 1 -- 172.21.15.12:0/1101069001 <== mon.1 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 743873206 0 0) 0x7f54700ba860 con 0x7f54700b8d70 2024-05-15T15:40:25.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.025+0000 7f546f7fe640 1 --2- 172.21.15.12:0/1101069001 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f547014e530 0x7f54700ba320 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5460009ea0 tx=0x7f546002a7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4189001c0cdbe91 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:25.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.026+0000 7f546e7fc640 1 -- 172.21.15.12:0/1101069001 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5460036070 con 0x7f547014e530 2024-05-15T15:40:25.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.026+0000 7f546e7fc640 1 -- 172.21.15.12:0/1101069001 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5460031600 con 0x7f547014e530 2024-05-15T15:40:25.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.026+0000 7f546e7fc640 1 -- 172.21.15.12:0/1101069001 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54600319d0 con 0x7f547014e530 2024-05-15T15:40:25.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.026+0000 7f5475cb6640 1 -- 172.21.15.12:0/1101069001 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f547014e530 msgr2=0x7f54700ba320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:25.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.026+0000 7f5475cb6640 1 --2- 172.21.15.12:0/1101069001 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f547014e530 0x7f54700ba320 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5460009ea0 tx=0x7f546002a7b0 comp rx=0 tx=0).stop 2024-05-15T15:40:25.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.026+0000 7f5475cb6640 1 -- 172.21.15.12:0/1101069001 shutdown_connections 2024-05-15T15:40:25.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.026+0000 7f5475cb6640 1 --2- 172.21.15.12:0/1101069001 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f54700bd440 0x7f54700bd850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:25.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.026+0000 7f5475cb6640 1 --2- 172.21.15.12:0/1101069001 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f547014e530 0x7f54700ba320 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:25.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.026+0000 7f5475cb6640 1 -- 172.21.15.12:0/1101069001 >> 172.21.15.12:0/1101069001 conn(0x7f54700c0570 msgr2=0x7f54700c0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:25.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.026+0000 7f5475cb6640 1 -- 172.21.15.12:0/1101069001 shutdown_connections 2024-05-15T15:40:25.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.026+0000 7f5475cb6640 1 -- 172.21.15.12:0/1101069001 wait complete. 2024-05-15T15:40:25.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.028+0000 7f5475cb6640 1 Processor -- start 2024-05-15T15:40:25.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.028+0000 7f5475cb6640 1 -- start start 2024-05-15T15:40:25.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.029+0000 7f5475cb6640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f54700b8d70 0x7f547013f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:25.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.029+0000 7f5475cb6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f54700bd440 0x7f5470140cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:25.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.029+0000 7f5475cb6640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f547014e530 0x7f547013d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:25.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.029+0000 7f5475cb6640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f54700bbb70 con 0x7f54700bd440 2024-05-15T15:40:25.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.029+0000 7f5475cb6640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f547014f2a0 con 0x7f54700b8d70 2024-05-15T15:40:25.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.029+0000 7f5475cb6640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f547014e940 con 0x7f547014e530 2024-05-15T15:40:25.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.029+0000 7f546effd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f54700bd440 0x7f5470140cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:25.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.029+0000 7f546effd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f54700bd440 0x7f5470140cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38348/0 (socket says 172.21.15.12:38348) 2024-05-15T15:40:25.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.029+0000 7f546effd640 1 -- 172.21.15.12:0/3229736042 learned_addr learned my addr 172.21.15.12:0/3229736042 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:25.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.029+0000 7f546ffff640 1 --2- 172.21.15.12:0/3229736042 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f547014e530 0x7f547013d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:25.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.030+0000 7f546f7fe640 1 --2- 172.21.15.12:0/3229736042 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f54700b8d70 0x7f547013f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:25.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.030+0000 7f546effd640 1 -- 172.21.15.12:0/3229736042 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f547014e530 msgr2=0x7f547013d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:25.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.030+0000 7f546effd640 1 --2- 172.21.15.12:0/3229736042 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f547014e530 0x7f547013d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:25.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.030+0000 7f546effd640 1 -- 172.21.15.12:0/3229736042 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f54700b8d70 msgr2=0x7f547013f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:25.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.030+0000 7f546effd640 1 --2- 172.21.15.12:0/3229736042 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f54700b8d70 0x7f547013f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:25.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.030+0000 7f546effd640 1 -- 172.21.15.12:0/3229736042 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54701e4200 con 0x7f54700bd440 2024-05-15T15:40:25.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.030+0000 7f546effd640 1 --2- 172.21.15.12:0/3229736042 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f54700bd440 0x7f5470140cc0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f546400e870 tx=0x7f546400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:25.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.030+0000 7f5457fff640 1 -- 172.21.15.12:0/3229736042 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5464017070 con 0x7f54700bd440 2024-05-15T15:40:25.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.030+0000 7f5457fff640 1 -- 172.21.15.12:0/3229736042 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f546400c8e0 con 0x7f54700bd440 2024-05-15T15:40:25.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.030+0000 7f5457fff640 1 -- 172.21.15.12:0/3229736042 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f546400ccd0 con 0x7f54700bd440 2024-05-15T15:40:25.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.030+0000 7f5475cb6640 1 -- 172.21.15.12:0/3229736042 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5470149370 con 0x7f54700bd440 2024-05-15T15:40:25.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.030+0000 7f5475cb6640 1 -- 172.21.15.12:0/3229736042 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54701e4780 con 0x7f54700bd440 2024-05-15T15:40:25.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.031+0000 7f5475cb6640 1 -- 172.21.15.12:0/3229736042 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f547013e5b0 con 0x7f54700bd440 2024-05-15T15:40:25.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.032+0000 7f5457fff640 1 -- 172.21.15.12:0/3229736042 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f546401a070 con 0x7f54700bd440 2024-05-15T15:40:25.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.032+0000 7f5457fff640 1 --2- 172.21.15.12:0/3229736042 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f545c076300 0x7f545c078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:25.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.033+0000 7f5457fff640 1 -- 172.21.15.12:0/3229736042 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 4943+0+0 (secure 0 0 0) 0x7f54640970b0 con 0x7f54700bd440 2024-05-15T15:40:25.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.033+0000 7f546f7fe640 1 --2- 172.21.15.12:0/3229736042 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f545c076300 0x7f545c078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:25.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.033+0000 7f546f7fe640 1 --2- 172.21.15.12:0/3229736042 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f545c076300 0x7f545c078810 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f5460033000 tx=0x7f546002e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:25.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.037+0000 7f5457fff640 1 -- 172.21.15.12:0/3229736042 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f54640606d0 con 0x7f54700bd440 2024-05-15T15:40:25.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.245+0000 7f5475cb6640 1 -- 172.21.15.12:0/3229736042 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f5470050940 con 0x7f54700bd440 2024-05-15T15:40:25.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.825+0000 7f5457fff640 1 -- 172.21.15.12:0/3229736042 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v28) ==== 97+0+0 (secure 0 0 0) 0x7f54640649d0 con 0x7f54700bd440 2024-05-15T15:40:25.827 INFO:teuthology.orchestra.run.smithi012.stderr: removed all blocklist entries 2024-05-15T15:40:25.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.828+0000 7f5475cb6640 1 -- 172.21.15.12:0/3229736042 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f545c076300 msgr2=0x7f545c078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:25.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.828+0000 7f5475cb6640 1 --2- 172.21.15.12:0/3229736042 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f545c076300 0x7f545c078810 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f5460033000 tx=0x7f546002e000 comp rx=0 tx=0).stop 2024-05-15T15:40:25.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.828+0000 7f5475cb6640 1 -- 172.21.15.12:0/3229736042 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f54700bd440 msgr2=0x7f5470140cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:25.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.828+0000 7f5475cb6640 1 --2- 172.21.15.12:0/3229736042 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f54700bd440 0x7f5470140cc0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f546400e870 tx=0x7f546400ec70 comp rx=0 tx=0).stop 2024-05-15T15:40:25.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.828+0000 7f5475cb6640 1 -- 172.21.15.12:0/3229736042 shutdown_connections 2024-05-15T15:40:25.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.828+0000 7f5475cb6640 1 --2- 172.21.15.12:0/3229736042 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f547014e530 0x7f547013d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:25.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.828+0000 7f5475cb6640 1 --2- 172.21.15.12:0/3229736042 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f545c076300 0x7f545c078810 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:25.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.828+0000 7f5475cb6640 1 --2- 172.21.15.12:0/3229736042 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f54700bd440 0x7f5470140cc0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:25.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.828+0000 7f5475cb6640 1 --2- 172.21.15.12:0/3229736042 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f54700b8d70 0x7f547013f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:25.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.828+0000 7f5475cb6640 1 -- 172.21.15.12:0/3229736042 >> 172.21.15.12:0/3229736042 conn(0x7f54700c0570 msgr2=0x7f5470068600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:25.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.828+0000 7f5475cb6640 1 -- 172.21.15.12:0/3229736042 shutdown_connections 2024-05-15T15:40:25.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.829+0000 7f5475cb6640 1 -- 172.21.15.12:0/3229736042 wait complete. 2024-05-15T15:40:25.846 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-05-15T15:40:25.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.962+0000 7f5e3c629640 1 Processor -- start 2024-05-15T15:40:25.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.962+0000 7f5e3c629640 1 -- start start 2024-05-15T15:40:25.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.963+0000 7f5e3c629640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5e340bd6d0 0x7f5e340be940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:25.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.963+0000 7f5e3c629640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5e340bee80 0x7f5e34158e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:25.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.963+0000 7f5e3c629640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e3406e140 con 0x7f5e34151fc0 2024-05-15T15:40:25.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.963+0000 7f5e3c629640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f5e340c36f0 con 0x7f5e340bd6d0 2024-05-15T15:40:25.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.963+0000 7f5e3c629640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f5e34152530 con 0x7f5e340bee80 2024-05-15T15:40:25.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.963+0000 7f5e39bc4640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5e340bd6d0 0x7f5e340be940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:25.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.963+0000 7f5e3a3c5640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f5e34151fc0 0x7f5e3406da30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:47220/0 (socket says 172.21.15.12:47220) 2024-05-15T15:40:25.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.963+0000 7f5e3a3c5640 1 -- 172.21.15.12:0/2970905829 learned_addr learned my addr 172.21.15.12:0/2970905829 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-05-15T15:40:25.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.963+0000 7f5e3abc6640 1 --2- 172.21.15.12:0/2970905829 >> v2:172.21.15.84:3300/0 conn(0x7f5e340bee80 0x7f5e34158e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:25.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.963+0000 7f5e39bc4640 1 -- 172.21.15.12:0/2970905829 >> v2:172.21.15.84:3300/0 conn(0x7f5e340bee80 msgr2=0x7f5e34158e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:40:25.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.963+0000 7f5e39bc4640 1 --2- 172.21.15.12:0/2970905829 >> v2:172.21.15.84:3300/0 conn(0x7f5e340bee80 0x7f5e34158e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:25.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.964+0000 7f5e39bc4640 1 -- 172.21.15.12:0/2970905829 >> v1:172.21.15.12:6789/0 conn(0x7f5e34151fc0 legacy=0x7f5e3406da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:25.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.964+0000 7f5e39bc4640 1 -- 172.21.15.12:0/2970905829 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e34152810 con 0x7f5e340bd6d0 2024-05-15T15:40:25.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.964+0000 7f5e39bc4640 1 --2- 172.21.15.12:0/2970905829 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e340bd6d0 0x7f5e340be940 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f5e340bf8f0 tx=0x7f5e2402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8852f196599beebc server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:25.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.964+0000 7f5e393c3640 1 -- 172.21.15.12:0/2970905829 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e24037070 con 0x7f5e340bd6d0 2024-05-15T15:40:25.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.964+0000 7f5e393c3640 1 -- 172.21.15.12:0/2970905829 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e24032440 con 0x7f5e340bd6d0 2024-05-15T15:40:25.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.964+0000 7f5e393c3640 1 -- 172.21.15.12:0/2970905829 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e2402ae60 con 0x7f5e340bd6d0 2024-05-15T15:40:25.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.965+0000 7f5e3c629640 1 -- 172.21.15.12:0/2970905829 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e340bd6d0 msgr2=0x7f5e340be940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:25.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.965+0000 7f5e3c629640 1 --2- 172.21.15.12:0/2970905829 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e340bd6d0 0x7f5e340be940 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f5e340bf8f0 tx=0x7f5e2402a110 comp rx=0 tx=0).stop 2024-05-15T15:40:25.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.965+0000 7f5e3c629640 1 -- 172.21.15.12:0/2970905829 shutdown_connections 2024-05-15T15:40:25.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.965+0000 7f5e3c629640 1 --2- 172.21.15.12:0/2970905829 >> v2:172.21.15.84:3300/0 conn(0x7f5e340bee80 0x7f5e34158e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:25.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.965+0000 7f5e3c629640 1 --2- 172.21.15.12:0/2970905829 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e340bd6d0 0x7f5e340be940 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:25.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.965+0000 7f5e3c629640 1 -- 172.21.15.12:0/2970905829 >> 172.21.15.12:0/2970905829 conn(0x7f5e340c3d20 msgr2=0x7f5e340c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:25.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.965+0000 7f5e3c629640 1 -- 172.21.15.12:0/2970905829 shutdown_connections 2024-05-15T15:40:25.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.965+0000 7f5e3c629640 1 -- 172.21.15.12:0/2970905829 wait complete. 2024-05-15T15:40:25.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.967+0000 7f5e3c629640 1 Processor -- start 2024-05-15T15:40:25.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.967+0000 7f5e3c629640 1 -- start start 2024-05-15T15:40:25.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.968+0000 7f5e3c629640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e340bd6d0 0x7f5e341e47f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:25.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.968+0000 7f5e3c629640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f5e340bee80 0x7f5e340b7610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:25.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.968+0000 7f5e3c629640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e34151fc0 0x7f5e3414b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:25.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.968+0000 7f5e3c629640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f5e340bdae0 con 0x7f5e340bd6d0 2024-05-15T15:40:25.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.968+0000 7f5e3c629640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f5e340c0070 con 0x7f5e34151fc0 2024-05-15T15:40:25.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.968+0000 7f5e3c629640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f5e340a2ed0 con 0x7f5e340bee80 2024-05-15T15:40:25.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.968+0000 7f5e3a3c5640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e340bd6d0 0x7f5e341e47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:25.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.968+0000 7f5e3a3c5640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e340bd6d0 0x7f5e341e47f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38376/0 (socket says 172.21.15.12:38376) 2024-05-15T15:40:25.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.968+0000 7f5e3a3c5640 1 -- 172.21.15.12:0/3337560638 learned_addr learned my addr 172.21.15.12:0/3337560638 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:25.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.968+0000 7f5e3abc6640 1 --2- 172.21.15.12:0/3337560638 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e34151fc0 0x7f5e3414b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:25.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.968+0000 7f5e39bc4640 1 --2- 172.21.15.12:0/3337560638 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f5e340bee80 0x7f5e340b7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:25.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.968+0000 7f5e3a3c5640 1 -- 172.21.15.12:0/3337560638 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f5e340bee80 msgr2=0x7f5e340b7610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:25.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.968+0000 7f5e3a3c5640 1 --2- 172.21.15.12:0/3337560638 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f5e340bee80 0x7f5e340b7610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:25.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.968+0000 7f5e3a3c5640 1 -- 172.21.15.12:0/3337560638 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e34151fc0 msgr2=0x7f5e3414b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:25.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.968+0000 7f5e3a3c5640 1 --2- 172.21.15.12:0/3337560638 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e34151fc0 0x7f5e3414b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:25.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.968+0000 7f5e3a3c5640 1 -- 172.21.15.12:0/3337560638 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e341e4d30 con 0x7f5e340bd6d0 2024-05-15T15:40:25.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.968+0000 7f5e3abc6640 1 --2- 172.21.15.12:0/3337560638 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e34151fc0 0x7f5e3414b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-15T15:40:25.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.968+0000 7f5e3a3c5640 1 --2- 172.21.15.12:0/3337560638 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e340bd6d0 0x7f5e341e47f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f5e3000c370 tx=0x7f5e3000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:25.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.968+0000 7f5e2affd640 1 -- 172.21.15.12:0/3337560638 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e30017070 con 0x7f5e340bd6d0 2024-05-15T15:40:25.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.968+0000 7f5e2affd640 1 -- 172.21.15.12:0/3337560638 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e30005ce0 con 0x7f5e340bd6d0 2024-05-15T15:40:25.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.969+0000 7f5e3c629640 1 -- 172.21.15.12:0/3337560638 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e340ba620 con 0x7f5e340bd6d0 2024-05-15T15:40:25.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.969+0000 7f5e2affd640 1 -- 172.21.15.12:0/3337560638 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e30007310 con 0x7f5e340bd6d0 2024-05-15T15:40:25.973 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.969+0000 7f5e3c629640 1 -- 172.21.15.12:0/3337560638 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e340b8530 con 0x7f5e340bd6d0 2024-05-15T15:40:25.974 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.970+0000 7f5e3c629640 1 -- 172.21.15.12:0/3337560638 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e340bb0f0 con 0x7f5e340bd6d0 2024-05-15T15:40:25.974 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.970+0000 7f5e2affd640 1 -- 172.21.15.12:0/3337560638 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f5e3001a070 con 0x7f5e340bd6d0 2024-05-15T15:40:25.975 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.971+0000 7f5e2affd640 1 --2- 172.21.15.12:0/3337560638 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f5e180762d0 0x7f5e180787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:25.975 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.971+0000 7f5e2affd640 1 -- 172.21.15.12:0/3337560638 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7f5e300966a0 con 0x7f5e340bd6d0 2024-05-15T15:40:25.975 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.971+0000 7f5e39bc4640 1 --2- 172.21.15.12:0/3337560638 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f5e180762d0 0x7f5e180787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:25.975 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.972+0000 7f5e39bc4640 1 --2- 172.21.15.12:0/3337560638 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f5e180762d0 0x7f5e180787e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f5e24034000 tx=0x7f5e2402e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:25.977 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:25.976+0000 7f5e2affd640 1 -- 172.21.15.12:0/3337560638 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f5e3406e140 con 0x7f5e340bd6d0 2024-05-15T15:40:26.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.238+0000 7f5e3c629640 1 -- 172.21.15.12:0/3337560638 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f5e34050940 con 0x7f5e340bd6d0 2024-05-15T15:40:26.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.239+0000 7f5e2affd640 1 -- 172.21.15.12:0/3337560638 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) ==== 80+0+5491 (secure 0 0 0) 0x7f5e300602c0 con 0x7f5e340bd6d0 2024-05-15T15:40:26.241 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-05-15T15:40:26.241 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-05-15T15:40:26.241 INFO:teuthology.orchestra.run.smithi012.stdout: "auth_dump": [ 2024-05-15T15:40:26.241 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-05-15T15:40:26.241 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mds.a", 2024-05-15T15:40:26.241 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQAP10RmmQ2uCRAAFB9bs/ym4nRSFKX584a6mQ==", 2024-05-15T15:40:26.241 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2024-05-15T15:40:26.241 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2024-05-15T15:40:26.241 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2024-05-15T15:40:26.241 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2024-05-15T15:40:26.241 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2024-05-15T15:40:26.242 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-05-15T15:40:26.242 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-05-15T15:40:26.242 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-05-15T15:40:26.242 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mds.b", 2024-05-15T15:40:26.242 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQAP10RmDQ5ZFhAA78W/atUW8ScGMPhq8VKE6w==", 2024-05-15T15:40:26.242 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2024-05-15T15:40:26.242 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2024-05-15T15:40:26.242 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2024-05-15T15:40:26.242 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2024-05-15T15:40:26.242 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2024-05-15T15:40:26.242 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-05-15T15:40:26.242 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-05-15T15:40:26.243 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-05-15T15:40:26.243 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mds.c", 2024-05-15T15:40:26.243 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQAP10RmuB07ERAACvsGo526hg1gaXZQtBgs+g==", 2024-05-15T15:40:26.243 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2024-05-15T15:40:26.243 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2024-05-15T15:40:26.243 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2024-05-15T15:40:26.243 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2024-05-15T15:40:26.243 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2024-05-15T15:40:26.243 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-05-15T15:40:26.243 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-05-15T15:40:26.243 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-05-15T15:40:26.243 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.0", 2024-05-15T15:40:26.243 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQAS10RmxP6MNBAAFAUbMsN4KpAu7dQEGQ9o7Q==", 2024-05-15T15:40:26.243 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2024-05-15T15:40:26.244 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow profile osd", 2024-05-15T15:40:26.244 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile osd", 2024-05-15T15:40:26.244 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2024-05-15T15:40:26.244 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-05-15T15:40:26.244 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-05-15T15:40:26.244 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-05-15T15:40:26.244 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.1", 2024-05-15T15:40:26.244 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQAV10RmWySDMxAATzW1HykcApFzQgrMKKU1Bw==", 2024-05-15T15:40:26.244 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2024-05-15T15:40:26.244 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow profile osd", 2024-05-15T15:40:26.244 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile osd", 2024-05-15T15:40:26.244 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2024-05-15T15:40:26.244 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-05-15T15:40:26.244 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-05-15T15:40:26.245 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-05-15T15:40:26.245 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.2", 2024-05-15T15:40:26.245 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQAY10RmK9w8MhAAtv6kgdHrx0T0qPIGZ9P8/Q==", 2024-05-15T15:40:26.245 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2024-05-15T15:40:26.245 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow profile osd", 2024-05-15T15:40:26.245 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile osd", 2024-05-15T15:40:26.245 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2024-05-15T15:40:26.245 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-05-15T15:40:26.245 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-05-15T15:40:26.245 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-05-15T15:40:26.245 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.3", 2024-05-15T15:40:26.245 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQAb10RmKnXtMBAAP4HVGQshldH+e5d9bgJIZA==", 2024-05-15T15:40:26.245 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2024-05-15T15:40:26.245 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow profile osd", 2024-05-15T15:40:26.246 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile osd", 2024-05-15T15:40:26.246 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2024-05-15T15:40:26.246 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-05-15T15:40:26.246 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-05-15T15:40:26.246 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-05-15T15:40:26.246 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.4", 2024-05-15T15:40:26.246 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQAh10RmeCUoMxAAGFSV0KY4ncBkIU4msHmNiQ==", 2024-05-15T15:40:26.246 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2024-05-15T15:40:26.246 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow profile osd", 2024-05-15T15:40:26.246 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile osd", 2024-05-15T15:40:26.246 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2024-05-15T15:40:26.246 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-05-15T15:40:26.246 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-05-15T15:40:26.246 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-05-15T15:40:26.246 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.5", 2024-05-15T15:40:26.247 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQAk10RmraNVMxAAHLlxhGUYQGlFsVGOvKtXsQ==", 2024-05-15T15:40:26.247 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2024-05-15T15:40:26.247 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow profile osd", 2024-05-15T15:40:26.247 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile osd", 2024-05-15T15:40:26.247 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2024-05-15T15:40:26.247 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-05-15T15:40:26.247 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-05-15T15:40:26.247 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-05-15T15:40:26.247 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.6", 2024-05-15T15:40:26.247 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQAn10Rm/ObgMRAAkTAoPV6wKKNDgqsp0H4WBA==", 2024-05-15T15:40:26.247 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2024-05-15T15:40:26.247 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow profile osd", 2024-05-15T15:40:26.247 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile osd", 2024-05-15T15:40:26.247 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2024-05-15T15:40:26.248 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-05-15T15:40:26.248 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-05-15T15:40:26.248 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-05-15T15:40:26.248 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.7", 2024-05-15T15:40:26.248 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQAq10Rm50mLMBAAcltsG3nIohFBu6fmG79LYQ==", 2024-05-15T15:40:26.248 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2024-05-15T15:40:26.248 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow profile osd", 2024-05-15T15:40:26.248 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile osd", 2024-05-15T15:40:26.248 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2024-05-15T15:40:26.248 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-05-15T15:40:26.248 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-05-15T15:40:26.248 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-05-15T15:40:26.248 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.0", 2024-05-15T15:40:26.248 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQAP10RmgcqhJBAAq/xIvSfZmvkmH8pu4FHIBw==", 2024-05-15T15:40:26.249 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2024-05-15T15:40:26.249 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2024-05-15T15:40:26.249 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow r", 2024-05-15T15:40:26.249 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow rw", 2024-05-15T15:40:26.249 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow rwx" 2024-05-15T15:40:26.249 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-05-15T15:40:26.249 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-05-15T15:40:26.249 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-05-15T15:40:26.249 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.admin", 2024-05-15T15:40:26.249 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQAO10RmfwxAGxAAT4yZTOYUbsOeG8fF0pvBaQ==", 2024-05-15T15:40:26.249 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2024-05-15T15:40:26.249 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow *", 2024-05-15T15:40:26.249 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2024-05-15T15:40:26.249 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2024-05-15T15:40:26.249 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2024-05-15T15:40:26.250 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-05-15T15:40:26.250 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-05-15T15:40:26.250 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-05-15T15:40:26.250 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.bootstrap-mds", 2024-05-15T15:40:26.250 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQAw10RmjZJvFxAAq9jnbH2iU+3TVV/1GpFLfg==", 2024-05-15T15:40:26.250 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2024-05-15T15:40:26.250 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile bootstrap-mds" 2024-05-15T15:40:26.250 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-05-15T15:40:26.250 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-05-15T15:40:26.250 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-05-15T15:40:26.250 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.bootstrap-mgr", 2024-05-15T15:40:26.250 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQAw10RmGp1vFxAAVktDflPv4zp+AQmNtygdtA==", 2024-05-15T15:40:26.250 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2024-05-15T15:40:26.251 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile bootstrap-mgr" 2024-05-15T15:40:26.251 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-05-15T15:40:26.251 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-05-15T15:40:26.251 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-05-15T15:40:26.251 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.bootstrap-osd", 2024-05-15T15:40:26.251 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQAw10RmzKRvFxAAD+XDHx4NUEeUHOhTre4dGg==", 2024-05-15T15:40:26.251 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2024-05-15T15:40:26.251 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile bootstrap-osd" 2024-05-15T15:40:26.251 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-05-15T15:40:26.251 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-05-15T15:40:26.251 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-05-15T15:40:26.251 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.bootstrap-rbd", 2024-05-15T15:40:26.251 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQAw10RmRqxvFxAAbxAQ0iiPdu/2vr3vC4q80w==", 2024-05-15T15:40:26.251 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2024-05-15T15:40:26.252 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile bootstrap-rbd" 2024-05-15T15:40:26.252 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-05-15T15:40:26.252 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-05-15T15:40:26.252 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-05-15T15:40:26.252 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-05-15T15:40:26.252 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQAw10RmGrZvFxAAhTYqbL3pi3wSBrPUyHdZzQ==", 2024-05-15T15:40:26.252 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2024-05-15T15:40:26.252 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-05-15T15:40:26.252 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-05-15T15:40:26.252 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-05-15T15:40:26.252 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-05-15T15:40:26.252 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.bootstrap-rgw", 2024-05-15T15:40:26.252 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQAw10RmDb5vFxAABLlg9KCplh30lcj2nplNbw==", 2024-05-15T15:40:26.252 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2024-05-15T15:40:26.253 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile bootstrap-rgw" 2024-05-15T15:40:26.253 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-05-15T15:40:26.253 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-05-15T15:40:26.253 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-05-15T15:40:26.253 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mgr.x", 2024-05-15T15:40:26.253 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQAP10RmMFHvBRAAT8pfcXRRCuyK73tJkbHtHQ==", 2024-05-15T15:40:26.253 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2024-05-15T15:40:26.253 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow *", 2024-05-15T15:40:26.253 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile mgr", 2024-05-15T15:40:26.253 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2024-05-15T15:40:26.253 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-05-15T15:40:26.254 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-05-15T15:40:26.254 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-05-15T15:40:26.254 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mgr.y", 2024-05-15T15:40:26.254 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQAP10RmRRvYARAA5dteLyaQOKK4MGV47G2K4A==", 2024-05-15T15:40:26.254 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2024-05-15T15:40:26.254 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow *", 2024-05-15T15:40:26.254 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile mgr", 2024-05-15T15:40:26.254 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2024-05-15T15:40:26.254 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-05-15T15:40:26.254 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-05-15T15:40:26.254 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-05-15T15:40:26.255 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-05-15T15:40:26.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.241+0000 7f5e3c629640 1 -- 172.21.15.12:0/3337560638 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f5e180762d0 msgr2=0x7f5e180787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:26.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.241+0000 7f5e3c629640 1 --2- 172.21.15.12:0/3337560638 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f5e180762d0 0x7f5e180787e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f5e24034000 tx=0x7f5e2402e000 comp rx=0 tx=0).stop 2024-05-15T15:40:26.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.241+0000 7f5e3c629640 1 -- 172.21.15.12:0/3337560638 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e340bd6d0 msgr2=0x7f5e341e47f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:26.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.241+0000 7f5e3c629640 1 --2- 172.21.15.12:0/3337560638 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e340bd6d0 0x7f5e341e47f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f5e3000c370 tx=0x7f5e3000c830 comp rx=0 tx=0).stop 2024-05-15T15:40:26.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.241+0000 7f5e3c629640 1 -- 172.21.15.12:0/3337560638 shutdown_connections 2024-05-15T15:40:26.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.241+0000 7f5e3c629640 1 --2- 172.21.15.12:0/3337560638 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e34151fc0 0x7f5e3414b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:26.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.241+0000 7f5e3c629640 1 --2- 172.21.15.12:0/3337560638 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f5e340bee80 0x7f5e340b7610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:26.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.241+0000 7f5e3c629640 1 --2- 172.21.15.12:0/3337560638 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f5e180762d0 0x7f5e180787e0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:26.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.241+0000 7f5e3c629640 1 --2- 172.21.15.12:0/3337560638 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e340bd6d0 0x7f5e341e47f0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:26.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.241+0000 7f5e3c629640 1 -- 172.21.15.12:0/3337560638 >> 172.21.15.12:0/3337560638 conn(0x7f5e340c3d20 msgr2=0x7f5e340c17e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:26.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.241+0000 7f5e3c629640 1 -- 172.21.15.12:0/3337560638 shutdown_connections 2024-05-15T15:40:26.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.241+0000 7f5e3c629640 1 -- 172.21.15.12:0/3337560638 wait complete. 2024-05-15T15:40:26.258 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-05-15T15:40:26.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.369+0000 7fcc39900640 1 Processor -- start 2024-05-15T15:40:26.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.369+0000 7fcc39900640 1 -- start start 2024-05-15T15:40:26.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.370+0000 7fcc39900640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fcc3414e360 0x7fcc341522d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:26.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.370+0000 7fcc39900640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc340c1390 con 0x7fcc340bf9b0 2024-05-15T15:40:26.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.370+0000 7fcc39900640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc340c0620 con 0x7fcc34148770 2024-05-15T15:40:26.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.370+0000 7fcc39900640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fcc34151e40 con 0x7fcc3414e360 2024-05-15T15:40:26.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.370+0000 7fcc32ffd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fcc3414e360 0x7fcc341522d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:26.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.370+0000 7fcc32ffd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fcc3414e360 0x7fcc341522d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38392/0 (socket says 172.21.15.12:38392) 2024-05-15T15:40:26.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.370+0000 7fcc32ffd640 1 -- 172.21.15.12:0/4259142576 learned_addr learned my addr 172.21.15.12:0/4259142576 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:26.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.370+0000 7fcc337fe640 1 --1- 172.21.15.12:0/4259142576 >> v1:172.21.15.12:6789/0 conn(0x7fcc340bf9b0 0x7fcc340bfdc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:47234/0 (socket says 172.21.15.12:47234) 2024-05-15T15:40:26.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.371+0000 7fcc32ffd640 1 -- 172.21.15.12:0/4259142576 >> v1:172.21.15.84:6789/0 conn(0x7fcc34148770 legacy=0x7fcc340c0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:26.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.371+0000 7fcc32ffd640 1 -- 172.21.15.12:0/4259142576 >> v1:172.21.15.12:6789/0 conn(0x7fcc340bf9b0 legacy=0x7fcc340bfdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:26.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.371+0000 7fcc32ffd640 1 -- 172.21.15.12:0/4259142576 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc34151ad0 con 0x7fcc3414e360 2024-05-15T15:40:26.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.371+0000 7fcc32ffd640 1 --2- 172.21.15.12:0/4259142576 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcc3414e360 0x7fcc341522d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fcc28009e80 tx=0x7fcc2802a870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bbd2d8d93009c38 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:26.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.372+0000 7fcc31ffb640 1 -- 172.21.15.12:0/4259142576 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc28037070 con 0x7fcc3414e360 2024-05-15T15:40:26.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.372+0000 7fcc31ffb640 1 -- 172.21.15.12:0/4259142576 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc28032420 con 0x7fcc3414e360 2024-05-15T15:40:26.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.372+0000 7fcc31ffb640 1 -- 172.21.15.12:0/4259142576 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc280327f0 con 0x7fcc3414e360 2024-05-15T15:40:26.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.372+0000 7fcc39900640 1 -- 172.21.15.12:0/4259142576 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcc3414e360 msgr2=0x7fcc341522d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:26.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.372+0000 7fcc39900640 1 --2- 172.21.15.12:0/4259142576 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcc3414e360 0x7fcc341522d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fcc28009e80 tx=0x7fcc2802a870 comp rx=0 tx=0).stop 2024-05-15T15:40:26.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.372+0000 7fcc39900640 1 -- 172.21.15.12:0/4259142576 shutdown_connections 2024-05-15T15:40:26.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.372+0000 7fcc39900640 1 --2- 172.21.15.12:0/4259142576 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcc3414e360 0x7fcc341522d0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:26.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.372+0000 7fcc39900640 1 -- 172.21.15.12:0/4259142576 >> 172.21.15.12:0/4259142576 conn(0x7fcc340c17c0 msgr2=0x7fcc340c1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:26.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.373+0000 7fcc39900640 1 -- 172.21.15.12:0/4259142576 shutdown_connections 2024-05-15T15:40:26.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.373+0000 7fcc39900640 1 -- 172.21.15.12:0/4259142576 wait complete. 2024-05-15T15:40:26.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.374+0000 7fcc39900640 1 Processor -- start 2024-05-15T15:40:26.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.374+0000 7fcc39900640 1 -- start start 2024-05-15T15:40:26.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.375+0000 7fcc39900640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcc340bf9b0 0x7fcc34142100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:26.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.375+0000 7fcc39900640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcc34148770 0x7fcc34150830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:26.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.375+0000 7fcc39900640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fcc3414e360 0x7fcc341e7be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:26.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.375+0000 7fcc39900640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fcc34159e50 con 0x7fcc340bf9b0 2024-05-15T15:40:26.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.375+0000 7fcc39900640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fcc34159cd0 con 0x7fcc34148770 2024-05-15T15:40:26.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.375+0000 7fcc39900640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fcc34159fd0 con 0x7fcc3414e360 2024-05-15T15:40:26.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.376+0000 7fcc32ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcc340bf9b0 0x7fcc34142100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:26.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.376+0000 7fcc32ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcc340bf9b0 0x7fcc34142100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38402/0 (socket says 172.21.15.12:38402) 2024-05-15T15:40:26.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.376+0000 7fcc32ffd640 1 -- 172.21.15.12:0/2461548475 learned_addr learned my addr 172.21.15.12:0/2461548475 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:26.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.376+0000 7fcc327fc640 1 --2- 172.21.15.12:0/2461548475 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcc34148770 0x7fcc34150830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:26.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.376+0000 7fcc337fe640 1 --2- 172.21.15.12:0/2461548475 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fcc3414e360 0x7fcc341e7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:26.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.376+0000 7fcc32ffd640 1 -- 172.21.15.12:0/2461548475 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fcc3414e360 msgr2=0x7fcc341e7be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:26.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.376+0000 7fcc32ffd640 1 --2- 172.21.15.12:0/2461548475 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fcc3414e360 0x7fcc341e7be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:26.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.376+0000 7fcc32ffd640 1 -- 172.21.15.12:0/2461548475 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcc34148770 msgr2=0x7fcc34150830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:26.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.376+0000 7fcc32ffd640 1 --2- 172.21.15.12:0/2461548475 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcc34148770 0x7fcc34150830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:26.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.376+0000 7fcc32ffd640 1 -- 172.21.15.12:0/2461548475 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc34150d70 con 0x7fcc340bf9b0 2024-05-15T15:40:26.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.376+0000 7fcc32ffd640 1 --2- 172.21.15.12:0/2461548475 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcc340bf9b0 0x7fcc34142100 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fcc28035040 tx=0x7fcc28004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:26.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.376+0000 7fcc1bfff640 1 -- 172.21.15.12:0/2461548475 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc28037050 con 0x7fcc340bf9b0 2024-05-15T15:40:26.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.376+0000 7fcc1bfff640 1 -- 172.21.15.12:0/2461548475 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc28043070 con 0x7fcc340bf9b0 2024-05-15T15:40:26.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.376+0000 7fcc39900640 1 -- 172.21.15.12:0/2461548475 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc3413d390 con 0x7fcc340bf9b0 2024-05-15T15:40:26.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.376+0000 7fcc1bfff640 1 -- 172.21.15.12:0/2461548475 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc2803e690 con 0x7fcc340bf9b0 2024-05-15T15:40:26.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.376+0000 7fcc39900640 1 -- 172.21.15.12:0/2461548475 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc340b8460 con 0x7fcc340bf9b0 2024-05-15T15:40:26.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.378+0000 7fcc39900640 1 -- 172.21.15.12:0/2461548475 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc34050940 con 0x7fcc340bf9b0 2024-05-15T15:40:26.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.378+0000 7fcc1bfff640 1 -- 172.21.15.12:0/2461548475 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fcc2803e830 con 0x7fcc340bf9b0 2024-05-15T15:40:26.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.379+0000 7fcc1bfff640 1 --2- 172.21.15.12:0/2461548475 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fcc20076300 0x7fcc20078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:26.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.379+0000 7fcc1bfff640 1 -- 172.21.15.12:0/2461548475 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7fcc280b7e50 con 0x7fcc340bf9b0 2024-05-15T15:40:26.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.379+0000 7fcc327fc640 1 --2- 172.21.15.12:0/2461548475 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fcc20076300 0x7fcc20078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:26.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.379+0000 7fcc327fc640 1 --2- 172.21.15.12:0/2461548475 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fcc20076300 0x7fcc20078810 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fcc3406f760 tx=0x7fcc24009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:26.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.383+0000 7fcc1bfff640 1 -- 172.21.15.12:0/2461548475 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fcc28081380 con 0x7fcc340bf9b0 2024-05-15T15:40:26.652 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.650+0000 7fcc39900640 1 -- 172.21.15.12:0/2461548475 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7fcc340bf790 con 0x7fcc340bf9b0 2024-05-15T15:40:26.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.653+0000 7fcc1bfff640 1 -- 172.21.15.12:0/2461548475 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v5) ==== 90+0+0 (secure 0 0 0) 0x7fcc28085680 con 0x7fcc340bf9b0 2024-05-15T15:40:26.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.655+0000 7fcc39900640 1 -- 172.21.15.12:0/2461548475 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fcc20076300 msgr2=0x7fcc20078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:26.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.655+0000 7fcc39900640 1 --2- 172.21.15.12:0/2461548475 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fcc20076300 0x7fcc20078810 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fcc3406f760 tx=0x7fcc24009040 comp rx=0 tx=0).stop 2024-05-15T15:40:26.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.655+0000 7fcc39900640 1 -- 172.21.15.12:0/2461548475 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcc340bf9b0 msgr2=0x7fcc34142100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:26.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.655+0000 7fcc39900640 1 --2- 172.21.15.12:0/2461548475 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcc340bf9b0 0x7fcc34142100 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fcc28035040 tx=0x7fcc28004a40 comp rx=0 tx=0).stop 2024-05-15T15:40:26.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.655+0000 7fcc39900640 1 -- 172.21.15.12:0/2461548475 shutdown_connections 2024-05-15T15:40:26.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.655+0000 7fcc39900640 1 --2- 172.21.15.12:0/2461548475 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fcc3414e360 0x7fcc341e7be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:26.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.655+0000 7fcc39900640 1 --2- 172.21.15.12:0/2461548475 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcc34148770 0x7fcc34150830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:26.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.655+0000 7fcc39900640 1 --2- 172.21.15.12:0/2461548475 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fcc20076300 0x7fcc20078810 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:26.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.655+0000 7fcc39900640 1 --2- 172.21.15.12:0/2461548475 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcc340bf9b0 0x7fcc34142100 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:26.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.655+0000 7fcc39900640 1 -- 172.21.15.12:0/2461548475 >> 172.21.15.12:0/2461548475 conn(0x7fcc340c17c0 msgr2=0x7fcc3413f670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:26.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.655+0000 7fcc39900640 1 -- 172.21.15.12:0/2461548475 shutdown_connections 2024-05-15T15:40:26.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.655+0000 7fcc39900640 1 -- 172.21.15.12:0/2461548475 wait complete. 2024-05-15T15:40:26.668 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-05-15T15:40:26.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.781+0000 7fd7e855f640 1 Processor -- start 2024-05-15T15:40:26.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.781+0000 7fd7e855f640 1 -- start start 2024-05-15T15:40:26.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.782+0000 7fd7e855f640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd7e00bc1c0 0x7fd7e00a0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:26.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.782+0000 7fd7e855f640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd7e0146380 0x7fd7e0070a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:26.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.782+0000 7fd7e855f640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fd7e014c8e0 0x7fd7e014ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:26.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.782+0000 7fd7e855f640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fd7e014c450 con 0x7fd7e00bc1c0 2024-05-15T15:40:26.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.782+0000 7fd7e855f640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7fd7e014c120 con 0x7fd7e0146380 2024-05-15T15:40:26.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.782+0000 7fd7e855f640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fd7e0071e40 con 0x7fd7e014c8e0 2024-05-15T15:40:26.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.783+0000 7fd7e62fb640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd7e00bc1c0 0x7fd7e00a0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:26.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.783+0000 7fd7e62fb640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd7e00bc1c0 0x7fd7e00a0ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46924/0 (socket says 172.21.15.12:46924) 2024-05-15T15:40:26.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.783+0000 7fd7e62fb640 1 -- 172.21.15.12:0/3050226954 learned_addr learned my addr 172.21.15.12:0/3050226954 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:26.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.783+0000 7fd7e5afa640 1 --2- 172.21.15.12:0/3050226954 >> v2:172.21.15.84:3300/0 conn(0x7fd7e0146380 0x7fd7e0070a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:26.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.783+0000 7fd7e6afc640 1 --2- 172.21.15.12:0/3050226954 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fd7e014c8e0 0x7fd7e014ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:26.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.783+0000 7fd7e62fb640 1 -- 172.21.15.12:0/3050226954 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fd7e014c8e0 msgr2=0x7fd7e014ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:40:26.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.783+0000 7fd7e62fb640 1 --2- 172.21.15.12:0/3050226954 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fd7e014c8e0 0x7fd7e014ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:26.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.783+0000 7fd7e62fb640 1 -- 172.21.15.12:0/3050226954 >> v2:172.21.15.84:3300/0 conn(0x7fd7e0146380 msgr2=0x7fd7e0070a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:40:26.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.783+0000 7fd7e62fb640 1 --2- 172.21.15.12:0/3050226954 >> v2:172.21.15.84:3300/0 conn(0x7fd7e0146380 0x7fd7e0070a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:26.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.783+0000 7fd7e62fb640 1 -- 172.21.15.12:0/3050226954 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7e00713d0 con 0x7fd7e00bc1c0 2024-05-15T15:40:26.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.783+0000 7fd7e5afa640 1 --2- 172.21.15.12:0/3050226954 >> v2:172.21.15.84:3300/0 conn(0x7fd7e0146380 0x7fd7e0070a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-15T15:40:26.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.783+0000 7fd7e6afc640 1 --2- 172.21.15.12:0/3050226954 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fd7e014c8e0 0x7fd7e014ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-15T15:40:26.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.784+0000 7fd7e62fb640 1 --2- 172.21.15.12:0/3050226954 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7e00bc1c0 0x7fd7e00a0ba0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd7e00bbe80 tx=0x7fd7dc02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=760a325956b81bb2 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:26.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.784+0000 7fd7e52f9640 1 -- 172.21.15.12:0/3050226954 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7dc037070 con 0x7fd7e00bc1c0 2024-05-15T15:40:26.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.784+0000 7fd7e52f9640 1 -- 172.21.15.12:0/3050226954 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7dc032440 con 0x7fd7e00bc1c0 2024-05-15T15:40:26.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.784+0000 7fd7e52f9640 1 -- 172.21.15.12:0/3050226954 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7dc032810 con 0x7fd7e00bc1c0 2024-05-15T15:40:26.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.785+0000 7fd7e855f640 1 -- 172.21.15.12:0/3050226954 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7e00bc1c0 msgr2=0x7fd7e00a0ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:26.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.785+0000 7fd7e855f640 1 --2- 172.21.15.12:0/3050226954 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7e00bc1c0 0x7fd7e00a0ba0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd7e00bbe80 tx=0x7fd7dc02a140 comp rx=0 tx=0).stop 2024-05-15T15:40:26.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.785+0000 7fd7e855f640 1 -- 172.21.15.12:0/3050226954 shutdown_connections 2024-05-15T15:40:26.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.785+0000 7fd7e855f640 1 --2- 172.21.15.12:0/3050226954 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fd7e014c8e0 0x7fd7e014ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:26.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.785+0000 7fd7e855f640 1 --2- 172.21.15.12:0/3050226954 >> v2:172.21.15.84:3300/0 conn(0x7fd7e0146380 0x7fd7e0070a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:26.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.785+0000 7fd7e855f640 1 --2- 172.21.15.12:0/3050226954 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7e00bc1c0 0x7fd7e00a0ba0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:26.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.785+0000 7fd7e855f640 1 -- 172.21.15.12:0/3050226954 >> 172.21.15.12:0/3050226954 conn(0x7fd7e00c17c0 msgr2=0x7fd7e00c1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:26.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.785+0000 7fd7e855f640 1 -- 172.21.15.12:0/3050226954 shutdown_connections 2024-05-15T15:40:26.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.785+0000 7fd7e855f640 1 -- 172.21.15.12:0/3050226954 wait complete. 2024-05-15T15:40:26.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.786+0000 7fd7e855f640 1 Processor -- start 2024-05-15T15:40:26.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.786+0000 7fd7e855f640 1 -- start start 2024-05-15T15:40:26.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.787+0000 7fd7e855f640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7e00bc1c0 0x7fd7e0144c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:26.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.787+0000 7fd7e855f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7e0146380 0x7fd7e00a1910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:26.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.787+0000 7fd7e855f640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fd7e014c8e0 0x7fd7e00a3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:26.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.787+0000 7fd7e855f640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fd7e00bd5f0 con 0x7fd7e0146380 2024-05-15T15:40:26.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.787+0000 7fd7e855f640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fd7e0146790 con 0x7fd7e00bc1c0 2024-05-15T15:40:26.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.787+0000 7fd7e855f640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fd7e00bd770 con 0x7fd7e014c8e0 2024-05-15T15:40:26.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.788+0000 7fd7e5afa640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7e0146380 0x7fd7e00a1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:26.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.788+0000 7fd7e5afa640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7e0146380 0x7fd7e00a1910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46928/0 (socket says 172.21.15.12:46928) 2024-05-15T15:40:26.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.788+0000 7fd7e5afa640 1 -- 172.21.15.12:0/1742710601 learned_addr learned my addr 172.21.15.12:0/1742710601 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:26.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.788+0000 7fd7e62fb640 1 --2- 172.21.15.12:0/1742710601 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7e00bc1c0 0x7fd7e0144c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:26.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.788+0000 7fd7e6afc640 1 --2- 172.21.15.12:0/1742710601 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fd7e014c8e0 0x7fd7e00a3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:26.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.788+0000 7fd7e5afa640 1 -- 172.21.15.12:0/1742710601 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fd7e014c8e0 msgr2=0x7fd7e00a3dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:26.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.788+0000 7fd7e5afa640 1 --2- 172.21.15.12:0/1742710601 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fd7e014c8e0 0x7fd7e00a3dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:26.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.788+0000 7fd7e5afa640 1 -- 172.21.15.12:0/1742710601 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7e00bc1c0 msgr2=0x7fd7e0144c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:26.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.788+0000 7fd7e5afa640 1 --2- 172.21.15.12:0/1742710601 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7e00bc1c0 0x7fd7e0144c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:26.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.788+0000 7fd7e5afa640 1 -- 172.21.15.12:0/1742710601 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7e01451b0 con 0x7fd7e0146380 2024-05-15T15:40:26.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.788+0000 7fd7e5afa640 1 --2- 172.21.15.12:0/1742710601 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7e0146380 0x7fd7e00a1910 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fd7d000c7f0 tx=0x7fd7d000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:26.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.788+0000 7fd7d6ffd640 1 -- 172.21.15.12:0/1742710601 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7d0015070 con 0x7fd7e0146380 2024-05-15T15:40:26.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.788+0000 7fd7d6ffd640 1 -- 172.21.15.12:0/1742710601 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7d00077c0 con 0x7fd7e0146380 2024-05-15T15:40:26.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.788+0000 7fd7e855f640 1 -- 172.21.15.12:0/1742710601 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7e01e2790 con 0x7fd7e0146380 2024-05-15T15:40:26.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.788+0000 7fd7d6ffd640 1 -- 172.21.15.12:0/1742710601 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7d0007bb0 con 0x7fd7e0146380 2024-05-15T15:40:26.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.788+0000 7fd7e855f640 1 -- 172.21.15.12:0/1742710601 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7e00a4310 con 0x7fd7e0146380 2024-05-15T15:40:26.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.789+0000 7fd7d4ff9640 1 -- 172.21.15.12:0/1742710601 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7bc005290 con 0x7fd7e0146380 2024-05-15T15:40:26.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.790+0000 7fd7d6ffd640 1 -- 172.21.15.12:0/1742710601 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd7d0018070 con 0x7fd7e0146380 2024-05-15T15:40:26.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.791+0000 7fd7d6ffd640 1 --2- 172.21.15.12:0/1742710601 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fd7c40762d0 0x7fd7c40787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:26.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.791+0000 7fd7d6ffd640 1 -- 172.21.15.12:0/1742710601 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7fd7d0097850 con 0x7fd7e0146380 2024-05-15T15:40:26.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.791+0000 7fd7e62fb640 1 --2- 172.21.15.12:0/1742710601 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fd7c40762d0 0x7fd7c40787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:26.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.792+0000 7fd7e62fb640 1 --2- 172.21.15.12:0/1742710601 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fd7c40762d0 0x7fd7c40787e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd7dc034000 tx=0x7fd7dc02e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:26.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:26.795+0000 7fd7d6ffd640 1 -- 172.21.15.12:0/1742710601 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fd7e01e2790 con 0x7fd7e0146380 2024-05-15T15:40:27.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.064+0000 7fd7d4ff9640 1 -- 172.21.15.12:0/1742710601 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7fd7bc005850 con 0x7fd7e0146380 2024-05-15T15:40:27.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.068+0000 7fd7d6ffd640 1 -- 172.21.15.12:0/1742710601 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v6) ==== 90+0+0 (secure 0 0 0) 0x7fd7d0061470 con 0x7fd7e0146380 2024-05-15T15:40:27.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.070+0000 7fd7d4ff9640 1 -- 172.21.15.12:0/1742710601 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fd7c40762d0 msgr2=0x7fd7c40787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:27.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.070+0000 7fd7d4ff9640 1 --2- 172.21.15.12:0/1742710601 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fd7c40762d0 0x7fd7c40787e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd7dc034000 tx=0x7fd7dc02e000 comp rx=0 tx=0).stop 2024-05-15T15:40:27.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.070+0000 7fd7d4ff9640 1 -- 172.21.15.12:0/1742710601 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7e0146380 msgr2=0x7fd7e00a1910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:27.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.070+0000 7fd7d4ff9640 1 --2- 172.21.15.12:0/1742710601 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7e0146380 0x7fd7e00a1910 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fd7d000c7f0 tx=0x7fd7d000ccb0 comp rx=0 tx=0).stop 2024-05-15T15:40:27.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.070+0000 7fd7d4ff9640 1 -- 172.21.15.12:0/1742710601 shutdown_connections 2024-05-15T15:40:27.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.070+0000 7fd7d4ff9640 1 --2- 172.21.15.12:0/1742710601 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fd7e014c8e0 0x7fd7e00a3dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:27.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.070+0000 7fd7d4ff9640 1 --2- 172.21.15.12:0/1742710601 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fd7c40762d0 0x7fd7c40787e0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:27.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.070+0000 7fd7d4ff9640 1 --2- 172.21.15.12:0/1742710601 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7e0146380 0x7fd7e00a1910 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:27.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.070+0000 7fd7d4ff9640 1 --2- 172.21.15.12:0/1742710601 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7e00bc1c0 0x7fd7e0144c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:27.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.070+0000 7fd7d4ff9640 1 -- 172.21.15.12:0/1742710601 >> 172.21.15.12:0/1742710601 conn(0x7fd7e00c17c0 msgr2=0x7fd7e0142850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:27.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.071+0000 7fd7d4ff9640 1 -- 172.21.15.12:0/1742710601 shutdown_connections 2024-05-15T15:40:27.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.071+0000 7fd7d4ff9640 1 -- 172.21.15.12:0/1742710601 wait complete. 2024-05-15T15:40:27.084 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-05-15T15:40:27.196 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.194+0000 7ff673a8b640 1 Processor -- start 2024-05-15T15:40:27.196 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.194+0000 7ff673a8b640 1 -- start start 2024-05-15T15:40:27.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.195+0000 7ff673a8b640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff66c14e530 0x7ff66c0ba320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:27.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.196+0000 7ff673a8b640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff66c0bd440 0x7ff66c0bd850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:27.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.196+0000 7ff673a8b640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff66c0ba860 con 0x7ff66c0b8d70 2024-05-15T15:40:27.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.196+0000 7ff673a8b640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7ff66c0b88e0 con 0x7ff66c0bd440 2024-05-15T15:40:27.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.196+0000 7ff673a8b640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7ff66c14ece0 con 0x7ff66c14e530 2024-05-15T15:40:27.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.196+0000 7ff672028640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7ff66c0b8d70 0x7ff66c0b9180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38296/0 (socket says 172.21.15.12:38296) 2024-05-15T15:40:27.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.196+0000 7ff672028640 1 -- 172.21.15.12:0/4159225006 learned_addr learned my addr 172.21.15.12:0/4159225006 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-05-15T15:40:27.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.196+0000 7ff671026640 1 --2- 172.21.15.12:0/4159225006 >> v2:172.21.15.84:3300/0 conn(0x7ff66c0bd440 0x7ff66c0bd850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:27.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.196+0000 7ff671827640 1 --2- 172.21.15.12:0/4159225006 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff66c14e530 0x7ff66c0ba320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:27.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.196+0000 7ff670825640 1 -- 172.21.15.12:0/4159225006 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 954355774 0 0) 0x7ff66c0ba860 con 0x7ff66c0b8d70 2024-05-15T15:40:27.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.196+0000 7ff670825640 1 -- 172.21.15.12:0/4159225006 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff658003520 con 0x7ff66c0b8d70 2024-05-15T15:40:27.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.196+0000 7ff671026640 1 -- 172.21.15.12:0/4159225006 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff66c14e530 msgr2=0x7ff66c0ba320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:40:27.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.196+0000 7ff671026640 1 --2- 172.21.15.12:0/4159225006 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff66c14e530 0x7ff66c0ba320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:27.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.196+0000 7ff671026640 1 -- 172.21.15.12:0/4159225006 >> v1:172.21.15.12:6789/0 conn(0x7ff66c0b8d70 legacy=0x7ff66c0b9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:27.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.196+0000 7ff670825640 1 -- 172.21.15.12:0/4159225006 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 204317821 0 0) 0x7ff658003520 con 0x7ff66c0b8d70 2024-05-15T15:40:27.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.196+0000 7ff671026640 1 -- 172.21.15.12:0/4159225006 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff66c0bdd90 con 0x7ff66c0bd440 2024-05-15T15:40:27.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.197+0000 7ff671026640 1 --2- 172.21.15.12:0/4159225006 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff66c0bd440 0x7ff66c0bd850 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff6680097a0 tx=0x7ff66802a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=477dd7d20fd228a2 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:27.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.197+0000 7ff670825640 1 -- 172.21.15.12:0/4159225006 <== mon.1 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff668037070 con 0x7ff66c0bd440 2024-05-15T15:40:27.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.197+0000 7ff670825640 1 -- 172.21.15.12:0/4159225006 <== mon.1 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff66802aba0 con 0x7ff66c0bd440 2024-05-15T15:40:27.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.197+0000 7ff670825640 1 -- 172.21.15.12:0/4159225006 <== mon.1 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff664001a70 con 0x7ff66c0bd440 2024-05-15T15:40:27.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.198+0000 7ff673a8b640 1 -- 172.21.15.12:0/4159225006 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff66c0bd440 msgr2=0x7ff66c0bd850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:27.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.198+0000 7ff673a8b640 1 --2- 172.21.15.12:0/4159225006 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff66c0bd440 0x7ff66c0bd850 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff6680097a0 tx=0x7ff66802a110 comp rx=0 tx=0).stop 2024-05-15T15:40:27.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.198+0000 7ff673a8b640 1 -- 172.21.15.12:0/4159225006 shutdown_connections 2024-05-15T15:40:27.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.198+0000 7ff673a8b640 1 --2- 172.21.15.12:0/4159225006 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff66c0bd440 0x7ff66c0bd850 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:27.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.198+0000 7ff673a8b640 1 --2- 172.21.15.12:0/4159225006 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff66c14e530 0x7ff66c0ba320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:27.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.198+0000 7ff673a8b640 1 -- 172.21.15.12:0/4159225006 >> 172.21.15.12:0/4159225006 conn(0x7ff66c0c0570 msgr2=0x7ff66c0c0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:27.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.198+0000 7ff673a8b640 1 -- 172.21.15.12:0/4159225006 shutdown_connections 2024-05-15T15:40:27.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.198+0000 7ff673a8b640 1 -- 172.21.15.12:0/4159225006 wait complete. 2024-05-15T15:40:27.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.201+0000 7ff673a8b640 1 Processor -- start 2024-05-15T15:40:27.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.201+0000 7ff673a8b640 1 -- start start 2024-05-15T15:40:27.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.203+0000 7ff673a8b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff66c0b8d70 0x7ff66c142820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:27.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.203+0000 7ff673a8b640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff66c0bd440 0x7ff66c140e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:27.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.203+0000 7ff673a8b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff66c14e530 0x7ff66c141380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:27.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.203+0000 7ff673a8b640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7ff66c0bbb70 con 0x7ff66c14e530 2024-05-15T15:40:27.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.203+0000 7ff673a8b640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ff66c14f2a0 con 0x7ff66c0b8d70 2024-05-15T15:40:27.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.203+0000 7ff673a8b640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7ff66c14e940 con 0x7ff66c0bd440 2024-05-15T15:40:27.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.203+0000 7ff672028640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff66c14e530 0x7ff66c141380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:27.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.203+0000 7ff672028640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff66c14e530 0x7ff66c141380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46936/0 (socket says 172.21.15.12:46936) 2024-05-15T15:40:27.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.203+0000 7ff672028640 1 -- 172.21.15.12:0/2061788429 learned_addr learned my addr 172.21.15.12:0/2061788429 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:27.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.203+0000 7ff671827640 1 --2- 172.21.15.12:0/2061788429 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff66c0b8d70 0x7ff66c142820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:27.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.203+0000 7ff671026640 1 --2- 172.21.15.12:0/2061788429 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff66c0bd440 0x7ff66c140e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:27.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.203+0000 7ff672028640 1 -- 172.21.15.12:0/2061788429 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff66c0bd440 msgr2=0x7ff66c140e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:27.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.203+0000 7ff672028640 1 --2- 172.21.15.12:0/2061788429 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff66c0bd440 0x7ff66c140e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:27.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.203+0000 7ff672028640 1 -- 172.21.15.12:0/2061788429 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff66c0b8d70 msgr2=0x7ff66c142820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:27.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.203+0000 7ff672028640 1 --2- 172.21.15.12:0/2061788429 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff66c0b8d70 0x7ff66c142820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:27.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.203+0000 7ff672028640 1 -- 172.21.15.12:0/2061788429 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff66c142d60 con 0x7ff66c14e530 2024-05-15T15:40:27.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.203+0000 7ff672028640 1 --2- 172.21.15.12:0/2061788429 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff66c14e530 0x7ff66c141380 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff66400cb40 tx=0x7ff66400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:27.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.203+0000 7ff6627fc640 1 -- 172.21.15.12:0/2061788429 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff66400aca0 con 0x7ff66c14e530 2024-05-15T15:40:27.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.204+0000 7ff6627fc640 1 -- 172.21.15.12:0/2061788429 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff664012400 con 0x7ff66c14e530 2024-05-15T15:40:27.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.204+0000 7ff673a8b640 1 -- 172.21.15.12:0/2061788429 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff66c13fbc0 con 0x7ff66c14e530 2024-05-15T15:40:27.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.204+0000 7ff6627fc640 1 -- 172.21.15.12:0/2061788429 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff66400ae60 con 0x7ff66c14e530 2024-05-15T15:40:27.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.204+0000 7ff673a8b640 1 -- 172.21.15.12:0/2061788429 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff66c140180 con 0x7ff66c14e530 2024-05-15T15:40:27.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.205+0000 7ff673a8b640 1 -- 172.21.15.12:0/2061788429 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff66c13f9a0 con 0x7ff66c14e530 2024-05-15T15:40:27.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.205+0000 7ff6627fc640 1 -- 172.21.15.12:0/2061788429 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff6640127f0 con 0x7ff66c14e530 2024-05-15T15:40:27.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.206+0000 7ff6627fc640 1 --2- 172.21.15.12:0/2061788429 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7ff6500762d0 0x7ff6500787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:27.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.206+0000 7ff6627fc640 1 -- 172.21.15.12:0/2061788429 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7ff664097a10 con 0x7ff66c14e530 2024-05-15T15:40:27.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.206+0000 7ff671827640 1 --2- 172.21.15.12:0/2061788429 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7ff6500762d0 0x7ff6500787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:27.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.206+0000 7ff671827640 1 --2- 172.21.15.12:0/2061788429 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7ff6500762d0 0x7ff6500787e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff65c009a20 tx=0x7ff65c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:27.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.210+0000 7ff6627fc640 1 -- 172.21.15.12:0/2061788429 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7ff664061640 con 0x7ff66c14e530 2024-05-15T15:40:27.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.479+0000 7ff673a8b640 1 -- 172.21.15.12:0/2061788429 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7ff66c050940 con 0x7ff66c14e530 2024-05-15T15:40:27.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.483+0000 7ff6627fc640 1 -- 172.21.15.12:0/2061788429 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v7) ==== 90+0+0 (secure 0 0 0) 0x7ff664060f40 con 0x7ff66c14e530 2024-05-15T15:40:27.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.486+0000 7ff673a8b640 1 -- 172.21.15.12:0/2061788429 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7ff6500762d0 msgr2=0x7ff6500787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:27.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.486+0000 7ff673a8b640 1 --2- 172.21.15.12:0/2061788429 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7ff6500762d0 0x7ff6500787e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff65c009a20 tx=0x7ff65c008040 comp rx=0 tx=0).stop 2024-05-15T15:40:27.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.486+0000 7ff673a8b640 1 -- 172.21.15.12:0/2061788429 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff66c14e530 msgr2=0x7ff66c141380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:27.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.486+0000 7ff673a8b640 1 --2- 172.21.15.12:0/2061788429 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff66c14e530 0x7ff66c141380 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff66400cb40 tx=0x7ff66400a060 comp rx=0 tx=0).stop 2024-05-15T15:40:27.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.486+0000 7ff673a8b640 1 -- 172.21.15.12:0/2061788429 shutdown_connections 2024-05-15T15:40:27.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.486+0000 7ff673a8b640 1 --2- 172.21.15.12:0/2061788429 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7ff6500762d0 0x7ff6500787e0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:27.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.486+0000 7ff673a8b640 1 --2- 172.21.15.12:0/2061788429 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff66c14e530 0x7ff66c141380 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:27.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.486+0000 7ff673a8b640 1 --2- 172.21.15.12:0/2061788429 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff66c0bd440 0x7ff66c140e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:27.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.486+0000 7ff673a8b640 1 --2- 172.21.15.12:0/2061788429 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff66c0b8d70 0x7ff66c142820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:27.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.486+0000 7ff673a8b640 1 -- 172.21.15.12:0/2061788429 >> 172.21.15.12:0/2061788429 conn(0x7ff66c0c0570 msgr2=0x7ff66c068600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:27.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.486+0000 7ff673a8b640 1 -- 172.21.15.12:0/2061788429 shutdown_connections 2024-05-15T15:40:27.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.486+0000 7ff673a8b640 1 -- 172.21.15.12:0/2061788429 wait complete. 2024-05-15T15:40:27.500 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-05-15T15:40:27.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.610+0000 7fa457205640 1 Processor -- start 2024-05-15T15:40:27.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.610+0000 7fa457205640 1 -- start start 2024-05-15T15:40:27.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.611+0000 7fa457205640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa450151fc0 0x7fa4500bd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:27.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.611+0000 7fa457205640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa45006da30 0x7fa4500be940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:27.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.611+0000 7fa457205640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa45006de40 0x7fa4500bee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:27.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.611+0000 7fa457205640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fa4500bdc10 con 0x7fa45006de40 2024-05-15T15:40:27.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.611+0000 7fa457205640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7fa4500c36f0 con 0x7fa450151fc0 2024-05-15T15:40:27.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.611+0000 7fa457205640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fa450152530 con 0x7fa45006da30 2024-05-15T15:40:27.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.611+0000 7fa4557a2640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa45006de40 0x7fa4500bee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:27.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.611+0000 7fa4557a2640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa45006de40 0x7fa4500bee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46942/0 (socket says 172.21.15.12:46942) 2024-05-15T15:40:27.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.611+0000 7fa4557a2640 1 -- 172.21.15.12:0/3511300786 learned_addr learned my addr 172.21.15.12:0/3511300786 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:27.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.612+0000 7fa454fa1640 1 --2- 172.21.15.12:0/3511300786 >> v2:172.21.15.84:3300/0 conn(0x7fa450151fc0 0x7fa4500bd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:27.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.612+0000 7fa44ffff640 1 --2- 172.21.15.12:0/3511300786 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa45006da30 0x7fa4500be940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:27.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.612+0000 7fa4557a2640 1 -- 172.21.15.12:0/3511300786 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa45006da30 msgr2=0x7fa4500be940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:40:27.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.612+0000 7fa4557a2640 1 --2- 172.21.15.12:0/3511300786 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa45006da30 0x7fa4500be940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:27.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.612+0000 7fa4557a2640 1 -- 172.21.15.12:0/3511300786 >> v2:172.21.15.84:3300/0 conn(0x7fa450151fc0 msgr2=0x7fa4500bd6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:40:27.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.612+0000 7fa4557a2640 1 --2- 172.21.15.12:0/3511300786 >> v2:172.21.15.84:3300/0 conn(0x7fa450151fc0 0x7fa4500bd6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:27.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.612+0000 7fa4557a2640 1 -- 172.21.15.12:0/3511300786 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa450152810 con 0x7fa45006de40 2024-05-15T15:40:27.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.612+0000 7fa454fa1640 1 --2- 172.21.15.12:0/3511300786 >> v2:172.21.15.84:3300/0 conn(0x7fa450151fc0 0x7fa4500bd6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-15T15:40:27.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.612+0000 7fa4557a2640 1 --2- 172.21.15.12:0/3511300786 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa45006de40 0x7fa4500bee80 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa45008d300 tx=0x7fa43802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d45d53d724fe505 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:27.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.613+0000 7fa44f7fe640 1 -- 172.21.15.12:0/3511300786 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa438037070 con 0x7fa45006de40 2024-05-15T15:40:27.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.613+0000 7fa44f7fe640 1 -- 172.21.15.12:0/3511300786 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa438032440 con 0x7fa45006de40 2024-05-15T15:40:27.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.613+0000 7fa44f7fe640 1 -- 172.21.15.12:0/3511300786 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa438032810 con 0x7fa45006de40 2024-05-15T15:40:27.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.613+0000 7fa457205640 1 -- 172.21.15.12:0/3511300786 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa45006de40 msgr2=0x7fa4500bee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:27.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.613+0000 7fa457205640 1 --2- 172.21.15.12:0/3511300786 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa45006de40 0x7fa4500bee80 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa45008d300 tx=0x7fa43802a1e0 comp rx=0 tx=0).stop 2024-05-15T15:40:27.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.613+0000 7fa457205640 1 -- 172.21.15.12:0/3511300786 shutdown_connections 2024-05-15T15:40:27.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.613+0000 7fa457205640 1 --2- 172.21.15.12:0/3511300786 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa45006de40 0x7fa4500bee80 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:27.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.613+0000 7fa457205640 1 --2- 172.21.15.12:0/3511300786 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa45006da30 0x7fa4500be940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:27.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.613+0000 7fa457205640 1 --2- 172.21.15.12:0/3511300786 >> v2:172.21.15.84:3300/0 conn(0x7fa450151fc0 0x7fa4500bd6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:27.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.613+0000 7fa457205640 1 -- 172.21.15.12:0/3511300786 >> 172.21.15.12:0/3511300786 conn(0x7fa4500c3d20 msgr2=0x7fa4500c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:27.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.613+0000 7fa457205640 1 -- 172.21.15.12:0/3511300786 shutdown_connections 2024-05-15T15:40:27.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.613+0000 7fa457205640 1 -- 172.21.15.12:0/3511300786 wait complete. 2024-05-15T15:40:27.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.615+0000 7fa457205640 1 Processor -- start 2024-05-15T15:40:27.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.615+0000 7fa457205640 1 -- start start 2024-05-15T15:40:27.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.616+0000 7fa457205640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa45006da30 0x7fa4500bc370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:27.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.616+0000 7fa457205640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa45006de40 0x7fa4501516b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:27.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.616+0000 7fa457205640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa450151fc0 0x7fa45014a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:27.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.616+0000 7fa457205640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa4500a3050 con 0x7fa45006da30 2024-05-15T15:40:27.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.616+0000 7fa457205640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa4500a2ed0 con 0x7fa450151fc0 2024-05-15T15:40:27.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.616+0000 7fa457205640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fa45014e570 con 0x7fa45006de40 2024-05-15T15:40:27.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.616+0000 7fa454fa1640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa45006da30 0x7fa4500bc370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:27.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.616+0000 7fa454fa1640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa45006da30 0x7fa4500bc370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46944/0 (socket says 172.21.15.12:46944) 2024-05-15T15:40:27.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.616+0000 7fa454fa1640 1 -- 172.21.15.12:0/2996005082 learned_addr learned my addr 172.21.15.12:0/2996005082 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:27.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.616+0000 7fa44ffff640 1 --2- 172.21.15.12:0/2996005082 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa45006de40 0x7fa4501516b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:27.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.616+0000 7fa4557a2640 1 --2- 172.21.15.12:0/2996005082 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa450151fc0 0x7fa45014a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:27.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.616+0000 7fa454fa1640 1 -- 172.21.15.12:0/2996005082 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa45006de40 msgr2=0x7fa4501516b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:27.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.616+0000 7fa454fa1640 1 --2- 172.21.15.12:0/2996005082 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa45006de40 0x7fa4501516b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:27.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.616+0000 7fa454fa1640 1 -- 172.21.15.12:0/2996005082 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa450151fc0 msgr2=0x7fa45014a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:27.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.616+0000 7fa454fa1640 1 --2- 172.21.15.12:0/2996005082 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa450151fc0 0x7fa45014a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:27.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.616+0000 7fa454fa1640 1 -- 172.21.15.12:0/2996005082 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4500bc8b0 con 0x7fa45006da30 2024-05-15T15:40:27.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.616+0000 7fa4557a2640 1 --2- 172.21.15.12:0/2996005082 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa450151fc0 0x7fa45014a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-15T15:40:27.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.617+0000 7fa454fa1640 1 --2- 172.21.15.12:0/2996005082 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa45006da30 0x7fa4500bc370 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa44800c820 tx=0x7fa44800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:27.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.617+0000 7fa44d7fa640 1 -- 172.21.15.12:0/2996005082 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa448015070 con 0x7fa45006da30 2024-05-15T15:40:27.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.617+0000 7fa44d7fa640 1 -- 172.21.15.12:0/2996005082 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa448007a30 con 0x7fa45006da30 2024-05-15T15:40:27.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.617+0000 7fa457205640 1 -- 172.21.15.12:0/2996005082 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa45014f6d0 con 0x7fa45006da30 2024-05-15T15:40:27.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.617+0000 7fa44d7fa640 1 -- 172.21.15.12:0/2996005082 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa448007de0 con 0x7fa45006da30 2024-05-15T15:40:27.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.617+0000 7fa457205640 1 -- 172.21.15.12:0/2996005082 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa450151bf0 con 0x7fa45006da30 2024-05-15T15:40:27.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.618+0000 7fa457205640 1 -- 172.21.15.12:0/2996005082 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa45014f8a0 con 0x7fa45006da30 2024-05-15T15:40:27.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.618+0000 7fa44d7fa640 1 -- 172.21.15.12:0/2996005082 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa448018070 con 0x7fa45006da30 2024-05-15T15:40:27.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.619+0000 7fa44d7fa640 1 --2- 172.21.15.12:0/2996005082 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fa4300762d0 0x7fa4300787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:27.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.619+0000 7fa44d7fa640 1 -- 172.21.15.12:0/2996005082 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7fa4480970c0 con 0x7fa45006da30 2024-05-15T15:40:27.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.619+0000 7fa44ffff640 1 --2- 172.21.15.12:0/2996005082 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fa4300762d0 0x7fa4300787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:27.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.620+0000 7fa44ffff640 1 --2- 172.21.15.12:0/2996005082 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fa4300762d0 0x7fa4300787e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa4500bd270 tx=0x7fa440009770 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:27.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.624+0000 7fa44d7fa640 1 -- 172.21.15.12:0/2996005082 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fa448060720 con 0x7fa45006da30 2024-05-15T15:40:27.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.888+0000 7fa457205640 1 -- 172.21.15.12:0/2996005082 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7fa450050940 con 0x7fa45006da30 2024-05-15T15:40:27.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.892+0000 7fa44d7fa640 1 -- 172.21.15.12:0/2996005082 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v8) ==== 90+0+0 (secure 0 0 0) 0x7fa448064a20 con 0x7fa45006da30 2024-05-15T15:40:27.896 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.894+0000 7fa457205640 1 -- 172.21.15.12:0/2996005082 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fa4300762d0 msgr2=0x7fa4300787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:27.896 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.894+0000 7fa457205640 1 --2- 172.21.15.12:0/2996005082 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fa4300762d0 0x7fa4300787e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa4500bd270 tx=0x7fa440009770 comp rx=0 tx=0).stop 2024-05-15T15:40:27.897 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.894+0000 7fa457205640 1 -- 172.21.15.12:0/2996005082 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa45006da30 msgr2=0x7fa4500bc370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:27.897 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.894+0000 7fa457205640 1 --2- 172.21.15.12:0/2996005082 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa45006da30 0x7fa4500bc370 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa44800c820 tx=0x7fa44800cce0 comp rx=0 tx=0).stop 2024-05-15T15:40:27.897 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.894+0000 7fa457205640 1 -- 172.21.15.12:0/2996005082 shutdown_connections 2024-05-15T15:40:27.897 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.894+0000 7fa457205640 1 --2- 172.21.15.12:0/2996005082 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa450151fc0 0x7fa45014a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:27.897 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.894+0000 7fa457205640 1 --2- 172.21.15.12:0/2996005082 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa45006de40 0x7fa4501516b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:27.897 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.894+0000 7fa457205640 1 --2- 172.21.15.12:0/2996005082 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fa4300762d0 0x7fa4300787e0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:27.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.894+0000 7fa457205640 1 --2- 172.21.15.12:0/2996005082 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa45006da30 0x7fa4500bc370 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:27.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.894+0000 7fa457205640 1 -- 172.21.15.12:0/2996005082 >> 172.21.15.12:0/2996005082 conn(0x7fa4500c3d20 msgr2=0x7fa45014c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:27.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.894+0000 7fa457205640 1 -- 172.21.15.12:0/2996005082 shutdown_connections 2024-05-15T15:40:27.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:27.894+0000 7fa457205640 1 -- 172.21.15.12:0/2996005082 wait complete. 2024-05-15T15:40:27.908 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-05-15T15:40:28.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.018+0000 7f580642b640 1 Processor -- start 2024-05-15T15:40:28.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.018+0000 7f580642b640 1 -- start start 2024-05-15T15:40:28.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.019+0000 7f580642b640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f580014e360 0x7f58001522d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:28.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.019+0000 7f580642b640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f58000bf9b0 0x7f58000bfdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:28.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.019+0000 7f580642b640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58000c1390 con 0x7f5800148770 2024-05-15T15:40:28.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.019+0000 7f580642b640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f5800151e40 con 0x7f580014e360 2024-05-15T15:40:28.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.019+0000 7f580642b640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f58000c0620 con 0x7f58000bf9b0 2024-05-15T15:40:28.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.019+0000 7f57fffff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f580014e360 0x7f58001522d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:28.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.019+0000 7f57fffff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f580014e360 0x7f58001522d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46948/0 (socket says 172.21.15.12:46948) 2024-05-15T15:40:28.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.019+0000 7f57fffff640 1 -- 172.21.15.12:0/2736346666 learned_addr learned my addr 172.21.15.12:0/2736346666 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:28.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.019+0000 7f58049c8640 1 --2- 172.21.15.12:0/2736346666 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f58000bf9b0 0x7f58000bfdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:28.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.019+0000 7f57fffff640 1 -- 172.21.15.12:0/2736346666 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f58000bf9b0 msgr2=0x7f58000bfdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:40:28.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.019+0000 7f57fffff640 1 --2- 172.21.15.12:0/2736346666 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f58000bf9b0 0x7f58000bfdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:28.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.019+0000 7f57fffff640 1 -- 172.21.15.12:0/2736346666 >> v1:172.21.15.84:6789/0 conn(0x7f5800148770 legacy=0x7f58000c0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:28.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.019+0000 7f57fffff640 1 -- 172.21.15.12:0/2736346666 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5800151ad0 con 0x7f580014e360 2024-05-15T15:40:28.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.020+0000 7f57fffff640 1 --2- 172.21.15.12:0/2736346666 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f580014e360 0x7f58001522d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f57e8009870 tx=0x7f57e802a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c609e06c4ccb8ca server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:28.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.020+0000 7f57feffd640 1 -- 172.21.15.12:0/2736346666 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57e8037070 con 0x7f580014e360 2024-05-15T15:40:28.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.020+0000 7f57feffd640 1 -- 172.21.15.12:0/2736346666 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57e802ae50 con 0x7f580014e360 2024-05-15T15:40:28.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.020+0000 7f57feffd640 1 -- 172.21.15.12:0/2736346666 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57e8032860 con 0x7f580014e360 2024-05-15T15:40:28.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.021+0000 7f580642b640 1 -- 172.21.15.12:0/2736346666 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f580014e360 msgr2=0x7f58001522d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:28.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.021+0000 7f580642b640 1 --2- 172.21.15.12:0/2736346666 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f580014e360 0x7f58001522d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f57e8009870 tx=0x7f57e802a300 comp rx=0 tx=0).stop 2024-05-15T15:40:28.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.021+0000 7f580642b640 1 -- 172.21.15.12:0/2736346666 shutdown_connections 2024-05-15T15:40:28.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.021+0000 7f580642b640 1 --2- 172.21.15.12:0/2736346666 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f58000bf9b0 0x7f58000bfdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:28.026 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.021+0000 7f580642b640 1 --2- 172.21.15.12:0/2736346666 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f580014e360 0x7f58001522d0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:28.026 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.021+0000 7f580642b640 1 -- 172.21.15.12:0/2736346666 >> 172.21.15.12:0/2736346666 conn(0x7f58000c17c0 msgr2=0x7f58000c1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:28.026 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.021+0000 7f580642b640 1 -- 172.21.15.12:0/2736346666 shutdown_connections 2024-05-15T15:40:28.026 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.021+0000 7f580642b640 1 -- 172.21.15.12:0/2736346666 wait complete. 2024-05-15T15:40:28.026 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.023+0000 7f580642b640 1 Processor -- start 2024-05-15T15:40:28.026 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.023+0000 7f580642b640 1 -- start start 2024-05-15T15:40:28.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.024+0000 7f580642b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58000bf9b0 0x7f580006ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:28.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.024+0000 7f580642b640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f5800148770 0x7f580014fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:28.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.024+0000 7f580642b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f580014e360 0x7f580013ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:28.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.024+0000 7f580642b640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f5800158cc0 con 0x7f580014e360 2024-05-15T15:40:28.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.024+0000 7f580642b640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f58000c0300 con 0x7f58000bf9b0 2024-05-15T15:40:28.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.024+0000 7f580642b640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f5800158e40 con 0x7f5800148770 2024-05-15T15:40:28.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.024+0000 7f58049c8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f580014e360 0x7f580013ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:28.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.024+0000 7f58049c8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f580014e360 0x7f580013ca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46952/0 (socket says 172.21.15.12:46952) 2024-05-15T15:40:28.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.024+0000 7f58049c8640 1 -- 172.21.15.12:0/3482704080 learned_addr learned my addr 172.21.15.12:0/3482704080 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:28.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.024+0000 7f57fffff640 1 --2- 172.21.15.12:0/3482704080 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58000bf9b0 0x7f580006ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:28.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.024+0000 7f57ff7fe640 1 --2- 172.21.15.12:0/3482704080 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f5800148770 0x7f580014fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:28.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.024+0000 7f58049c8640 1 -- 172.21.15.12:0/3482704080 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f5800148770 msgr2=0x7f580014fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:28.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.024+0000 7f58049c8640 1 --2- 172.21.15.12:0/3482704080 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f5800148770 0x7f580014fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:28.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.024+0000 7f58049c8640 1 -- 172.21.15.12:0/3482704080 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58000bf9b0 msgr2=0x7f580006ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:28.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.024+0000 7f58049c8640 1 --2- 172.21.15.12:0/3482704080 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58000bf9b0 0x7f580006ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:28.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.024+0000 7f58049c8640 1 -- 172.21.15.12:0/3482704080 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58001501b0 con 0x7f580014e360 2024-05-15T15:40:28.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.024+0000 7f57ff7fe640 1 --2- 172.21.15.12:0/3482704080 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f5800148770 0x7f580014fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-15T15:40:28.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.024+0000 7f57fffff640 1 --2- 172.21.15.12:0/3482704080 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58000bf9b0 0x7f580006ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-15T15:40:28.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.025+0000 7f58049c8640 1 --2- 172.21.15.12:0/3482704080 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f580014e360 0x7f580013ca50 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f57f8007d70 tx=0x7f57f800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:28.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.025+0000 7f57fcff9640 1 -- 172.21.15.12:0/3482704080 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57f8014420 con 0x7f580014e360 2024-05-15T15:40:28.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.025+0000 7f57fcff9640 1 -- 172.21.15.12:0/3482704080 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57f8019070 con 0x7f580014e360 2024-05-15T15:40:28.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.025+0000 7f580642b640 1 -- 172.21.15.12:0/3482704080 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58000a0990 con 0x7f580014e360 2024-05-15T15:40:28.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.025+0000 7f57fcff9640 1 -- 172.21.15.12:0/3482704080 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57f8014820 con 0x7f580014e360 2024-05-15T15:40:28.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.025+0000 7f580642b640 1 -- 172.21.15.12:0/3482704080 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58000722a0 con 0x7f580014e360 2024-05-15T15:40:28.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.026+0000 7f580642b640 1 -- 172.21.15.12:0/3482704080 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5800050940 con 0x7f580014e360 2024-05-15T15:40:28.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.027+0000 7f57fcff9640 1 -- 172.21.15.12:0/3482704080 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f57f80149c0 con 0x7f580014e360 2024-05-15T15:40:28.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.027+0000 7f57fcff9640 1 --2- 172.21.15.12:0/3482704080 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f57e00762d0 0x7f57e00787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:28.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.027+0000 7f57fcff9640 1 -- 172.21.15.12:0/3482704080 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7f57f8097b70 con 0x7f580014e360 2024-05-15T15:40:28.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.027+0000 7f57fffff640 1 --2- 172.21.15.12:0/3482704080 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f57e00762d0 0x7f57e00787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:28.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.028+0000 7f57fffff640 1 --2- 172.21.15.12:0/3482704080 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f57e00762d0 0x7f57e00787e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f57e8034000 tx=0x7f57e802e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:28.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.032+0000 7f57fcff9640 1 -- 172.21.15.12:0/3482704080 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f57f80617a0 con 0x7f580014e360 2024-05-15T15:40:28.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.296+0000 7f580642b640 1 -- 172.21.15.12:0/3482704080 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7f58000bf790 con 0x7f580014e360 2024-05-15T15:40:28.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.301+0000 7f57fcff9640 1 -- 172.21.15.12:0/3482704080 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v9) ==== 97+0+0 (secure 0 0 0) 0x7f57f80610a0 con 0x7f580014e360 2024-05-15T15:40:28.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.303+0000 7f580642b640 1 -- 172.21.15.12:0/3482704080 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f57e00762d0 msgr2=0x7f57e00787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:28.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.303+0000 7f580642b640 1 --2- 172.21.15.12:0/3482704080 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f57e00762d0 0x7f57e00787e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f57e8034000 tx=0x7f57e802e000 comp rx=0 tx=0).stop 2024-05-15T15:40:28.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.303+0000 7f580642b640 1 -- 172.21.15.12:0/3482704080 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f580014e360 msgr2=0x7f580013ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:28.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.303+0000 7f580642b640 1 --2- 172.21.15.12:0/3482704080 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f580014e360 0x7f580013ca50 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f57f8007d70 tx=0x7f57f800e4b0 comp rx=0 tx=0).stop 2024-05-15T15:40:28.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.303+0000 7f580642b640 1 -- 172.21.15.12:0/3482704080 shutdown_connections 2024-05-15T15:40:28.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.303+0000 7f580642b640 1 --2- 172.21.15.12:0/3482704080 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f57e00762d0 0x7f57e00787e0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:28.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.303+0000 7f580642b640 1 --2- 172.21.15.12:0/3482704080 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f580014e360 0x7f580013ca50 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:28.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.303+0000 7f580642b640 1 --2- 172.21.15.12:0/3482704080 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f5800148770 0x7f580014fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:28.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.303+0000 7f580642b640 1 --2- 172.21.15.12:0/3482704080 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58000bf9b0 0x7f580006ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:28.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.303+0000 7f580642b640 1 -- 172.21.15.12:0/3482704080 >> 172.21.15.12:0/3482704080 conn(0x7f58000c17c0 msgr2=0x7f58000c0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:28.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.303+0000 7f580642b640 1 -- 172.21.15.12:0/3482704080 shutdown_connections 2024-05-15T15:40:28.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.303+0000 7f580642b640 1 -- 172.21.15.12:0/3482704080 wait complete. 2024-05-15T15:40:28.316 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-05-15T15:40:28.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.427+0000 7f85f8b76640 1 Processor -- start 2024-05-15T15:40:28.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.427+0000 7f85f8b76640 1 -- start start 2024-05-15T15:40:28.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.428+0000 7f85f8b76640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f85f40bf5c0 0x7f85f40be2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:28.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.428+0000 7f85f8b76640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f85f40bfa30 0x7f85f4158c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:28.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.428+0000 7f85f8b76640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85f4151b40 con 0x7f85f409fd50 2024-05-15T15:40:28.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.428+0000 7f85f8b76640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f85f41518f0 con 0x7f85f40bf5c0 2024-05-15T15:40:28.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.428+0000 7f85f8b76640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f85f4152190 con 0x7f85f40bfa30 2024-05-15T15:40:28.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.428+0000 7f85f259c640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f85f40bf5c0 0x7f85f40be2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:28.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.428+0000 7f85f259c640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f85f40bf5c0 0x7f85f40be2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46966/0 (socket says 172.21.15.12:46966) 2024-05-15T15:40:28.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.428+0000 7f85f259c640 1 -- 172.21.15.12:0/3842312773 learned_addr learned my addr 172.21.15.12:0/3842312773 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:28.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.428+0000 7f85f2d9d640 1 --2- 172.21.15.12:0/3842312773 >> v2:172.21.15.84:3300/0 conn(0x7f85f40bfa30 0x7f85f4158c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:28.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.428+0000 7f85f259c640 1 -- 172.21.15.12:0/3842312773 >> v2:172.21.15.84:3300/0 conn(0x7f85f40bfa30 msgr2=0x7f85f4158c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:40:28.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.428+0000 7f85f259c640 1 --2- 172.21.15.12:0/3842312773 >> v2:172.21.15.84:3300/0 conn(0x7f85f40bfa30 0x7f85f4158c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:28.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.428+0000 7f85f259c640 1 -- 172.21.15.12:0/3842312773 >> v1:172.21.15.84:6789/0 conn(0x7f85f409fd50 legacy=0x7f85f40bd400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:40:28.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.428+0000 7f85f259c640 1 -- 172.21.15.12:0/3842312773 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85f4151e20 con 0x7f85f40bf5c0 2024-05-15T15:40:28.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.428+0000 7f85f2d9d640 1 --2- 172.21.15.12:0/3842312773 >> v2:172.21.15.84:3300/0 conn(0x7f85f40bfa30 0x7f85f4158c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-15T15:40:28.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.429+0000 7f85f259c640 1 --2- 172.21.15.12:0/3842312773 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f85f40bf5c0 0x7f85f40be2e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f85f40c0980 tx=0x7f85e402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c1947852ee86bfa server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:28.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.429+0000 7f85f1d9b640 1 -- 172.21.15.12:0/3842312773 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85e4037070 con 0x7f85f40bf5c0 2024-05-15T15:40:28.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.429+0000 7f85f1d9b640 1 -- 172.21.15.12:0/3842312773 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85e4032440 con 0x7f85f40bf5c0 2024-05-15T15:40:28.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.429+0000 7f85f1d9b640 1 -- 172.21.15.12:0/3842312773 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85e4032810 con 0x7f85f40bf5c0 2024-05-15T15:40:28.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.430+0000 7f85f8b76640 1 -- 172.21.15.12:0/3842312773 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f85f40bf5c0 msgr2=0x7f85f40be2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:28.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.430+0000 7f85f8b76640 1 --2- 172.21.15.12:0/3842312773 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f85f40bf5c0 0x7f85f40be2e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f85f40c0980 tx=0x7f85e402a270 comp rx=0 tx=0).stop 2024-05-15T15:40:28.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.430+0000 7f85f8b76640 1 -- 172.21.15.12:0/3842312773 shutdown_connections 2024-05-15T15:40:28.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.430+0000 7f85f8b76640 1 --2- 172.21.15.12:0/3842312773 >> v2:172.21.15.84:3300/0 conn(0x7f85f40bfa30 0x7f85f4158c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:28.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.430+0000 7f85f8b76640 1 --2- 172.21.15.12:0/3842312773 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f85f40bf5c0 0x7f85f40be2e0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:28.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.430+0000 7f85f8b76640 1 -- 172.21.15.12:0/3842312773 >> 172.21.15.12:0/3842312773 conn(0x7f85f40c17c0 msgr2=0x7f85f40c1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:28.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.430+0000 7f85f8b76640 1 -- 172.21.15.12:0/3842312773 shutdown_connections 2024-05-15T15:40:28.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.430+0000 7f85f8b76640 1 -- 172.21.15.12:0/3842312773 wait complete. 2024-05-15T15:40:28.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.432+0000 7f85f8b76640 1 Processor -- start 2024-05-15T15:40:28.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.432+0000 7f85f8b76640 1 -- start start 2024-05-15T15:40:28.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.433+0000 7f85f8b76640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f85f409fd50 0x7f85f406d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:28.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.433+0000 7f85f8b76640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f85f40bf5c0 0x7f85f41454d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:28.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.433+0000 7f85f8b76640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f85f40bfa30 0x7f85f4145d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:28.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.433+0000 7f85f8b76640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f85f41527a0 con 0x7f85f40bfa30 2024-05-15T15:40:28.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.433+0000 7f85f8b76640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f85f4152620 con 0x7f85f409fd50 2024-05-15T15:40:28.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.433+0000 7f85f8b76640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f85f40a0160 con 0x7f85f40bf5c0 2024-05-15T15:40:28.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.433+0000 7f85f2d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f85f40bfa30 0x7f85f4145d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:28.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.433+0000 7f85f2d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f85f40bfa30 0x7f85f4145d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46972/0 (socket says 172.21.15.12:46972) 2024-05-15T15:40:28.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.433+0000 7f85f2d9d640 1 -- 172.21.15.12:0/1561373970 learned_addr learned my addr 172.21.15.12:0/1561373970 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:28.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.433+0000 7f85ebfff640 1 --2- 172.21.15.12:0/1561373970 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f85f40bf5c0 0x7f85f41454d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:28.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.433+0000 7f85f259c640 1 --2- 172.21.15.12:0/1561373970 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f85f409fd50 0x7f85f406d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:28.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.433+0000 7f85f2d9d640 1 -- 172.21.15.12:0/1561373970 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f85f40bf5c0 msgr2=0x7f85f41454d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:28.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.433+0000 7f85f2d9d640 1 --2- 172.21.15.12:0/1561373970 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f85f40bf5c0 0x7f85f41454d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:28.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.433+0000 7f85f2d9d640 1 -- 172.21.15.12:0/1561373970 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f85f409fd50 msgr2=0x7f85f406d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:28.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.433+0000 7f85f2d9d640 1 --2- 172.21.15.12:0/1561373970 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f85f409fd50 0x7f85f406d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:28.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.433+0000 7f85f2d9d640 1 -- 172.21.15.12:0/1561373970 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85f406dea0 con 0x7f85f40bfa30 2024-05-15T15:40:28.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.433+0000 7f85f2d9d640 1 --2- 172.21.15.12:0/1561373970 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f85f40bfa30 0x7f85f4145d00 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f85ec00cd80 tx=0x7f85ec00a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:28.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.434+0000 7f85eaffd640 1 -- 172.21.15.12:0/1561373970 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85ec00f680 con 0x7f85f40bfa30 2024-05-15T15:40:28.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.434+0000 7f85eaffd640 1 -- 172.21.15.12:0/1561373970 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85ec00f840 con 0x7f85f40bfa30 2024-05-15T15:40:28.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.434+0000 7f85f8b76640 1 -- 172.21.15.12:0/1561373970 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85f41e8de0 con 0x7f85f40bfa30 2024-05-15T15:40:28.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.434+0000 7f85eaffd640 1 -- 172.21.15.12:0/1561373970 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85ec00fc30 con 0x7f85f40bfa30 2024-05-15T15:40:28.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.434+0000 7f85f8b76640 1 -- 172.21.15.12:0/1561373970 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85f41e8060 con 0x7f85f40bfa30 2024-05-15T15:40:28.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.435+0000 7f85f8b76640 1 -- 172.21.15.12:0/1561373970 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85f414f2a0 con 0x7f85f40bfa30 2024-05-15T15:40:28.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.436+0000 7f85eaffd640 1 -- 172.21.15.12:0/1561373970 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f85ec0213f0 con 0x7f85f40bfa30 2024-05-15T15:40:28.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.436+0000 7f85eaffd640 1 --2- 172.21.15.12:0/1561373970 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f85d40762d0 0x7f85d40787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:28.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.436+0000 7f85eaffd640 1 -- 172.21.15.12:0/1561373970 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7f85ec097fe0 con 0x7f85f40bfa30 2024-05-15T15:40:28.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.436+0000 7f85f259c640 1 --2- 172.21.15.12:0/1561373970 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f85d40762d0 0x7f85d40787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:28.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.437+0000 7f85f259c640 1 --2- 172.21.15.12:0/1561373970 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f85d40762d0 0x7f85d40787e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f85e4034000 tx=0x7f85e402e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:28.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.441+0000 7f85eaffd640 1 -- 172.21.15.12:0/1561373970 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f85ec014030 con 0x7f85f40bfa30 2024-05-15T15:40:28.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.705+0000 7f85f8b76640 1 -- 172.21.15.12:0/1561373970 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7f85f414bd20 con 0x7f85f40bfa30 2024-05-15T15:40:28.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.710+0000 7f85eaffd640 1 -- 172.21.15.12:0/1561373970 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v10) ==== 90+0+0 (secure 0 0 0) 0x7f85ec061c90 con 0x7f85f40bfa30 2024-05-15T15:40:28.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.712+0000 7f85f8b76640 1 -- 172.21.15.12:0/1561373970 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f85d40762d0 msgr2=0x7f85d40787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:28.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.712+0000 7f85f8b76640 1 --2- 172.21.15.12:0/1561373970 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f85d40762d0 0x7f85d40787e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f85e4034000 tx=0x7f85e402e000 comp rx=0 tx=0).stop 2024-05-15T15:40:28.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.712+0000 7f85f8b76640 1 -- 172.21.15.12:0/1561373970 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f85f40bfa30 msgr2=0x7f85f4145d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:28.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.712+0000 7f85f8b76640 1 --2- 172.21.15.12:0/1561373970 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f85f40bfa30 0x7f85f4145d00 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f85ec00cd80 tx=0x7f85ec00a650 comp rx=0 tx=0).stop 2024-05-15T15:40:28.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.712+0000 7f85f8b76640 1 -- 172.21.15.12:0/1561373970 shutdown_connections 2024-05-15T15:40:28.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.712+0000 7f85f8b76640 1 --2- 172.21.15.12:0/1561373970 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f85d40762d0 0x7f85d40787e0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:28.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.712+0000 7f85f8b76640 1 --2- 172.21.15.12:0/1561373970 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f85f40bfa30 0x7f85f4145d00 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:28.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.712+0000 7f85f8b76640 1 --2- 172.21.15.12:0/1561373970 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f85f40bf5c0 0x7f85f41454d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:28.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.712+0000 7f85f8b76640 1 --2- 172.21.15.12:0/1561373970 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f85f409fd50 0x7f85f406d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:28.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.712+0000 7f85f8b76640 1 -- 172.21.15.12:0/1561373970 >> 172.21.15.12:0/1561373970 conn(0x7f85f40c17c0 msgr2=0x7f85f4140f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:28.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.712+0000 7f85f8b76640 1 -- 172.21.15.12:0/1561373970 shutdown_connections 2024-05-15T15:40:28.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.712+0000 7f85f8b76640 1 -- 172.21.15.12:0/1561373970 wait complete. 2024-05-15T15:40:28.725 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-15T15:40:28.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.835+0000 7fa787084640 1 Processor -- start 2024-05-15T15:40:28.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.835+0000 7fa787084640 1 -- start start 2024-05-15T15:40:28.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.837+0000 7fa787084640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa7800bcb00 0x7fa78014b650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:28.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.837+0000 7fa787084640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa78014bb90 0x7fa780155a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:28.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.837+0000 7fa787084640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7800bb700 con 0x7fa780145580 2024-05-15T15:40:28.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.837+0000 7fa787084640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fa7800bcf10 con 0x7fa78014bb90 2024-05-15T15:40:28.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.837+0000 7fa787084640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7fa7800a5b60 con 0x7fa7800bcb00 2024-05-15T15:40:28.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.837+0000 7fa785621640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa78014bb90 0x7fa780155a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:28.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.837+0000 7fa785621640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa78014bb90 0x7fa780155a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46978/0 (socket says 172.21.15.12:46978) 2024-05-15T15:40:28.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.837+0000 7fa785621640 1 -- 172.21.15.12:0/365044995 learned_addr learned my addr 172.21.15.12:0/365044995 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:28.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.837+0000 7fa77ffff640 1 --2- 172.21.15.12:0/365044995 >> v2:172.21.15.84:3300/0 conn(0x7fa7800bcb00 0x7fa78014b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:28.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.837+0000 7fa785621640 1 -- 172.21.15.12:0/365044995 >> v2:172.21.15.84:3300/0 conn(0x7fa7800bcb00 msgr2=0x7fa78014b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:40:28.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.837+0000 7fa785621640 1 --2- 172.21.15.12:0/365044995 >> v2:172.21.15.84:3300/0 conn(0x7fa7800bcb00 0x7fa78014b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:28.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.837+0000 7fa785621640 1 -- 172.21.15.12:0/365044995 >> v1:172.21.15.84:6789/0 conn(0x7fa780145580 legacy=0x7fa7800baff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:40:28.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.837+0000 7fa785621640 1 -- 172.21.15.12:0/365044995 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa78014eef0 con 0x7fa78014bb90 2024-05-15T15:40:28.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.838+0000 7fa785621640 1 --2- 172.21.15.12:0/365044995 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa78014bb90 0x7fa780155a40 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fa7800bc590 tx=0x7fa77002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23b742a31a13540d server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:28.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.838+0000 7fa77f7fe640 1 -- 172.21.15.12:0/365044995 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa770037070 con 0x7fa78014bb90 2024-05-15T15:40:28.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.838+0000 7fa77f7fe640 1 -- 172.21.15.12:0/365044995 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa770032440 con 0x7fa78014bb90 2024-05-15T15:40:28.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.838+0000 7fa77f7fe640 1 -- 172.21.15.12:0/365044995 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa770032810 con 0x7fa78014bb90 2024-05-15T15:40:28.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.839+0000 7fa787084640 1 -- 172.21.15.12:0/365044995 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa78014bb90 msgr2=0x7fa780155a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:28.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.839+0000 7fa787084640 1 --2- 172.21.15.12:0/365044995 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa78014bb90 0x7fa780155a40 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fa7800bc590 tx=0x7fa77002a1e0 comp rx=0 tx=0).stop 2024-05-15T15:40:28.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.839+0000 7fa787084640 1 -- 172.21.15.12:0/365044995 shutdown_connections 2024-05-15T15:40:28.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.839+0000 7fa787084640 1 --2- 172.21.15.12:0/365044995 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa78014bb90 0x7fa780155a40 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:28.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.839+0000 7fa787084640 1 --2- 172.21.15.12:0/365044995 >> v2:172.21.15.84:3300/0 conn(0x7fa7800bcb00 0x7fa78014b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:28.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.839+0000 7fa787084640 1 -- 172.21.15.12:0/365044995 >> 172.21.15.12:0/365044995 conn(0x7fa7800bd0f0 msgr2=0x7fa7800bd500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:28.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.839+0000 7fa787084640 1 -- 172.21.15.12:0/365044995 shutdown_connections 2024-05-15T15:40:28.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.839+0000 7fa787084640 1 -- 172.21.15.12:0/365044995 wait complete. 2024-05-15T15:40:28.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.840+0000 7fa787084640 1 Processor -- start 2024-05-15T15:40:28.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.840+0000 7fa787084640 1 -- start start 2024-05-15T15:40:28.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.841+0000 7fa787084640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa7800bcb00 0x7fa78006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:28.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.841+0000 7fa787084640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa780145580 0x7fa7801446e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:28.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.841+0000 7fa787084640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa78014bb90 0x7fa780144c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:28.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.841+0000 7fa787084640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa78014bfa0 con 0x7fa780145580 2024-05-15T15:40:28.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.841+0000 7fa787084640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa78014f4b0 con 0x7fa78014bb90 2024-05-15T15:40:28.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.841+0000 7fa787084640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fa7800c0240 con 0x7fa7800bcb00 2024-05-15T15:40:28.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.842+0000 7fa77ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa780145580 0x7fa7801446e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:28.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.842+0000 7fa77ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa780145580 0x7fa7801446e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46986/0 (socket says 172.21.15.12:46986) 2024-05-15T15:40:28.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.842+0000 7fa77ffff640 1 -- 172.21.15.12:0/1087928265 learned_addr learned my addr 172.21.15.12:0/1087928265 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:28.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.842+0000 7fa784e20640 1 --2- 172.21.15.12:0/1087928265 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa7800bcb00 0x7fa78006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:28.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.842+0000 7fa785621640 1 --2- 172.21.15.12:0/1087928265 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa78014bb90 0x7fa780144c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:28.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.842+0000 7fa77ffff640 1 -- 172.21.15.12:0/1087928265 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa7800bcb00 msgr2=0x7fa78006c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:28.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.842+0000 7fa77ffff640 1 --2- 172.21.15.12:0/1087928265 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa7800bcb00 0x7fa78006c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:28.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.842+0000 7fa77ffff640 1 -- 172.21.15.12:0/1087928265 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa78014bb90 msgr2=0x7fa780144c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:28.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.842+0000 7fa77ffff640 1 --2- 172.21.15.12:0/1087928265 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa78014bb90 0x7fa780144c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:28.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.842+0000 7fa77ffff640 1 -- 172.21.15.12:0/1087928265 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa78006ce30 con 0x7fa780145580 2024-05-15T15:40:28.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.842+0000 7fa77ffff640 1 --2- 172.21.15.12:0/1087928265 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa780145580 0x7fa7801446e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fa77400d5f0 tx=0x7fa77400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:28.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.842+0000 7fa77d7fa640 1 -- 172.21.15.12:0/1087928265 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7740125f0 con 0x7fa780145580 2024-05-15T15:40:28.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.842+0000 7fa77d7fa640 1 -- 172.21.15.12:0/1087928265 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa774019070 con 0x7fa780145580 2024-05-15T15:40:28.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.842+0000 7fa787084640 1 -- 172.21.15.12:0/1087928265 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa78014e600 con 0x7fa780145580 2024-05-15T15:40:28.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.842+0000 7fa77d7fa640 1 -- 172.21.15.12:0/1087928265 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7740129d0 con 0x7fa780145580 2024-05-15T15:40:28.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.842+0000 7fa787084640 1 -- 172.21.15.12:0/1087928265 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa78014d100 con 0x7fa780145580 2024-05-15T15:40:28.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.843+0000 7fa787084640 1 -- 172.21.15.12:0/1087928265 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7800bf3e0 con 0x7fa780145580 2024-05-15T15:40:28.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.844+0000 7fa77d7fa640 1 -- 172.21.15.12:0/1087928265 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa774012b70 con 0x7fa780145580 2024-05-15T15:40:28.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.844+0000 7fa77d7fa640 1 --2- 172.21.15.12:0/1087928265 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fa76c0762d0 0x7fa76c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:28.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.845+0000 7fa77d7fa640 1 -- 172.21.15.12:0/1087928265 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7fa774097770 con 0x7fa780145580 2024-05-15T15:40:28.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.845+0000 7fa784e20640 1 --2- 172.21.15.12:0/1087928265 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fa76c0762d0 0x7fa76c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:28.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.845+0000 7fa784e20640 1 --2- 172.21.15.12:0/1087928265 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fa76c0762d0 0x7fa76c0787e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa778009f20 tx=0x7fa7780094d0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:28.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:28.849+0000 7fa77d7fa640 1 -- 172.21.15.12:0/1087928265 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fa7800bf3e0 con 0x7fa780145580 2024-05-15T15:40:29.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.041+0000 7fa787084640 1 -- 172.21.15.12:0/1087928265 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fa780069b50 con 0x7fa780145580 2024-05-15T15:40:29.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.041+0000 7fa77d7fa640 1 -- 172.21.15.12:0/1087928265 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v29) ==== 84+0+65 (secure 0 0 0) 0x7fa774061390 con 0x7fa780145580 2024-05-15T15:40:29.044 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-05-15T15:40:29.044 INFO:teuthology.orchestra.run.smithi012.stdout:[ 2024-05-15T15:40:29.044 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-05-15T15:40:29.044 INFO:teuthology.orchestra.run.smithi012.stdout: "poolnum": 1, 2024-05-15T15:40:29.044 INFO:teuthology.orchestra.run.smithi012.stdout: "poolname": ".mgr" 2024-05-15T15:40:29.044 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-05-15T15:40:29.044 INFO:teuthology.orchestra.run.smithi012.stdout:] 2024-05-15T15:40:29.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.043+0000 7fa787084640 1 -- 172.21.15.12:0/1087928265 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fa76c0762d0 msgr2=0x7fa76c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:29.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.043+0000 7fa787084640 1 --2- 172.21.15.12:0/1087928265 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fa76c0762d0 0x7fa76c0787e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa778009f20 tx=0x7fa7780094d0 comp rx=0 tx=0).stop 2024-05-15T15:40:29.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.043+0000 7fa787084640 1 -- 172.21.15.12:0/1087928265 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa780145580 msgr2=0x7fa7801446e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:29.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.043+0000 7fa787084640 1 --2- 172.21.15.12:0/1087928265 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa780145580 0x7fa7801446e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fa77400d5f0 tx=0x7fa77400dab0 comp rx=0 tx=0).stop 2024-05-15T15:40:29.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.044+0000 7fa787084640 1 -- 172.21.15.12:0/1087928265 shutdown_connections 2024-05-15T15:40:29.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.044+0000 7fa787084640 1 --2- 172.21.15.12:0/1087928265 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa78014bb90 0x7fa780144c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:29.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.044+0000 7fa787084640 1 --2- 172.21.15.12:0/1087928265 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fa76c0762d0 0x7fa76c0787e0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:29.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.044+0000 7fa787084640 1 --2- 172.21.15.12:0/1087928265 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa780145580 0x7fa7801446e0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:29.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.044+0000 7fa787084640 1 --2- 172.21.15.12:0/1087928265 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa7800bcb00 0x7fa78006c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:29.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.044+0000 7fa787084640 1 -- 172.21.15.12:0/1087928265 >> 172.21.15.12:0/1087928265 conn(0x7fa7800bd0f0 msgr2=0x7fa7800becd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:29.047 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.044+0000 7fa787084640 1 -- 172.21.15.12:0/1087928265 shutdown_connections 2024-05-15T15:40:29.047 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.044+0000 7fa787084640 1 -- 172.21.15.12:0/1087928265 wait complete. 2024-05-15T15:40:29.056 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-15T15:40:29.057 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-15T15:40:29.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.170+0000 7f52da95e640 1 Processor -- start 2024-05-15T15:40:29.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.170+0000 7f52da95e640 1 -- start start 2024-05-15T15:40:29.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.171+0000 7f52da95e640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f52d4151fc0 0x7f52d40bd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:29.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.171+0000 7f52da95e640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f52d406da30 0x7f52d40be940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:29.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.171+0000 7f52da95e640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f52d406de40 0x7f52d40bee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:29.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.171+0000 7f52da95e640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f52d40bdc10 con 0x7f52d4151fc0 2024-05-15T15:40:29.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.171+0000 7f52da95e640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f52d40c36f0 con 0x7f52d406da30 2024-05-15T15:40:29.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.171+0000 7f52da95e640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f52d4152530 con 0x7f52d406de40 2024-05-15T15:40:29.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.171+0000 7f52d3fff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f52d4151fc0 0x7f52d40bd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:29.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.172+0000 7f52d3fff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f52d4151fc0 0x7f52d40bd6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46988/0 (socket says 172.21.15.12:46988) 2024-05-15T15:40:29.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.172+0000 7f52d3fff640 1 -- 172.21.15.12:0/2104981 learned_addr learned my addr 172.21.15.12:0/2104981 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:29.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.172+0000 7f52d37fe640 1 --2- 172.21.15.12:0/2104981 >> v2:172.21.15.84:3300/0 conn(0x7f52d406da30 0x7f52d40be940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:29.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.172+0000 7f52d8efb640 1 --2- 172.21.15.12:0/2104981 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f52d406de40 0x7f52d40bee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:29.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.172+0000 7f52d3fff640 1 -- 172.21.15.12:0/2104981 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f52d406de40 msgr2=0x7f52d40bee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:40:29.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.172+0000 7f52d3fff640 1 --2- 172.21.15.12:0/2104981 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f52d406de40 0x7f52d40bee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:29.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.172+0000 7f52d3fff640 1 -- 172.21.15.12:0/2104981 >> v2:172.21.15.84:3300/0 conn(0x7f52d406da30 msgr2=0x7f52d40be940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:40:29.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.172+0000 7f52d3fff640 1 --2- 172.21.15.12:0/2104981 >> v2:172.21.15.84:3300/0 conn(0x7f52d406da30 0x7f52d40be940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:29.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.172+0000 7f52d3fff640 1 -- 172.21.15.12:0/2104981 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52d4152810 con 0x7f52d4151fc0 2024-05-15T15:40:29.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.173+0000 7f52d3fff640 1 --2- 172.21.15.12:0/2104981 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52d4151fc0 0x7f52d40bd6d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f52d40c38d0 tx=0x7f52bc02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb70542e898fe494 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:29.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.173+0000 7f52d2ffd640 1 -- 172.21.15.12:0/2104981 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52bc037070 con 0x7f52d4151fc0 2024-05-15T15:40:29.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.173+0000 7f52d2ffd640 1 -- 172.21.15.12:0/2104981 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52bc032440 con 0x7f52d4151fc0 2024-05-15T15:40:29.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.173+0000 7f52d2ffd640 1 -- 172.21.15.12:0/2104981 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52bc032810 con 0x7f52d4151fc0 2024-05-15T15:40:29.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.173+0000 7f52da95e640 1 -- 172.21.15.12:0/2104981 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52d4151fc0 msgr2=0x7f52d40bd6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:29.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.173+0000 7f52da95e640 1 --2- 172.21.15.12:0/2104981 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52d4151fc0 0x7f52d40bd6d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f52d40c38d0 tx=0x7f52bc02a1c0 comp rx=0 tx=0).stop 2024-05-15T15:40:29.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.173+0000 7f52da95e640 1 -- 172.21.15.12:0/2104981 shutdown_connections 2024-05-15T15:40:29.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.173+0000 7f52da95e640 1 --2- 172.21.15.12:0/2104981 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f52d406de40 0x7f52d40bee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:29.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.173+0000 7f52da95e640 1 --2- 172.21.15.12:0/2104981 >> v2:172.21.15.84:3300/0 conn(0x7f52d406da30 0x7f52d40be940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:29.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.173+0000 7f52da95e640 1 --2- 172.21.15.12:0/2104981 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52d4151fc0 0x7f52d40bd6d0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:29.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.173+0000 7f52da95e640 1 -- 172.21.15.12:0/2104981 >> 172.21.15.12:0/2104981 conn(0x7f52d40c3d20 msgr2=0x7f52d40c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:29.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.174+0000 7f52da95e640 1 -- 172.21.15.12:0/2104981 shutdown_connections 2024-05-15T15:40:29.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.174+0000 7f52da95e640 1 -- 172.21.15.12:0/2104981 wait complete. 2024-05-15T15:40:29.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.175+0000 7f52da95e640 1 Processor -- start 2024-05-15T15:40:29.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.175+0000 7f52da95e640 1 -- start start 2024-05-15T15:40:29.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.176+0000 7f52da95e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52d406da30 0x7f52d40baea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:29.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.176+0000 7f52da95e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52d406de40 0x7f52d40b5940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:29.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.176+0000 7f52da95e640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f52d4151fc0 0x7f52d41e7a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:29.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.176+0000 7f52da95e640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f52d40a3050 con 0x7f52d406de40 2024-05-15T15:40:29.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.176+0000 7f52da95e640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f52d40a2ed0 con 0x7f52d406da30 2024-05-15T15:40:29.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.176+0000 7f52da95e640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f52d414e570 con 0x7f52d4151fc0 2024-05-15T15:40:29.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.176+0000 7f52d37fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52d406de40 0x7f52d40b5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:29.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.176+0000 7f52d37fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52d406de40 0x7f52d40b5940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46998/0 (socket says 172.21.15.12:46998) 2024-05-15T15:40:29.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.176+0000 7f52d37fe640 1 -- 172.21.15.12:0/2723535216 learned_addr learned my addr 172.21.15.12:0/2723535216 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:29.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.176+0000 7f52d3fff640 1 --2- 172.21.15.12:0/2723535216 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52d406da30 0x7f52d40baea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:29.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.177+0000 7f52d8efb640 1 --2- 172.21.15.12:0/2723535216 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f52d4151fc0 0x7f52d41e7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:29.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.177+0000 7f52d37fe640 1 -- 172.21.15.12:0/2723535216 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f52d4151fc0 msgr2=0x7f52d41e7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:29.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.177+0000 7f52d37fe640 1 --2- 172.21.15.12:0/2723535216 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f52d4151fc0 0x7f52d41e7a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:29.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.177+0000 7f52d37fe640 1 -- 172.21.15.12:0/2723535216 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52d406da30 msgr2=0x7f52d40baea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:29.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.177+0000 7f52d37fe640 1 --2- 172.21.15.12:0/2723535216 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52d406da30 0x7f52d40baea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:29.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.177+0000 7f52d37fe640 1 -- 172.21.15.12:0/2723535216 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52d40bc890 con 0x7f52d406de40 2024-05-15T15:40:29.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.177+0000 7f52d3fff640 1 --2- 172.21.15.12:0/2723535216 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52d406da30 0x7f52d40baea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-15T15:40:29.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.177+0000 7f52d8efb640 1 --2- 172.21.15.12:0/2723535216 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f52d4151fc0 0x7f52d41e7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-15T15:40:29.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.177+0000 7f52d37fe640 1 --2- 172.21.15.12:0/2723535216 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52d406de40 0x7f52d40b5940 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f52c400e870 tx=0x7f52c400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:29.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.177+0000 7f52d0ff9640 1 -- 172.21.15.12:0/2723535216 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52c4017070 con 0x7f52d406de40 2024-05-15T15:40:29.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.177+0000 7f52d0ff9640 1 -- 172.21.15.12:0/2723535216 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52c4009e40 con 0x7f52d406de40 2024-05-15T15:40:29.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.177+0000 7f52d0ff9640 1 -- 172.21.15.12:0/2723535216 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52c400cb60 con 0x7f52d406de40 2024-05-15T15:40:29.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.177+0000 7f52da95e640 1 -- 172.21.15.12:0/2723535216 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52d40bba40 con 0x7f52d406de40 2024-05-15T15:40:29.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.177+0000 7f52da95e640 1 -- 172.21.15.12:0/2723535216 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52d41e4980 con 0x7f52d406de40 2024-05-15T15:40:29.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.178+0000 7f52da95e640 1 -- 172.21.15.12:0/2723535216 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52d4151770 con 0x7f52d406de40 2024-05-15T15:40:29.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.179+0000 7f52d0ff9640 1 -- 172.21.15.12:0/2723535216 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f52c401a070 con 0x7f52d406de40 2024-05-15T15:40:29.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.179+0000 7f52d0ff9640 1 --2- 172.21.15.12:0/2723535216 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f52b40762d0 0x7f52b40787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:29.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.179+0000 7f52d0ff9640 1 -- 172.21.15.12:0/2723535216 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7f52c4097090 con 0x7f52d406de40 2024-05-15T15:40:29.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.180+0000 7f52d3fff640 1 --2- 172.21.15.12:0/2723535216 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f52b40762d0 0x7f52b40787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:29.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.180+0000 7f52d3fff640 1 --2- 172.21.15.12:0/2723535216 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f52b40762d0 0x7f52b40787e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f52bc034000 tx=0x7f52bc02e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:29.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.184+0000 7f52d0ff9640 1 -- 172.21.15.12:0/2723535216 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f52c4060d40 con 0x7f52d406de40 2024-05-15T15:40:29.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.377+0000 7f52da95e640 1 -- 172.21.15.12:0/2723535216 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f52d4050940 con 0x7f52d406de40 2024-05-15T15:40:29.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.835+0000 7f52d0ff9640 1 -- 172.21.15.12:0/2723535216 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v30) ==== 138+0+0 (secure 0 0 0) 0x7f52c4060640 con 0x7f52d406de40 2024-05-15T15:40:29.837 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_metadata' created 2024-05-15T15:40:29.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.838+0000 7f52da95e640 1 -- 172.21.15.12:0/2723535216 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f52b40762d0 msgr2=0x7f52b40787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:29.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.838+0000 7f52da95e640 1 --2- 172.21.15.12:0/2723535216 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f52b40762d0 0x7f52b40787e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f52bc034000 tx=0x7f52bc02e000 comp rx=0 tx=0).stop 2024-05-15T15:40:29.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.838+0000 7f52da95e640 1 -- 172.21.15.12:0/2723535216 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52d406de40 msgr2=0x7f52d40b5940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:29.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.838+0000 7f52da95e640 1 --2- 172.21.15.12:0/2723535216 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52d406de40 0x7f52d40b5940 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f52c400e870 tx=0x7f52c400ed30 comp rx=0 tx=0).stop 2024-05-15T15:40:29.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.838+0000 7f52da95e640 1 -- 172.21.15.12:0/2723535216 shutdown_connections 2024-05-15T15:40:29.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.838+0000 7f52da95e640 1 --2- 172.21.15.12:0/2723535216 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f52d4151fc0 0x7f52d41e7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:29.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.838+0000 7f52da95e640 1 --2- 172.21.15.12:0/2723535216 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f52b40762d0 0x7f52b40787e0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:29.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.838+0000 7f52da95e640 1 --2- 172.21.15.12:0/2723535216 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52d406de40 0x7f52d40b5940 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:29.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.838+0000 7f52da95e640 1 --2- 172.21.15.12:0/2723535216 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52d406da30 0x7f52d40baea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:29.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.838+0000 7f52da95e640 1 -- 172.21.15.12:0/2723535216 >> 172.21.15.12:0/2723535216 conn(0x7f52d40c3d20 msgr2=0x7f52d40c16e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:29.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.838+0000 7f52da95e640 1 -- 172.21.15.12:0/2723535216 shutdown_connections 2024-05-15T15:40:29.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.838+0000 7f52da95e640 1 -- 172.21.15.12:0/2723535216 wait complete. 2024-05-15T15:40:29.855 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-05-15T15:40:29.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.976+0000 7f8a5a11f640 1 Processor -- start 2024-05-15T15:40:29.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.976+0000 7f8a5a11f640 1 -- start start 2024-05-15T15:40:29.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.977+0000 7f8a5a11f640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8a54151fc0 0x7f8a540bd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:29.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.977+0000 7f8a5a11f640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8a5406da30 0x7f8a540be940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:29.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.977+0000 7f8a5a11f640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a540c36f0 con 0x7f8a5406de40 2024-05-15T15:40:29.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.977+0000 7f8a5a11f640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f8a540bdc10 con 0x7f8a54151fc0 2024-05-15T15:40:29.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.977+0000 7f8a5a11f640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f8a54152530 con 0x7f8a5406da30 2024-05-15T15:40:29.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.977+0000 7f8a537fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8a54151fc0 0x7f8a540bd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:29.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.977+0000 7f8a53fff640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f8a5406de40 0x7f8a5414e570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38304/0 (socket says 172.21.15.12:38304) 2024-05-15T15:40:29.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.977+0000 7f8a53fff640 1 -- 172.21.15.12:0/2841605760 learned_addr learned my addr 172.21.15.12:0/2841605760 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-05-15T15:40:29.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.978+0000 7f8a52ffd640 1 --2- 172.21.15.12:0/2841605760 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8a5406da30 0x7f8a540be940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:29.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.978+0000 7f8a537fe640 1 -- 172.21.15.12:0/2841605760 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8a5406da30 msgr2=0x7f8a540be940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:40:29.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.978+0000 7f8a537fe640 1 --2- 172.21.15.12:0/2841605760 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8a5406da30 0x7f8a540be940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:29.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.978+0000 7f8a537fe640 1 -- 172.21.15.12:0/2841605760 >> v1:172.21.15.12:6789/0 conn(0x7f8a5406de40 legacy=0x7f8a5414e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:29.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.978+0000 7f8a527fc640 1 -- 172.21.15.12:0/2841605760 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 698840396 0 0) 0x7f8a540c36f0 con 0x7f8a5406de40 2024-05-15T15:40:29.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.978+0000 7f8a537fe640 1 -- 172.21.15.12:0/2841605760 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a54152810 con 0x7f8a54151fc0 2024-05-15T15:40:29.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.978+0000 7f8a537fe640 1 --2- 172.21.15.12:0/2841605760 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a54151fc0 0x7f8a540bd6d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f8a440097a0 tx=0x7f8a4402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9dee287e85c72df server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:29.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.979+0000 7f8a527fc640 1 -- 172.21.15.12:0/2841605760 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a44037070 con 0x7f8a54151fc0 2024-05-15T15:40:29.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.979+0000 7f8a527fc640 1 -- 172.21.15.12:0/2841605760 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a44032440 con 0x7f8a54151fc0 2024-05-15T15:40:29.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.979+0000 7f8a527fc640 1 -- 172.21.15.12:0/2841605760 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a44032810 con 0x7f8a54151fc0 2024-05-15T15:40:29.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.979+0000 7f8a5a11f640 1 -- 172.21.15.12:0/2841605760 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a54151fc0 msgr2=0x7f8a540bd6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:29.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.979+0000 7f8a5a11f640 1 --2- 172.21.15.12:0/2841605760 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a54151fc0 0x7f8a540bd6d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f8a440097a0 tx=0x7f8a4402a180 comp rx=0 tx=0).stop 2024-05-15T15:40:29.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.979+0000 7f8a5a11f640 1 -- 172.21.15.12:0/2841605760 shutdown_connections 2024-05-15T15:40:29.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.979+0000 7f8a5a11f640 1 --2- 172.21.15.12:0/2841605760 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8a5406da30 0x7f8a540be940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:29.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.979+0000 7f8a5a11f640 1 --2- 172.21.15.12:0/2841605760 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a54151fc0 0x7f8a540bd6d0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:29.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.979+0000 7f8a5a11f640 1 -- 172.21.15.12:0/2841605760 >> 172.21.15.12:0/2841605760 conn(0x7f8a540c3d20 msgr2=0x7f8a540c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:29.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.979+0000 7f8a5a11f640 1 -- 172.21.15.12:0/2841605760 shutdown_connections 2024-05-15T15:40:29.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.979+0000 7f8a5a11f640 1 -- 172.21.15.12:0/2841605760 wait complete. 2024-05-15T15:40:29.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.981+0000 7f8a5a11f640 1 Processor -- start 2024-05-15T15:40:29.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.981+0000 7f8a5a11f640 1 -- start start 2024-05-15T15:40:29.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.982+0000 7f8a5a11f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a5406da30 0x7f8a541d9f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:29.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.982+0000 7f8a5a11f640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8a5406de40 0x7f8a541e4a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:29.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.982+0000 7f8a5a11f640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a54151fc0 0x7f8a541e4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:29.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.982+0000 7f8a5a11f640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f8a540a3050 con 0x7f8a5406da30 2024-05-15T15:40:29.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.982+0000 7f8a5a11f640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f8a540a2ed0 con 0x7f8a54151fc0 2024-05-15T15:40:29.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.982+0000 7f8a5a11f640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f8a540bee80 con 0x7f8a5406de40 2024-05-15T15:40:29.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.982+0000 7f8a537fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a5406da30 0x7f8a541d9f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:29.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.982+0000 7f8a537fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a5406da30 0x7f8a541d9f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47016/0 (socket says 172.21.15.12:47016) 2024-05-15T15:40:29.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.982+0000 7f8a537fe640 1 -- 172.21.15.12:0/3225482707 learned_addr learned my addr 172.21.15.12:0/3225482707 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:29.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.983+0000 7f8a53fff640 1 --2- 172.21.15.12:0/3225482707 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a54151fc0 0x7f8a541e4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:29.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.983+0000 7f8a52ffd640 1 --2- 172.21.15.12:0/3225482707 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8a5406de40 0x7f8a541e4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:29.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.983+0000 7f8a537fe640 1 -- 172.21.15.12:0/3225482707 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8a5406de40 msgr2=0x7f8a541e4a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:29.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.983+0000 7f8a537fe640 1 --2- 172.21.15.12:0/3225482707 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8a5406de40 0x7f8a541e4a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:29.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.983+0000 7f8a537fe640 1 -- 172.21.15.12:0/3225482707 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a54151fc0 msgr2=0x7f8a541e4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:29.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.983+0000 7f8a537fe640 1 --2- 172.21.15.12:0/3225482707 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a54151fc0 0x7f8a541e4f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:29.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.983+0000 7f8a537fe640 1 -- 172.21.15.12:0/3225482707 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a541da4a0 con 0x7f8a5406da30 2024-05-15T15:40:29.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.983+0000 7f8a52ffd640 1 --2- 172.21.15.12:0/3225482707 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8a5406de40 0x7f8a541e4a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-15T15:40:29.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.983+0000 7f8a53fff640 1 --2- 172.21.15.12:0/3225482707 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a54151fc0 0x7f8a541e4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-15T15:40:29.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.983+0000 7f8a537fe640 1 --2- 172.21.15.12:0/3225482707 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a5406da30 0x7f8a541d9f60 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f8a44000c00 tx=0x7f8a440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:29.988 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.983+0000 7f8a3bfff640 1 -- 172.21.15.12:0/3225482707 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a44037040 con 0x7f8a5406da30 2024-05-15T15:40:29.988 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.983+0000 7f8a3bfff640 1 -- 172.21.15.12:0/3225482707 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a44042070 con 0x7f8a5406da30 2024-05-15T15:40:29.988 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.983+0000 7f8a5a11f640 1 -- 172.21.15.12:0/3225482707 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a54147660 con 0x7f8a5406da30 2024-05-15T15:40:29.988 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.983+0000 7f8a3bfff640 1 -- 172.21.15.12:0/3225482707 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a44030bb0 con 0x7f8a5406da30 2024-05-15T15:40:29.988 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.983+0000 7f8a5a11f640 1 -- 172.21.15.12:0/3225482707 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a54148d00 con 0x7f8a5406da30 2024-05-15T15:40:29.988 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.984+0000 7f8a5a11f640 1 -- 172.21.15.12:0/3225482707 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a54050940 con 0x7f8a5406da30 2024-05-15T15:40:29.989 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.986+0000 7f8a3bfff640 1 -- 172.21.15.12:0/3225482707 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8a44047460 con 0x7f8a5406da30 2024-05-15T15:40:29.989 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.986+0000 7f8a3bfff640 1 --2- 172.21.15.12:0/3225482707 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f8a40076300 0x7f8a40078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:29.989 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.986+0000 7f8a3bfff640 1 -- 172.21.15.12:0/3225482707 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5227+0+0 (secure 0 0 0) 0x7f8a440b8a00 con 0x7f8a5406da30 2024-05-15T15:40:29.989 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.986+0000 7f8a52ffd640 1 --2- 172.21.15.12:0/3225482707 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f8a40076300 0x7f8a40078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:29.989 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.987+0000 7f8a52ffd640 1 --2- 172.21.15.12:0/3225482707 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f8a40076300 0x7f8a40078810 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8a48006fd0 tx=0x7f8a48008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:29.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:29.990+0000 7f8a3bfff640 1 -- 172.21.15.12:0/3225482707 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f8a4404d060 con 0x7f8a5406da30 2024-05-15T15:40:30.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:30.179+0000 7f8a5a11f640 1 -- 172.21.15.12:0/3225482707 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f8a5406eb40 con 0x7f8a5406da30 2024-05-15T15:40:30.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:30.841+0000 7f8a3bfff640 1 -- 172.21.15.12:0/3225482707 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v31) ==== 170+0+0 (secure 0 0 0) 0x7f8a44032e20 con 0x7f8a5406da30 2024-05-15T15:40:30.843 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_data' created 2024-05-15T15:40:30.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:30.845+0000 7f8a5a11f640 1 -- 172.21.15.12:0/3225482707 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f8a40076300 msgr2=0x7f8a40078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:30.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:30.845+0000 7f8a5a11f640 1 --2- 172.21.15.12:0/3225482707 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f8a40076300 0x7f8a40078810 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8a48006fd0 tx=0x7f8a48008040 comp rx=0 tx=0).stop 2024-05-15T15:40:30.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:30.845+0000 7f8a5a11f640 1 -- 172.21.15.12:0/3225482707 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a5406da30 msgr2=0x7f8a541d9f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:30.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:30.845+0000 7f8a5a11f640 1 --2- 172.21.15.12:0/3225482707 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a5406da30 0x7f8a541d9f60 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f8a44000c00 tx=0x7f8a440046c0 comp rx=0 tx=0).stop 2024-05-15T15:40:30.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:30.852+0000 7f8a5a11f640 1 -- 172.21.15.12:0/3225482707 shutdown_connections 2024-05-15T15:40:30.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:30.852+0000 7f8a5a11f640 1 --2- 172.21.15.12:0/3225482707 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a54151fc0 0x7f8a541e4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:30.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:30.852+0000 7f8a5a11f640 1 --2- 172.21.15.12:0/3225482707 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8a5406de40 0x7f8a541e4a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:30.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:30.852+0000 7f8a5a11f640 1 --2- 172.21.15.12:0/3225482707 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f8a40076300 0x7f8a40078810 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:30.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:30.852+0000 7f8a5a11f640 1 --2- 172.21.15.12:0/3225482707 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a5406da30 0x7f8a541d9f60 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:30.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:30.852+0000 7f8a5a11f640 1 -- 172.21.15.12:0/3225482707 >> 172.21.15.12:0/3225482707 conn(0x7f8a540c3d20 msgr2=0x7f8a540a4c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:30.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:30.854+0000 7f8a5a11f640 1 -- 172.21.15.12:0/3225482707 shutdown_connections 2024-05-15T15:40:30.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:30.854+0000 7f8a5a11f640 1 -- 172.21.15.12:0/3225482707 wait complete. 2024-05-15T15:40:30.877 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-15T15:40:30.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:30.996+0000 7fd02176b640 1 Processor -- start 2024-05-15T15:40:30.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:30.996+0000 7fd02176b640 1 -- start start 2024-05-15T15:40:30.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:30.997+0000 7fd02176b640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd01c152180 0x7fd01c152590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:31.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:30.997+0000 7fd02176b640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd01c074320 0x7fd01c074730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:31.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:30.997+0000 7fd02176b640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd01c0bbc80 con 0x7fd01c06c8c0 2024-05-15T15:40:31.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:30.997+0000 7fd02176b640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fd01c151a10 con 0x7fd01c074320 2024-05-15T15:40:31.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:30.997+0000 7fd02176b640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7fd01c0bb090 con 0x7fd01c152180 2024-05-15T15:40:31.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:30.997+0000 7fd01b7fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd01c074320 0x7fd01c074730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:31.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:30.997+0000 7fd01b7fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd01c074320 0x7fd01c074730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47022/0 (socket says 172.21.15.12:47022) 2024-05-15T15:40:31.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:30.997+0000 7fd01b7fe640 1 -- 172.21.15.12:0/4194680683 learned_addr learned my addr 172.21.15.12:0/4194680683 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:31.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:30.997+0000 7fd01a7fc640 1 --2- 172.21.15.12:0/4194680683 >> v2:172.21.15.84:3300/0 conn(0x7fd01c152180 0x7fd01c152590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:31.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:30.998+0000 7fd01b7fe640 1 -- 172.21.15.12:0/4194680683 >> v2:172.21.15.84:3300/0 conn(0x7fd01c152180 msgr2=0x7fd01c152590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:40:31.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:30.998+0000 7fd01b7fe640 1 --2- 172.21.15.12:0/4194680683 >> v2:172.21.15.84:3300/0 conn(0x7fd01c152180 0x7fd01c152590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:31.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:30.998+0000 7fd01b7fe640 1 -- 172.21.15.12:0/4194680683 >> v1:172.21.15.84:6789/0 conn(0x7fd01c06c8c0 legacy=0x7fd01c0bb4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:31.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:30.998+0000 7fd01b7fe640 1 -- 172.21.15.12:0/4194680683 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd01c0bbf60 con 0x7fd01c074320 2024-05-15T15:40:31.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:30.998+0000 7fd01b7fe640 1 --2- 172.21.15.12:0/4194680683 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd01c074320 0x7fd01c074730 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd01c151b90 tx=0x7fd00c02a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd16fbbd8b7a2023 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:31.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:30.999+0000 7fd019ffb640 1 -- 172.21.15.12:0/4194680683 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd00c036070 con 0x7fd01c074320 2024-05-15T15:40:31.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:30.999+0000 7fd019ffb640 1 -- 172.21.15.12:0/4194680683 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd00c031600 con 0x7fd01c074320 2024-05-15T15:40:31.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:30.999+0000 7fd019ffb640 1 -- 172.21.15.12:0/4194680683 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd00c0319d0 con 0x7fd01c074320 2024-05-15T15:40:31.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:30.999+0000 7fd02176b640 1 -- 172.21.15.12:0/4194680683 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd01c074320 msgr2=0x7fd01c074730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:31.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:30.999+0000 7fd02176b640 1 --2- 172.21.15.12:0/4194680683 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd01c074320 0x7fd01c074730 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd01c151b90 tx=0x7fd00c02a730 comp rx=0 tx=0).stop 2024-05-15T15:40:31.003 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:30.999+0000 7fd02176b640 1 -- 172.21.15.12:0/4194680683 shutdown_connections 2024-05-15T15:40:31.003 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:30.999+0000 7fd02176b640 1 --2- 172.21.15.12:0/4194680683 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd01c074320 0x7fd01c074730 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:31.003 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:30.999+0000 7fd02176b640 1 --2- 172.21.15.12:0/4194680683 >> v2:172.21.15.84:3300/0 conn(0x7fd01c152180 0x7fd01c152590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:31.003 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:30.999+0000 7fd02176b640 1 -- 172.21.15.12:0/4194680683 >> 172.21.15.12:0/4194680683 conn(0x7fd01c0bd0f0 msgr2=0x7fd01c0bd500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:31.003 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:30.999+0000 7fd02176b640 1 -- 172.21.15.12:0/4194680683 shutdown_connections 2024-05-15T15:40:31.003 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:30.999+0000 7fd02176b640 1 -- 172.21.15.12:0/4194680683 wait complete. 2024-05-15T15:40:31.003 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:31.001+0000 7fd02176b640 1 Processor -- start 2024-05-15T15:40:31.003 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:31.001+0000 7fd02176b640 1 -- start start 2024-05-15T15:40:31.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:31.002+0000 7fd02176b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd01c06c8c0 0x7fd01c148a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:31.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:31.002+0000 7fd02176b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd01c074320 0x7fd01c14b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:31.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:31.002+0000 7fd02176b640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fd01c152180 0x7fd01c070d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:31.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:31.002+0000 7fd02176b640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fd01c06ccd0 con 0x7fd01c06c8c0 2024-05-15T15:40:31.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:31.002+0000 7fd02176b640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fd01c14e4c0 con 0x7fd01c074320 2024-05-15T15:40:31.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:31.002+0000 7fd02176b640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fd01c06ce50 con 0x7fd01c152180 2024-05-15T15:40:31.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:31.002+0000 7fd01affd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd01c06c8c0 0x7fd01c148a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:31.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:31.002+0000 7fd01affd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd01c06c8c0 0x7fd01c148a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47024/0 (socket says 172.21.15.12:47024) 2024-05-15T15:40:31.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:31.002+0000 7fd01affd640 1 -- 172.21.15.12:0/1967595765 learned_addr learned my addr 172.21.15.12:0/1967595765 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:31.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:31.002+0000 7fd01b7fe640 1 --2- 172.21.15.12:0/1967595765 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fd01c152180 0x7fd01c070d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:31.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:31.002+0000 7fd01a7fc640 1 --2- 172.21.15.12:0/1967595765 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd01c074320 0x7fd01c14b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:31.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:31.003+0000 7fd01affd640 1 -- 172.21.15.12:0/1967595765 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fd01c152180 msgr2=0x7fd01c070d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:31.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:31.003+0000 7fd01affd640 1 --2- 172.21.15.12:0/1967595765 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fd01c152180 0x7fd01c070d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:31.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:31.003+0000 7fd01affd640 1 -- 172.21.15.12:0/1967595765 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd01c074320 msgr2=0x7fd01c14b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:31.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:31.003+0000 7fd01affd640 1 --2- 172.21.15.12:0/1967595765 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd01c074320 0x7fd01c14b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:31.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:31.003+0000 7fd01affd640 1 -- 172.21.15.12:0/1967595765 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd01c148f90 con 0x7fd01c06c8c0 2024-05-15T15:40:31.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:31.003+0000 7fd01affd640 1 --2- 172.21.15.12:0/1967595765 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd01c06c8c0 0x7fd01c148a50 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fd01400c3a0 tx=0x7fd01400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:31.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:31.003+0000 7fd0037fe640 1 -- 172.21.15.12:0/1967595765 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd014017070 con 0x7fd01c06c8c0 2024-05-15T15:40:31.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:31.003+0000 7fd0037fe640 1 -- 172.21.15.12:0/1967595765 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0140052d0 con 0x7fd01c06c8c0 2024-05-15T15:40:31.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:31.003+0000 7fd02176b640 1 -- 172.21.15.12:0/1967595765 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd01c14ba90 con 0x7fd01c06c8c0 2024-05-15T15:40:31.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:31.003+0000 7fd0037fe640 1 -- 172.21.15.12:0/1967595765 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd014003830 con 0x7fd01c06c8c0 2024-05-15T15:40:31.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:31.003+0000 7fd02176b640 1 -- 172.21.15.12:0/1967595765 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd01c1e4580 con 0x7fd01c06c8c0 2024-05-15T15:40:31.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:31.004+0000 7fd02176b640 1 -- 172.21.15.12:0/1967595765 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd01c0be3f0 con 0x7fd01c06c8c0 2024-05-15T15:40:31.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:31.005+0000 7fd0037fe640 1 -- 172.21.15.12:0/1967595765 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd01401a070 con 0x7fd01c06c8c0 2024-05-15T15:40:31.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:31.005+0000 7fd0037fe640 1 --2- 172.21.15.12:0/1967595765 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fd0080762d0 0x7fd0080787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:31.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:31.006+0000 7fd0037fe640 1 -- 172.21.15.12:0/1967595765 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5609+0+0 (secure 0 0 0) 0x7fd0140968b0 con 0x7fd01c06c8c0 2024-05-15T15:40:31.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:31.006+0000 7fd01a7fc640 1 --2- 172.21.15.12:0/1967595765 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fd0080762d0 0x7fd0080787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:31.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:31.006+0000 7fd01a7fc640 1 --2- 172.21.15.12:0/1967595765 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fd0080762d0 0x7fd0080787e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd01c1da730 tx=0x7fd010009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:31.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:31.011+0000 7fd0037fe640 1 -- 172.21.15.12:0/1967595765 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fd01405fba0 con 0x7fd01c06c8c0 2024-05-15T15:40:31.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:31.241+0000 7fd02176b640 1 -- 172.21.15.12:0/1967595765 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fd01c050940 con 0x7fd01c06c8c0 2024-05-15T15:40:31.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:31.842+0000 7fd0037fe640 1 -- 172.21.15.12:0/1967595765 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v12) ==== 172+0+0 (secure 0 0 0) 0x7fd0140681e0 con 0x7fd01c06c8c0 2024-05-15T15:40:31.845 INFO:teuthology.orchestra.run.smithi012.stderr:new fs with metadata pool 4 and data pool 5 2024-05-15T15:40:31.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:31.846+0000 7fd02176b640 1 -- 172.21.15.12:0/1967595765 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fd0080762d0 msgr2=0x7fd0080787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:31.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:31.846+0000 7fd02176b640 1 --2- 172.21.15.12:0/1967595765 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fd0080762d0 0x7fd0080787e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd01c1da730 tx=0x7fd010009190 comp rx=0 tx=0).stop 2024-05-15T15:40:31.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:31.847+0000 7fd02176b640 1 -- 172.21.15.12:0/1967595765 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd01c06c8c0 msgr2=0x7fd01c148a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:31.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:31.847+0000 7fd02176b640 1 --2- 172.21.15.12:0/1967595765 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd01c06c8c0 0x7fd01c148a50 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fd01400c3a0 tx=0x7fd01400c860 comp rx=0 tx=0).stop 2024-05-15T15:40:31.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:31.847+0000 7fd02176b640 1 -- 172.21.15.12:0/1967595765 shutdown_connections 2024-05-15T15:40:31.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:31.847+0000 7fd02176b640 1 --2- 172.21.15.12:0/1967595765 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fd01c152180 0x7fd01c070d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:31.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:31.847+0000 7fd02176b640 1 --2- 172.21.15.12:0/1967595765 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd01c074320 0x7fd01c14b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:31.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:31.847+0000 7fd02176b640 1 --2- 172.21.15.12:0/1967595765 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fd0080762d0 0x7fd0080787e0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:31.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:31.847+0000 7fd02176b640 1 --2- 172.21.15.12:0/1967595765 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd01c06c8c0 0x7fd01c148a50 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:31.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:31.847+0000 7fd02176b640 1 -- 172.21.15.12:0/1967595765 >> 172.21.15.12:0/1967595765 conn(0x7fd01c0bd0f0 msgr2=0x7fd01c1d7810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:31.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:31.848+0000 7fd02176b640 1 -- 172.21.15.12:0/1967595765 shutdown_connections 2024-05-15T15:40:31.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:31.848+0000 7fd02176b640 1 -- 172.21.15.12:0/1967595765 wait complete. 2024-05-15T15:40:31.888 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-15T15:40:32.003 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.001+0000 7f2d2b7e3640 1 Processor -- start 2024-05-15T15:40:32.003 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.001+0000 7f2d2b7e3640 1 -- start start 2024-05-15T15:40:32.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.002+0000 7f2d2b7e3640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f2d2414e360 0x7f2d241522d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:32.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.002+0000 7f2d2b7e3640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f2d24148770 0x7f2d240c0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:32.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.002+0000 7f2d2b7e3640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d240c0620 con 0x7f2d240bf9b0 2024-05-15T15:40:32.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.002+0000 7f2d2b7e3640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f2d24151e40 con 0x7f2d24148770 2024-05-15T15:40:32.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.002+0000 7f2d2b7e3640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f2d24151ad0 con 0x7f2d2414e360 2024-05-15T15:40:32.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.002+0000 7f2d28d7e640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f2d24148770 0x7f2d240c0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:32.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.002+0000 7f2d29d80640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f2d240bf9b0 0x7f2d240bfdc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38320/0 (socket says 172.21.15.12:38320) 2024-05-15T15:40:32.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.002+0000 7f2d29d80640 1 -- 172.21.15.12:0/1077297851 learned_addr learned my addr 172.21.15.12:0/1077297851 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-05-15T15:40:32.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.002+0000 7f2d2957f640 1 --2- 172.21.15.12:0/1077297851 >> v2:172.21.15.84:3300/0 conn(0x7f2d2414e360 0x7f2d241522d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:32.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.003+0000 7f2d28d7e640 1 -- 172.21.15.12:0/1077297851 >> v2:172.21.15.84:3300/0 conn(0x7f2d2414e360 msgr2=0x7f2d241522d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:40:32.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.003+0000 7f2d28d7e640 1 --2- 172.21.15.12:0/1077297851 >> v2:172.21.15.84:3300/0 conn(0x7f2d2414e360 0x7f2d241522d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:32.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.003+0000 7f2d28d7e640 1 -- 172.21.15.12:0/1077297851 >> v1:172.21.15.12:6789/0 conn(0x7f2d240bf9b0 legacy=0x7f2d240bfdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:32.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.003+0000 7f2d1bfff640 1 -- 172.21.15.12:0/1077297851 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2188524650 0 0) 0x7f2d240c0620 con 0x7f2d240bf9b0 2024-05-15T15:40:32.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.003+0000 7f2d28d7e640 1 -- 172.21.15.12:0/1077297851 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d24152810 con 0x7f2d24148770 2024-05-15T15:40:32.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.003+0000 7f2d28d7e640 1 --2- 172.21.15.12:0/1077297851 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d24148770 0x7f2d240c0c80 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f2d140097a0 tx=0x7f2d1402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=decbb6baa567f82 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:32.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.003+0000 7f2d1bfff640 1 -- 172.21.15.12:0/1077297851 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d14037070 con 0x7f2d24148770 2024-05-15T15:40:32.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.003+0000 7f2d1bfff640 1 -- 172.21.15.12:0/1077297851 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d14032440 con 0x7f2d24148770 2024-05-15T15:40:32.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.003+0000 7f2d1bfff640 1 -- 172.21.15.12:0/1077297851 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d14032810 con 0x7f2d24148770 2024-05-15T15:40:32.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.004+0000 7f2d2b7e3640 1 -- 172.21.15.12:0/1077297851 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d24148770 msgr2=0x7f2d240c0c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:32.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.004+0000 7f2d2b7e3640 1 --2- 172.21.15.12:0/1077297851 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d24148770 0x7f2d240c0c80 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f2d140097a0 tx=0x7f2d1402a270 comp rx=0 tx=0).stop 2024-05-15T15:40:32.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.004+0000 7f2d2b7e3640 1 -- 172.21.15.12:0/1077297851 shutdown_connections 2024-05-15T15:40:32.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.004+0000 7f2d2b7e3640 1 --2- 172.21.15.12:0/1077297851 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d24148770 0x7f2d240c0c80 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:32.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.004+0000 7f2d2b7e3640 1 --2- 172.21.15.12:0/1077297851 >> v2:172.21.15.84:3300/0 conn(0x7f2d2414e360 0x7f2d241522d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:32.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.004+0000 7f2d2b7e3640 1 -- 172.21.15.12:0/1077297851 >> 172.21.15.12:0/1077297851 conn(0x7f2d240c17c0 msgr2=0x7f2d240c1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:32.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.004+0000 7f2d2b7e3640 1 -- 172.21.15.12:0/1077297851 shutdown_connections 2024-05-15T15:40:32.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.004+0000 7f2d2b7e3640 1 -- 172.21.15.12:0/1077297851 wait complete. 2024-05-15T15:40:32.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.006+0000 7f2d2b7e3640 1 Processor -- start 2024-05-15T15:40:32.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.006+0000 7f2d2b7e3640 1 -- start start 2024-05-15T15:40:32.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.007+0000 7f2d2b7e3640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f2d240bf9b0 0x7f2d2406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:32.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.007+0000 7f2d2b7e3640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d24148770 0x7f2d2413da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:32.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.007+0000 7f2d2b7e3640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d2414e360 0x7f2d2413dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:32.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.007+0000 7f2d2b7e3640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f2d24158cc0 con 0x7f2d2414e360 2024-05-15T15:40:32.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.007+0000 7f2d2b7e3640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f2d240c13d0 con 0x7f2d24148770 2024-05-15T15:40:32.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.007+0000 7f2d2b7e3640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f2d24158e40 con 0x7f2d240bf9b0 2024-05-15T15:40:32.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.007+0000 7f2d29d80640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d2414e360 0x7f2d2413dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:32.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.007+0000 7f2d29d80640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d2414e360 0x7f2d2413dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47046/0 (socket says 172.21.15.12:47046) 2024-05-15T15:40:32.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.007+0000 7f2d29d80640 1 -- 172.21.15.12:0/1011018267 learned_addr learned my addr 172.21.15.12:0/1011018267 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:32.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.007+0000 7f2d28d7e640 1 --2- 172.21.15.12:0/1011018267 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d24148770 0x7f2d2413da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:32.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.007+0000 7f2d2957f640 1 --2- 172.21.15.12:0/1011018267 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f2d240bf9b0 0x7f2d2406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:32.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.007+0000 7f2d29d80640 1 -- 172.21.15.12:0/1011018267 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f2d240bf9b0 msgr2=0x7f2d2406edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:32.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.007+0000 7f2d29d80640 1 --2- 172.21.15.12:0/1011018267 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f2d240bf9b0 0x7f2d2406edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:32.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.007+0000 7f2d29d80640 1 -- 172.21.15.12:0/1011018267 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d24148770 msgr2=0x7f2d2413da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:32.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.007+0000 7f2d29d80640 1 --2- 172.21.15.12:0/1011018267 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d24148770 0x7f2d2413da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:32.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.007+0000 7f2d29d80640 1 -- 172.21.15.12:0/1011018267 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d2406f2f0 con 0x7f2d2414e360 2024-05-15T15:40:32.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.007+0000 7f2d2957f640 1 --2- 172.21.15.12:0/1011018267 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f2d240bf9b0 0x7f2d2406edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-15T15:40:32.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.008+0000 7f2d29d80640 1 --2- 172.21.15.12:0/1011018267 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d2414e360 0x7f2d2413dfa0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f2d1c00c680 tx=0x7f2d1c00cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:32.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.008+0000 7f2d19ffb640 1 -- 172.21.15.12:0/1011018267 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d1c018070 con 0x7f2d2414e360 2024-05-15T15:40:32.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.008+0000 7f2d19ffb640 1 -- 172.21.15.12:0/1011018267 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d1c004d60 con 0x7f2d2414e360 2024-05-15T15:40:32.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.008+0000 7f2d19ffb640 1 -- 172.21.15.12:0/1011018267 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d1c00a880 con 0x7f2d2414e360 2024-05-15T15:40:32.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.008+0000 7f2d2b7e3640 1 -- 172.21.15.12:0/1011018267 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d241e79c0 con 0x7f2d2414e360 2024-05-15T15:40:32.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.008+0000 7f2d2b7e3640 1 -- 172.21.15.12:0/1011018267 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d241e7f80 con 0x7f2d2414e360 2024-05-15T15:40:32.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.009+0000 7f2d2b7e3640 1 -- 172.21.15.12:0/1011018267 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d24050940 con 0x7f2d2414e360 2024-05-15T15:40:32.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.010+0000 7f2d19ffb640 1 -- 172.21.15.12:0/1011018267 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2d1c01b070 con 0x7f2d2414e360 2024-05-15T15:40:32.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.010+0000 7f2d19ffb640 1 --2- 172.21.15.12:0/1011018267 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f2d08076300 0x7f2d08078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:32.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.010+0000 7f2d2957f640 1 --2- 172.21.15.12:0/1011018267 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f2d08076300 0x7f2d08078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:32.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.010+0000 7f2d19ffb640 1 -- 172.21.15.12:0/1011018267 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f2d1c0969c0 con 0x7f2d2414e360 2024-05-15T15:40:32.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.011+0000 7f2d2957f640 1 --2- 172.21.15.12:0/1011018267 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f2d08076300 0x7f2d08078810 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2d20006fd0 tx=0x7f2d20008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:32.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.015+0000 7f2d19ffb640 1 -- 172.21.15.12:0/1011018267 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f2d1c098e20 con 0x7f2d2414e360 2024-05-15T15:40:32.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.205+0000 7f2d2b7e3640 1 -- 172.21.15.12:0/1011018267 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2d240714f0 con 0x7f2d2414e360 2024-05-15T15:40:32.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.206+0000 7f2d19ffb640 1 -- 172.21.15.12:0/1011018267 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) ==== 74+0+16586 (secure 0 0 0) 0x7f2d1c0603b0 con 0x7f2d2414e360 2024-05-15T15:40:32.209 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-05-15T15:40:32.209 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":32,"fsid":"3b7fc4b2-b85c-49b5-a5de-38444eeed40d","created":"2024-05-15T15:39:28.392476+0000","modified":"2024-05-15T15:40:31.243141+0000","last_up_change":"2024-05-15T15:39:39.363983+0000","last_in_change":"2024-05-15T15:39:30.591216+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-15T15:39:40.715999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-05-15T15:40:29.381895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-05-15T15:40:30.183897+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0d06a12a-866a-418e-9776-704d74354579","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":3943681952},{"type":"v1","addr":"172.21.15.12:6809","nonce":3943681952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":3943681952},{"type":"v1","addr":"172.21.15.12:6812","nonce":3943681952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":3943681952},{"type":"v1","addr":"172.21.15.12:6821","nonce":3943681952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":3943681952},{"type":"v1","addr":"172.21.15.12:6816","nonce":3943681952}]},"public_addr":"172.21.15.12:6809/3943681952","cluster_addr":"172.21.15.12:6812/3943681952","heartbeat_back_addr":"172.21.15.12:6821/3943681952","heartbeat_front_addr":"172.21.15.12:6816/3943681952","state":["exists","up"]},{"osd":1,"uuid":"09d0fa19-9ef8-4f35-bf99-6e86658c6f10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6811","nonce":1763752148},{"type":"v1","addr":"172.21.15.12:6813","nonce":1763752148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":1763752148},{"type":"v1","addr":"172.21.15.12:6817","nonce":1763752148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":1763752148},{"type":"v1","addr":"172.21.15.12:6827","nonce":1763752148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6819","nonce":1763752148},{"type":"v1","addr":"172.21.15.12:6822","nonce":1763752148}]},"public_addr":"172.21.15.12:6813/1763752148","cluster_addr":"172.21.15.12:6817/1763752148","heartbeat_back_addr":"172.21.15.12:6827/1763752148","heartbeat_front_addr":"172.21.15.12:6822/1763752148","state":["exists","up"]},{"osd":2,"uuid":"b204c6ad-f431-40a5-ba27-9844294f0ece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":2173702802},{"type":"v1","addr":"172.21.15.12:6823","nonce":2173702802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":2173702802},{"type":"v1","addr":"172.21.15.12:6826","nonce":2173702802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":2173702802},{"type":"v1","addr":"172.21.15.12:6831","nonce":2173702802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":2173702802},{"type":"v1","addr":"172.21.15.12:6829","nonce":2173702802}]},"public_addr":"172.21.15.12:6823/2173702802","cluster_addr":"172.21.15.12:6826/2173702802","heartbeat_back_addr":"172.21.15.12:6831/2173702802","heartbeat_front_addr":"172.21.15.12:6829/2173702802","state":["exists","up"]},{"osd":3,"uuid":"660a9ccb-2ee5-42d8-8481-0835047a8260","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":3956443113},{"type":"v1","addr":"172.21.15.12:6801","nonce":3956443113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":3956443113},{"type":"v1","addr":"172.21.15.12:6803","nonce":3956443113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":3956443113},{"type":"v1","addr":"172.21.15.12:6807","nonce":3956443113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":3956443113},{"type":"v1","addr":"172.21.15.12:6805","nonce":3956443113}]},"public_addr":"172.21.15.12:6801/3956443113","cluster_addr":"172.21.15.12:6803/3956443113","heartbeat_back_addr":"172.21.15.12:6807/3956443113","heartbeat_front_addr":"172.21.15.12:6805/3956443113","state":["exists","up"]},{"osd":4,"uuid":"9eef1461-a961-457c-9a78-43b5098a46a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":1021092792},{"type":"v1","addr":"172.21.15.84:6809","nonce":1021092792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":1021092792},{"type":"v1","addr":"172.21.15.84:6811","nonce":1021092792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":1021092792},{"type":"v1","addr":"172.21.15.84:6815","nonce":1021092792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":1021092792},{"type":"v1","addr":"172.21.15.84:6813","nonce":1021092792}]},"public_addr":"172.21.15.84:6809/1021092792","cluster_addr":"172.21.15.84:6811/1021092792","heartbeat_back_addr":"172.21.15.84:6815/1021092792","heartbeat_front_addr":"172.21.15.84:6813/1021092792","state":["exists","up"]},{"osd":5,"uuid":"5f924e2f-6c71-4741-a727-d3710c438431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":3173527851},{"type":"v1","addr":"172.21.15.84:6801","nonce":3173527851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":3173527851},{"type":"v1","addr":"172.21.15.84:6803","nonce":3173527851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":3173527851},{"type":"v1","addr":"172.21.15.84:6807","nonce":3173527851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":3173527851},{"type":"v1","addr":"172.21.15.84:6805","nonce":3173527851}]},"public_addr":"172.21.15.84:6801/3173527851","cluster_addr":"172.21.15.84:6803/3173527851","heartbeat_back_addr":"172.21.15.84:6807/3173527851","heartbeat_front_addr":"172.21.15.84:6805/3173527851","state":["exists","up"]},{"osd":6,"uuid":"efae9975-8c16-4ad3-892f-71f3c59718d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3029180670},{"type":"v1","addr":"172.21.15.84:6817","nonce":3029180670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3029180670},{"type":"v1","addr":"172.21.15.84:6819","nonce":3029180670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3029180670},{"type":"v1","addr":"172.21.15.84:6823","nonce":3029180670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3029180670},{"type":"v1","addr":"172.21.15.84:6821","nonce":3029180670}]},"public_addr":"172.21.15.84:6817/3029180670","cluster_addr":"172.21.15.84:6819/3029180670","heartbeat_back_addr":"172.21.15.84:6823/3029180670","heartbeat_front_addr":"172.21.15.84:6821/3029180670","state":["exists","up"]},{"osd":7,"uuid":"6426efba-ee4d-4e44-83d1-c76c75aec30c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3067620602},{"type":"v1","addr":"172.21.15.84:6825","nonce":3067620602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3067620602},{"type":"v1","addr":"172.21.15.84:6827","nonce":3067620602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":3067620602},{"type":"v1","addr":"172.21.15.84:6831","nonce":3067620602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":3067620602},{"type":"v1","addr":"172.21.15.84:6829","nonce":3067620602}]},"public_addr":"172.21.15.84:6825/3067620602","cluster_addr":"172.21.15.84:6827/3067620602","heartbeat_back_addr":"172.21.15.84:6831/3067620602","heartbeat_front_addr":"172.21.15.84:6829/3067620602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.809514+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.845364+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.762733+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.688597+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.699228+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.747865+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.712415+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.820683+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-15T15:40:32.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.208+0000 7f2d2b7e3640 1 -- 172.21.15.12:0/1011018267 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f2d08076300 msgr2=0x7f2d08078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:32.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.208+0000 7f2d2b7e3640 1 --2- 172.21.15.12:0/1011018267 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f2d08076300 0x7f2d08078810 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2d20006fd0 tx=0x7f2d20008040 comp rx=0 tx=0).stop 2024-05-15T15:40:32.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.208+0000 7f2d2b7e3640 1 -- 172.21.15.12:0/1011018267 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d2414e360 msgr2=0x7f2d2413dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:32.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.208+0000 7f2d2b7e3640 1 --2- 172.21.15.12:0/1011018267 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d2414e360 0x7f2d2413dfa0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f2d1c00c680 tx=0x7f2d1c00cb40 comp rx=0 tx=0).stop 2024-05-15T15:40:32.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.209+0000 7f2d2b7e3640 1 -- 172.21.15.12:0/1011018267 shutdown_connections 2024-05-15T15:40:32.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.209+0000 7f2d2b7e3640 1 --2- 172.21.15.12:0/1011018267 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f2d08076300 0x7f2d08078810 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:32.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.209+0000 7f2d2b7e3640 1 --2- 172.21.15.12:0/1011018267 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d2414e360 0x7f2d2413dfa0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:32.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.209+0000 7f2d2b7e3640 1 --2- 172.21.15.12:0/1011018267 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d24148770 0x7f2d2413da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:32.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.209+0000 7f2d2b7e3640 1 --2- 172.21.15.12:0/1011018267 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f2d240bf9b0 0x7f2d2406edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:32.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.209+0000 7f2d2b7e3640 1 -- 172.21.15.12:0/1011018267 >> 172.21.15.12:0/1011018267 conn(0x7f2d240c17c0 msgr2=0x7f2d2414d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:32.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.209+0000 7f2d2b7e3640 1 -- 172.21.15.12:0/1011018267 shutdown_connections 2024-05-15T15:40:32.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.209+0000 7f2d2b7e3640 1 -- 172.21.15.12:0/1011018267 wait complete. 2024-05-15T15:40:32.223 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-15T15:40:32.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.332+0000 7f87cbee0640 1 Processor -- start 2024-05-15T15:40:32.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.332+0000 7f87cbee0640 1 -- start start 2024-05-15T15:40:32.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.333+0000 7f87cbee0640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f87c40bd6d0 0x7f87c40be940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:32.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.333+0000 7f87cbee0640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87c406e140 con 0x7f87c4151fc0 2024-05-15T15:40:32.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.333+0000 7f87cbee0640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87c40c36f0 con 0x7f87c40bee80 2024-05-15T15:40:32.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.333+0000 7f87cbee0640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f87c4152530 con 0x7f87c40bd6d0 2024-05-15T15:40:32.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.333+0000 7f87c9c7c640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f87c4151fc0 0x7f87c406da30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38328/0 (socket says 172.21.15.12:38328) 2024-05-15T15:40:32.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.333+0000 7f87c9c7c640 1 -- 172.21.15.12:0/293804292 learned_addr learned my addr 172.21.15.12:0/293804292 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-05-15T15:40:32.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.333+0000 7f87c947b640 1 --2- 172.21.15.12:0/293804292 >> v2:172.21.15.84:3300/0 conn(0x7f87c40bd6d0 0x7f87c40be940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:32.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.334+0000 7f87c8c7a640 1 -- 172.21.15.12:0/293804292 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1025378197 0 0) 0x7f87c0001110 con 0x7f87c4151fc0 2024-05-15T15:40:32.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.334+0000 7f87c8c7a640 1 -- 172.21.15.12:0/293804292 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f87b0003520 con 0x7f87c4151fc0 2024-05-15T15:40:32.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.334+0000 7f87c8c7a640 1 -- 172.21.15.12:0/293804292 <== mon.1 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1790633139 0 0) 0x7f87c40c36f0 con 0x7f87c40bee80 2024-05-15T15:40:32.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.334+0000 7f87c8c7a640 1 -- 172.21.15.12:0/293804292 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f87c0001110 con 0x7f87c40bee80 2024-05-15T15:40:32.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.334+0000 7f87c8c7a640 1 -- 172.21.15.12:0/293804292 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1607321386 0 0) 0x7f87b0003520 con 0x7f87c4151fc0 2024-05-15T15:40:32.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.334+0000 7f87c8c7a640 1 -- 172.21.15.12:0/293804292 >> v2:172.21.15.84:3300/0 conn(0x7f87c40bd6d0 msgr2=0x7f87c40be940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:40:32.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.334+0000 7f87c8c7a640 1 --2- 172.21.15.12:0/293804292 >> v2:172.21.15.84:3300/0 conn(0x7f87c40bd6d0 0x7f87c40be940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:32.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.334+0000 7f87c8c7a640 1 -- 172.21.15.12:0/293804292 >> v1:172.21.15.84:6789/0 conn(0x7f87c40bee80 legacy=0x7f87c4158e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:32.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.334+0000 7f87c8c7a640 1 -- 172.21.15.12:0/293804292 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87c4152810 con 0x7f87c4151fc0 2024-05-15T15:40:32.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.334+0000 7f87c8c7a640 1 -- 172.21.15.12:0/293804292 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 38171736 0 0) 0x7f87c00018e0 con 0x7f87c4151fc0 2024-05-15T15:40:32.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.334+0000 7f87c8c7a640 1 -- 172.21.15.12:0/293804292 >> v1:172.21.15.12:6789/0 conn(0x7f87c4151fc0 legacy=0x7f87c406da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:32.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.334+0000 7f87c8c7a640 1 --2- 172.21.15.12:0/293804292 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f87b0003c30 0x7f87b0004080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:32.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.334+0000 7f87c8c7a640 1 --2- 172.21.15.12:0/293804292 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f87b0004800 0x7f87b0004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:32.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.334+0000 7f87c8c7a640 1 --2- 172.21.15.12:0/293804292 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f87b0005320 0x7f87b000b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:32.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.334+0000 7f87c8c7a640 1 -- 172.21.15.12:0/293804292 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f87c4152530 con 0x7f87b0004800 2024-05-15T15:40:32.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.334+0000 7f87c8c7a640 1 -- 172.21.15.12:0/293804292 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f87b000c2c0 con 0x7f87b0005320 2024-05-15T15:40:32.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.334+0000 7f87c8c7a640 1 -- 172.21.15.12:0/293804292 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f87b000c4c0 con 0x7f87b0003c30 2024-05-15T15:40:32.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.334+0000 7f87c947b640 1 --2- 172.21.15.12:0/293804292 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f87b0004800 0x7f87b0004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:32.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.334+0000 7f87ca47d640 1 --2- 172.21.15.12:0/293804292 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f87b0005320 0x7f87b000b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:32.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.334+0000 7f87c9c7c640 1 --2- 172.21.15.12:0/293804292 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f87b0003c30 0x7f87b0004080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:32.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.334+0000 7f87c947b640 1 -- 172.21.15.12:0/293804292 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f87b0003c30 msgr2=0x7f87b0004080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:40:32.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.334+0000 7f87c947b640 1 --2- 172.21.15.12:0/293804292 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f87b0003c30 0x7f87b0004080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:32.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.334+0000 7f87c947b640 1 -- 172.21.15.12:0/293804292 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f87b0005320 msgr2=0x7f87b000b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:40:32.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.334+0000 7f87c947b640 1 --2- 172.21.15.12:0/293804292 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f87b0005320 0x7f87b000b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:32.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.334+0000 7f87c947b640 1 -- 172.21.15.12:0/293804292 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87b0003520 con 0x7f87b0004800 2024-05-15T15:40:32.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.334+0000 7f87ca47d640 1 --2- 172.21.15.12:0/293804292 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f87b0005320 0x7f87b000b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-15T15:40:32.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.334+0000 7f87ca47d640 1 -- 172.21.15.12:0/293804292 reap_dead start 2024-05-15T15:40:32.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.335+0000 7f87c947b640 1 --2- 172.21.15.12:0/293804292 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f87b0004800 0x7f87b0004c10 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f87c406e3d0 tx=0x7f87b0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=976fcb057b36e6f8 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:32.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.335+0000 7f87c8c7a640 1 -- 172.21.15.12:0/293804292 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87b4036070 con 0x7f87b0004800 2024-05-15T15:40:32.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.335+0000 7f87c8c7a640 1 -- 172.21.15.12:0/293804292 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87b4031400 con 0x7f87b0004800 2024-05-15T15:40:32.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.335+0000 7f87c8c7a640 1 -- 172.21.15.12:0/293804292 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87b4009690 con 0x7f87b0004800 2024-05-15T15:40:32.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.336+0000 7f87cbee0640 1 -- 172.21.15.12:0/293804292 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f87b0004800 msgr2=0x7f87b0004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:32.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.336+0000 7f87cbee0640 1 --2- 172.21.15.12:0/293804292 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f87b0004800 0x7f87b0004c10 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f87c406e3d0 tx=0x7f87b0005830 comp rx=0 tx=0).stop 2024-05-15T15:40:32.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.336+0000 7f87cbee0640 1 -- 172.21.15.12:0/293804292 shutdown_connections 2024-05-15T15:40:32.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.336+0000 7f87cbee0640 1 --2- 172.21.15.12:0/293804292 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f87b0004800 0x7f87b0004c10 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:32.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.336+0000 7f87cbee0640 1 -- 172.21.15.12:0/293804292 >> 172.21.15.12:0/293804292 conn(0x7f87c40c3d20 msgr2=0x7f87c40c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:32.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.336+0000 7f87cbee0640 1 -- 172.21.15.12:0/293804292 shutdown_connections 2024-05-15T15:40:32.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.336+0000 7f87cbee0640 1 -- 172.21.15.12:0/293804292 wait complete. 2024-05-15T15:40:32.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.338+0000 7f87cbee0640 1 Processor -- start 2024-05-15T15:40:32.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.338+0000 7f87cbee0640 1 -- start start 2024-05-15T15:40:32.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.339+0000 7f87cbee0640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f87b0004800 0x7f87c4150390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:32.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.339+0000 7f87cbee0640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f87c414ee20 0x7f87c41e7d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:32.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.339+0000 7f87cbee0640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f87c40b5c00 0x7f87c40b6010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:32.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.339+0000 7f87cbee0640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f87c40bdae0 con 0x7f87c40b5c00 2024-05-15T15:40:32.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.339+0000 7f87cbee0640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f87c40c0070 con 0x7f87c414ee20 2024-05-15T15:40:32.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.339+0000 7f87cbee0640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f87c40a2ed0 con 0x7f87b0004800 2024-05-15T15:40:32.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.339+0000 7f87ca47d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f87c40b5c00 0x7f87c40b6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:32.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.339+0000 7f87ca47d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f87c40b5c00 0x7f87c40b6010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47060/0 (socket says 172.21.15.12:47060) 2024-05-15T15:40:32.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.339+0000 7f87ca47d640 1 -- 172.21.15.12:0/2449138776 learned_addr learned my addr 172.21.15.12:0/2449138776 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:32.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.339+0000 7f87c947b640 1 --2- 172.21.15.12:0/2449138776 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f87c414ee20 0x7f87c41e7d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:32.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.339+0000 7f87c9c7c640 1 --2- 172.21.15.12:0/2449138776 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f87b0004800 0x7f87c4150390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:32.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.339+0000 7f87ca47d640 1 -- 172.21.15.12:0/2449138776 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f87b0004800 msgr2=0x7f87c4150390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:32.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.339+0000 7f87ca47d640 1 --2- 172.21.15.12:0/2449138776 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f87b0004800 0x7f87c4150390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:32.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.339+0000 7f87ca47d640 1 -- 172.21.15.12:0/2449138776 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f87c414ee20 msgr2=0x7f87c41e7d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:32.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.339+0000 7f87ca47d640 1 --2- 172.21.15.12:0/2449138776 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f87c414ee20 0x7f87c41e7d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:32.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.339+0000 7f87ca47d640 1 -- 172.21.15.12:0/2449138776 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87c41508d0 con 0x7f87c40b5c00 2024-05-15T15:40:32.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.339+0000 7f87c947b640 1 --2- 172.21.15.12:0/2449138776 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f87c414ee20 0x7f87c41e7d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-15T15:40:32.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.339+0000 7f87c9c7c640 1 --2- 172.21.15.12:0/2449138776 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f87b0004800 0x7f87c4150390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-15T15:40:32.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.339+0000 7f87ca47d640 1 --2- 172.21.15.12:0/2449138776 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f87c40b5c00 0x7f87c40b6010 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f87c40b7360 tx=0x7f87bc00eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:32.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.339+0000 7f87ba7fc640 1 -- 172.21.15.12:0/2449138776 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87bc003970 con 0x7f87c40b5c00 2024-05-15T15:40:32.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.340+0000 7f87ba7fc640 1 -- 172.21.15.12:0/2449138776 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87bc018070 con 0x7f87c40b5c00 2024-05-15T15:40:32.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.340+0000 7f87cbee0640 1 -- 172.21.15.12:0/2449138776 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87c41e8860 con 0x7f87c40b5c00 2024-05-15T15:40:32.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.340+0000 7f87ba7fc640 1 -- 172.21.15.12:0/2449138776 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87bc003d50 con 0x7f87c40b5c00 2024-05-15T15:40:32.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.340+0000 7f87cbee0640 1 -- 172.21.15.12:0/2449138776 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87c414fb90 con 0x7f87c40b5c00 2024-05-15T15:40:32.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.341+0000 7f87cbee0640 1 -- 172.21.15.12:0/2449138776 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87c41e8670 con 0x7f87c40b5c00 2024-05-15T15:40:32.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.341+0000 7f87ba7fc640 1 -- 172.21.15.12:0/2449138776 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f87bc0050d0 con 0x7f87c40b5c00 2024-05-15T15:40:32.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.342+0000 7f87ba7fc640 1 --2- 172.21.15.12:0/2449138776 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f87a80762d0 0x7f87a80787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:32.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.342+0000 7f87ba7fc640 1 -- 172.21.15.12:0/2449138776 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f87bc0973a0 con 0x7f87c40b5c00 2024-05-15T15:40:32.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.342+0000 7f87c9c7c640 1 --2- 172.21.15.12:0/2449138776 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f87a80762d0 0x7f87a80787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:32.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.343+0000 7f87c9c7c640 1 --2- 172.21.15.12:0/2449138776 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f87a80762d0 0x7f87a80787e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f87c0007fd0 tx=0x7f87c0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:32.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.347+0000 7f87ba7fc640 1 -- 172.21.15.12:0/2449138776 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f87bc060c70 con 0x7f87c40b5c00 2024-05-15T15:40:32.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.538+0000 7f87cbee0640 1 -- 172.21.15.12:0/2449138776 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f87c4050940 con 0x7f87c40b5c00 2024-05-15T15:40:32.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.539+0000 7f87ba7fc640 1 -- 172.21.15.12:0/2449138776 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) ==== 74+0+16586 (secure 0 0 0) 0x7f87bc060570 con 0x7f87c40b5c00 2024-05-15T15:40:32.541 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-05-15T15:40:32.541 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":32,"fsid":"3b7fc4b2-b85c-49b5-a5de-38444eeed40d","created":"2024-05-15T15:39:28.392476+0000","modified":"2024-05-15T15:40:31.243141+0000","last_up_change":"2024-05-15T15:39:39.363983+0000","last_in_change":"2024-05-15T15:39:30.591216+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-15T15:39:40.715999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-05-15T15:40:29.381895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-05-15T15:40:30.183897+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0d06a12a-866a-418e-9776-704d74354579","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":3943681952},{"type":"v1","addr":"172.21.15.12:6809","nonce":3943681952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":3943681952},{"type":"v1","addr":"172.21.15.12:6812","nonce":3943681952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":3943681952},{"type":"v1","addr":"172.21.15.12:6821","nonce":3943681952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":3943681952},{"type":"v1","addr":"172.21.15.12:6816","nonce":3943681952}]},"public_addr":"172.21.15.12:6809/3943681952","cluster_addr":"172.21.15.12:6812/3943681952","heartbeat_back_addr":"172.21.15.12:6821/3943681952","heartbeat_front_addr":"172.21.15.12:6816/3943681952","state":["exists","up"]},{"osd":1,"uuid":"09d0fa19-9ef8-4f35-bf99-6e86658c6f10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6811","nonce":1763752148},{"type":"v1","addr":"172.21.15.12:6813","nonce":1763752148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":1763752148},{"type":"v1","addr":"172.21.15.12:6817","nonce":1763752148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":1763752148},{"type":"v1","addr":"172.21.15.12:6827","nonce":1763752148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6819","nonce":1763752148},{"type":"v1","addr":"172.21.15.12:6822","nonce":1763752148}]},"public_addr":"172.21.15.12:6813/1763752148","cluster_addr":"172.21.15.12:6817/1763752148","heartbeat_back_addr":"172.21.15.12:6827/1763752148","heartbeat_front_addr":"172.21.15.12:6822/1763752148","state":["exists","up"]},{"osd":2,"uuid":"b204c6ad-f431-40a5-ba27-9844294f0ece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":2173702802},{"type":"v1","addr":"172.21.15.12:6823","nonce":2173702802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":2173702802},{"type":"v1","addr":"172.21.15.12:6826","nonce":2173702802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":2173702802},{"type":"v1","addr":"172.21.15.12:6831","nonce":2173702802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":2173702802},{"type":"v1","addr":"172.21.15.12:6829","nonce":2173702802}]},"public_addr":"172.21.15.12:6823/2173702802","cluster_addr":"172.21.15.12:6826/2173702802","heartbeat_back_addr":"172.21.15.12:6831/2173702802","heartbeat_front_addr":"172.21.15.12:6829/2173702802","state":["exists","up"]},{"osd":3,"uuid":"660a9ccb-2ee5-42d8-8481-0835047a8260","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":3956443113},{"type":"v1","addr":"172.21.15.12:6801","nonce":3956443113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":3956443113},{"type":"v1","addr":"172.21.15.12:6803","nonce":3956443113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":3956443113},{"type":"v1","addr":"172.21.15.12:6807","nonce":3956443113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":3956443113},{"type":"v1","addr":"172.21.15.12:6805","nonce":3956443113}]},"public_addr":"172.21.15.12:6801/3956443113","cluster_addr":"172.21.15.12:6803/3956443113","heartbeat_back_addr":"172.21.15.12:6807/3956443113","heartbeat_front_addr":"172.21.15.12:6805/3956443113","state":["exists","up"]},{"osd":4,"uuid":"9eef1461-a961-457c-9a78-43b5098a46a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":1021092792},{"type":"v1","addr":"172.21.15.84:6809","nonce":1021092792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":1021092792},{"type":"v1","addr":"172.21.15.84:6811","nonce":1021092792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":1021092792},{"type":"v1","addr":"172.21.15.84:6815","nonce":1021092792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":1021092792},{"type":"v1","addr":"172.21.15.84:6813","nonce":1021092792}]},"public_addr":"172.21.15.84:6809/1021092792","cluster_addr":"172.21.15.84:6811/1021092792","heartbeat_back_addr":"172.21.15.84:6815/1021092792","heartbeat_front_addr":"172.21.15.84:6813/1021092792","state":["exists","up"]},{"osd":5,"uuid":"5f924e2f-6c71-4741-a727-d3710c438431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":3173527851},{"type":"v1","addr":"172.21.15.84:6801","nonce":3173527851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":3173527851},{"type":"v1","addr":"172.21.15.84:6803","nonce":3173527851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":3173527851},{"type":"v1","addr":"172.21.15.84:6807","nonce":3173527851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":3173527851},{"type":"v1","addr":"172.21.15.84:6805","nonce":3173527851}]},"public_addr":"172.21.15.84:6801/3173527851","cluster_addr":"172.21.15.84:6803/3173527851","heartbeat_back_addr":"172.21.15.84:6807/3173527851","heartbeat_front_addr":"172.21.15.84:6805/3173527851","state":["exists","up"]},{"osd":6,"uuid":"efae9975-8c16-4ad3-892f-71f3c59718d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3029180670},{"type":"v1","addr":"172.21.15.84:6817","nonce":3029180670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3029180670},{"type":"v1","addr":"172.21.15.84:6819","nonce":3029180670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3029180670},{"type":"v1","addr":"172.21.15.84:6823","nonce":3029180670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3029180670},{"type":"v1","addr":"172.21.15.84:6821","nonce":3029180670}]},"public_addr":"172.21.15.84:6817/3029180670","cluster_addr":"172.21.15.84:6819/3029180670","heartbeat_back_addr":"172.21.15.84:6823/3029180670","heartbeat_front_addr":"172.21.15.84:6821/3029180670","state":["exists","up"]},{"osd":7,"uuid":"6426efba-ee4d-4e44-83d1-c76c75aec30c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3067620602},{"type":"v1","addr":"172.21.15.84:6825","nonce":3067620602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3067620602},{"type":"v1","addr":"172.21.15.84:6827","nonce":3067620602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":3067620602},{"type":"v1","addr":"172.21.15.84:6831","nonce":3067620602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":3067620602},{"type":"v1","addr":"172.21.15.84:6829","nonce":3067620602}]},"public_addr":"172.21.15.84:6825/3067620602","cluster_addr":"172.21.15.84:6827/3067620602","heartbeat_back_addr":"172.21.15.84:6831/3067620602","heartbeat_front_addr":"172.21.15.84:6829/3067620602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.809514+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.845364+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.762733+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.688597+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.699228+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.747865+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.712415+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.820683+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-15T15:40:32.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.541+0000 7f87cbee0640 1 -- 172.21.15.12:0/2449138776 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f87a80762d0 msgr2=0x7f87a80787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:32.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.541+0000 7f87cbee0640 1 --2- 172.21.15.12:0/2449138776 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f87a80762d0 0x7f87a80787e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f87c0007fd0 tx=0x7f87c0009040 comp rx=0 tx=0).stop 2024-05-15T15:40:32.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.541+0000 7f87cbee0640 1 -- 172.21.15.12:0/2449138776 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f87c40b5c00 msgr2=0x7f87c40b6010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:32.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.541+0000 7f87cbee0640 1 --2- 172.21.15.12:0/2449138776 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f87c40b5c00 0x7f87c40b6010 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f87c40b7360 tx=0x7f87bc00eb20 comp rx=0 tx=0).stop 2024-05-15T15:40:32.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.541+0000 7f87cbee0640 1 -- 172.21.15.12:0/2449138776 shutdown_connections 2024-05-15T15:40:32.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.541+0000 7f87cbee0640 1 --2- 172.21.15.12:0/2449138776 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f87a80762d0 0x7f87a80787e0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:32.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.541+0000 7f87cbee0640 1 --2- 172.21.15.12:0/2449138776 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f87c40b5c00 0x7f87c40b6010 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:32.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.541+0000 7f87cbee0640 1 --2- 172.21.15.12:0/2449138776 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f87c414ee20 0x7f87c41e7d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:32.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.541+0000 7f87cbee0640 1 --2- 172.21.15.12:0/2449138776 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f87b0004800 0x7f87c4150390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:32.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.541+0000 7f87cbee0640 1 -- 172.21.15.12:0/2449138776 >> 172.21.15.12:0/2449138776 conn(0x7f87c40c3d20 msgr2=0x7f87c40bbe60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:32.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.541+0000 7f87cbee0640 1 -- 172.21.15.12:0/2449138776 shutdown_connections 2024-05-15T15:40:32.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.541+0000 7f87cbee0640 1 -- 172.21.15.12:0/2449138776 wait complete. 2024-05-15T15:40:32.554 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-15T15:40:32.669 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.667+0000 7f12850d1640 1 Processor -- start 2024-05-15T15:40:32.669 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.667+0000 7f12850d1640 1 -- start start 2024-05-15T15:40:32.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.668+0000 7f12850d1640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1280151fc0 0x7f12800bd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:32.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.668+0000 7f12850d1640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f12800bf050 0x7f1280158e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:32.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.668+0000 7f12850d1640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12800c36f0 con 0x7f128006da30 2024-05-15T15:40:32.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.668+0000 7f12850d1640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f12800bdc10 con 0x7f12800bf050 2024-05-15T15:40:32.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.668+0000 7f12850d1640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f1280152530 con 0x7f1280151fc0 2024-05-15T15:40:32.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.668+0000 7f127f59e640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f12800bf050 0x7f1280158e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:32.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.668+0000 7f127f59e640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f12800bf050 0x7f1280158e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47070/0 (socket says 172.21.15.12:47070) 2024-05-15T15:40:32.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.668+0000 7f127f59e640 1 -- 172.21.15.12:0/1473567698 learned_addr learned my addr 172.21.15.12:0/1473567698 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:32.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.668+0000 7f127ed9d640 1 --2- 172.21.15.12:0/1473567698 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1280151fc0 0x7f12800bd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:32.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.669+0000 7f127f59e640 1 -- 172.21.15.12:0/1473567698 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1280151fc0 msgr2=0x7f12800bd6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:40:32.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.669+0000 7f127f59e640 1 --2- 172.21.15.12:0/1473567698 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1280151fc0 0x7f12800bd6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:32.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.669+0000 7f127f59e640 1 -- 172.21.15.12:0/1473567698 >> v1:172.21.15.84:6789/0 conn(0x7f128006da30 legacy=0x7f12800be940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:32.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.669+0000 7f127f59e640 1 -- 172.21.15.12:0/1473567698 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1280152810 con 0x7f12800bf050 2024-05-15T15:40:32.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.669+0000 7f127f59e640 1 --2- 172.21.15.12:0/1473567698 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f12800bf050 0x7f1280158e90 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f1278009e50 tx=0x7f127802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e70b0e12f169899f server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:32.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.669+0000 7f127e59c640 1 -- 172.21.15.12:0/1473567698 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1278036070 con 0x7f12800bf050 2024-05-15T15:40:32.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.669+0000 7f127e59c640 1 -- 172.21.15.12:0/1473567698 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1278031600 con 0x7f12800bf050 2024-05-15T15:40:32.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.669+0000 7f127e59c640 1 -- 172.21.15.12:0/1473567698 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12780319d0 con 0x7f12800bf050 2024-05-15T15:40:32.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.670+0000 7f12850d1640 1 -- 172.21.15.12:0/1473567698 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f12800bf050 msgr2=0x7f1280158e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:32.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.670+0000 7f12850d1640 1 --2- 172.21.15.12:0/1473567698 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f12800bf050 0x7f1280158e90 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f1278009e50 tx=0x7f127802a680 comp rx=0 tx=0).stop 2024-05-15T15:40:32.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.670+0000 7f12850d1640 1 -- 172.21.15.12:0/1473567698 shutdown_connections 2024-05-15T15:40:32.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.670+0000 7f12850d1640 1 --2- 172.21.15.12:0/1473567698 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f12800bf050 0x7f1280158e90 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:32.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.670+0000 7f12850d1640 1 --2- 172.21.15.12:0/1473567698 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1280151fc0 0x7f12800bd6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:32.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.670+0000 7f12850d1640 1 -- 172.21.15.12:0/1473567698 >> 172.21.15.12:0/1473567698 conn(0x7f12800c3d20 msgr2=0x7f12800c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:32.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.670+0000 7f12850d1640 1 -- 172.21.15.12:0/1473567698 shutdown_connections 2024-05-15T15:40:32.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.670+0000 7f12850d1640 1 -- 172.21.15.12:0/1473567698 wait complete. 2024-05-15T15:40:32.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.672+0000 7f12850d1640 1 Processor -- start 2024-05-15T15:40:32.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.672+0000 7f12850d1640 1 -- start start 2024-05-15T15:40:32.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.673+0000 7f12850d1640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f128006da30 0x7f128014c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:32.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.673+0000 7f12850d1640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f12800bf050 0x7f12800b9400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:32.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.673+0000 7f12850d1640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1280151fc0 0x7f12801e7840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:32.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.673+0000 7f12850d1640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f12800a3050 con 0x7f128006da30 2024-05-15T15:40:32.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.673+0000 7f12850d1640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f12800a2ed0 con 0x7f12800bf050 2024-05-15T15:40:32.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.673+0000 7f12850d1640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f128006de40 con 0x7f1280151fc0 2024-05-15T15:40:32.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.673+0000 7f127ed9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f128006da30 0x7f128014c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:32.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.673+0000 7f127ed9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f128006da30 0x7f128014c1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47076/0 (socket says 172.21.15.12:47076) 2024-05-15T15:40:32.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.673+0000 7f127ed9d640 1 -- 172.21.15.12:0/1385146086 learned_addr learned my addr 172.21.15.12:0/1385146086 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:32.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.673+0000 7f127f59e640 1 --2- 172.21.15.12:0/1385146086 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1280151fc0 0x7f12801e7840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:32.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.673+0000 7f1277fff640 1 --2- 172.21.15.12:0/1385146086 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f12800bf050 0x7f12800b9400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:32.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.673+0000 7f127ed9d640 1 -- 172.21.15.12:0/1385146086 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1280151fc0 msgr2=0x7f12801e7840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:32.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.673+0000 7f127ed9d640 1 --2- 172.21.15.12:0/1385146086 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1280151fc0 0x7f12801e7840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:32.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.673+0000 7f127ed9d640 1 -- 172.21.15.12:0/1385146086 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f12800bf050 msgr2=0x7f12800b9400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:32.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.673+0000 7f127ed9d640 1 --2- 172.21.15.12:0/1385146086 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f12800bf050 0x7f12800b9400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:32.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.673+0000 7f127ed9d640 1 -- 172.21.15.12:0/1385146086 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12800b9940 con 0x7f128006da30 2024-05-15T15:40:32.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.673+0000 7f1277fff640 1 --2- 172.21.15.12:0/1385146086 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f12800bf050 0x7f12800b9400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-15T15:40:32.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.674+0000 7f127ed9d640 1 --2- 172.21.15.12:0/1385146086 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f128006da30 0x7f128014c1b0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f127000e870 tx=0x7f127000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:32.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.674+0000 7f12777fe640 1 -- 172.21.15.12:0/1385146086 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1270017070 con 0x7f128006da30 2024-05-15T15:40:32.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.674+0000 7f12777fe640 1 -- 172.21.15.12:0/1385146086 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f127000c940 con 0x7f128006da30 2024-05-15T15:40:32.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.674+0000 7f12777fe640 1 -- 172.21.15.12:0/1385146086 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f127000cd30 con 0x7f128006da30 2024-05-15T15:40:32.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.674+0000 7f12850d1640 1 -- 172.21.15.12:0/1385146086 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f128014ed10 con 0x7f128006da30 2024-05-15T15:40:32.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.674+0000 7f12850d1640 1 -- 172.21.15.12:0/1385146086 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12801e7d80 con 0x7f128006da30 2024-05-15T15:40:32.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.675+0000 7f12850d1640 1 -- 172.21.15.12:0/1385146086 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1280050940 con 0x7f128006da30 2024-05-15T15:40:32.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.676+0000 7f12777fe640 1 -- 172.21.15.12:0/1385146086 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f127001a070 con 0x7f128006da30 2024-05-15T15:40:32.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.676+0000 7f12777fe640 1 --2- 172.21.15.12:0/1385146086 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f1260076300 0x7f1260078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:32.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.676+0000 7f1277fff640 1 --2- 172.21.15.12:0/1385146086 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f1260076300 0x7f1260078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:32.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.676+0000 7f12777fe640 1 -- 172.21.15.12:0/1385146086 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f1270097450 con 0x7f128006da30 2024-05-15T15:40:32.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.677+0000 7f1277fff640 1 --2- 172.21.15.12:0/1385146086 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f1260076300 0x7f1260078810 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f12800be130 tx=0x7f1268009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:32.683 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.681+0000 7f12777fe640 1 -- 172.21.15.12:0/1385146086 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f12800b9940 con 0x7f128006da30 2024-05-15T15:40:32.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:32.914+0000 7f12850d1640 1 -- 172.21.15.12:0/1385146086 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f128006eb40 con 0x7f128006da30 2024-05-15T15:40:33.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:33.867+0000 7f12777fe640 1 -- 172.21.15.12:0/1385146086 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v15) ==== 118+0+0 (secure 0 0 0) 0x7f1270060db0 con 0x7f128006da30 2024-05-15T15:40:33.873 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:33.870+0000 7f12850d1640 1 -- 172.21.15.12:0/1385146086 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f1260076300 msgr2=0x7f1260078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:33.873 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:33.870+0000 7f12850d1640 1 --2- 172.21.15.12:0/1385146086 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f1260076300 0x7f1260078810 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f12800be130 tx=0x7f1268009040 comp rx=0 tx=0).stop 2024-05-15T15:40:33.873 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:33.870+0000 7f12850d1640 1 -- 172.21.15.12:0/1385146086 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f128006da30 msgr2=0x7f128014c1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:33.873 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:33.870+0000 7f12850d1640 1 --2- 172.21.15.12:0/1385146086 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f128006da30 0x7f128014c1b0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f127000e870 tx=0x7f127000ed30 comp rx=0 tx=0).stop 2024-05-15T15:40:33.873 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:33.871+0000 7f12850d1640 1 -- 172.21.15.12:0/1385146086 shutdown_connections 2024-05-15T15:40:33.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:33.871+0000 7f12850d1640 1 --2- 172.21.15.12:0/1385146086 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1280151fc0 0x7f12801e7840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:33.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:33.871+0000 7f12850d1640 1 --2- 172.21.15.12:0/1385146086 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f12800bf050 0x7f12800b9400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:33.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:33.871+0000 7f12850d1640 1 --2- 172.21.15.12:0/1385146086 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f1260076300 0x7f1260078810 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:33.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:33.871+0000 7f12850d1640 1 --2- 172.21.15.12:0/1385146086 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f128006da30 0x7f128014c1b0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:33.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:33.871+0000 7f12850d1640 1 -- 172.21.15.12:0/1385146086 >> 172.21.15.12:0/1385146086 conn(0x7f12800c3d20 msgr2=0x7f12800c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:33.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:33.871+0000 7f12850d1640 1 -- 172.21.15.12:0/1385146086 shutdown_connections 2024-05-15T15:40:33.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:33.871+0000 7f12850d1640 1 -- 172.21.15.12:0/1385146086 wait complete. 2024-05-15T15:40:33.886 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-05-15T15:40:33.887 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-05-15T15:40:34.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:34.006+0000 7f4892bb2640 1 Processor -- start 2024-05-15T15:40:34.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:34.006+0000 7f4892bb2640 1 -- start start 2024-05-15T15:40:34.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:34.007+0000 7f4892bb2640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f488c151fc0 0x7f488c0bd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:34.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:34.007+0000 7f4892bb2640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f488c0bf050 0x7f488c158e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:34.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:34.007+0000 7f4892bb2640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f488c0c36f0 con 0x7f488c06da30 2024-05-15T15:40:34.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:34.007+0000 7f4892bb2640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f488c0bdc10 con 0x7f488c0bf050 2024-05-15T15:40:34.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:34.007+0000 7f4892bb2640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f488c152530 con 0x7f488c151fc0 2024-05-15T15:40:34.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:34.007+0000 7f489114f640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f488c0bf050 0x7f488c158e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:34.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:34.008+0000 7f489114f640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f488c0bf050 0x7f488c158e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47092/0 (socket says 172.21.15.12:47092) 2024-05-15T15:40:34.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:34.008+0000 7f489114f640 1 -- 172.21.15.12:0/283905702 learned_addr learned my addr 172.21.15.12:0/283905702 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:34.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:34.008+0000 7f489094e640 1 --2- 172.21.15.12:0/283905702 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f488c151fc0 0x7f488c0bd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:34.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:34.008+0000 7f489114f640 1 -- 172.21.15.12:0/283905702 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f488c151fc0 msgr2=0x7f488c0bd6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:40:34.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:34.008+0000 7f489114f640 1 --2- 172.21.15.12:0/283905702 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f488c151fc0 0x7f488c0bd6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:34.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:34.008+0000 7f489114f640 1 -- 172.21.15.12:0/283905702 >> v1:172.21.15.84:6789/0 conn(0x7f488c06da30 legacy=0x7f488c0be940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:34.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:34.008+0000 7f489114f640 1 -- 172.21.15.12:0/283905702 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f488c152810 con 0x7f488c0bf050 2024-05-15T15:40:34.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:34.009+0000 7f489114f640 1 --2- 172.21.15.12:0/283905702 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f488c0bf050 0x7f488c158e90 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f4884009e50 tx=0x7f488402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc77ce42693108f2 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:34.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:34.009+0000 7f488b7fe640 1 -- 172.21.15.12:0/283905702 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4884036070 con 0x7f488c0bf050 2024-05-15T15:40:34.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:34.009+0000 7f488b7fe640 1 -- 172.21.15.12:0/283905702 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4884031600 con 0x7f488c0bf050 2024-05-15T15:40:34.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:34.009+0000 7f488b7fe640 1 -- 172.21.15.12:0/283905702 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48840319d0 con 0x7f488c0bf050 2024-05-15T15:40:34.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:34.009+0000 7f4892bb2640 1 -- 172.21.15.12:0/283905702 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f488c0bf050 msgr2=0x7f488c158e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:34.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:34.009+0000 7f4892bb2640 1 --2- 172.21.15.12:0/283905702 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f488c0bf050 0x7f488c158e90 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f4884009e50 tx=0x7f488402a680 comp rx=0 tx=0).stop 2024-05-15T15:40:34.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:34.009+0000 7f4892bb2640 1 -- 172.21.15.12:0/283905702 shutdown_connections 2024-05-15T15:40:34.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:34.009+0000 7f4892bb2640 1 --2- 172.21.15.12:0/283905702 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f488c0bf050 0x7f488c158e90 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:34.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:34.009+0000 7f4892bb2640 1 --2- 172.21.15.12:0/283905702 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f488c151fc0 0x7f488c0bd6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:34.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:34.009+0000 7f4892bb2640 1 -- 172.21.15.12:0/283905702 >> 172.21.15.12:0/283905702 conn(0x7f488c0c3d20 msgr2=0x7f488c0c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:34.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:34.010+0000 7f4892bb2640 1 -- 172.21.15.12:0/283905702 shutdown_connections 2024-05-15T15:40:34.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:34.010+0000 7f4892bb2640 1 -- 172.21.15.12:0/283905702 wait complete. 2024-05-15T15:40:34.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:34.011+0000 7f4892bb2640 1 Processor -- start 2024-05-15T15:40:34.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:34.011+0000 7f4892bb2640 1 -- start start 2024-05-15T15:40:34.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:34.012+0000 7f4892bb2640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f488c06da30 0x7f488c14c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:34.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:34.012+0000 7f4892bb2640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f488c0bf050 0x7f488c0b9400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:34.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:34.012+0000 7f4892bb2640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f488c151fc0 0x7f488c1e7840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:34.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:34.012+0000 7f4892bb2640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f488c0a3050 con 0x7f488c151fc0 2024-05-15T15:40:34.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:34.012+0000 7f4892bb2640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f488c0a2ed0 con 0x7f488c0bf050 2024-05-15T15:40:34.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:34.012+0000 7f4892bb2640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f488c06de40 con 0x7f488c06da30 2024-05-15T15:40:34.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:34.012+0000 7f489114f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f488c151fc0 0x7f488c1e7840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:34.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:34.012+0000 7f489114f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f488c151fc0 0x7f488c1e7840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47104/0 (socket says 172.21.15.12:47104) 2024-05-15T15:40:34.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:34.012+0000 7f489114f640 1 -- 172.21.15.12:0/2455604246 learned_addr learned my addr 172.21.15.12:0/2455604246 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:34.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:34.013+0000 7f489094e640 1 --2- 172.21.15.12:0/2455604246 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f488c06da30 0x7f488c14c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:34.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:34.013+0000 7f488bfff640 1 --2- 172.21.15.12:0/2455604246 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f488c0bf050 0x7f488c0b9400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:34.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:34.013+0000 7f489114f640 1 -- 172.21.15.12:0/2455604246 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f488c06da30 msgr2=0x7f488c14c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:34.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:34.013+0000 7f489114f640 1 --2- 172.21.15.12:0/2455604246 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f488c06da30 0x7f488c14c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:34.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:34.013+0000 7f489114f640 1 -- 172.21.15.12:0/2455604246 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f488c0bf050 msgr2=0x7f488c0b9400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:34.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:34.013+0000 7f489114f640 1 --2- 172.21.15.12:0/2455604246 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f488c0bf050 0x7f488c0b9400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:34.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:34.013+0000 7f489114f640 1 -- 172.21.15.12:0/2455604246 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f488c0b9940 con 0x7f488c151fc0 2024-05-15T15:40:34.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:34.013+0000 7f489114f640 1 --2- 172.21.15.12:0/2455604246 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f488c151fc0 0x7f488c1e7840 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f4884034040 tx=0x7f4884004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:34.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:34.013+0000 7f48897fa640 1 -- 172.21.15.12:0/2455604246 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4884036050 con 0x7f488c151fc0 2024-05-15T15:40:34.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:34.013+0000 7f48897fa640 1 -- 172.21.15.12:0/2455604246 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4884042070 con 0x7f488c151fc0 2024-05-15T15:40:34.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:34.013+0000 7f4892bb2640 1 -- 172.21.15.12:0/2455604246 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f488c14ed10 con 0x7f488c151fc0 2024-05-15T15:40:34.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:34.013+0000 7f48897fa640 1 -- 172.21.15.12:0/2455604246 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4884009510 con 0x7f488c151fc0 2024-05-15T15:40:34.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:34.013+0000 7f4892bb2640 1 -- 172.21.15.12:0/2455604246 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f488c1e7d80 con 0x7f488c151fc0 2024-05-15T15:40:34.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:34.014+0000 7f4892bb2640 1 -- 172.21.15.12:0/2455604246 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f488c050940 con 0x7f488c151fc0 2024-05-15T15:40:34.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:34.015+0000 7f48897fa640 1 -- 172.21.15.12:0/2455604246 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f4884007bd0 con 0x7f488c151fc0 2024-05-15T15:40:34.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:34.015+0000 7f48897fa640 1 --2- 172.21.15.12:0/2455604246 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f4878076300 0x7f4878078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:34.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:34.016+0000 7f48897fa640 1 -- 172.21.15.12:0/2455604246 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f48840b8330 con 0x7f488c151fc0 2024-05-15T15:40:34.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:34.016+0000 7f489094e640 1 --2- 172.21.15.12:0/2455604246 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f4878076300 0x7f4878078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:34.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:34.016+0000 7f489094e640 1 --2- 172.21.15.12:0/2455604246 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f4878076300 0x7f4878078810 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f487c0079a0 tx=0x7f487c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:34.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:34.020+0000 7f48897fa640 1 -- 172.21.15.12:0/2455604246 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f488c0b9940 con 0x7f488c151fc0 2024-05-15T15:40:34.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:34.252+0000 7f4892bb2640 1 -- 172.21.15.12:0/2455604246 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f488c0bbc10 con 0x7f488c151fc0 2024-05-15T15:40:34.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:34.873+0000 7f48897fa640 1 -- 172.21.15.12:0/2455604246 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v16) ==== 122+0+0 (secure 0 0 0) 0x7f4884081640 con 0x7f488c151fc0 2024-05-15T15:40:34.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:34.875+0000 7f4892bb2640 1 -- 172.21.15.12:0/2455604246 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f4878076300 msgr2=0x7f4878078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:34.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:34.875+0000 7f4892bb2640 1 --2- 172.21.15.12:0/2455604246 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f4878076300 0x7f4878078810 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f487c0079a0 tx=0x7f487c008040 comp rx=0 tx=0).stop 2024-05-15T15:40:34.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:34.875+0000 7f4892bb2640 1 -- 172.21.15.12:0/2455604246 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f488c151fc0 msgr2=0x7f488c1e7840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:34.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:34.875+0000 7f4892bb2640 1 --2- 172.21.15.12:0/2455604246 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f488c151fc0 0x7f488c1e7840 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f4884034040 tx=0x7f4884004a40 comp rx=0 tx=0).stop 2024-05-15T15:40:34.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:34.875+0000 7f4892bb2640 1 -- 172.21.15.12:0/2455604246 shutdown_connections 2024-05-15T15:40:34.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:34.875+0000 7f4892bb2640 1 --2- 172.21.15.12:0/2455604246 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f4878076300 0x7f4878078810 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:34.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:34.875+0000 7f4892bb2640 1 --2- 172.21.15.12:0/2455604246 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f488c151fc0 0x7f488c1e7840 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:34.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:34.875+0000 7f4892bb2640 1 --2- 172.21.15.12:0/2455604246 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f488c0bf050 0x7f488c0b9400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:34.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:34.875+0000 7f4892bb2640 1 --2- 172.21.15.12:0/2455604246 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f488c06da30 0x7f488c14c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:34.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:34.875+0000 7f4892bb2640 1 -- 172.21.15.12:0/2455604246 >> 172.21.15.12:0/2455604246 conn(0x7f488c0c3d20 msgr2=0x7f488c0c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:34.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:34.876+0000 7f4892bb2640 1 -- 172.21.15.12:0/2455604246 shutdown_connections 2024-05-15T15:40:34.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:34.876+0000 7f4892bb2640 1 -- 172.21.15.12:0/2455604246 wait complete. 2024-05-15T15:40:34.891 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-05-15T15:40:34.891 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-15T15:40:35.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.007+0000 7f79385f3640 1 Processor -- start 2024-05-15T15:40:35.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.007+0000 7f79385f3640 1 -- start start 2024-05-15T15:40:35.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.009+0000 7f79385f3640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f79300bd440 0x7f79300bd850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:35.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.009+0000 7f79385f3640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f79300b8d70 0x7f79300b9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:35.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.009+0000 7f79385f3640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79300bdd90 con 0x7f793014e530 2024-05-15T15:40:35.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.009+0000 7f79385f3640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f79300b88e0 con 0x7f79300b8d70 2024-05-15T15:40:35.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.009+0000 7f79385f3640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f793014ece0 con 0x7f79300bd440 2024-05-15T15:40:35.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.009+0000 7f7936b90640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f79300b8d70 0x7f79300b9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:35.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.009+0000 7f7936b90640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f79300b8d70 0x7f79300b9180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47108/0 (socket says 172.21.15.12:47108) 2024-05-15T15:40:35.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.009+0000 7f7936b90640 1 -- 172.21.15.12:0/3467409045 learned_addr learned my addr 172.21.15.12:0/3467409045 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:35.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.009+0000 7f7935b8e640 1 --2- 172.21.15.12:0/3467409045 >> v2:172.21.15.84:3300/0 conn(0x7f79300bd440 0x7f79300bd850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:35.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.009+0000 7f7936b90640 1 -- 172.21.15.12:0/3467409045 >> v2:172.21.15.84:3300/0 conn(0x7f79300bd440 msgr2=0x7f79300bd850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:40:35.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.009+0000 7f7936b90640 1 --2- 172.21.15.12:0/3467409045 >> v2:172.21.15.84:3300/0 conn(0x7f79300bd440 0x7f79300bd850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:35.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.009+0000 7f7936b90640 1 -- 172.21.15.12:0/3467409045 >> v1:172.21.15.84:6789/0 conn(0x7f793014e530 legacy=0x7f79300ba320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:40:35.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.009+0000 7f7936b90640 1 -- 172.21.15.12:0/3467409045 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f793014efc0 con 0x7f79300b8d70 2024-05-15T15:40:35.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.010+0000 7f7936b90640 1 --2- 172.21.15.12:0/3467409045 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f79300b8d70 0x7f79300b9180 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f79300a96a0 tx=0x7f792802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80c4ad875da88da6 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:35.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.010+0000 7f793538d640 1 -- 172.21.15.12:0/3467409045 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7928036070 con 0x7f79300b8d70 2024-05-15T15:40:35.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.010+0000 7f793538d640 1 -- 172.21.15.12:0/3467409045 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7928031600 con 0x7f79300b8d70 2024-05-15T15:40:35.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.010+0000 7f793538d640 1 -- 172.21.15.12:0/3467409045 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79280319d0 con 0x7f79300b8d70 2024-05-15T15:40:35.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.011+0000 7f79385f3640 1 -- 172.21.15.12:0/3467409045 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f79300b8d70 msgr2=0x7f79300b9180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:35.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.011+0000 7f79385f3640 1 --2- 172.21.15.12:0/3467409045 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f79300b8d70 0x7f79300b9180 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f79300a96a0 tx=0x7f792802a6a0 comp rx=0 tx=0).stop 2024-05-15T15:40:35.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.011+0000 7f79385f3640 1 -- 172.21.15.12:0/3467409045 shutdown_connections 2024-05-15T15:40:35.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.011+0000 7f79385f3640 1 --2- 172.21.15.12:0/3467409045 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f79300b8d70 0x7f79300b9180 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:35.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.011+0000 7f79385f3640 1 --2- 172.21.15.12:0/3467409045 >> v2:172.21.15.84:3300/0 conn(0x7f79300bd440 0x7f79300bd850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:35.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.011+0000 7f79385f3640 1 -- 172.21.15.12:0/3467409045 >> 172.21.15.12:0/3467409045 conn(0x7f79300c0570 msgr2=0x7f79300c0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:35.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.011+0000 7f79385f3640 1 -- 172.21.15.12:0/3467409045 shutdown_connections 2024-05-15T15:40:35.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.011+0000 7f79385f3640 1 -- 172.21.15.12:0/3467409045 wait complete. 2024-05-15T15:40:35.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.013+0000 7f79385f3640 1 Processor -- start 2024-05-15T15:40:35.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.013+0000 7f79385f3640 1 -- start start 2024-05-15T15:40:35.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.014+0000 7f79385f3640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f79300b8d70 0x7f79301e48c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:35.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.014+0000 7f79385f3640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79300bd440 0x7f7930141890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:35.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.014+0000 7f79385f3640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f793014e530 0x7f7930142d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:35.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.014+0000 7f79385f3640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f79300b96c0 con 0x7f793014e530 2024-05-15T15:40:35.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.014+0000 7f79385f3640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f79300bbb70 con 0x7f79300bd440 2024-05-15T15:40:35.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.014+0000 7f79385f3640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f793014e940 con 0x7f79300b8d70 2024-05-15T15:40:35.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.014+0000 7f7936b90640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f793014e530 0x7f7930142d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:35.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.014+0000 7f7936b90640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f793014e530 0x7f7930142d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47122/0 (socket says 172.21.15.12:47122) 2024-05-15T15:40:35.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.014+0000 7f7936b90640 1 -- 172.21.15.12:0/2877542646 learned_addr learned my addr 172.21.15.12:0/2877542646 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:35.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.014+0000 7f7935b8e640 1 --2- 172.21.15.12:0/2877542646 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79300bd440 0x7f7930141890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:35.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.014+0000 7f793638f640 1 --2- 172.21.15.12:0/2877542646 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f79300b8d70 0x7f79301e48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:35.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.014+0000 7f7936b90640 1 -- 172.21.15.12:0/2877542646 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f79300b8d70 msgr2=0x7f79301e48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:35.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.014+0000 7f7936b90640 1 --2- 172.21.15.12:0/2877542646 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f79300b8d70 0x7f79301e48c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:35.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.014+0000 7f7936b90640 1 -- 172.21.15.12:0/2877542646 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79300bd440 msgr2=0x7f7930141890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:35.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.014+0000 7f7936b90640 1 --2- 172.21.15.12:0/2877542646 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79300bd440 0x7f7930141890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:35.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.014+0000 7f7936b90640 1 -- 172.21.15.12:0/2877542646 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7930141dd0 con 0x7f793014e530 2024-05-15T15:40:35.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.014+0000 7f7936b90640 1 --2- 172.21.15.12:0/2877542646 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f793014e530 0x7f7930142d80 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f792802ac90 tx=0x7f7928004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:35.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.015+0000 7f7926ffd640 1 -- 172.21.15.12:0/2877542646 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7928036050 con 0x7f793014e530 2024-05-15T15:40:35.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.015+0000 7f7926ffd640 1 -- 172.21.15.12:0/2877542646 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7928042070 con 0x7f793014e530 2024-05-15T15:40:35.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.015+0000 7f79385f3640 1 -- 172.21.15.12:0/2877542646 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79301432c0 con 0x7f793014e530 2024-05-15T15:40:35.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.015+0000 7f7926ffd640 1 -- 172.21.15.12:0/2877542646 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7928009510 con 0x7f793014e530 2024-05-15T15:40:35.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.015+0000 7f79385f3640 1 -- 172.21.15.12:0/2877542646 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79301e53a0 con 0x7f793014e530 2024-05-15T15:40:35.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.016+0000 7f79385f3640 1 -- 172.21.15.12:0/2877542646 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7930050940 con 0x7f793014e530 2024-05-15T15:40:35.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.016+0000 7f7926ffd640 1 -- 172.21.15.12:0/2877542646 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7928007bd0 con 0x7f793014e530 2024-05-15T15:40:35.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.017+0000 7f7926ffd640 1 --2- 172.21.15.12:0/2877542646 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f7914076300 0x7f7914078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:35.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.017+0000 7f7926ffd640 1 -- 172.21.15.12:0/2877542646 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f79280b8460 con 0x7f793014e530 2024-05-15T15:40:35.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.017+0000 7f793638f640 1 --2- 172.21.15.12:0/2877542646 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f7914076300 0x7f7914078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:35.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.018+0000 7f793638f640 1 --2- 172.21.15.12:0/2877542646 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f7914076300 0x7f7914078810 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f792c0098c0 tx=0x7f792c009060 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:35.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.022+0000 7f7926ffd640 1 -- 172.21.15.12:0/2877542646 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f7928081640 con 0x7f793014e530 2024-05-15T15:40:35.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.258+0000 7f79385f3640 1 -- 172.21.15.12:0/2877542646 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f79301e4ef0 con 0x7f793014e530 2024-05-15T15:40:35.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.259+0000 7f7926ffd640 1 -- 172.21.15.12:0/2877542646 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+4350 (secure 0 0 0) 0x7f7928085940 con 0x7f793014e530 2024-05-15T15:40:35.261 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-05-15T15:40:35.261 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4577,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/1749847216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1749847216},{"type":"v1","addr":"172.21.15.84:6835","nonce":1749847216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4580,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/3678098513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6833","nonce":3678098513},{"type":"v1","addr":"172.21.15.12:6835","nonce":3678098513}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-15T15:40:31.243097+0000","modified":"2024-05-15T15:40:34.253461+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4759},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4759":{"gid":4759,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.12:6834/32438370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":32438370},{"type":"v1","addr":"172.21.15.12:6834","nonce":32438370}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4759,"qdb_cluster":[4759]},"id":2}]} 2024-05-15T15:40:35.261 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 16 2024-05-15T15:40:35.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.261+0000 7f79385f3640 1 -- 172.21.15.12:0/2877542646 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f7914076300 msgr2=0x7f7914078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:35.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.261+0000 7f79385f3640 1 --2- 172.21.15.12:0/2877542646 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f7914076300 0x7f7914078810 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f792c0098c0 tx=0x7f792c009060 comp rx=0 tx=0).stop 2024-05-15T15:40:35.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.261+0000 7f79385f3640 1 -- 172.21.15.12:0/2877542646 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f793014e530 msgr2=0x7f7930142d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:35.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.261+0000 7f79385f3640 1 --2- 172.21.15.12:0/2877542646 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f793014e530 0x7f7930142d80 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f792802ac90 tx=0x7f7928004a40 comp rx=0 tx=0).stop 2024-05-15T15:40:35.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.261+0000 7f79385f3640 1 -- 172.21.15.12:0/2877542646 shutdown_connections 2024-05-15T15:40:35.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.261+0000 7f79385f3640 1 --2- 172.21.15.12:0/2877542646 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f7914076300 0x7f7914078810 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:35.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.261+0000 7f79385f3640 1 --2- 172.21.15.12:0/2877542646 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f793014e530 0x7f7930142d80 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:35.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.261+0000 7f79385f3640 1 --2- 172.21.15.12:0/2877542646 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79300bd440 0x7f7930141890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:35.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.261+0000 7f79385f3640 1 --2- 172.21.15.12:0/2877542646 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f79300b8d70 0x7f79301e48c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:35.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.261+0000 7f79385f3640 1 -- 172.21.15.12:0/2877542646 >> 172.21.15.12:0/2877542646 conn(0x7f79300c0570 msgr2=0x7f79300ba320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:35.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.261+0000 7f79385f3640 1 -- 172.21.15.12:0/2877542646 shutdown_connections 2024-05-15T15:40:35.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.261+0000 7f79385f3640 1 -- 172.21.15.12:0/2877542646 wait complete. 2024-05-15T15:40:35.274 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-15T15:40:35.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.383+0000 7f958d253640 1 Processor -- start 2024-05-15T15:40:35.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.383+0000 7f958d253640 1 -- start start 2024-05-15T15:40:35.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.384+0000 7f958d253640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f95880be4f0 0x7f95880bfef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:35.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.384+0000 7f958d253640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95880720d0 con 0x7f958814d0f0 2024-05-15T15:40:35.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.384+0000 7f958d253640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95880bf6f0 con 0x7f958814cce0 2024-05-15T15:40:35.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.384+0000 7f958d253640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f95880bfa60 con 0x7f95880be4f0 2024-05-15T15:40:35.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.384+0000 7f9586d9d640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f95880be4f0 0x7f95880bfef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:35.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.384+0000 7f9586d9d640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f95880be4f0 0x7f95880bfef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47134/0 (socket says 172.21.15.12:47134) 2024-05-15T15:40:35.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.384+0000 7f9586d9d640 1 -- 172.21.15.12:0/2172293994 learned_addr learned my addr 172.21.15.12:0/2172293994 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:35.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.384+0000 7f958759e640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f958814d0f0 0x7f9588156cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38330/0 (socket says 172.21.15.12:38330) 2024-05-15T15:40:35.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.385+0000 7f9586d9d640 1 -- 172.21.15.12:0/2172293994 >> v1:172.21.15.84:6789/0 conn(0x7f958814cce0 legacy=0x7f95880716a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:35.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.385+0000 7f9586d9d640 1 -- 172.21.15.12:0/2172293994 >> v1:172.21.15.12:6789/0 conn(0x7f958814d0f0 legacy=0x7f9588156cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:35.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.385+0000 7f958659c640 1 -- 172.21.15.12:0/2172293994 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2507941976 0 0) 0x7f95880720d0 con 0x7f958814d0f0 2024-05-15T15:40:35.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.385+0000 7f9586d9d640 1 -- 172.21.15.12:0/2172293994 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95880be900 con 0x7f95880be4f0 2024-05-15T15:40:35.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.385+0000 7f9586d9d640 1 --2- 172.21.15.12:0/2172293994 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95880be4f0 0x7f95880bfef0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f95880bfbe0 tx=0x7f957802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=697df514f2d44b86 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:35.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.385+0000 7f958659c640 1 -- 172.21.15.12:0/2172293994 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9578037070 con 0x7f95880be4f0 2024-05-15T15:40:35.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.386+0000 7f958659c640 1 -- 172.21.15.12:0/2172293994 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9578032440 con 0x7f95880be4f0 2024-05-15T15:40:35.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.386+0000 7f958659c640 1 -- 172.21.15.12:0/2172293994 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9578032810 con 0x7f95880be4f0 2024-05-15T15:40:35.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.386+0000 7f958d253640 1 -- 172.21.15.12:0/2172293994 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95880be4f0 msgr2=0x7f95880bfef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:35.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.386+0000 7f958d253640 1 --2- 172.21.15.12:0/2172293994 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95880be4f0 0x7f95880bfef0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f95880bfbe0 tx=0x7f957802a270 comp rx=0 tx=0).stop 2024-05-15T15:40:35.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.386+0000 7f958d253640 1 -- 172.21.15.12:0/2172293994 shutdown_connections 2024-05-15T15:40:35.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.386+0000 7f958d253640 1 --2- 172.21.15.12:0/2172293994 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95880be4f0 0x7f95880bfef0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:35.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.386+0000 7f958d253640 1 -- 172.21.15.12:0/2172293994 >> 172.21.15.12:0/2172293994 conn(0x7f95880c17c0 msgr2=0x7f95880c1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:35.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.386+0000 7f958d253640 1 -- 172.21.15.12:0/2172293994 shutdown_connections 2024-05-15T15:40:35.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.386+0000 7f958d253640 1 -- 172.21.15.12:0/2172293994 wait complete. 2024-05-15T15:40:35.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.388+0000 7f958d253640 1 Processor -- start 2024-05-15T15:40:35.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.388+0000 7f958d253640 1 -- start start 2024-05-15T15:40:35.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.389+0000 7f958d253640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f95880be4f0 0x7f95881d5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:35.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.389+0000 7f958d253640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f958814cce0 0x7f958809c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:35.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.389+0000 7f958d253640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f958814d0f0 0x7f95881498f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:35.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.389+0000 7f958d253640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f95880723b0 con 0x7f958814cce0 2024-05-15T15:40:35.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.389+0000 7f958d253640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f9588071310 con 0x7f958814d0f0 2024-05-15T15:40:35.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.389+0000 7f958d253640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f95880c0430 con 0x7f95880be4f0 2024-05-15T15:40:35.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.389+0000 7f957ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f958814cce0 0x7f958809c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:35.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.389+0000 7f957ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f958814cce0 0x7f958809c4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47138/0 (socket says 172.21.15.12:47138) 2024-05-15T15:40:35.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.389+0000 7f957ffff640 1 -- 172.21.15.12:0/2087117049 learned_addr learned my addr 172.21.15.12:0/2087117049 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:35.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.389+0000 7f958759e640 1 --2- 172.21.15.12:0/2087117049 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f958814d0f0 0x7f95881498f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:35.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.389+0000 7f9586d9d640 1 --2- 172.21.15.12:0/2087117049 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f95880be4f0 0x7f95881d5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:35.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.389+0000 7f957ffff640 1 -- 172.21.15.12:0/2087117049 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f95880be4f0 msgr2=0x7f95881d5920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:35.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.389+0000 7f957ffff640 1 --2- 172.21.15.12:0/2087117049 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f95880be4f0 0x7f95881d5920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:35.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.389+0000 7f957ffff640 1 -- 172.21.15.12:0/2087117049 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f958814d0f0 msgr2=0x7f95881498f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:35.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.389+0000 7f957ffff640 1 --2- 172.21.15.12:0/2087117049 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f958814d0f0 0x7f95881498f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:35.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.389+0000 7f957ffff640 1 -- 172.21.15.12:0/2087117049 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95881d5e60 con 0x7f958814cce0 2024-05-15T15:40:35.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.390+0000 7f958759e640 1 --2- 172.21.15.12:0/2087117049 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f958814d0f0 0x7f95881498f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-15T15:40:35.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.390+0000 7f9586d9d640 1 --2- 172.21.15.12:0/2087117049 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f95880be4f0 0x7f95881d5920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-15T15:40:35.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.390+0000 7f957ffff640 1 --2- 172.21.15.12:0/2087117049 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f958814cce0 0x7f958809c4b0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f957000c3d0 tx=0x7f957000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:35.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.390+0000 7f957f7fe640 1 -- 172.21.15.12:0/2087117049 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9570017070 con 0x7f958814cce0 2024-05-15T15:40:35.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.390+0000 7f957f7fe640 1 -- 172.21.15.12:0/2087117049 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95700052d0 con 0x7f958814cce0 2024-05-15T15:40:35.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.390+0000 7f957f7fe640 1 -- 172.21.15.12:0/2087117049 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95700037f0 con 0x7f958814cce0 2024-05-15T15:40:35.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.390+0000 7f958d253640 1 -- 172.21.15.12:0/2087117049 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f958809c9f0 con 0x7f958814cce0 2024-05-15T15:40:35.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.390+0000 7f958d253640 1 -- 172.21.15.12:0/2087117049 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95880a2d20 con 0x7f958814cce0 2024-05-15T15:40:35.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.391+0000 7f958d253640 1 -- 172.21.15.12:0/2087117049 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9588050940 con 0x7f958814cce0 2024-05-15T15:40:35.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.392+0000 7f957f7fe640 1 -- 172.21.15.12:0/2087117049 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f957001a070 con 0x7f958814cce0 2024-05-15T15:40:35.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.392+0000 7f957f7fe640 1 --2- 172.21.15.12:0/2087117049 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f9568076300 0x7f9568078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:35.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.392+0000 7f957f7fe640 1 -- 172.21.15.12:0/2087117049 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f95700968a0 con 0x7f958814cce0 2024-05-15T15:40:35.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.393+0000 7f9586d9d640 1 --2- 172.21.15.12:0/2087117049 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f9568076300 0x7f9568078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:35.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.393+0000 7f9586d9d640 1 --2- 172.21.15.12:0/2087117049 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f9568076300 0x7f9568078810 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f9578034000 tx=0x7f957802e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:35.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.397+0000 7f957f7fe640 1 -- 172.21.15.12:0/2087117049 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f957005fb10 con 0x7f958814cce0 2024-05-15T15:40:35.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.587+0000 7f958d253640 1 -- 172.21.15.12:0/2087117049 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f95880c0e20 con 0x7f958814cce0 2024-05-15T15:40:35.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.589+0000 7f957f7fe640 1 -- 172.21.15.12:0/2087117049 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) ==== 74+0+16573 (secure 0 0 0) 0x7f9570068150 con 0x7f958814cce0 2024-05-15T15:40:35.591 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-05-15T15:40:35.591 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":33,"fsid":"3b7fc4b2-b85c-49b5-a5de-38444eeed40d","created":"2024-05-15T15:39:28.392476+0000","modified":"2024-05-15T15:40:32.843588+0000","last_up_change":"2024-05-15T15:39:39.363983+0000","last_in_change":"2024-05-15T15:39:30.591216+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-15T15:39:40.715999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-05-15T15:40:29.381895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-05-15T15:40:30.183897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0d06a12a-866a-418e-9776-704d74354579","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":3943681952},{"type":"v1","addr":"172.21.15.12:6809","nonce":3943681952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":3943681952},{"type":"v1","addr":"172.21.15.12:6812","nonce":3943681952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":3943681952},{"type":"v1","addr":"172.21.15.12:6821","nonce":3943681952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":3943681952},{"type":"v1","addr":"172.21.15.12:6816","nonce":3943681952}]},"public_addr":"172.21.15.12:6809/3943681952","cluster_addr":"172.21.15.12:6812/3943681952","heartbeat_back_addr":"172.21.15.12:6821/3943681952","heartbeat_front_addr":"172.21.15.12:6816/3943681952","state":["exists","up"]},{"osd":1,"uuid":"09d0fa19-9ef8-4f35-bf99-6e86658c6f10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6811","nonce":1763752148},{"type":"v1","addr":"172.21.15.12:6813","nonce":1763752148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":1763752148},{"type":"v1","addr":"172.21.15.12:6817","nonce":1763752148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":1763752148},{"type":"v1","addr":"172.21.15.12:6827","nonce":1763752148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6819","nonce":1763752148},{"type":"v1","addr":"172.21.15.12:6822","nonce":1763752148}]},"public_addr":"172.21.15.12:6813/1763752148","cluster_addr":"172.21.15.12:6817/1763752148","heartbeat_back_addr":"172.21.15.12:6827/1763752148","heartbeat_front_addr":"172.21.15.12:6822/1763752148","state":["exists","up"]},{"osd":2,"uuid":"b204c6ad-f431-40a5-ba27-9844294f0ece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":2173702802},{"type":"v1","addr":"172.21.15.12:6823","nonce":2173702802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":2173702802},{"type":"v1","addr":"172.21.15.12:6826","nonce":2173702802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":2173702802},{"type":"v1","addr":"172.21.15.12:6831","nonce":2173702802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":2173702802},{"type":"v1","addr":"172.21.15.12:6829","nonce":2173702802}]},"public_addr":"172.21.15.12:6823/2173702802","cluster_addr":"172.21.15.12:6826/2173702802","heartbeat_back_addr":"172.21.15.12:6831/2173702802","heartbeat_front_addr":"172.21.15.12:6829/2173702802","state":["exists","up"]},{"osd":3,"uuid":"660a9ccb-2ee5-42d8-8481-0835047a8260","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":3956443113},{"type":"v1","addr":"172.21.15.12:6801","nonce":3956443113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":3956443113},{"type":"v1","addr":"172.21.15.12:6803","nonce":3956443113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":3956443113},{"type":"v1","addr":"172.21.15.12:6807","nonce":3956443113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":3956443113},{"type":"v1","addr":"172.21.15.12:6805","nonce":3956443113}]},"public_addr":"172.21.15.12:6801/3956443113","cluster_addr":"172.21.15.12:6803/3956443113","heartbeat_back_addr":"172.21.15.12:6807/3956443113","heartbeat_front_addr":"172.21.15.12:6805/3956443113","state":["exists","up"]},{"osd":4,"uuid":"9eef1461-a961-457c-9a78-43b5098a46a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":1021092792},{"type":"v1","addr":"172.21.15.84:6809","nonce":1021092792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":1021092792},{"type":"v1","addr":"172.21.15.84:6811","nonce":1021092792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":1021092792},{"type":"v1","addr":"172.21.15.84:6815","nonce":1021092792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":1021092792},{"type":"v1","addr":"172.21.15.84:6813","nonce":1021092792}]},"public_addr":"172.21.15.84:6809/1021092792","cluster_addr":"172.21.15.84:6811/1021092792","heartbeat_back_addr":"172.21.15.84:6815/1021092792","heartbeat_front_addr":"172.21.15.84:6813/1021092792","state":["exists","up"]},{"osd":5,"uuid":"5f924e2f-6c71-4741-a727-d3710c438431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":3173527851},{"type":"v1","addr":"172.21.15.84:6801","nonce":3173527851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":3173527851},{"type":"v1","addr":"172.21.15.84:6803","nonce":3173527851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":3173527851},{"type":"v1","addr":"172.21.15.84:6807","nonce":3173527851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":3173527851},{"type":"v1","addr":"172.21.15.84:6805","nonce":3173527851}]},"public_addr":"172.21.15.84:6801/3173527851","cluster_addr":"172.21.15.84:6803/3173527851","heartbeat_back_addr":"172.21.15.84:6807/3173527851","heartbeat_front_addr":"172.21.15.84:6805/3173527851","state":["exists","up"]},{"osd":6,"uuid":"efae9975-8c16-4ad3-892f-71f3c59718d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3029180670},{"type":"v1","addr":"172.21.15.84:6817","nonce":3029180670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3029180670},{"type":"v1","addr":"172.21.15.84:6819","nonce":3029180670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3029180670},{"type":"v1","addr":"172.21.15.84:6823","nonce":3029180670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3029180670},{"type":"v1","addr":"172.21.15.84:6821","nonce":3029180670}]},"public_addr":"172.21.15.84:6817/3029180670","cluster_addr":"172.21.15.84:6819/3029180670","heartbeat_back_addr":"172.21.15.84:6823/3029180670","heartbeat_front_addr":"172.21.15.84:6821/3029180670","state":["exists","up"]},{"osd":7,"uuid":"6426efba-ee4d-4e44-83d1-c76c75aec30c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3067620602},{"type":"v1","addr":"172.21.15.84:6825","nonce":3067620602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3067620602},{"type":"v1","addr":"172.21.15.84:6827","nonce":3067620602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":3067620602},{"type":"v1","addr":"172.21.15.84:6831","nonce":3067620602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":3067620602},{"type":"v1","addr":"172.21.15.84:6829","nonce":3067620602}]},"public_addr":"172.21.15.84:6825/3067620602","cluster_addr":"172.21.15.84:6827/3067620602","heartbeat_back_addr":"172.21.15.84:6831/3067620602","heartbeat_front_addr":"172.21.15.84:6829/3067620602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.809514+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.845364+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.762733+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.688597+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.699228+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.747865+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.712415+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.820683+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-15T15:40:35.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.591+0000 7f958d253640 1 -- 172.21.15.12:0/2087117049 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f9568076300 msgr2=0x7f9568078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:35.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.591+0000 7f958d253640 1 --2- 172.21.15.12:0/2087117049 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f9568076300 0x7f9568078810 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f9578034000 tx=0x7f957802e000 comp rx=0 tx=0).stop 2024-05-15T15:40:35.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.591+0000 7f958d253640 1 -- 172.21.15.12:0/2087117049 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f958814cce0 msgr2=0x7f958809c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:35.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.591+0000 7f958d253640 1 --2- 172.21.15.12:0/2087117049 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f958814cce0 0x7f958809c4b0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f957000c3d0 tx=0x7f957000c890 comp rx=0 tx=0).stop 2024-05-15T15:40:35.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.591+0000 7f958d253640 1 -- 172.21.15.12:0/2087117049 shutdown_connections 2024-05-15T15:40:35.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.591+0000 7f958d253640 1 --2- 172.21.15.12:0/2087117049 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f958814d0f0 0x7f95881498f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:35.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.591+0000 7f958d253640 1 --2- 172.21.15.12:0/2087117049 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f9568076300 0x7f9568078810 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:35.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.591+0000 7f958d253640 1 --2- 172.21.15.12:0/2087117049 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f958814cce0 0x7f958809c4b0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:35.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.591+0000 7f958d253640 1 --2- 172.21.15.12:0/2087117049 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f95880be4f0 0x7f95881d5920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:35.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.591+0000 7f958d253640 1 -- 172.21.15.12:0/2087117049 >> 172.21.15.12:0/2087117049 conn(0x7f95880c17c0 msgr2=0x7f95880a4cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:35.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.591+0000 7f958d253640 1 -- 172.21.15.12:0/2087117049 shutdown_connections 2024-05-15T15:40:35.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.591+0000 7f958d253640 1 -- 172.21.15.12:0/2087117049 wait complete. 2024-05-15T15:40:35.604 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-15T15:40:35.605 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-15T15:40:35.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.714+0000 7f9ce257e640 1 Processor -- start 2024-05-15T15:40:35.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.714+0000 7f9ce257e640 1 -- start start 2024-05-15T15:40:35.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.715+0000 7f9ce257e640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f9cdc0be3f0 0x7f9cdc14cb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:35.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.715+0000 7f9ce257e640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f9cdc14fad0 0x7f9cdc14fee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:35.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.715+0000 7f9ce257e640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9cdc0bb890 con 0x7f9cdc074b00 2024-05-15T15:40:35.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.715+0000 7f9ce257e640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f9cdc0bb470 con 0x7f9cdc0be3f0 2024-05-15T15:40:35.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.715+0000 7f9ce257e640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f9cdc0bbb30 con 0x7f9cdc14fad0 2024-05-15T15:40:35.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.715+0000 7f9cdb7fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f9cdc0be3f0 0x7f9cdc14cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:35.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.715+0000 7f9cdbfff640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f9cdc074b00 0x7f9cdc06c8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38344/0 (socket says 172.21.15.12:38344) 2024-05-15T15:40:35.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.715+0000 7f9cdbfff640 1 -- 172.21.15.12:0/1574998056 learned_addr learned my addr 172.21.15.12:0/1574998056 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-05-15T15:40:35.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.716+0000 7f9ce0b1b640 1 --2- 172.21.15.12:0/1574998056 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f9cdc14fad0 0x7f9cdc14fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:35.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.716+0000 7f9cdb7fe640 1 -- 172.21.15.12:0/1574998056 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f9cdc14fad0 msgr2=0x7f9cdc14fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:40:35.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.716+0000 7f9cdb7fe640 1 --2- 172.21.15.12:0/1574998056 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f9cdc14fad0 0x7f9cdc14fee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:35.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.716+0000 7f9cdb7fe640 1 -- 172.21.15.12:0/1574998056 >> v1:172.21.15.12:6789/0 conn(0x7f9cdc074b00 legacy=0x7f9cdc06c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:35.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.716+0000 7f9cdb7fe640 1 -- 172.21.15.12:0/1574998056 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cdc0bbe10 con 0x7f9cdc0be3f0 2024-05-15T15:40:35.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.716+0000 7f9cdaffd640 1 -- 172.21.15.12:0/1574998056 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1101547607 0 0) 0x7f9cdc0bb890 con 0x7f9cdc074b00 2024-05-15T15:40:35.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.717+0000 7f9cdb7fe640 1 --2- 172.21.15.12:0/1574998056 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9cdc0be3f0 0x7f9cdc14cb20 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f9ccc0097a0 tx=0x7f9ccc02a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=135fbd631796bd24 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:35.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.717+0000 7f9cdaffd640 1 -- 172.21.15.12:0/1574998056 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ccc037070 con 0x7f9cdc0be3f0 2024-05-15T15:40:35.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.717+0000 7f9cdaffd640 1 -- 172.21.15.12:0/1574998056 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ccc02ae50 con 0x7f9cdc0be3f0 2024-05-15T15:40:35.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.717+0000 7f9cdaffd640 1 -- 172.21.15.12:0/1574998056 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ccc032660 con 0x7f9cdc0be3f0 2024-05-15T15:40:35.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.717+0000 7f9ce257e640 1 -- 172.21.15.12:0/1574998056 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9cdc0be3f0 msgr2=0x7f9cdc14cb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:35.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.717+0000 7f9ce257e640 1 --2- 172.21.15.12:0/1574998056 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9cdc0be3f0 0x7f9cdc14cb20 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f9ccc0097a0 tx=0x7f9ccc02a100 comp rx=0 tx=0).stop 2024-05-15T15:40:35.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.717+0000 7f9ce257e640 1 -- 172.21.15.12:0/1574998056 shutdown_connections 2024-05-15T15:40:35.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.717+0000 7f9ce257e640 1 --2- 172.21.15.12:0/1574998056 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f9cdc14fad0 0x7f9cdc14fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:35.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.717+0000 7f9ce257e640 1 --2- 172.21.15.12:0/1574998056 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9cdc0be3f0 0x7f9cdc14cb20 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:35.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.717+0000 7f9ce257e640 1 -- 172.21.15.12:0/1574998056 >> 172.21.15.12:0/1574998056 conn(0x7f9cdc0bd0f0 msgr2=0x7f9cdc0bd500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:35.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.717+0000 7f9ce257e640 1 -- 172.21.15.12:0/1574998056 shutdown_connections 2024-05-15T15:40:35.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.717+0000 7f9ce257e640 1 -- 172.21.15.12:0/1574998056 wait complete. 2024-05-15T15:40:35.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.719+0000 7f9ce257e640 1 Processor -- start 2024-05-15T15:40:35.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.719+0000 7f9ce257e640 1 -- start start 2024-05-15T15:40:35.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.720+0000 7f9ce257e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9cdc074b00 0x7f9cdc1419f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:35.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.720+0000 7f9ce257e640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f9cdc0be3f0 0x7f9cdc1e6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:35.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.720+0000 7f9ce257e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9cdc14fad0 0x7f9cdc13fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:35.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.720+0000 7f9ce257e640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f9cdc0bc3d0 con 0x7f9cdc074b00 2024-05-15T15:40:35.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.720+0000 7f9ce257e640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f9cdc150420 con 0x7f9cdc14fad0 2024-05-15T15:40:35.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.720+0000 7f9ce257e640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f9cdc14d060 con 0x7f9cdc0be3f0 2024-05-15T15:40:35.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.720+0000 7f9cdbfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9cdc074b00 0x7f9cdc1419f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:35.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.720+0000 7f9cdbfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9cdc074b00 0x7f9cdc1419f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47158/0 (socket says 172.21.15.12:47158) 2024-05-15T15:40:35.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.720+0000 7f9cdbfff640 1 -- 172.21.15.12:0/1728349954 learned_addr learned my addr 172.21.15.12:0/1728349954 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:35.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.720+0000 7f9cdb7fe640 1 --2- 172.21.15.12:0/1728349954 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f9cdc0be3f0 0x7f9cdc1e6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:35.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.720+0000 7f9ce0b1b640 1 --2- 172.21.15.12:0/1728349954 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9cdc14fad0 0x7f9cdc13fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:35.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.721+0000 7f9cdbfff640 1 -- 172.21.15.12:0/1728349954 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f9cdc0be3f0 msgr2=0x7f9cdc1e6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:35.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.721+0000 7f9cdbfff640 1 --2- 172.21.15.12:0/1728349954 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f9cdc0be3f0 0x7f9cdc1e6130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:35.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.721+0000 7f9cdbfff640 1 -- 172.21.15.12:0/1728349954 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9cdc14fad0 msgr2=0x7f9cdc13fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:35.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.721+0000 7f9cdbfff640 1 --2- 172.21.15.12:0/1728349954 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9cdc14fad0 0x7f9cdc13fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:35.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.721+0000 7f9cdbfff640 1 -- 172.21.15.12:0/1728349954 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cdc141f30 con 0x7f9cdc074b00 2024-05-15T15:40:35.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.721+0000 7f9cdbfff640 1 --2- 172.21.15.12:0/1728349954 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9cdc074b00 0x7f9cdc1419f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f9cd000c410 tx=0x7f9cd000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:35.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.721+0000 7f9cd8ff9640 1 -- 172.21.15.12:0/1728349954 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cd00074e0 con 0x7f9cdc074b00 2024-05-15T15:40:35.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.721+0000 7f9cd8ff9640 1 -- 172.21.15.12:0/1728349954 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cd00047e0 con 0x7f9cdc074b00 2024-05-15T15:40:35.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.721+0000 7f9cd8ff9640 1 -- 172.21.15.12:0/1728349954 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cd0004bd0 con 0x7f9cdc074b00 2024-05-15T15:40:35.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.721+0000 7f9ce257e640 1 -- 172.21.15.12:0/1728349954 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cdc148b80 con 0x7f9cdc074b00 2024-05-15T15:40:35.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.721+0000 7f9ce257e640 1 -- 172.21.15.12:0/1728349954 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cdc14e2b0 con 0x7f9cdc074b00 2024-05-15T15:40:35.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.722+0000 7f9ce257e640 1 -- 172.21.15.12:0/1728349954 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9cdc143410 con 0x7f9cdc074b00 2024-05-15T15:40:35.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.723+0000 7f9cd8ff9640 1 -- 172.21.15.12:0/1728349954 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f9cd0011070 con 0x7f9cdc074b00 2024-05-15T15:40:35.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.723+0000 7f9cd8ff9640 1 --2- 172.21.15.12:0/1728349954 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f9cc8076300 0x7f9cc8078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:35.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.723+0000 7f9cd8ff9640 1 -- 172.21.15.12:0/1728349954 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f9cd0097100 con 0x7f9cdc074b00 2024-05-15T15:40:35.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.723+0000 7f9cdb7fe640 1 --2- 172.21.15.12:0/1728349954 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f9cc8076300 0x7f9cc8078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:35.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.724+0000 7f9cdb7fe640 1 --2- 172.21.15.12:0/1728349954 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f9cc8076300 0x7f9cc8078810 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f9ccc034000 tx=0x7f9ccc02e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:35.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.728+0000 7f9cd8ff9640 1 -- 172.21.15.12:0/1728349954 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f9cdc143410 con 0x7f9cdc074b00 2024-05-15T15:40:35.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.914+0000 7f9ce257e640 1 -- 172.21.15.12:0/1728349954 --> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9cdc14cd30 con 0x7f9cc8076300 2024-05-15T15:40:35.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.921+0000 7f9cd8ff9640 1 -- 172.21.15.12:0/1728349954 <== mgr.4106 v2:172.21.15.84:6832/4173299311 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+238625 (secure 0 0 0) 0x7f9cdc14cd30 con 0x7f9cc8076300 2024-05-15T15:40:35.925 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-05-15T15:40:35.926 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-05-15T15:40:35.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.923+0000 7f9ce257e640 1 -- 172.21.15.12:0/1728349954 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f9cc8076300 msgr2=0x7f9cc8078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:35.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.923+0000 7f9ce257e640 1 --2- 172.21.15.12:0/1728349954 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f9cc8076300 0x7f9cc8078810 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f9ccc034000 tx=0x7f9ccc02e000 comp rx=0 tx=0).stop 2024-05-15T15:40:35.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.923+0000 7f9ce257e640 1 -- 172.21.15.12:0/1728349954 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9cdc074b00 msgr2=0x7f9cdc1419f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:35.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.923+0000 7f9ce257e640 1 --2- 172.21.15.12:0/1728349954 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9cdc074b00 0x7f9cdc1419f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f9cd000c410 tx=0x7f9cd000c8d0 comp rx=0 tx=0).stop 2024-05-15T15:40:35.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.923+0000 7f9ce257e640 1 -- 172.21.15.12:0/1728349954 shutdown_connections 2024-05-15T15:40:35.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.923+0000 7f9ce257e640 1 --2- 172.21.15.12:0/1728349954 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9cdc14fad0 0x7f9cdc13fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:35.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.923+0000 7f9ce257e640 1 --2- 172.21.15.12:0/1728349954 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f9cdc0be3f0 0x7f9cdc1e6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:35.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.923+0000 7f9ce257e640 1 --2- 172.21.15.12:0/1728349954 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f9cc8076300 0x7f9cc8078810 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:35.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.923+0000 7f9ce257e640 1 --2- 172.21.15.12:0/1728349954 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9cdc074b00 0x7f9cdc1419f0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:35.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.923+0000 7f9ce257e640 1 -- 172.21.15.12:0/1728349954 >> 172.21.15.12:0/1728349954 conn(0x7f9cdc0bd0f0 msgr2=0x7f9cdc142960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:35.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.924+0000 7f9ce257e640 1 -- 172.21.15.12:0/1728349954 shutdown_connections 2024-05-15T15:40:35.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:35.924+0000 7f9ce257e640 1 -- 172.21.15.12:0/1728349954 wait complete. 2024-05-15T15:40:35.937 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":55,"stamp":"2024-05-15T15:40:34.711286+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":36,"acting":36,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":20,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":3,"kb":754974720,"kb_used":219844,"kb_used_data":3648,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754876,"statfs":{"total":773094113280,"available":772868993024,"internally_reserved":0,"allocated":3735552,"data_stored":2106516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.874290"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-15T15:40:30.850054+0000","last_change":"2024-05-15T15:40:30.850054+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.850054+0000","last_undegraded":"2024-05-15T15:40:30.850054+0000","last_fullsized":"2024-05-15T15:40:30.850054+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-15T15:40:30.848792+0000","last_change":"2024-05-15T15:40:30.848792+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.848792+0000","last_undegraded":"2024-05-15T15:40:30.848792+0000","last_fullsized":"2024-05-15T15:40:30.848792+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-15T15:40:30.847400+0000","last_change":"2024-05-15T15:40:30.847400+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.847400+0000","last_undegraded":"2024-05-15T15:40:30.847400+0000","last_fullsized":"2024-05-15T15:40:30.847400+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-15T15:40:30.848183+0000","last_change":"2024-05-15T15:40:30.848183+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.848183+0000","last_undegraded":"2024-05-15T15:40:30.848183+0000","last_fullsized":"2024-05-15T15:40:30.848183+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-15T15:40:30.847665+0000","last_change":"2024-05-15T15:40:30.847665+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.847665+0000","last_undegraded":"2024-05-15T15:40:30.847665+0000","last_fullsized":"2024-05-15T15:40:30.847665+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:29.829984+0000","last_change":"2024-05-15T15:40:29.829984+0000","last_active":"2024-05-15T15:40:29.829984+0000","last_peered":"2024-05-15T15:40:29.829984+0000","last_clean":"2024-05-15T15:40:29.829984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:29.829984+0000","last_undegraded":"2024-05-15T15:40:29.829984+0000","last_fullsized":"2024-05-15T15:40:29.829984+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T15:40:30.871791+0000","last_change":"2024-05-15T15:40:30.866859+0000","last_active":"2024-05-15T15:40:30.871791+0000","last_peered":"2024-05-15T15:40:30.871791+0000","last_clean":"2024-05-15T15:40:30.871791+0000","last_became_active":"2024-05-15T15:40:30.866428+0000","last_became_peered":"2024-05-15T15:40:30.866428+0000","last_unstale":"2024-05-15T15:40:30.871791+0000","last_undegraded":"2024-05-15T15:40:30.871791+0000","last_fullsized":"2024-05-15T15:40:30.871791+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:58:01.392397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:29.829984+0000","last_change":"2024-05-15T15:40:29.829984+0000","last_active":"2024-05-15T15:40:29.829984+0000","last_peered":"2024-05-15T15:40:29.829984+0000","last_clean":"2024-05-15T15:40:29.829984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:29.829984+0000","last_undegraded":"2024-05-15T15:40:29.829984+0000","last_fullsized":"2024-05-15T15:40:29.829984+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-15T15:40:30.846972+0000","last_change":"2024-05-15T15:40:30.846972+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.846972+0000","last_undegraded":"2024-05-15T15:40:30.846972+0000","last_fullsized":"2024-05-15T15:40:30.846972+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T15:40:30.866089+0000","last_change":"2024-05-15T15:40:30.857947+0000","last_active":"2024-05-15T15:40:30.866089+0000","last_peered":"2024-05-15T15:40:30.866089+0000","last_clean":"2024-05-15T15:40:30.866089+0000","last_became_active":"2024-05-15T15:40:30.857649+0000","last_became_peered":"2024-05-15T15:40:30.857649+0000","last_unstale":"2024-05-15T15:40:30.866089+0000","last_undegraded":"2024-05-15T15:40:30.866089+0000","last_fullsized":"2024-05-15T15:40:30.866089+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:00:02.621628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:29.829984+0000","last_change":"2024-05-15T15:40:29.829984+0000","last_active":"2024-05-15T15:40:29.829984+0000","last_peered":"2024-05-15T15:40:29.829984+0000","last_clean":"2024-05-15T15:40:29.829984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:29.829984+0000","last_undegraded":"2024-05-15T15:40:29.829984+0000","last_fullsized":"2024-05-15T15:40:29.829984+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:29.829984+0000","last_change":"2024-05-15T15:40:29.829984+0000","last_active":"2024-05-15T15:40:29.829984+0000","last_peered":"2024-05-15T15:40:29.829984+0000","last_clean":"2024-05-15T15:40:29.829984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:29.829984+0000","last_undegraded":"2024-05-15T15:40:29.829984+0000","last_fullsized":"2024-05-15T15:40:29.829984+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:29.829984+0000","last_change":"2024-05-15T15:40:29.829984+0000","last_active":"2024-05-15T15:40:29.829984+0000","last_peered":"2024-05-15T15:40:29.829984+0000","last_clean":"2024-05-15T15:40:29.829984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:29.829984+0000","last_undegraded":"2024-05-15T15:40:29.829984+0000","last_fullsized":"2024-05-15T15:40:29.829984+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-15T15:40:30.845746+0000","last_change":"2024-05-15T15:40:30.845746+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.845746+0000","last_undegraded":"2024-05-15T15:40:30.845746+0000","last_fullsized":"2024-05-15T15:40:30.845746+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:29.829984+0000","last_change":"2024-05-15T15:40:29.829984+0000","last_active":"2024-05-15T15:40:29.829984+0000","last_peered":"2024-05-15T15:40:29.829984+0000","last_clean":"2024-05-15T15:40:29.829984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:29.829984+0000","last_undegraded":"2024-05-15T15:40:29.829984+0000","last_fullsized":"2024-05-15T15:40:29.829984+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:29.829984+0000","last_change":"2024-05-15T15:40:29.829984+0000","last_active":"2024-05-15T15:40:29.829984+0000","last_peered":"2024-05-15T15:40:29.829984+0000","last_clean":"2024-05-15T15:40:29.829984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:29.829984+0000","last_undegraded":"2024-05-15T15:40:29.829984+0000","last_fullsized":"2024-05-15T15:40:29.829984+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-15T15:40:30.845968+0000","last_change":"2024-05-15T15:40:30.845968+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.845968+0000","last_undegraded":"2024-05-15T15:40:30.845968+0000","last_fullsized":"2024-05-15T15:40:30.845968+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:29.829984+0000","last_change":"2024-05-15T15:40:29.829984+0000","last_active":"2024-05-15T15:40:29.829984+0000","last_peered":"2024-05-15T15:40:29.829984+0000","last_clean":"2024-05-15T15:40:29.829984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:29.829984+0000","last_undegraded":"2024-05-15T15:40:29.829984+0000","last_fullsized":"2024-05-15T15:40:29.829984+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-15T15:40:30.849029+0000","last_change":"2024-05-15T15:40:30.849029+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.849029+0000","last_undegraded":"2024-05-15T15:40:30.849029+0000","last_fullsized":"2024-05-15T15:40:30.849029+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:29.829984+0000","last_change":"2024-05-15T15:40:29.829984+0000","last_active":"2024-05-15T15:40:29.829984+0000","last_peered":"2024-05-15T15:40:29.829984+0000","last_clean":"2024-05-15T15:40:29.829984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:29.829984+0000","last_undegraded":"2024-05-15T15:40:29.829984+0000","last_fullsized":"2024-05-15T15:40:29.829984+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:29.829984+0000","last_change":"2024-05-15T15:40:29.829984+0000","last_active":"2024-05-15T15:40:29.829984+0000","last_peered":"2024-05-15T15:40:29.829984+0000","last_clean":"2024-05-15T15:40:29.829984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:29.829984+0000","last_undegraded":"2024-05-15T15:40:29.829984+0000","last_fullsized":"2024-05-15T15:40:29.829984+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:29.829984+0000","last_change":"2024-05-15T15:40:29.829984+0000","last_active":"2024-05-15T15:40:29.829984+0000","last_peered":"2024-05-15T15:40:29.829984+0000","last_clean":"2024-05-15T15:40:29.829984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:29.829984+0000","last_undegraded":"2024-05-15T15:40:29.829984+0000","last_fullsized":"2024-05-15T15:40:29.829984+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-15T15:40:30.846550+0000","last_change":"2024-05-15T15:40:30.846550+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.846550+0000","last_undegraded":"2024-05-15T15:40:30.846550+0000","last_fullsized":"2024-05-15T15:40:30.846550+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T15:40:30.866023+0000","last_change":"2024-05-15T15:40:30.856989+0000","last_active":"2024-05-15T15:40:30.866023+0000","last_peered":"2024-05-15T15:40:30.866023+0000","last_clean":"2024-05-15T15:40:30.866023+0000","last_became_active":"2024-05-15T15:40:30.856464+0000","last_became_peered":"2024-05-15T15:40:30.856464+0000","last_unstale":"2024-05-15T15:40:30.866023+0000","last_undegraded":"2024-05-15T15:40:30.866023+0000","last_fullsized":"2024-05-15T15:40:30.866023+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:01:01.491109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T15:40:30.865968+0000","last_change":"2024-05-15T15:40:30.856323+0000","last_active":"2024-05-15T15:40:30.865968+0000","last_peered":"2024-05-15T15:40:30.865968+0000","last_clean":"2024-05-15T15:40:30.865968+0000","last_became_active":"2024-05-15T15:40:30.856001+0000","last_became_peered":"2024-05-15T15:40:30.856001+0000","last_unstale":"2024-05-15T15:40:30.865968+0000","last_undegraded":"2024-05-15T15:40:30.865968+0000","last_fullsized":"2024-05-15T15:40:30.865968+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:50:04.108918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:29.829984+0000","last_change":"2024-05-15T15:40:29.829984+0000","last_active":"2024-05-15T15:40:29.829984+0000","last_peered":"2024-05-15T15:40:29.829984+0000","last_clean":"2024-05-15T15:40:29.829984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:29.829984+0000","last_undegraded":"2024-05-15T15:40:29.829984+0000","last_fullsized":"2024-05-15T15:40:29.829984+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:29.829984+0000","last_change":"2024-05-15T15:40:29.829984+0000","last_active":"2024-05-15T15:40:29.829984+0000","last_peered":"2024-05-15T15:40:29.829984+0000","last_clean":"2024-05-15T15:40:29.829984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:29.829984+0000","last_undegraded":"2024-05-15T15:40:29.829984+0000","last_fullsized":"2024-05-15T15:40:29.829984+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:29.829984+0000","last_change":"2024-05-15T15:40:29.829984+0000","last_active":"2024-05-15T15:40:29.829984+0000","last_peered":"2024-05-15T15:40:29.829984+0000","last_clean":"2024-05-15T15:40:29.829984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:29.829984+0000","last_undegraded":"2024-05-15T15:40:29.829984+0000","last_fullsized":"2024-05-15T15:40:29.829984+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:29.829984+0000","last_change":"2024-05-15T15:40:29.829984+0000","last_active":"2024-05-15T15:40:29.829984+0000","last_peered":"2024-05-15T15:40:29.829984+0000","last_clean":"2024-05-15T15:40:29.829984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:29.829984+0000","last_undegraded":"2024-05-15T15:40:29.829984+0000","last_fullsized":"2024-05-15T15:40:29.829984+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:29.829984+0000","last_change":"2024-05-15T15:40:29.829984+0000","last_active":"2024-05-15T15:40:29.829984+0000","last_peered":"2024-05-15T15:40:29.829984+0000","last_clean":"2024-05-15T15:40:29.829984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:29.829984+0000","last_undegraded":"2024-05-15T15:40:29.829984+0000","last_fullsized":"2024-05-15T15:40:29.829984+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:29.829984+0000","last_change":"2024-05-15T15:40:29.829984+0000","last_active":"2024-05-15T15:40:29.829984+0000","last_peered":"2024-05-15T15:40:29.829984+0000","last_clean":"2024-05-15T15:40:29.829984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:29.829984+0000","last_undegraded":"2024-05-15T15:40:29.829984+0000","last_fullsized":"2024-05-15T15:40:29.829984+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:29.829984+0000","last_change":"2024-05-15T15:40:29.829984+0000","last_active":"2024-05-15T15:40:29.829984+0000","last_peered":"2024-05-15T15:40:29.829984+0000","last_clean":"2024-05-15T15:40:29.829984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:29.829984+0000","last_undegraded":"2024-05-15T15:40:29.829984+0000","last_fullsized":"2024-05-15T15:40:29.829984+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:29.829984+0000","last_change":"2024-05-15T15:40:29.829984+0000","last_active":"2024-05-15T15:40:29.829984+0000","last_peered":"2024-05-15T15:40:29.829984+0000","last_clean":"2024-05-15T15:40:29.829984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:29.829984+0000","last_undegraded":"2024-05-15T15:40:29.829984+0000","last_fullsized":"2024-05-15T15:40:29.829984+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:29.829984+0000","last_change":"2024-05-15T15:40:29.829984+0000","last_active":"2024-05-15T15:40:29.829984+0000","last_peered":"2024-05-15T15:40:29.829984+0000","last_clean":"2024-05-15T15:40:29.829984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:29.829984+0000","last_undegraded":"2024-05-15T15:40:29.829984+0000","last_fullsized":"2024-05-15T15:40:29.829984+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:29.829984+0000","last_change":"2024-05-15T15:40:29.829984+0000","last_active":"2024-05-15T15:40:29.829984+0000","last_peered":"2024-05-15T15:40:29.829984+0000","last_clean":"2024-05-15T15:40:29.829984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:29.829984+0000","last_undegraded":"2024-05-15T15:40:29.829984+0000","last_fullsized":"2024-05-15T15:40:29.829984+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:29.829984+0000","last_change":"2024-05-15T15:40:29.829984+0000","last_active":"2024-05-15T15:40:29.829984+0000","last_peered":"2024-05-15T15:40:29.829984+0000","last_clean":"2024-05-15T15:40:29.829984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:29.829984+0000","last_undegraded":"2024-05-15T15:40:29.829984+0000","last_fullsized":"2024-05-15T15:40:29.829984+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:29.829984+0000","last_change":"2024-05-15T15:40:29.829984+0000","last_active":"2024-05-15T15:40:29.829984+0000","last_peered":"2024-05-15T15:40:29.829984+0000","last_clean":"2024-05-15T15:40:29.829984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:29.829984+0000","last_undegraded":"2024-05-15T15:40:29.829984+0000","last_fullsized":"2024-05-15T15:40:29.829984+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:29.829984+0000","last_change":"2024-05-15T15:40:29.829984+0000","last_active":"2024-05-15T15:40:29.829984+0000","last_peered":"2024-05-15T15:40:29.829984+0000","last_clean":"2024-05-15T15:40:29.829984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:29.829984+0000","last_undegraded":"2024-05-15T15:40:29.829984+0000","last_fullsized":"2024-05-15T15:40:29.829984+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-15T15:40:30.845726+0000","last_change":"2024-05-15T15:40:30.845726+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.845726+0000","last_undegraded":"2024-05-15T15:40:30.845726+0000","last_fullsized":"2024-05-15T15:40:30.845726+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:29.829984+0000","last_change":"2024-05-15T15:40:29.829984+0000","last_active":"2024-05-15T15:40:29.829984+0000","last_peered":"2024-05-15T15:40:29.829984+0000","last_clean":"2024-05-15T15:40:29.829984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:29.829984+0000","last_undegraded":"2024-05-15T15:40:29.829984+0000","last_fullsized":"2024-05-15T15:40:29.829984+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-15T15:40:30.845709+0000","last_change":"2024-05-15T15:40:30.845709+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.845709+0000","last_undegraded":"2024-05-15T15:40:30.845709+0000","last_fullsized":"2024-05-15T15:40:30.845709+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:29.829984+0000","last_change":"2024-05-15T15:40:29.829984+0000","last_active":"2024-05-15T15:40:29.829984+0000","last_peered":"2024-05-15T15:40:29.829984+0000","last_clean":"2024-05-15T15:40:29.829984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:29.829984+0000","last_undegraded":"2024-05-15T15:40:29.829984+0000","last_fullsized":"2024-05-15T15:40:29.829984+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T15:40:30.871786+0000","last_change":"2024-05-15T15:40:30.866837+0000","last_active":"2024-05-15T15:40:30.871786+0000","last_peered":"2024-05-15T15:40:30.871786+0000","last_clean":"2024-05-15T15:40:30.871786+0000","last_became_active":"2024-05-15T15:40:30.866530+0000","last_became_peered":"2024-05-15T15:40:30.866530+0000","last_unstale":"2024-05-15T15:40:30.871786+0000","last_undegraded":"2024-05-15T15:40:30.871786+0000","last_fullsized":"2024-05-15T15:40:30.871786+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:12:17.658105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:29.829984+0000","last_change":"2024-05-15T15:40:29.829984+0000","last_active":"2024-05-15T15:40:29.829984+0000","last_peered":"2024-05-15T15:40:29.829984+0000","last_clean":"2024-05-15T15:40:29.829984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:29.829984+0000","last_undegraded":"2024-05-15T15:40:29.829984+0000","last_fullsized":"2024-05-15T15:40:29.829984+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":121,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-15T15:40:25.836750+0000","last_change":"2024-05-15T15:39:42.584601+0000","last_active":"2024-05-15T15:40:25.836750+0000","last_peered":"2024-05-15T15:40:25.836750+0000","last_clean":"2024-05-15T15:40:25.836750+0000","last_became_active":"2024-05-15T15:39:42.584129+0000","last_became_peered":"2024-05-15T15:39:42.584129+0000","last_unstale":"2024-05-15T15:40:25.836750+0000","last_undegraded":"2024-05-15T15:40:25.836750+0000","last_fullsized":"2024-05-15T15:40:25.836750+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:41.378107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:41.378107+0000","last_clean_scrub_stamp":"2024-05-15T15:39:41.378107+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:23:25.285669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":1},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":10,"acting":10,"num_store_stats":1},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509453,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27328,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":315392,"data_stored":114211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509453,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27332,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":315392,"data_stored":114211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509454,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27908,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343932,"statfs":{"total":96636764160,"available":96608186368,"internally_reserved":0,"allocated":909312,"data_stored":704579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509453,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27340,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":315392,"data_stored":114211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509453,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27336,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":315392,"data_stored":114211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509454,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27920,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343920,"statfs":{"total":96636764160,"available":96608174080,"internally_reserved":0,"allocated":909312,"data_stored":704579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509453,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27328,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":315392,"data_stored":114211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":339968,"data_stored":126303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-15T15:40:35.943 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-15T15:40:36.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.086+0000 7f8cff8f0640 1 Processor -- start 2024-05-15T15:40:36.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.086+0000 7f8cff8f0640 1 -- start start 2024-05-15T15:40:36.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.087+0000 7f8cff8f0640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8cf80bd6d0 0x7f8cf80be940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:36.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.087+0000 7f8cff8f0640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8cf80bee80 0x7f8cf8158e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:36.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.087+0000 7f8cff8f0640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8cf806e140 con 0x7f8cf8151fc0 2024-05-15T15:40:36.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.087+0000 7f8cff8f0640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f8cf80c36f0 con 0x7f8cf80bd6d0 2024-05-15T15:40:36.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.087+0000 7f8cff8f0640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f8cf8152530 con 0x7f8cf80bee80 2024-05-15T15:40:36.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.088+0000 7f8cfce8b640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8cf80bd6d0 0x7f8cf80be940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:36.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.088+0000 7f8cfce8b640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8cf80bd6d0 0x7f8cf80be940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47172/0 (socket says 172.21.15.12:47172) 2024-05-15T15:40:36.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.088+0000 7f8cfce8b640 1 -- 172.21.15.12:0/2001188208 learned_addr learned my addr 172.21.15.12:0/2001188208 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:36.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.088+0000 7f8cfde8d640 1 --2- 172.21.15.12:0/2001188208 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8cf80bee80 0x7f8cf8158e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:36.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.088+0000 7f8cfce8b640 1 -- 172.21.15.12:0/2001188208 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8cf80bee80 msgr2=0x7f8cf8158e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:40:36.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.088+0000 7f8cfce8b640 1 --2- 172.21.15.12:0/2001188208 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8cf80bee80 0x7f8cf8158e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:36.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.088+0000 7f8cfce8b640 1 -- 172.21.15.12:0/2001188208 >> v1:172.21.15.84:6789/0 conn(0x7f8cf8151fc0 legacy=0x7f8cf806da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:36.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.088+0000 7f8cfce8b640 1 -- 172.21.15.12:0/2001188208 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cf8152810 con 0x7f8cf80bd6d0 2024-05-15T15:40:36.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.089+0000 7f8cfce8b640 1 --2- 172.21.15.12:0/2001188208 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8cf80bd6d0 0x7f8cf80be940 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f8cec009870 tx=0x7f8cec02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a14ba0cfd3295d1e server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:36.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.089+0000 7f8cf7fff640 1 -- 172.21.15.12:0/2001188208 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cec037070 con 0x7f8cf80bd6d0 2024-05-15T15:40:36.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.089+0000 7f8cf7fff640 1 -- 172.21.15.12:0/2001188208 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cec032440 con 0x7f8cf80bd6d0 2024-05-15T15:40:36.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.089+0000 7f8cf7fff640 1 -- 172.21.15.12:0/2001188208 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cec032810 con 0x7f8cf80bd6d0 2024-05-15T15:40:36.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.089+0000 7f8cff8f0640 1 -- 172.21.15.12:0/2001188208 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8cf80bd6d0 msgr2=0x7f8cf80be940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:36.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.089+0000 7f8cff8f0640 1 --2- 172.21.15.12:0/2001188208 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8cf80bd6d0 0x7f8cf80be940 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f8cec009870 tx=0x7f8cec02a270 comp rx=0 tx=0).stop 2024-05-15T15:40:36.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.089+0000 7f8cff8f0640 1 -- 172.21.15.12:0/2001188208 shutdown_connections 2024-05-15T15:40:36.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.089+0000 7f8cff8f0640 1 --2- 172.21.15.12:0/2001188208 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8cf80bee80 0x7f8cf8158e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:36.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.089+0000 7f8cff8f0640 1 --2- 172.21.15.12:0/2001188208 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8cf80bd6d0 0x7f8cf80be940 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:36.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.089+0000 7f8cff8f0640 1 -- 172.21.15.12:0/2001188208 >> 172.21.15.12:0/2001188208 conn(0x7f8cf80c3d20 msgr2=0x7f8cf80c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:36.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.090+0000 7f8cff8f0640 1 -- 172.21.15.12:0/2001188208 shutdown_connections 2024-05-15T15:40:36.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.090+0000 7f8cff8f0640 1 -- 172.21.15.12:0/2001188208 wait complete. 2024-05-15T15:40:36.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.091+0000 7f8cff8f0640 1 Processor -- start 2024-05-15T15:40:36.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.091+0000 7f8cff8f0640 1 -- start start 2024-05-15T15:40:36.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.092+0000 7f8cff8f0640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8cf80bd6d0 0x7f8cf8148a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:36.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.092+0000 7f8cff8f0640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8cf80bee80 0x7f8cf814e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:36.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.092+0000 7f8cff8f0640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8cf8151fc0 0x7f8cf81e7890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:36.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.092+0000 7f8cff8f0640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f8cf80bdae0 con 0x7f8cf80bd6d0 2024-05-15T15:40:36.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.092+0000 7f8cff8f0640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f8cf80c0070 con 0x7f8cf8151fc0 2024-05-15T15:40:36.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.092+0000 7f8cff8f0640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f8cf80a2ed0 con 0x7f8cf80bee80 2024-05-15T15:40:36.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.092+0000 7f8cfd68c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8cf80bd6d0 0x7f8cf8148a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:36.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.092+0000 7f8cfd68c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8cf80bd6d0 0x7f8cf8148a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47182/0 (socket says 172.21.15.12:47182) 2024-05-15T15:40:36.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.092+0000 7f8cfd68c640 1 -- 172.21.15.12:0/359769074 learned_addr learned my addr 172.21.15.12:0/359769074 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:36.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.092+0000 7f8cfde8d640 1 --2- 172.21.15.12:0/359769074 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8cf8151fc0 0x7f8cf81e7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:36.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.092+0000 7f8cfce8b640 1 --2- 172.21.15.12:0/359769074 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8cf80bee80 0x7f8cf814e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:36.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.093+0000 7f8cfd68c640 1 -- 172.21.15.12:0/359769074 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8cf80bee80 msgr2=0x7f8cf814e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:36.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.093+0000 7f8cfd68c640 1 --2- 172.21.15.12:0/359769074 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8cf80bee80 0x7f8cf814e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:36.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.093+0000 7f8cfd68c640 1 -- 172.21.15.12:0/359769074 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8cf8151fc0 msgr2=0x7f8cf81e7890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:36.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.093+0000 7f8cfd68c640 1 --2- 172.21.15.12:0/359769074 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8cf8151fc0 0x7f8cf81e7890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:36.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.093+0000 7f8cfd68c640 1 -- 172.21.15.12:0/359769074 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cf80a6500 con 0x7f8cf80bd6d0 2024-05-15T15:40:36.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.093+0000 7f8cfd68c640 1 --2- 172.21.15.12:0/359769074 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8cf80bd6d0 0x7f8cf8148a20 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f8ce800c7b0 tx=0x7f8ce800cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:36.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.093+0000 7f8cf5ffb640 1 -- 172.21.15.12:0/359769074 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ce8003b70 con 0x7f8cf80bd6d0 2024-05-15T15:40:36.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.093+0000 7f8cf5ffb640 1 -- 172.21.15.12:0/359769074 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ce8003d10 con 0x7f8cf80bd6d0 2024-05-15T15:40:36.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.093+0000 7f8cff8f0640 1 -- 172.21.15.12:0/359769074 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cf814e520 con 0x7f8cf80bd6d0 2024-05-15T15:40:36.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.093+0000 7f8cf5ffb640 1 -- 172.21.15.12:0/359769074 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ce800aa70 con 0x7f8cf80bd6d0 2024-05-15T15:40:36.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.093+0000 7f8cff8f0640 1 -- 172.21.15.12:0/359769074 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cf814d370 con 0x7f8cf80bd6d0 2024-05-15T15:40:36.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.094+0000 7f8cff8f0640 1 -- 172.21.15.12:0/359769074 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8cf8050940 con 0x7f8cf80bd6d0 2024-05-15T15:40:36.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.095+0000 7f8cf5ffb640 1 -- 172.21.15.12:0/359769074 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8ce800ac10 con 0x7f8cf80bd6d0 2024-05-15T15:40:36.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.095+0000 7f8cf5ffb640 1 --2- 172.21.15.12:0/359769074 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f8ce40762d0 0x7f8ce40787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:36.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.095+0000 7f8cf5ffb640 1 -- 172.21.15.12:0/359769074 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f8ce80973e0 con 0x7f8cf80bd6d0 2024-05-15T15:40:36.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.096+0000 7f8cfce8b640 1 --2- 172.21.15.12:0/359769074 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f8ce40762d0 0x7f8ce40787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:36.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.096+0000 7f8cfce8b640 1 --2- 172.21.15.12:0/359769074 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f8ce40762d0 0x7f8ce40787e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8cec034000 tx=0x7f8cec02e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:36.102 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.100+0000 7f8cf5ffb640 1 -- 172.21.15.12:0/359769074 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f8cf806e140 con 0x7f8cf80bd6d0 2024-05-15T15:40:36.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.290+0000 7f8cff8f0640 1 -- 172.21.15.12:0/359769074 --> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8cf814e340 con 0x7f8ce40762d0 2024-05-15T15:40:36.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.296+0000 7f8cf5ffb640 1 -- 172.21.15.12:0/359769074 <== mgr.4106 v2:172.21.15.84:6832/4173299311 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+238625 (secure 0 0 0) 0x7f8cec032730 con 0x7f8ce40762d0 2024-05-15T15:40:36.300 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-05-15T15:40:36.301 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-05-15T15:40:36.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.299+0000 7f8cff8f0640 1 -- 172.21.15.12:0/359769074 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f8ce40762d0 msgr2=0x7f8ce40787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:36.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.299+0000 7f8cff8f0640 1 --2- 172.21.15.12:0/359769074 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f8ce40762d0 0x7f8ce40787e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8cec034000 tx=0x7f8cec02e000 comp rx=0 tx=0).stop 2024-05-15T15:40:36.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.299+0000 7f8cff8f0640 1 -- 172.21.15.12:0/359769074 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8cf80bd6d0 msgr2=0x7f8cf8148a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:36.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.299+0000 7f8cff8f0640 1 --2- 172.21.15.12:0/359769074 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8cf80bd6d0 0x7f8cf8148a20 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f8ce800c7b0 tx=0x7f8ce800cc70 comp rx=0 tx=0).stop 2024-05-15T15:40:36.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.299+0000 7f8cff8f0640 1 -- 172.21.15.12:0/359769074 shutdown_connections 2024-05-15T15:40:36.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.299+0000 7f8cff8f0640 1 --2- 172.21.15.12:0/359769074 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8cf8151fc0 0x7f8cf81e7890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:36.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.299+0000 7f8cff8f0640 1 --2- 172.21.15.12:0/359769074 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8cf80bee80 0x7f8cf814e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:36.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.299+0000 7f8cff8f0640 1 --2- 172.21.15.12:0/359769074 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f8ce40762d0 0x7f8ce40787e0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:36.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.299+0000 7f8cff8f0640 1 --2- 172.21.15.12:0/359769074 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8cf80bd6d0 0x7f8cf8148a20 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:36.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.299+0000 7f8cff8f0640 1 -- 172.21.15.12:0/359769074 >> 172.21.15.12:0/359769074 conn(0x7f8cf80c3d20 msgr2=0x7f8cf80a4910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:36.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.299+0000 7f8cff8f0640 1 -- 172.21.15.12:0/359769074 shutdown_connections 2024-05-15T15:40:36.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.299+0000 7f8cff8f0640 1 -- 172.21.15.12:0/359769074 wait complete. 2024-05-15T15:40:36.312 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":55,"stamp":"2024-05-15T15:40:34.711286+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":36,"acting":36,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":20,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":3,"kb":754974720,"kb_used":219844,"kb_used_data":3648,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754876,"statfs":{"total":773094113280,"available":772868993024,"internally_reserved":0,"allocated":3735552,"data_stored":2106516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.874290"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-15T15:40:30.850054+0000","last_change":"2024-05-15T15:40:30.850054+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.850054+0000","last_undegraded":"2024-05-15T15:40:30.850054+0000","last_fullsized":"2024-05-15T15:40:30.850054+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-15T15:40:30.848792+0000","last_change":"2024-05-15T15:40:30.848792+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.848792+0000","last_undegraded":"2024-05-15T15:40:30.848792+0000","last_fullsized":"2024-05-15T15:40:30.848792+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-15T15:40:30.847400+0000","last_change":"2024-05-15T15:40:30.847400+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.847400+0000","last_undegraded":"2024-05-15T15:40:30.847400+0000","last_fullsized":"2024-05-15T15:40:30.847400+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-15T15:40:30.848183+0000","last_change":"2024-05-15T15:40:30.848183+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.848183+0000","last_undegraded":"2024-05-15T15:40:30.848183+0000","last_fullsized":"2024-05-15T15:40:30.848183+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-15T15:40:30.847665+0000","last_change":"2024-05-15T15:40:30.847665+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.847665+0000","last_undegraded":"2024-05-15T15:40:30.847665+0000","last_fullsized":"2024-05-15T15:40:30.847665+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:29.829984+0000","last_change":"2024-05-15T15:40:29.829984+0000","last_active":"2024-05-15T15:40:29.829984+0000","last_peered":"2024-05-15T15:40:29.829984+0000","last_clean":"2024-05-15T15:40:29.829984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:29.829984+0000","last_undegraded":"2024-05-15T15:40:29.829984+0000","last_fullsized":"2024-05-15T15:40:29.829984+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T15:40:30.871791+0000","last_change":"2024-05-15T15:40:30.866859+0000","last_active":"2024-05-15T15:40:30.871791+0000","last_peered":"2024-05-15T15:40:30.871791+0000","last_clean":"2024-05-15T15:40:30.871791+0000","last_became_active":"2024-05-15T15:40:30.866428+0000","last_became_peered":"2024-05-15T15:40:30.866428+0000","last_unstale":"2024-05-15T15:40:30.871791+0000","last_undegraded":"2024-05-15T15:40:30.871791+0000","last_fullsized":"2024-05-15T15:40:30.871791+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:58:01.392397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:29.829984+0000","last_change":"2024-05-15T15:40:29.829984+0000","last_active":"2024-05-15T15:40:29.829984+0000","last_peered":"2024-05-15T15:40:29.829984+0000","last_clean":"2024-05-15T15:40:29.829984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:29.829984+0000","last_undegraded":"2024-05-15T15:40:29.829984+0000","last_fullsized":"2024-05-15T15:40:29.829984+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-15T15:40:30.846972+0000","last_change":"2024-05-15T15:40:30.846972+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.846972+0000","last_undegraded":"2024-05-15T15:40:30.846972+0000","last_fullsized":"2024-05-15T15:40:30.846972+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T15:40:30.866089+0000","last_change":"2024-05-15T15:40:30.857947+0000","last_active":"2024-05-15T15:40:30.866089+0000","last_peered":"2024-05-15T15:40:30.866089+0000","last_clean":"2024-05-15T15:40:30.866089+0000","last_became_active":"2024-05-15T15:40:30.857649+0000","last_became_peered":"2024-05-15T15:40:30.857649+0000","last_unstale":"2024-05-15T15:40:30.866089+0000","last_undegraded":"2024-05-15T15:40:30.866089+0000","last_fullsized":"2024-05-15T15:40:30.866089+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:00:02.621628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:29.829984+0000","last_change":"2024-05-15T15:40:29.829984+0000","last_active":"2024-05-15T15:40:29.829984+0000","last_peered":"2024-05-15T15:40:29.829984+0000","last_clean":"2024-05-15T15:40:29.829984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:29.829984+0000","last_undegraded":"2024-05-15T15:40:29.829984+0000","last_fullsized":"2024-05-15T15:40:29.829984+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:29.829984+0000","last_change":"2024-05-15T15:40:29.829984+0000","last_active":"2024-05-15T15:40:29.829984+0000","last_peered":"2024-05-15T15:40:29.829984+0000","last_clean":"2024-05-15T15:40:29.829984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:29.829984+0000","last_undegraded":"2024-05-15T15:40:29.829984+0000","last_fullsized":"2024-05-15T15:40:29.829984+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:29.829984+0000","last_change":"2024-05-15T15:40:29.829984+0000","last_active":"2024-05-15T15:40:29.829984+0000","last_peered":"2024-05-15T15:40:29.829984+0000","last_clean":"2024-05-15T15:40:29.829984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:29.829984+0000","last_undegraded":"2024-05-15T15:40:29.829984+0000","last_fullsized":"2024-05-15T15:40:29.829984+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-15T15:40:30.845746+0000","last_change":"2024-05-15T15:40:30.845746+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.845746+0000","last_undegraded":"2024-05-15T15:40:30.845746+0000","last_fullsized":"2024-05-15T15:40:30.845746+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:29.829984+0000","last_change":"2024-05-15T15:40:29.829984+0000","last_active":"2024-05-15T15:40:29.829984+0000","last_peered":"2024-05-15T15:40:29.829984+0000","last_clean":"2024-05-15T15:40:29.829984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:29.829984+0000","last_undegraded":"2024-05-15T15:40:29.829984+0000","last_fullsized":"2024-05-15T15:40:29.829984+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:29.829984+0000","last_change":"2024-05-15T15:40:29.829984+0000","last_active":"2024-05-15T15:40:29.829984+0000","last_peered":"2024-05-15T15:40:29.829984+0000","last_clean":"2024-05-15T15:40:29.829984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:29.829984+0000","last_undegraded":"2024-05-15T15:40:29.829984+0000","last_fullsized":"2024-05-15T15:40:29.829984+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-15T15:40:30.845968+0000","last_change":"2024-05-15T15:40:30.845968+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.845968+0000","last_undegraded":"2024-05-15T15:40:30.845968+0000","last_fullsized":"2024-05-15T15:40:30.845968+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:29.829984+0000","last_change":"2024-05-15T15:40:29.829984+0000","last_active":"2024-05-15T15:40:29.829984+0000","last_peered":"2024-05-15T15:40:29.829984+0000","last_clean":"2024-05-15T15:40:29.829984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:29.829984+0000","last_undegraded":"2024-05-15T15:40:29.829984+0000","last_fullsized":"2024-05-15T15:40:29.829984+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-15T15:40:30.849029+0000","last_change":"2024-05-15T15:40:30.849029+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.849029+0000","last_undegraded":"2024-05-15T15:40:30.849029+0000","last_fullsized":"2024-05-15T15:40:30.849029+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:29.829984+0000","last_change":"2024-05-15T15:40:29.829984+0000","last_active":"2024-05-15T15:40:29.829984+0000","last_peered":"2024-05-15T15:40:29.829984+0000","last_clean":"2024-05-15T15:40:29.829984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:29.829984+0000","last_undegraded":"2024-05-15T15:40:29.829984+0000","last_fullsized":"2024-05-15T15:40:29.829984+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:29.829984+0000","last_change":"2024-05-15T15:40:29.829984+0000","last_active":"2024-05-15T15:40:29.829984+0000","last_peered":"2024-05-15T15:40:29.829984+0000","last_clean":"2024-05-15T15:40:29.829984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:29.829984+0000","last_undegraded":"2024-05-15T15:40:29.829984+0000","last_fullsized":"2024-05-15T15:40:29.829984+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:29.829984+0000","last_change":"2024-05-15T15:40:29.829984+0000","last_active":"2024-05-15T15:40:29.829984+0000","last_peered":"2024-05-15T15:40:29.829984+0000","last_clean":"2024-05-15T15:40:29.829984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:29.829984+0000","last_undegraded":"2024-05-15T15:40:29.829984+0000","last_fullsized":"2024-05-15T15:40:29.829984+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-15T15:40:30.846550+0000","last_change":"2024-05-15T15:40:30.846550+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.846550+0000","last_undegraded":"2024-05-15T15:40:30.846550+0000","last_fullsized":"2024-05-15T15:40:30.846550+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T15:40:30.866023+0000","last_change":"2024-05-15T15:40:30.856989+0000","last_active":"2024-05-15T15:40:30.866023+0000","last_peered":"2024-05-15T15:40:30.866023+0000","last_clean":"2024-05-15T15:40:30.866023+0000","last_became_active":"2024-05-15T15:40:30.856464+0000","last_became_peered":"2024-05-15T15:40:30.856464+0000","last_unstale":"2024-05-15T15:40:30.866023+0000","last_undegraded":"2024-05-15T15:40:30.866023+0000","last_fullsized":"2024-05-15T15:40:30.866023+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:01:01.491109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T15:40:30.865968+0000","last_change":"2024-05-15T15:40:30.856323+0000","last_active":"2024-05-15T15:40:30.865968+0000","last_peered":"2024-05-15T15:40:30.865968+0000","last_clean":"2024-05-15T15:40:30.865968+0000","last_became_active":"2024-05-15T15:40:30.856001+0000","last_became_peered":"2024-05-15T15:40:30.856001+0000","last_unstale":"2024-05-15T15:40:30.865968+0000","last_undegraded":"2024-05-15T15:40:30.865968+0000","last_fullsized":"2024-05-15T15:40:30.865968+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:50:04.108918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:29.829984+0000","last_change":"2024-05-15T15:40:29.829984+0000","last_active":"2024-05-15T15:40:29.829984+0000","last_peered":"2024-05-15T15:40:29.829984+0000","last_clean":"2024-05-15T15:40:29.829984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:29.829984+0000","last_undegraded":"2024-05-15T15:40:29.829984+0000","last_fullsized":"2024-05-15T15:40:29.829984+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:29.829984+0000","last_change":"2024-05-15T15:40:29.829984+0000","last_active":"2024-05-15T15:40:29.829984+0000","last_peered":"2024-05-15T15:40:29.829984+0000","last_clean":"2024-05-15T15:40:29.829984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:29.829984+0000","last_undegraded":"2024-05-15T15:40:29.829984+0000","last_fullsized":"2024-05-15T15:40:29.829984+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:29.829984+0000","last_change":"2024-05-15T15:40:29.829984+0000","last_active":"2024-05-15T15:40:29.829984+0000","last_peered":"2024-05-15T15:40:29.829984+0000","last_clean":"2024-05-15T15:40:29.829984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:29.829984+0000","last_undegraded":"2024-05-15T15:40:29.829984+0000","last_fullsized":"2024-05-15T15:40:29.829984+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:29.829984+0000","last_change":"2024-05-15T15:40:29.829984+0000","last_active":"2024-05-15T15:40:29.829984+0000","last_peered":"2024-05-15T15:40:29.829984+0000","last_clean":"2024-05-15T15:40:29.829984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:29.829984+0000","last_undegraded":"2024-05-15T15:40:29.829984+0000","last_fullsized":"2024-05-15T15:40:29.829984+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:29.829984+0000","last_change":"2024-05-15T15:40:29.829984+0000","last_active":"2024-05-15T15:40:29.829984+0000","last_peered":"2024-05-15T15:40:29.829984+0000","last_clean":"2024-05-15T15:40:29.829984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:29.829984+0000","last_undegraded":"2024-05-15T15:40:29.829984+0000","last_fullsized":"2024-05-15T15:40:29.829984+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:29.829984+0000","last_change":"2024-05-15T15:40:29.829984+0000","last_active":"2024-05-15T15:40:29.829984+0000","last_peered":"2024-05-15T15:40:29.829984+0000","last_clean":"2024-05-15T15:40:29.829984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:29.829984+0000","last_undegraded":"2024-05-15T15:40:29.829984+0000","last_fullsized":"2024-05-15T15:40:29.829984+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:29.829984+0000","last_change":"2024-05-15T15:40:29.829984+0000","last_active":"2024-05-15T15:40:29.829984+0000","last_peered":"2024-05-15T15:40:29.829984+0000","last_clean":"2024-05-15T15:40:29.829984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:29.829984+0000","last_undegraded":"2024-05-15T15:40:29.829984+0000","last_fullsized":"2024-05-15T15:40:29.829984+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:29.829984+0000","last_change":"2024-05-15T15:40:29.829984+0000","last_active":"2024-05-15T15:40:29.829984+0000","last_peered":"2024-05-15T15:40:29.829984+0000","last_clean":"2024-05-15T15:40:29.829984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:29.829984+0000","last_undegraded":"2024-05-15T15:40:29.829984+0000","last_fullsized":"2024-05-15T15:40:29.829984+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:29.829984+0000","last_change":"2024-05-15T15:40:29.829984+0000","last_active":"2024-05-15T15:40:29.829984+0000","last_peered":"2024-05-15T15:40:29.829984+0000","last_clean":"2024-05-15T15:40:29.829984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:29.829984+0000","last_undegraded":"2024-05-15T15:40:29.829984+0000","last_fullsized":"2024-05-15T15:40:29.829984+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:29.829984+0000","last_change":"2024-05-15T15:40:29.829984+0000","last_active":"2024-05-15T15:40:29.829984+0000","last_peered":"2024-05-15T15:40:29.829984+0000","last_clean":"2024-05-15T15:40:29.829984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:29.829984+0000","last_undegraded":"2024-05-15T15:40:29.829984+0000","last_fullsized":"2024-05-15T15:40:29.829984+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:29.829984+0000","last_change":"2024-05-15T15:40:29.829984+0000","last_active":"2024-05-15T15:40:29.829984+0000","last_peered":"2024-05-15T15:40:29.829984+0000","last_clean":"2024-05-15T15:40:29.829984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:29.829984+0000","last_undegraded":"2024-05-15T15:40:29.829984+0000","last_fullsized":"2024-05-15T15:40:29.829984+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:29.829984+0000","last_change":"2024-05-15T15:40:29.829984+0000","last_active":"2024-05-15T15:40:29.829984+0000","last_peered":"2024-05-15T15:40:29.829984+0000","last_clean":"2024-05-15T15:40:29.829984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:29.829984+0000","last_undegraded":"2024-05-15T15:40:29.829984+0000","last_fullsized":"2024-05-15T15:40:29.829984+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:29.829984+0000","last_change":"2024-05-15T15:40:29.829984+0000","last_active":"2024-05-15T15:40:29.829984+0000","last_peered":"2024-05-15T15:40:29.829984+0000","last_clean":"2024-05-15T15:40:29.829984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:29.829984+0000","last_undegraded":"2024-05-15T15:40:29.829984+0000","last_fullsized":"2024-05-15T15:40:29.829984+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-15T15:40:30.845726+0000","last_change":"2024-05-15T15:40:30.845726+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.845726+0000","last_undegraded":"2024-05-15T15:40:30.845726+0000","last_fullsized":"2024-05-15T15:40:30.845726+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:29.829984+0000","last_change":"2024-05-15T15:40:29.829984+0000","last_active":"2024-05-15T15:40:29.829984+0000","last_peered":"2024-05-15T15:40:29.829984+0000","last_clean":"2024-05-15T15:40:29.829984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:29.829984+0000","last_undegraded":"2024-05-15T15:40:29.829984+0000","last_fullsized":"2024-05-15T15:40:29.829984+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-15T15:40:30.845709+0000","last_change":"2024-05-15T15:40:30.845709+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.845709+0000","last_undegraded":"2024-05-15T15:40:30.845709+0000","last_fullsized":"2024-05-15T15:40:30.845709+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:29.829984+0000","last_change":"2024-05-15T15:40:29.829984+0000","last_active":"2024-05-15T15:40:29.829984+0000","last_peered":"2024-05-15T15:40:29.829984+0000","last_clean":"2024-05-15T15:40:29.829984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:29.829984+0000","last_undegraded":"2024-05-15T15:40:29.829984+0000","last_fullsized":"2024-05-15T15:40:29.829984+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T15:40:30.871786+0000","last_change":"2024-05-15T15:40:30.866837+0000","last_active":"2024-05-15T15:40:30.871786+0000","last_peered":"2024-05-15T15:40:30.871786+0000","last_clean":"2024-05-15T15:40:30.871786+0000","last_became_active":"2024-05-15T15:40:30.866530+0000","last_became_peered":"2024-05-15T15:40:30.866530+0000","last_unstale":"2024-05-15T15:40:30.871786+0000","last_undegraded":"2024-05-15T15:40:30.871786+0000","last_fullsized":"2024-05-15T15:40:30.871786+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:12:17.658105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:29.829984+0000","last_change":"2024-05-15T15:40:29.829984+0000","last_active":"2024-05-15T15:40:29.829984+0000","last_peered":"2024-05-15T15:40:29.829984+0000","last_clean":"2024-05-15T15:40:29.829984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:29.829984+0000","last_undegraded":"2024-05-15T15:40:29.829984+0000","last_fullsized":"2024-05-15T15:40:29.829984+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":121,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-15T15:40:25.836750+0000","last_change":"2024-05-15T15:39:42.584601+0000","last_active":"2024-05-15T15:40:25.836750+0000","last_peered":"2024-05-15T15:40:25.836750+0000","last_clean":"2024-05-15T15:40:25.836750+0000","last_became_active":"2024-05-15T15:39:42.584129+0000","last_became_peered":"2024-05-15T15:39:42.584129+0000","last_unstale":"2024-05-15T15:40:25.836750+0000","last_undegraded":"2024-05-15T15:40:25.836750+0000","last_fullsized":"2024-05-15T15:40:25.836750+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:41.378107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:41.378107+0000","last_clean_scrub_stamp":"2024-05-15T15:39:41.378107+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:23:25.285669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":1},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":10,"acting":10,"num_store_stats":1},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509453,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27328,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":315392,"data_stored":114211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509453,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27332,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":315392,"data_stored":114211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509454,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27908,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343932,"statfs":{"total":96636764160,"available":96608186368,"internally_reserved":0,"allocated":909312,"data_stored":704579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509453,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27340,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":315392,"data_stored":114211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509453,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27336,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":315392,"data_stored":114211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509454,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27920,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343920,"statfs":{"total":96636764160,"available":96608174080,"internally_reserved":0,"allocated":909312,"data_stored":704579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509453,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27328,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":315392,"data_stored":114211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":339968,"data_stored":126303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-15T15:40:36.316 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-15T15:40:36.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.463+0000 7fe1e34bd640 1 Processor -- start 2024-05-15T15:40:36.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.463+0000 7fe1e34bd640 1 -- start start 2024-05-15T15:40:36.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.464+0000 7fe1e34bd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe1dc0bb940 0x7fe1dc1462b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:36.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.464+0000 7fe1e34bd640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe1dc14fa20 0x7fe1dc14fe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:36.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.464+0000 7fe1e34bd640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1dc0a40b0 con 0x7fe1dc0a3bd0 2024-05-15T15:40:36.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.464+0000 7fe1e34bd640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fe1dc0a49e0 con 0x7fe1dc0bb940 2024-05-15T15:40:36.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.464+0000 7fe1e34bd640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fe1dc0a4390 con 0x7fe1dc14fa20 2024-05-15T15:40:36.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.464+0000 7fe1e1259640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fe1dc0a3bd0 0x7fe1dc0bc8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38346/0 (socket says 172.21.15.12:38346) 2024-05-15T15:40:36.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.464+0000 7fe1e1259640 1 -- 172.21.15.12:0/262965004 learned_addr learned my addr 172.21.15.12:0/262965004 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-05-15T15:40:36.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.464+0000 7fe1e0a58640 1 --2- 172.21.15.12:0/262965004 >> v2:172.21.15.12:3300/0 conn(0x7fe1dc0bb940 0x7fe1dc1462b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:36.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.464+0000 7fe1e1a5a640 1 --2- 172.21.15.12:0/262965004 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe1dc14fa20 0x7fe1dc14fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:36.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.464+0000 7fe1e0a58640 1 -- 172.21.15.12:0/262965004 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe1dc14fa20 msgr2=0x7fe1dc14fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:40:36.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.464+0000 7fe1e0a58640 1 --2- 172.21.15.12:0/262965004 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe1dc14fa20 0x7fe1dc14fe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:36.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.464+0000 7fe1e0a58640 1 -- 172.21.15.12:0/262965004 >> v1:172.21.15.12:6789/0 conn(0x7fe1dc0a3bd0 legacy=0x7fe1dc0bc8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:36.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.465+0000 7fe1e0a58640 1 -- 172.21.15.12:0/262965004 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1dc0a4670 con 0x7fe1dc0bb940 2024-05-15T15:40:36.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.465+0000 7fe1e0a58640 1 --2- 172.21.15.12:0/262965004 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1dc0bb940 0x7fe1dc1462b0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc0097a0 tx=0x7fe1cc02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b81476a52ea3c65a server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:36.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.465+0000 7fe1d3fff640 1 -- 172.21.15.12:0/262965004 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1cc037070 con 0x7fe1dc0bb940 2024-05-15T15:40:36.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.465+0000 7fe1d3fff640 1 -- 172.21.15.12:0/262965004 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1cc032440 con 0x7fe1dc0bb940 2024-05-15T15:40:36.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.465+0000 7fe1d3fff640 1 -- 172.21.15.12:0/262965004 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1cc032810 con 0x7fe1dc0bb940 2024-05-15T15:40:36.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.466+0000 7fe1e34bd640 1 -- 172.21.15.12:0/262965004 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1dc0bb940 msgr2=0x7fe1dc1462b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:36.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.466+0000 7fe1e34bd640 1 --2- 172.21.15.12:0/262965004 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1dc0bb940 0x7fe1dc1462b0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc0097a0 tx=0x7fe1cc02a180 comp rx=0 tx=0).stop 2024-05-15T15:40:36.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.466+0000 7fe1e34bd640 1 -- 172.21.15.12:0/262965004 shutdown_connections 2024-05-15T15:40:36.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.466+0000 7fe1e34bd640 1 --2- 172.21.15.12:0/262965004 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe1dc14fa20 0x7fe1dc14fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:36.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.466+0000 7fe1e34bd640 1 --2- 172.21.15.12:0/262965004 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1dc0bb940 0x7fe1dc1462b0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:36.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.466+0000 7fe1e34bd640 1 -- 172.21.15.12:0/262965004 >> 172.21.15.12:0/262965004 conn(0x7fe1dc0a1ac0 msgr2=0x7fe1dc0bbfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:36.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.466+0000 7fe1e34bd640 1 -- 172.21.15.12:0/262965004 shutdown_connections 2024-05-15T15:40:36.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.466+0000 7fe1e34bd640 1 -- 172.21.15.12:0/262965004 wait complete. 2024-05-15T15:40:36.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.468+0000 7fe1e34bd640 1 Processor -- start 2024-05-15T15:40:36.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.468+0000 7fe1e34bd640 1 -- start start 2024-05-15T15:40:36.472 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.469+0000 7fe1e34bd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1dc0a3bd0 0x7fe1dc149ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:36.472 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.469+0000 7fe1e34bd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1dc0bb940 0x7fe1dc0bec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:36.472 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.469+0000 7fe1e34bd640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe1dc14fa20 0x7fe1dc14bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:36.472 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.469+0000 7fe1e34bd640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fe1dc0a28b0 con 0x7fe1dc0bb940 2024-05-15T15:40:36.472 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.469+0000 7fe1e34bd640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fe1dc0bbe10 con 0x7fe1dc0a3bd0 2024-05-15T15:40:36.472 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.469+0000 7fe1e34bd640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fe1dc0a2a30 con 0x7fe1dc14fa20 2024-05-15T15:40:36.472 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.469+0000 7fe1e0a58640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1dc0bb940 0x7fe1dc0bec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:36.472 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.469+0000 7fe1e0a58640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1dc0bb940 0x7fe1dc0bec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47200/0 (socket says 172.21.15.12:47200) 2024-05-15T15:40:36.472 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.469+0000 7fe1e0a58640 1 -- 172.21.15.12:0/37333973 learned_addr learned my addr 172.21.15.12:0/37333973 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:36.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.469+0000 7fe1e1259640 1 --2- 172.21.15.12:0/37333973 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1dc0a3bd0 0x7fe1dc149ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:36.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.469+0000 7fe1e1a5a640 1 --2- 172.21.15.12:0/37333973 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe1dc14fa20 0x7fe1dc14bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:36.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.469+0000 7fe1e0a58640 1 -- 172.21.15.12:0/37333973 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe1dc14fa20 msgr2=0x7fe1dc14bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:36.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.469+0000 7fe1e0a58640 1 --2- 172.21.15.12:0/37333973 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe1dc14fa20 0x7fe1dc14bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:36.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.469+0000 7fe1e0a58640 1 -- 172.21.15.12:0/37333973 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1dc0a3bd0 msgr2=0x7fe1dc149ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:36.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.469+0000 7fe1e0a58640 1 --2- 172.21.15.12:0/37333973 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1dc0a3bd0 0x7fe1dc149ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:36.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.469+0000 7fe1e0a58640 1 -- 172.21.15.12:0/37333973 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1dc0bf140 con 0x7fe1dc0bb940 2024-05-15T15:40:36.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.469+0000 7fe1e0a58640 1 --2- 172.21.15.12:0/37333973 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1dc0bb940 0x7fe1dc0bec00 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc035040 tx=0x7fe1cc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:36.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.470+0000 7fe1d1ffb640 1 -- 172.21.15.12:0/37333973 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1cc037040 con 0x7fe1dc0bb940 2024-05-15T15:40:36.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.470+0000 7fe1d1ffb640 1 -- 172.21.15.12:0/37333973 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1cc030770 con 0x7fe1dc0bb940 2024-05-15T15:40:36.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.470+0000 7fe1d1ffb640 1 -- 172.21.15.12:0/37333973 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1cc030b40 con 0x7fe1dc0bb940 2024-05-15T15:40:36.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.470+0000 7fe1e34bd640 1 -- 172.21.15.12:0/37333973 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1dc143730 con 0x7fe1dc0bb940 2024-05-15T15:40:36.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.470+0000 7fe1e34bd640 1 -- 172.21.15.12:0/37333973 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1dc1e23a0 con 0x7fe1dc0bb940 2024-05-15T15:40:36.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.471+0000 7fe1e34bd640 1 -- 172.21.15.12:0/37333973 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1dc1e1ef0 con 0x7fe1dc0bb940 2024-05-15T15:40:36.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.471+0000 7fe1d1ffb640 1 -- 172.21.15.12:0/37333973 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe1cc044020 con 0x7fe1dc0bb940 2024-05-15T15:40:36.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.472+0000 7fe1d1ffb640 1 --2- 172.21.15.12:0/37333973 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fe1c0076300 0x7fe1c0078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:36.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.472+0000 7fe1d1ffb640 1 -- 172.21.15.12:0/37333973 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fe1cc0b7b30 con 0x7fe1dc0bb940 2024-05-15T15:40:36.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.472+0000 7fe1e1259640 1 --2- 172.21.15.12:0/37333973 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fe1c0076300 0x7fe1c0078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:36.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.473+0000 7fe1e1259640 1 --2- 172.21.15.12:0/37333973 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fe1c0076300 0x7fe1c0078810 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe1d8000f60 tx=0x7fe1d8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:36.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.476+0000 7fe1d1ffb640 1 -- 172.21.15.12:0/37333973 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fe1cc032e20 con 0x7fe1dc0bb940 2024-05-15T15:40:36.667 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.664+0000 7fe1e34bd640 1 -- 172.21.15.12:0/37333973 --> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe1dc144110 con 0x7fe1c0076300 2024-05-15T15:40:36.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.671+0000 7fe1d1ffb640 1 -- 172.21.15.12:0/37333973 <== mgr.4106 v2:172.21.15.84:6832/4173299311 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+238625 (secure 0 0 0) 0x7fe1dc144110 con 0x7fe1c0076300 2024-05-15T15:40:36.675 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-05-15T15:40:36.676 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-05-15T15:40:36.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.674+0000 7fe1e34bd640 1 -- 172.21.15.12:0/37333973 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fe1c0076300 msgr2=0x7fe1c0078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:36.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.674+0000 7fe1e34bd640 1 --2- 172.21.15.12:0/37333973 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fe1c0076300 0x7fe1c0078810 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe1d8000f60 tx=0x7fe1d8009040 comp rx=0 tx=0).stop 2024-05-15T15:40:36.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.674+0000 7fe1e34bd640 1 -- 172.21.15.12:0/37333973 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1dc0bb940 msgr2=0x7fe1dc0bec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:36.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.674+0000 7fe1e34bd640 1 --2- 172.21.15.12:0/37333973 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1dc0bb940 0x7fe1dc0bec00 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc035040 tx=0x7fe1cc0046c0 comp rx=0 tx=0).stop 2024-05-15T15:40:36.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.674+0000 7fe1e34bd640 1 -- 172.21.15.12:0/37333973 shutdown_connections 2024-05-15T15:40:36.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.674+0000 7fe1e34bd640 1 --2- 172.21.15.12:0/37333973 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe1dc14fa20 0x7fe1dc14bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:36.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.674+0000 7fe1e34bd640 1 --2- 172.21.15.12:0/37333973 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fe1c0076300 0x7fe1c0078810 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:36.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.674+0000 7fe1e34bd640 1 --2- 172.21.15.12:0/37333973 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1dc0bb940 0x7fe1dc0bec00 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:36.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.674+0000 7fe1e34bd640 1 --2- 172.21.15.12:0/37333973 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1dc0a3bd0 0x7fe1dc149ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:36.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.674+0000 7fe1e34bd640 1 -- 172.21.15.12:0/37333973 >> 172.21.15.12:0/37333973 conn(0x7fe1dc0a1ac0 msgr2=0x7fe1dc073bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:36.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.674+0000 7fe1e34bd640 1 -- 172.21.15.12:0/37333973 shutdown_connections 2024-05-15T15:40:36.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.674+0000 7fe1e34bd640 1 -- 172.21.15.12:0/37333973 wait complete. 2024-05-15T15:40:36.687 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":55,"stamp":"2024-05-15T15:40:34.711286+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":36,"acting":36,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":20,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":3,"kb":754974720,"kb_used":219844,"kb_used_data":3648,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754876,"statfs":{"total":773094113280,"available":772868993024,"internally_reserved":0,"allocated":3735552,"data_stored":2106516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.874290"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-15T15:40:30.850054+0000","last_change":"2024-05-15T15:40:30.850054+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.850054+0000","last_undegraded":"2024-05-15T15:40:30.850054+0000","last_fullsized":"2024-05-15T15:40:30.850054+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-15T15:40:30.848792+0000","last_change":"2024-05-15T15:40:30.848792+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.848792+0000","last_undegraded":"2024-05-15T15:40:30.848792+0000","last_fullsized":"2024-05-15T15:40:30.848792+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-15T15:40:30.847400+0000","last_change":"2024-05-15T15:40:30.847400+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.847400+0000","last_undegraded":"2024-05-15T15:40:30.847400+0000","last_fullsized":"2024-05-15T15:40:30.847400+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-15T15:40:30.848183+0000","last_change":"2024-05-15T15:40:30.848183+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.848183+0000","last_undegraded":"2024-05-15T15:40:30.848183+0000","last_fullsized":"2024-05-15T15:40:30.848183+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-15T15:40:30.847665+0000","last_change":"2024-05-15T15:40:30.847665+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.847665+0000","last_undegraded":"2024-05-15T15:40:30.847665+0000","last_fullsized":"2024-05-15T15:40:30.847665+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:29.829984+0000","last_change":"2024-05-15T15:40:29.829984+0000","last_active":"2024-05-15T15:40:29.829984+0000","last_peered":"2024-05-15T15:40:29.829984+0000","last_clean":"2024-05-15T15:40:29.829984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:29.829984+0000","last_undegraded":"2024-05-15T15:40:29.829984+0000","last_fullsized":"2024-05-15T15:40:29.829984+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T15:40:30.871791+0000","last_change":"2024-05-15T15:40:30.866859+0000","last_active":"2024-05-15T15:40:30.871791+0000","last_peered":"2024-05-15T15:40:30.871791+0000","last_clean":"2024-05-15T15:40:30.871791+0000","last_became_active":"2024-05-15T15:40:30.866428+0000","last_became_peered":"2024-05-15T15:40:30.866428+0000","last_unstale":"2024-05-15T15:40:30.871791+0000","last_undegraded":"2024-05-15T15:40:30.871791+0000","last_fullsized":"2024-05-15T15:40:30.871791+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:58:01.392397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:29.829984+0000","last_change":"2024-05-15T15:40:29.829984+0000","last_active":"2024-05-15T15:40:29.829984+0000","last_peered":"2024-05-15T15:40:29.829984+0000","last_clean":"2024-05-15T15:40:29.829984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:29.829984+0000","last_undegraded":"2024-05-15T15:40:29.829984+0000","last_fullsized":"2024-05-15T15:40:29.829984+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-15T15:40:30.846972+0000","last_change":"2024-05-15T15:40:30.846972+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.846972+0000","last_undegraded":"2024-05-15T15:40:30.846972+0000","last_fullsized":"2024-05-15T15:40:30.846972+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T15:40:30.866089+0000","last_change":"2024-05-15T15:40:30.857947+0000","last_active":"2024-05-15T15:40:30.866089+0000","last_peered":"2024-05-15T15:40:30.866089+0000","last_clean":"2024-05-15T15:40:30.866089+0000","last_became_active":"2024-05-15T15:40:30.857649+0000","last_became_peered":"2024-05-15T15:40:30.857649+0000","last_unstale":"2024-05-15T15:40:30.866089+0000","last_undegraded":"2024-05-15T15:40:30.866089+0000","last_fullsized":"2024-05-15T15:40:30.866089+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:00:02.621628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:29.829984+0000","last_change":"2024-05-15T15:40:29.829984+0000","last_active":"2024-05-15T15:40:29.829984+0000","last_peered":"2024-05-15T15:40:29.829984+0000","last_clean":"2024-05-15T15:40:29.829984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:29.829984+0000","last_undegraded":"2024-05-15T15:40:29.829984+0000","last_fullsized":"2024-05-15T15:40:29.829984+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:29.829984+0000","last_change":"2024-05-15T15:40:29.829984+0000","last_active":"2024-05-15T15:40:29.829984+0000","last_peered":"2024-05-15T15:40:29.829984+0000","last_clean":"2024-05-15T15:40:29.829984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:29.829984+0000","last_undegraded":"2024-05-15T15:40:29.829984+0000","last_fullsized":"2024-05-15T15:40:29.829984+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:29.829984+0000","last_change":"2024-05-15T15:40:29.829984+0000","last_active":"2024-05-15T15:40:29.829984+0000","last_peered":"2024-05-15T15:40:29.829984+0000","last_clean":"2024-05-15T15:40:29.829984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:29.829984+0000","last_undegraded":"2024-05-15T15:40:29.829984+0000","last_fullsized":"2024-05-15T15:40:29.829984+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-15T15:40:30.845746+0000","last_change":"2024-05-15T15:40:30.845746+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.845746+0000","last_undegraded":"2024-05-15T15:40:30.845746+0000","last_fullsized":"2024-05-15T15:40:30.845746+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:29.829984+0000","last_change":"2024-05-15T15:40:29.829984+0000","last_active":"2024-05-15T15:40:29.829984+0000","last_peered":"2024-05-15T15:40:29.829984+0000","last_clean":"2024-05-15T15:40:29.829984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:29.829984+0000","last_undegraded":"2024-05-15T15:40:29.829984+0000","last_fullsized":"2024-05-15T15:40:29.829984+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:29.829984+0000","last_change":"2024-05-15T15:40:29.829984+0000","last_active":"2024-05-15T15:40:29.829984+0000","last_peered":"2024-05-15T15:40:29.829984+0000","last_clean":"2024-05-15T15:40:29.829984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:29.829984+0000","last_undegraded":"2024-05-15T15:40:29.829984+0000","last_fullsized":"2024-05-15T15:40:29.829984+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-15T15:40:30.845968+0000","last_change":"2024-05-15T15:40:30.845968+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.845968+0000","last_undegraded":"2024-05-15T15:40:30.845968+0000","last_fullsized":"2024-05-15T15:40:30.845968+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:29.829984+0000","last_change":"2024-05-15T15:40:29.829984+0000","last_active":"2024-05-15T15:40:29.829984+0000","last_peered":"2024-05-15T15:40:29.829984+0000","last_clean":"2024-05-15T15:40:29.829984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:29.829984+0000","last_undegraded":"2024-05-15T15:40:29.829984+0000","last_fullsized":"2024-05-15T15:40:29.829984+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-15T15:40:30.849029+0000","last_change":"2024-05-15T15:40:30.849029+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.849029+0000","last_undegraded":"2024-05-15T15:40:30.849029+0000","last_fullsized":"2024-05-15T15:40:30.849029+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:29.829984+0000","last_change":"2024-05-15T15:40:29.829984+0000","last_active":"2024-05-15T15:40:29.829984+0000","last_peered":"2024-05-15T15:40:29.829984+0000","last_clean":"2024-05-15T15:40:29.829984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:29.829984+0000","last_undegraded":"2024-05-15T15:40:29.829984+0000","last_fullsized":"2024-05-15T15:40:29.829984+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:29.829984+0000","last_change":"2024-05-15T15:40:29.829984+0000","last_active":"2024-05-15T15:40:29.829984+0000","last_peered":"2024-05-15T15:40:29.829984+0000","last_clean":"2024-05-15T15:40:29.829984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:29.829984+0000","last_undegraded":"2024-05-15T15:40:29.829984+0000","last_fullsized":"2024-05-15T15:40:29.829984+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:29.829984+0000","last_change":"2024-05-15T15:40:29.829984+0000","last_active":"2024-05-15T15:40:29.829984+0000","last_peered":"2024-05-15T15:40:29.829984+0000","last_clean":"2024-05-15T15:40:29.829984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:29.829984+0000","last_undegraded":"2024-05-15T15:40:29.829984+0000","last_fullsized":"2024-05-15T15:40:29.829984+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-15T15:40:30.846550+0000","last_change":"2024-05-15T15:40:30.846550+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.846550+0000","last_undegraded":"2024-05-15T15:40:30.846550+0000","last_fullsized":"2024-05-15T15:40:30.846550+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T15:40:30.866023+0000","last_change":"2024-05-15T15:40:30.856989+0000","last_active":"2024-05-15T15:40:30.866023+0000","last_peered":"2024-05-15T15:40:30.866023+0000","last_clean":"2024-05-15T15:40:30.866023+0000","last_became_active":"2024-05-15T15:40:30.856464+0000","last_became_peered":"2024-05-15T15:40:30.856464+0000","last_unstale":"2024-05-15T15:40:30.866023+0000","last_undegraded":"2024-05-15T15:40:30.866023+0000","last_fullsized":"2024-05-15T15:40:30.866023+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:01:01.491109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T15:40:30.865968+0000","last_change":"2024-05-15T15:40:30.856323+0000","last_active":"2024-05-15T15:40:30.865968+0000","last_peered":"2024-05-15T15:40:30.865968+0000","last_clean":"2024-05-15T15:40:30.865968+0000","last_became_active":"2024-05-15T15:40:30.856001+0000","last_became_peered":"2024-05-15T15:40:30.856001+0000","last_unstale":"2024-05-15T15:40:30.865968+0000","last_undegraded":"2024-05-15T15:40:30.865968+0000","last_fullsized":"2024-05-15T15:40:30.865968+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:50:04.108918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:29.829984+0000","last_change":"2024-05-15T15:40:29.829984+0000","last_active":"2024-05-15T15:40:29.829984+0000","last_peered":"2024-05-15T15:40:29.829984+0000","last_clean":"2024-05-15T15:40:29.829984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:29.829984+0000","last_undegraded":"2024-05-15T15:40:29.829984+0000","last_fullsized":"2024-05-15T15:40:29.829984+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:29.829984+0000","last_change":"2024-05-15T15:40:29.829984+0000","last_active":"2024-05-15T15:40:29.829984+0000","last_peered":"2024-05-15T15:40:29.829984+0000","last_clean":"2024-05-15T15:40:29.829984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:29.829984+0000","last_undegraded":"2024-05-15T15:40:29.829984+0000","last_fullsized":"2024-05-15T15:40:29.829984+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:29.829984+0000","last_change":"2024-05-15T15:40:29.829984+0000","last_active":"2024-05-15T15:40:29.829984+0000","last_peered":"2024-05-15T15:40:29.829984+0000","last_clean":"2024-05-15T15:40:29.829984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:29.829984+0000","last_undegraded":"2024-05-15T15:40:29.829984+0000","last_fullsized":"2024-05-15T15:40:29.829984+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:29.829984+0000","last_change":"2024-05-15T15:40:29.829984+0000","last_active":"2024-05-15T15:40:29.829984+0000","last_peered":"2024-05-15T15:40:29.829984+0000","last_clean":"2024-05-15T15:40:29.829984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:29.829984+0000","last_undegraded":"2024-05-15T15:40:29.829984+0000","last_fullsized":"2024-05-15T15:40:29.829984+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:29.829984+0000","last_change":"2024-05-15T15:40:29.829984+0000","last_active":"2024-05-15T15:40:29.829984+0000","last_peered":"2024-05-15T15:40:29.829984+0000","last_clean":"2024-05-15T15:40:29.829984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:29.829984+0000","last_undegraded":"2024-05-15T15:40:29.829984+0000","last_fullsized":"2024-05-15T15:40:29.829984+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:29.829984+0000","last_change":"2024-05-15T15:40:29.829984+0000","last_active":"2024-05-15T15:40:29.829984+0000","last_peered":"2024-05-15T15:40:29.829984+0000","last_clean":"2024-05-15T15:40:29.829984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:29.829984+0000","last_undegraded":"2024-05-15T15:40:29.829984+0000","last_fullsized":"2024-05-15T15:40:29.829984+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:29.829984+0000","last_change":"2024-05-15T15:40:29.829984+0000","last_active":"2024-05-15T15:40:29.829984+0000","last_peered":"2024-05-15T15:40:29.829984+0000","last_clean":"2024-05-15T15:40:29.829984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:29.829984+0000","last_undegraded":"2024-05-15T15:40:29.829984+0000","last_fullsized":"2024-05-15T15:40:29.829984+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:29.829984+0000","last_change":"2024-05-15T15:40:29.829984+0000","last_active":"2024-05-15T15:40:29.829984+0000","last_peered":"2024-05-15T15:40:29.829984+0000","last_clean":"2024-05-15T15:40:29.829984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:29.829984+0000","last_undegraded":"2024-05-15T15:40:29.829984+0000","last_fullsized":"2024-05-15T15:40:29.829984+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:29.829984+0000","last_change":"2024-05-15T15:40:29.829984+0000","last_active":"2024-05-15T15:40:29.829984+0000","last_peered":"2024-05-15T15:40:29.829984+0000","last_clean":"2024-05-15T15:40:29.829984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:29.829984+0000","last_undegraded":"2024-05-15T15:40:29.829984+0000","last_fullsized":"2024-05-15T15:40:29.829984+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:29.829984+0000","last_change":"2024-05-15T15:40:29.829984+0000","last_active":"2024-05-15T15:40:29.829984+0000","last_peered":"2024-05-15T15:40:29.829984+0000","last_clean":"2024-05-15T15:40:29.829984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:29.829984+0000","last_undegraded":"2024-05-15T15:40:29.829984+0000","last_fullsized":"2024-05-15T15:40:29.829984+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:29.829984+0000","last_change":"2024-05-15T15:40:29.829984+0000","last_active":"2024-05-15T15:40:29.829984+0000","last_peered":"2024-05-15T15:40:29.829984+0000","last_clean":"2024-05-15T15:40:29.829984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:29.829984+0000","last_undegraded":"2024-05-15T15:40:29.829984+0000","last_fullsized":"2024-05-15T15:40:29.829984+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:29.829984+0000","last_change":"2024-05-15T15:40:29.829984+0000","last_active":"2024-05-15T15:40:29.829984+0000","last_peered":"2024-05-15T15:40:29.829984+0000","last_clean":"2024-05-15T15:40:29.829984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:29.829984+0000","last_undegraded":"2024-05-15T15:40:29.829984+0000","last_fullsized":"2024-05-15T15:40:29.829984+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:29.829984+0000","last_change":"2024-05-15T15:40:29.829984+0000","last_active":"2024-05-15T15:40:29.829984+0000","last_peered":"2024-05-15T15:40:29.829984+0000","last_clean":"2024-05-15T15:40:29.829984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:29.829984+0000","last_undegraded":"2024-05-15T15:40:29.829984+0000","last_fullsized":"2024-05-15T15:40:29.829984+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-15T15:40:30.845726+0000","last_change":"2024-05-15T15:40:30.845726+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.845726+0000","last_undegraded":"2024-05-15T15:40:30.845726+0000","last_fullsized":"2024-05-15T15:40:30.845726+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:29.829984+0000","last_change":"2024-05-15T15:40:29.829984+0000","last_active":"2024-05-15T15:40:29.829984+0000","last_peered":"2024-05-15T15:40:29.829984+0000","last_clean":"2024-05-15T15:40:29.829984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:29.829984+0000","last_undegraded":"2024-05-15T15:40:29.829984+0000","last_fullsized":"2024-05-15T15:40:29.829984+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-15T15:40:30.845709+0000","last_change":"2024-05-15T15:40:30.845709+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.845709+0000","last_undegraded":"2024-05-15T15:40:30.845709+0000","last_fullsized":"2024-05-15T15:40:30.845709+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:29.829984+0000","last_change":"2024-05-15T15:40:29.829984+0000","last_active":"2024-05-15T15:40:29.829984+0000","last_peered":"2024-05-15T15:40:29.829984+0000","last_clean":"2024-05-15T15:40:29.829984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:29.829984+0000","last_undegraded":"2024-05-15T15:40:29.829984+0000","last_fullsized":"2024-05-15T15:40:29.829984+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T15:40:30.871786+0000","last_change":"2024-05-15T15:40:30.866837+0000","last_active":"2024-05-15T15:40:30.871786+0000","last_peered":"2024-05-15T15:40:30.871786+0000","last_clean":"2024-05-15T15:40:30.871786+0000","last_became_active":"2024-05-15T15:40:30.866530+0000","last_became_peered":"2024-05-15T15:40:30.866530+0000","last_unstale":"2024-05-15T15:40:30.871786+0000","last_undegraded":"2024-05-15T15:40:30.871786+0000","last_fullsized":"2024-05-15T15:40:30.871786+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:12:17.658105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:30.836484+0000","last_change":"2024-05-15T15:40:30.836484+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.836484+0000","last_undegraded":"2024-05-15T15:40:30.836484+0000","last_fullsized":"2024-05-15T15:40:30.836484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T15:40:29.829984+0000","last_change":"2024-05-15T15:40:29.829984+0000","last_active":"2024-05-15T15:40:29.829984+0000","last_peered":"2024-05-15T15:40:29.829984+0000","last_clean":"2024-05-15T15:40:29.829984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:29.829984+0000","last_undegraded":"2024-05-15T15:40:29.829984+0000","last_fullsized":"2024-05-15T15:40:29.829984+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":121,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-15T15:40:25.836750+0000","last_change":"2024-05-15T15:39:42.584601+0000","last_active":"2024-05-15T15:40:25.836750+0000","last_peered":"2024-05-15T15:40:25.836750+0000","last_clean":"2024-05-15T15:40:25.836750+0000","last_became_active":"2024-05-15T15:39:42.584129+0000","last_became_peered":"2024-05-15T15:39:42.584129+0000","last_unstale":"2024-05-15T15:40:25.836750+0000","last_undegraded":"2024-05-15T15:40:25.836750+0000","last_fullsized":"2024-05-15T15:40:25.836750+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:41.378107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:41.378107+0000","last_clean_scrub_stamp":"2024-05-15T15:39:41.378107+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:23:25.285669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":1},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":10,"acting":10,"num_store_stats":1},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509453,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27328,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":315392,"data_stored":114211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509453,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27332,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":315392,"data_stored":114211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509454,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27908,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343932,"statfs":{"total":96636764160,"available":96608186368,"internally_reserved":0,"allocated":909312,"data_stored":704579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509453,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27340,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":315392,"data_stored":114211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509453,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27336,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":315392,"data_stored":114211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509454,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27920,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343920,"statfs":{"total":96636764160,"available":96608174080,"internally_reserved":0,"allocated":909312,"data_stored":704579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509453,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27328,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":315392,"data_stored":114211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":339968,"data_stored":126303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-15T15:40:36.690 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3f is not active+clean 2024-05-15T15:40:36.690 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-15T15:40:30.836484+0000', 'last_change': '2024-05-15T15:40:30.836484+0000', 'last_active': '2024-05-15T15:40:30.836484+0000', 'last_peered': '2024-05-15T15:40:30.836484+0000', 'last_clean': '2024-05-15T15:40:30.836484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T15:40:30.836484+0000', 'last_undegraded': '2024-05-15T15:40:30.836484+0000', 'last_fullsized': '2024-05-15T15:40:30.836484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_clean_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-15T15:40:36.690 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3e is not active+clean 2024-05-15T15:40:36.690 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-15T15:40:30.836484+0000', 'last_change': '2024-05-15T15:40:30.836484+0000', 'last_active': '2024-05-15T15:40:30.836484+0000', 'last_peered': '2024-05-15T15:40:30.836484+0000', 'last_clean': '2024-05-15T15:40:30.836484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T15:40:30.836484+0000', 'last_undegraded': '2024-05-15T15:40:30.836484+0000', 'last_fullsized': '2024-05-15T15:40:30.836484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_clean_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-15T15:40:36.691 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3d is not active+clean 2024-05-15T15:40:36.691 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-15T15:40:30.836484+0000', 'last_change': '2024-05-15T15:40:30.836484+0000', 'last_active': '2024-05-15T15:40:30.836484+0000', 'last_peered': '2024-05-15T15:40:30.836484+0000', 'last_clean': '2024-05-15T15:40:30.836484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T15:40:30.836484+0000', 'last_undegraded': '2024-05-15T15:40:30.836484+0000', 'last_fullsized': '2024-05-15T15:40:30.836484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_clean_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-15T15:40:36.691 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3c is not active+clean 2024-05-15T15:40:36.691 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-05-15T15:40:30.850054+0000', 'last_change': '2024-05-15T15:40:30.850054+0000', 'last_active': '2024-05-15T15:40:30.836484+0000', 'last_peered': '2024-05-15T15:40:30.836484+0000', 'last_clean': '2024-05-15T15:40:30.836484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T15:40:30.850054+0000', 'last_undegraded': '2024-05-15T15:40:30.850054+0000', 'last_fullsized': '2024-05-15T15:40:30.850054+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_clean_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-15T15:40:36.691 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3b is not active+clean 2024-05-15T15:40:36.691 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-15T15:40:30.836484+0000', 'last_change': '2024-05-15T15:40:30.836484+0000', 'last_active': '2024-05-15T15:40:30.836484+0000', 'last_peered': '2024-05-15T15:40:30.836484+0000', 'last_clean': '2024-05-15T15:40:30.836484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T15:40:30.836484+0000', 'last_undegraded': '2024-05-15T15:40:30.836484+0000', 'last_fullsized': '2024-05-15T15:40:30.836484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_clean_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-15T15:40:36.691 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3a is not active+clean 2024-05-15T15:40:36.691 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-15T15:40:30.836484+0000', 'last_change': '2024-05-15T15:40:30.836484+0000', 'last_active': '2024-05-15T15:40:30.836484+0000', 'last_peered': '2024-05-15T15:40:30.836484+0000', 'last_clean': '2024-05-15T15:40:30.836484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T15:40:30.836484+0000', 'last_undegraded': '2024-05-15T15:40:30.836484+0000', 'last_fullsized': '2024-05-15T15:40:30.836484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_clean_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-15T15:40:36.691 INFO:tasks.ceph.ceph_manager.ceph:PG 5.39 is not active+clean 2024-05-15T15:40:36.691 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-15T15:40:30.836484+0000', 'last_change': '2024-05-15T15:40:30.836484+0000', 'last_active': '2024-05-15T15:40:30.836484+0000', 'last_peered': '2024-05-15T15:40:30.836484+0000', 'last_clean': '2024-05-15T15:40:30.836484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T15:40:30.836484+0000', 'last_undegraded': '2024-05-15T15:40:30.836484+0000', 'last_fullsized': '2024-05-15T15:40:30.836484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_clean_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-15T15:40:36.691 INFO:tasks.ceph.ceph_manager.ceph:PG 5.38 is not active+clean 2024-05-15T15:40:36.692 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-15T15:40:30.836484+0000', 'last_change': '2024-05-15T15:40:30.836484+0000', 'last_active': '2024-05-15T15:40:30.836484+0000', 'last_peered': '2024-05-15T15:40:30.836484+0000', 'last_clean': '2024-05-15T15:40:30.836484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T15:40:30.836484+0000', 'last_undegraded': '2024-05-15T15:40:30.836484+0000', 'last_fullsized': '2024-05-15T15:40:30.836484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_clean_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-15T15:40:36.692 INFO:tasks.ceph.ceph_manager.ceph:PG 5.37 is not active+clean 2024-05-15T15:40:36.692 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-15T15:40:30.836484+0000', 'last_change': '2024-05-15T15:40:30.836484+0000', 'last_active': '2024-05-15T15:40:30.836484+0000', 'last_peered': '2024-05-15T15:40:30.836484+0000', 'last_clean': '2024-05-15T15:40:30.836484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T15:40:30.836484+0000', 'last_undegraded': '2024-05-15T15:40:30.836484+0000', 'last_fullsized': '2024-05-15T15:40:30.836484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_clean_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-15T15:40:36.692 INFO:tasks.ceph.ceph_manager.ceph:PG 5.36 is not active+clean 2024-05-15T15:40:36.692 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-05-15T15:40:30.848792+0000', 'last_change': '2024-05-15T15:40:30.848792+0000', 'last_active': '2024-05-15T15:40:30.836484+0000', 'last_peered': '2024-05-15T15:40:30.836484+0000', 'last_clean': '2024-05-15T15:40:30.836484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T15:40:30.848792+0000', 'last_undegraded': '2024-05-15T15:40:30.848792+0000', 'last_fullsized': '2024-05-15T15:40:30.848792+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_clean_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-15T15:40:36.692 INFO:tasks.ceph.ceph_manager.ceph:PG 5.35 is not active+clean 2024-05-15T15:40:36.692 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-15T15:40:30.836484+0000', 'last_change': '2024-05-15T15:40:30.836484+0000', 'last_active': '2024-05-15T15:40:30.836484+0000', 'last_peered': '2024-05-15T15:40:30.836484+0000', 'last_clean': '2024-05-15T15:40:30.836484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T15:40:30.836484+0000', 'last_undegraded': '2024-05-15T15:40:30.836484+0000', 'last_fullsized': '2024-05-15T15:40:30.836484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_clean_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-15T15:40:36.692 INFO:tasks.ceph.ceph_manager.ceph:PG 5.34 is not active+clean 2024-05-15T15:40:36.692 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-15T15:40:30.836484+0000', 'last_change': '2024-05-15T15:40:30.836484+0000', 'last_active': '2024-05-15T15:40:30.836484+0000', 'last_peered': '2024-05-15T15:40:30.836484+0000', 'last_clean': '2024-05-15T15:40:30.836484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T15:40:30.836484+0000', 'last_undegraded': '2024-05-15T15:40:30.836484+0000', 'last_fullsized': '2024-05-15T15:40:30.836484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_clean_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-15T15:40:36.692 INFO:tasks.ceph.ceph_manager.ceph:PG 5.33 is not active+clean 2024-05-15T15:40:36.692 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-15T15:40:30.836484+0000', 'last_change': '2024-05-15T15:40:30.836484+0000', 'last_active': '2024-05-15T15:40:30.836484+0000', 'last_peered': '2024-05-15T15:40:30.836484+0000', 'last_clean': '2024-05-15T15:40:30.836484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T15:40:30.836484+0000', 'last_undegraded': '2024-05-15T15:40:30.836484+0000', 'last_fullsized': '2024-05-15T15:40:30.836484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_clean_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-15T15:40:36.692 INFO:tasks.ceph.ceph_manager.ceph:PG 5.32 is not active+clean 2024-05-15T15:40:36.693 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-05-15T15:40:30.847400+0000', 'last_change': '2024-05-15T15:40:30.847400+0000', 'last_active': '2024-05-15T15:40:30.836484+0000', 'last_peered': '2024-05-15T15:40:30.836484+0000', 'last_clean': '2024-05-15T15:40:30.836484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T15:40:30.847400+0000', 'last_undegraded': '2024-05-15T15:40:30.847400+0000', 'last_fullsized': '2024-05-15T15:40:30.847400+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_clean_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-15T15:40:36.693 INFO:tasks.ceph.ceph_manager.ceph:PG 5.31 is not active+clean 2024-05-15T15:40:36.693 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-15T15:40:30.836484+0000', 'last_change': '2024-05-15T15:40:30.836484+0000', 'last_active': '2024-05-15T15:40:30.836484+0000', 'last_peered': '2024-05-15T15:40:30.836484+0000', 'last_clean': '2024-05-15T15:40:30.836484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T15:40:30.836484+0000', 'last_undegraded': '2024-05-15T15:40:30.836484+0000', 'last_fullsized': '2024-05-15T15:40:30.836484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_clean_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-15T15:40:36.693 INFO:tasks.ceph.ceph_manager.ceph:PG 5.30 is not active+clean 2024-05-15T15:40:36.693 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-15T15:40:30.836484+0000', 'last_change': '2024-05-15T15:40:30.836484+0000', 'last_active': '2024-05-15T15:40:30.836484+0000', 'last_peered': '2024-05-15T15:40:30.836484+0000', 'last_clean': '2024-05-15T15:40:30.836484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T15:40:30.836484+0000', 'last_undegraded': '2024-05-15T15:40:30.836484+0000', 'last_fullsized': '2024-05-15T15:40:30.836484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_clean_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-15T15:40:36.693 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2f is not active+clean 2024-05-15T15:40:36.693 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-15T15:40:30.836484+0000', 'last_change': '2024-05-15T15:40:30.836484+0000', 'last_active': '2024-05-15T15:40:30.836484+0000', 'last_peered': '2024-05-15T15:40:30.836484+0000', 'last_clean': '2024-05-15T15:40:30.836484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T15:40:30.836484+0000', 'last_undegraded': '2024-05-15T15:40:30.836484+0000', 'last_fullsized': '2024-05-15T15:40:30.836484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_clean_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-15T15:40:36.693 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2e is not active+clean 2024-05-15T15:40:36.693 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-15T15:40:30.836484+0000', 'last_change': '2024-05-15T15:40:30.836484+0000', 'last_active': '2024-05-15T15:40:30.836484+0000', 'last_peered': '2024-05-15T15:40:30.836484+0000', 'last_clean': '2024-05-15T15:40:30.836484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T15:40:30.836484+0000', 'last_undegraded': '2024-05-15T15:40:30.836484+0000', 'last_fullsized': '2024-05-15T15:40:30.836484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_clean_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-15T15:40:36.693 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2d is not active+clean 2024-05-15T15:40:36.693 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-15T15:40:30.836484+0000', 'last_change': '2024-05-15T15:40:30.836484+0000', 'last_active': '2024-05-15T15:40:30.836484+0000', 'last_peered': '2024-05-15T15:40:30.836484+0000', 'last_clean': '2024-05-15T15:40:30.836484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T15:40:30.836484+0000', 'last_undegraded': '2024-05-15T15:40:30.836484+0000', 'last_fullsized': '2024-05-15T15:40:30.836484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_clean_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-15T15:40:36.694 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2c is not active+clean 2024-05-15T15:40:36.694 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-15T15:40:30.836484+0000', 'last_change': '2024-05-15T15:40:30.836484+0000', 'last_active': '2024-05-15T15:40:30.836484+0000', 'last_peered': '2024-05-15T15:40:30.836484+0000', 'last_clean': '2024-05-15T15:40:30.836484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T15:40:30.836484+0000', 'last_undegraded': '2024-05-15T15:40:30.836484+0000', 'last_fullsized': '2024-05-15T15:40:30.836484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_clean_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-15T15:40:36.694 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2b is not active+clean 2024-05-15T15:40:36.694 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-15T15:40:30.836484+0000', 'last_change': '2024-05-15T15:40:30.836484+0000', 'last_active': '2024-05-15T15:40:30.836484+0000', 'last_peered': '2024-05-15T15:40:30.836484+0000', 'last_clean': '2024-05-15T15:40:30.836484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T15:40:30.836484+0000', 'last_undegraded': '2024-05-15T15:40:30.836484+0000', 'last_fullsized': '2024-05-15T15:40:30.836484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_clean_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-15T15:40:36.694 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2a is not active+clean 2024-05-15T15:40:36.694 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-15T15:40:30.836484+0000', 'last_change': '2024-05-15T15:40:30.836484+0000', 'last_active': '2024-05-15T15:40:30.836484+0000', 'last_peered': '2024-05-15T15:40:30.836484+0000', 'last_clean': '2024-05-15T15:40:30.836484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T15:40:30.836484+0000', 'last_undegraded': '2024-05-15T15:40:30.836484+0000', 'last_fullsized': '2024-05-15T15:40:30.836484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_clean_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-15T15:40:36.694 INFO:tasks.ceph.ceph_manager.ceph:PG 5.29 is not active+clean 2024-05-15T15:40:36.694 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-15T15:40:30.836484+0000', 'last_change': '2024-05-15T15:40:30.836484+0000', 'last_active': '2024-05-15T15:40:30.836484+0000', 'last_peered': '2024-05-15T15:40:30.836484+0000', 'last_clean': '2024-05-15T15:40:30.836484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T15:40:30.836484+0000', 'last_undegraded': '2024-05-15T15:40:30.836484+0000', 'last_fullsized': '2024-05-15T15:40:30.836484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_clean_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-15T15:40:36.694 INFO:tasks.ceph.ceph_manager.ceph:PG 5.28 is not active+clean 2024-05-15T15:40:36.694 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-15T15:40:30.836484+0000', 'last_change': '2024-05-15T15:40:30.836484+0000', 'last_active': '2024-05-15T15:40:30.836484+0000', 'last_peered': '2024-05-15T15:40:30.836484+0000', 'last_clean': '2024-05-15T15:40:30.836484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T15:40:30.836484+0000', 'last_undegraded': '2024-05-15T15:40:30.836484+0000', 'last_fullsized': '2024-05-15T15:40:30.836484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_clean_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-15T15:40:36.694 INFO:tasks.ceph.ceph_manager.ceph:PG 5.27 is not active+clean 2024-05-15T15:40:36.695 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-05-15T15:40:30.848183+0000', 'last_change': '2024-05-15T15:40:30.848183+0000', 'last_active': '2024-05-15T15:40:30.836484+0000', 'last_peered': '2024-05-15T15:40:30.836484+0000', 'last_clean': '2024-05-15T15:40:30.836484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T15:40:30.848183+0000', 'last_undegraded': '2024-05-15T15:40:30.848183+0000', 'last_fullsized': '2024-05-15T15:40:30.848183+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_clean_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-15T15:40:36.695 INFO:tasks.ceph.ceph_manager.ceph:PG 5.26 is not active+clean 2024-05-15T15:40:36.695 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-05-15T15:40:30.847665+0000', 'last_change': '2024-05-15T15:40:30.847665+0000', 'last_active': '2024-05-15T15:40:30.836484+0000', 'last_peered': '2024-05-15T15:40:30.836484+0000', 'last_clean': '2024-05-15T15:40:30.836484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T15:40:30.847665+0000', 'last_undegraded': '2024-05-15T15:40:30.847665+0000', 'last_fullsized': '2024-05-15T15:40:30.847665+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_clean_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-15T15:40:36.695 INFO:tasks.ceph.ceph_manager.ceph:PG 5.25 is not active+clean 2024-05-15T15:40:36.695 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-15T15:40:30.836484+0000', 'last_change': '2024-05-15T15:40:30.836484+0000', 'last_active': '2024-05-15T15:40:30.836484+0000', 'last_peered': '2024-05-15T15:40:30.836484+0000', 'last_clean': '2024-05-15T15:40:30.836484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T15:40:30.836484+0000', 'last_undegraded': '2024-05-15T15:40:30.836484+0000', 'last_fullsized': '2024-05-15T15:40:30.836484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_clean_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-15T15:40:36.695 INFO:tasks.ceph.ceph_manager.ceph:PG 5.24 is not active+clean 2024-05-15T15:40:36.695 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-15T15:40:30.836484+0000', 'last_change': '2024-05-15T15:40:30.836484+0000', 'last_active': '2024-05-15T15:40:30.836484+0000', 'last_peered': '2024-05-15T15:40:30.836484+0000', 'last_clean': '2024-05-15T15:40:30.836484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T15:40:30.836484+0000', 'last_undegraded': '2024-05-15T15:40:30.836484+0000', 'last_fullsized': '2024-05-15T15:40:30.836484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_clean_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-15T15:40:36.695 INFO:tasks.ceph.ceph_manager.ceph:PG 5.23 is not active+clean 2024-05-15T15:40:36.695 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-15T15:40:30.836484+0000', 'last_change': '2024-05-15T15:40:30.836484+0000', 'last_active': '2024-05-15T15:40:30.836484+0000', 'last_peered': '2024-05-15T15:40:30.836484+0000', 'last_clean': '2024-05-15T15:40:30.836484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T15:40:30.836484+0000', 'last_undegraded': '2024-05-15T15:40:30.836484+0000', 'last_fullsized': '2024-05-15T15:40:30.836484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_clean_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-15T15:40:36.695 INFO:tasks.ceph.ceph_manager.ceph:PG 5.22 is not active+clean 2024-05-15T15:40:36.695 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-15T15:40:30.836484+0000', 'last_change': '2024-05-15T15:40:30.836484+0000', 'last_active': '2024-05-15T15:40:30.836484+0000', 'last_peered': '2024-05-15T15:40:30.836484+0000', 'last_clean': '2024-05-15T15:40:30.836484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T15:40:30.836484+0000', 'last_undegraded': '2024-05-15T15:40:30.836484+0000', 'last_fullsized': '2024-05-15T15:40:30.836484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_clean_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-15T15:40:36.696 INFO:tasks.ceph.ceph_manager.ceph:PG 5.21 is not active+clean 2024-05-15T15:40:36.696 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-15T15:40:30.836484+0000', 'last_change': '2024-05-15T15:40:30.836484+0000', 'last_active': '2024-05-15T15:40:30.836484+0000', 'last_peered': '2024-05-15T15:40:30.836484+0000', 'last_clean': '2024-05-15T15:40:30.836484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T15:40:30.836484+0000', 'last_undegraded': '2024-05-15T15:40:30.836484+0000', 'last_fullsized': '2024-05-15T15:40:30.836484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_clean_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-15T15:40:36.696 INFO:tasks.ceph.ceph_manager.ceph:PG 5.20 is not active+clean 2024-05-15T15:40:36.696 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-15T15:40:30.836484+0000', 'last_change': '2024-05-15T15:40:30.836484+0000', 'last_active': '2024-05-15T15:40:30.836484+0000', 'last_peered': '2024-05-15T15:40:30.836484+0000', 'last_clean': '2024-05-15T15:40:30.836484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T15:40:30.836484+0000', 'last_undegraded': '2024-05-15T15:40:30.836484+0000', 'last_fullsized': '2024-05-15T15:40:30.836484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_clean_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-15T15:40:36.696 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1e is not active+clean 2024-05-15T15:40:36.696 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-15T15:40:30.836484+0000', 'last_change': '2024-05-15T15:40:30.836484+0000', 'last_active': '2024-05-15T15:40:30.836484+0000', 'last_peered': '2024-05-15T15:40:30.836484+0000', 'last_clean': '2024-05-15T15:40:30.836484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T15:40:30.836484+0000', 'last_undegraded': '2024-05-15T15:40:30.836484+0000', 'last_fullsized': '2024-05-15T15:40:30.836484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_clean_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-15T15:40:36.696 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1f is not active+clean 2024-05-15T15:40:36.696 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-15T15:40:29.829984+0000', 'last_change': '2024-05-15T15:40:29.829984+0000', 'last_active': '2024-05-15T15:40:29.829984+0000', 'last_peered': '2024-05-15T15:40:29.829984+0000', 'last_clean': '2024-05-15T15:40:29.829984+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T15:40:29.829984+0000', 'last_undegraded': '2024-05-15T15:40:29.829984+0000', 'last_fullsized': '2024-05-15T15:40:29.829984+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T15:40:29.829984+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T15:40:29.829984+0000', 'last_clean_scrub_stamp': '2024-05-15T15:40:29.829984+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-15T15:40:36.696 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1f is not active+clean 2024-05-15T15:40:36.696 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-15T15:40:30.836484+0000', 'last_change': '2024-05-15T15:40:30.836484+0000', 'last_active': '2024-05-15T15:40:30.836484+0000', 'last_peered': '2024-05-15T15:40:30.836484+0000', 'last_clean': '2024-05-15T15:40:30.836484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T15:40:30.836484+0000', 'last_undegraded': '2024-05-15T15:40:30.836484+0000', 'last_fullsized': '2024-05-15T15:40:30.836484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_clean_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-15T15:40:36.696 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1c is not active+clean 2024-05-15T15:40:36.696 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-15T15:40:30.836484+0000', 'last_change': '2024-05-15T15:40:30.836484+0000', 'last_active': '2024-05-15T15:40:30.836484+0000', 'last_peered': '2024-05-15T15:40:30.836484+0000', 'last_clean': '2024-05-15T15:40:30.836484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T15:40:30.836484+0000', 'last_undegraded': '2024-05-15T15:40:30.836484+0000', 'last_fullsized': '2024-05-15T15:40:30.836484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_clean_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-15T15:40:36.697 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1d is not active+clean 2024-05-15T15:40:36.697 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-15T15:40:29.829984+0000', 'last_change': '2024-05-15T15:40:29.829984+0000', 'last_active': '2024-05-15T15:40:29.829984+0000', 'last_peered': '2024-05-15T15:40:29.829984+0000', 'last_clean': '2024-05-15T15:40:29.829984+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T15:40:29.829984+0000', 'last_undegraded': '2024-05-15T15:40:29.829984+0000', 'last_fullsized': '2024-05-15T15:40:29.829984+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T15:40:29.829984+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T15:40:29.829984+0000', 'last_clean_scrub_stamp': '2024-05-15T15:40:29.829984+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-15T15:40:36.697 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1d is not active+clean 2024-05-15T15:40:36.697 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-05-15T15:40:30.846972+0000', 'last_change': '2024-05-15T15:40:30.846972+0000', 'last_active': '2024-05-15T15:40:30.836484+0000', 'last_peered': '2024-05-15T15:40:30.836484+0000', 'last_clean': '2024-05-15T15:40:30.836484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T15:40:30.846972+0000', 'last_undegraded': '2024-05-15T15:40:30.846972+0000', 'last_fullsized': '2024-05-15T15:40:30.846972+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_clean_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-15T15:40:36.697 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1a is not active+clean 2024-05-15T15:40:36.697 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-15T15:40:30.836484+0000', 'last_change': '2024-05-15T15:40:30.836484+0000', 'last_active': '2024-05-15T15:40:30.836484+0000', 'last_peered': '2024-05-15T15:40:30.836484+0000', 'last_clean': '2024-05-15T15:40:30.836484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T15:40:30.836484+0000', 'last_undegraded': '2024-05-15T15:40:30.836484+0000', 'last_fullsized': '2024-05-15T15:40:30.836484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_clean_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-15T15:40:36.697 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1b is not active+clean 2024-05-15T15:40:36.697 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-15T15:40:29.829984+0000', 'last_change': '2024-05-15T15:40:29.829984+0000', 'last_active': '2024-05-15T15:40:29.829984+0000', 'last_peered': '2024-05-15T15:40:29.829984+0000', 'last_clean': '2024-05-15T15:40:29.829984+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T15:40:29.829984+0000', 'last_undegraded': '2024-05-15T15:40:29.829984+0000', 'last_fullsized': '2024-05-15T15:40:29.829984+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T15:40:29.829984+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T15:40:29.829984+0000', 'last_clean_scrub_stamp': '2024-05-15T15:40:29.829984+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-15T15:40:36.697 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1b is not active+clean 2024-05-15T15:40:36.697 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-15T15:40:30.836484+0000', 'last_change': '2024-05-15T15:40:30.836484+0000', 'last_active': '2024-05-15T15:40:30.836484+0000', 'last_peered': '2024-05-15T15:40:30.836484+0000', 'last_clean': '2024-05-15T15:40:30.836484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T15:40:30.836484+0000', 'last_undegraded': '2024-05-15T15:40:30.836484+0000', 'last_fullsized': '2024-05-15T15:40:30.836484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_clean_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-15T15:40:36.697 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1a is not active+clean 2024-05-15T15:40:36.697 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-15T15:40:29.829984+0000', 'last_change': '2024-05-15T15:40:29.829984+0000', 'last_active': '2024-05-15T15:40:29.829984+0000', 'last_peered': '2024-05-15T15:40:29.829984+0000', 'last_clean': '2024-05-15T15:40:29.829984+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T15:40:29.829984+0000', 'last_undegraded': '2024-05-15T15:40:29.829984+0000', 'last_fullsized': '2024-05-15T15:40:29.829984+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T15:40:29.829984+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T15:40:29.829984+0000', 'last_clean_scrub_stamp': '2024-05-15T15:40:29.829984+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-15T15:40:36.698 INFO:tasks.ceph.ceph_manager.ceph:PG 5.18 is not active+clean 2024-05-15T15:40:36.698 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-15T15:40:30.836484+0000', 'last_change': '2024-05-15T15:40:30.836484+0000', 'last_active': '2024-05-15T15:40:30.836484+0000', 'last_peered': '2024-05-15T15:40:30.836484+0000', 'last_clean': '2024-05-15T15:40:30.836484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T15:40:30.836484+0000', 'last_undegraded': '2024-05-15T15:40:30.836484+0000', 'last_fullsized': '2024-05-15T15:40:30.836484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_clean_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-15T15:40:36.698 INFO:tasks.ceph.ceph_manager.ceph:PG 4.19 is not active+clean 2024-05-15T15:40:36.698 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-15T15:40:29.829984+0000', 'last_change': '2024-05-15T15:40:29.829984+0000', 'last_active': '2024-05-15T15:40:29.829984+0000', 'last_peered': '2024-05-15T15:40:29.829984+0000', 'last_clean': '2024-05-15T15:40:29.829984+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T15:40:29.829984+0000', 'last_undegraded': '2024-05-15T15:40:29.829984+0000', 'last_fullsized': '2024-05-15T15:40:29.829984+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T15:40:29.829984+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T15:40:29.829984+0000', 'last_clean_scrub_stamp': '2024-05-15T15:40:29.829984+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-15T15:40:36.698 INFO:tasks.ceph.ceph_manager.ceph:PG 5.19 is not active+clean 2024-05-15T15:40:36.698 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-05-15T15:40:30.845746+0000', 'last_change': '2024-05-15T15:40:30.845746+0000', 'last_active': '2024-05-15T15:40:30.836484+0000', 'last_peered': '2024-05-15T15:40:30.836484+0000', 'last_clean': '2024-05-15T15:40:30.836484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T15:40:30.845746+0000', 'last_undegraded': '2024-05-15T15:40:30.845746+0000', 'last_fullsized': '2024-05-15T15:40:30.845746+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_clean_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-15T15:40:36.698 INFO:tasks.ceph.ceph_manager.ceph:PG 4.18 is not active+clean 2024-05-15T15:40:36.698 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-15T15:40:29.829984+0000', 'last_change': '2024-05-15T15:40:29.829984+0000', 'last_active': '2024-05-15T15:40:29.829984+0000', 'last_peered': '2024-05-15T15:40:29.829984+0000', 'last_clean': '2024-05-15T15:40:29.829984+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T15:40:29.829984+0000', 'last_undegraded': '2024-05-15T15:40:29.829984+0000', 'last_fullsized': '2024-05-15T15:40:29.829984+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T15:40:29.829984+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T15:40:29.829984+0000', 'last_clean_scrub_stamp': '2024-05-15T15:40:29.829984+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-15T15:40:36.698 INFO:tasks.ceph.ceph_manager.ceph:PG 5.16 is not active+clean 2024-05-15T15:40:36.698 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-15T15:40:30.836484+0000', 'last_change': '2024-05-15T15:40:30.836484+0000', 'last_active': '2024-05-15T15:40:30.836484+0000', 'last_peered': '2024-05-15T15:40:30.836484+0000', 'last_clean': '2024-05-15T15:40:30.836484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T15:40:30.836484+0000', 'last_undegraded': '2024-05-15T15:40:30.836484+0000', 'last_fullsized': '2024-05-15T15:40:30.836484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_clean_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-15T15:40:36.699 INFO:tasks.ceph.ceph_manager.ceph:PG 4.17 is not active+clean 2024-05-15T15:40:36.699 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-15T15:40:29.829984+0000', 'last_change': '2024-05-15T15:40:29.829984+0000', 'last_active': '2024-05-15T15:40:29.829984+0000', 'last_peered': '2024-05-15T15:40:29.829984+0000', 'last_clean': '2024-05-15T15:40:29.829984+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T15:40:29.829984+0000', 'last_undegraded': '2024-05-15T15:40:29.829984+0000', 'last_fullsized': '2024-05-15T15:40:29.829984+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T15:40:29.829984+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T15:40:29.829984+0000', 'last_clean_scrub_stamp': '2024-05-15T15:40:29.829984+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-15T15:40:36.699 INFO:tasks.ceph.ceph_manager.ceph:PG 5.17 is not active+clean 2024-05-15T15:40:36.699 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-05-15T15:40:30.845968+0000', 'last_change': '2024-05-15T15:40:30.845968+0000', 'last_active': '2024-05-15T15:40:30.836484+0000', 'last_peered': '2024-05-15T15:40:30.836484+0000', 'last_clean': '2024-05-15T15:40:30.836484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T15:40:30.845968+0000', 'last_undegraded': '2024-05-15T15:40:30.845968+0000', 'last_fullsized': '2024-05-15T15:40:30.845968+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_clean_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-15T15:40:36.699 INFO:tasks.ceph.ceph_manager.ceph:PG 4.16 is not active+clean 2024-05-15T15:40:36.699 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-15T15:40:29.829984+0000', 'last_change': '2024-05-15T15:40:29.829984+0000', 'last_active': '2024-05-15T15:40:29.829984+0000', 'last_peered': '2024-05-15T15:40:29.829984+0000', 'last_clean': '2024-05-15T15:40:29.829984+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T15:40:29.829984+0000', 'last_undegraded': '2024-05-15T15:40:29.829984+0000', 'last_fullsized': '2024-05-15T15:40:29.829984+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T15:40:29.829984+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T15:40:29.829984+0000', 'last_clean_scrub_stamp': '2024-05-15T15:40:29.829984+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-15T15:40:36.699 INFO:tasks.ceph.ceph_manager.ceph:PG 5.14 is not active+clean 2024-05-15T15:40:36.699 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-05-15T15:40:30.849029+0000', 'last_change': '2024-05-15T15:40:30.849029+0000', 'last_active': '2024-05-15T15:40:30.836484+0000', 'last_peered': '2024-05-15T15:40:30.836484+0000', 'last_clean': '2024-05-15T15:40:30.836484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T15:40:30.849029+0000', 'last_undegraded': '2024-05-15T15:40:30.849029+0000', 'last_fullsized': '2024-05-15T15:40:30.849029+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_clean_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-15T15:40:36.699 INFO:tasks.ceph.ceph_manager.ceph:PG 4.15 is not active+clean 2024-05-15T15:40:36.699 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-15T15:40:29.829984+0000', 'last_change': '2024-05-15T15:40:29.829984+0000', 'last_active': '2024-05-15T15:40:29.829984+0000', 'last_peered': '2024-05-15T15:40:29.829984+0000', 'last_clean': '2024-05-15T15:40:29.829984+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T15:40:29.829984+0000', 'last_undegraded': '2024-05-15T15:40:29.829984+0000', 'last_fullsized': '2024-05-15T15:40:29.829984+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T15:40:29.829984+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T15:40:29.829984+0000', 'last_clean_scrub_stamp': '2024-05-15T15:40:29.829984+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-15T15:40:36.699 INFO:tasks.ceph.ceph_manager.ceph:PG 5.15 is not active+clean 2024-05-15T15:40:36.700 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-15T15:40:30.836484+0000', 'last_change': '2024-05-15T15:40:30.836484+0000', 'last_active': '2024-05-15T15:40:30.836484+0000', 'last_peered': '2024-05-15T15:40:30.836484+0000', 'last_clean': '2024-05-15T15:40:30.836484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T15:40:30.836484+0000', 'last_undegraded': '2024-05-15T15:40:30.836484+0000', 'last_fullsized': '2024-05-15T15:40:30.836484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_clean_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-15T15:40:36.700 INFO:tasks.ceph.ceph_manager.ceph:PG 4.14 is not active+clean 2024-05-15T15:40:36.700 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-15T15:40:29.829984+0000', 'last_change': '2024-05-15T15:40:29.829984+0000', 'last_active': '2024-05-15T15:40:29.829984+0000', 'last_peered': '2024-05-15T15:40:29.829984+0000', 'last_clean': '2024-05-15T15:40:29.829984+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T15:40:29.829984+0000', 'last_undegraded': '2024-05-15T15:40:29.829984+0000', 'last_fullsized': '2024-05-15T15:40:29.829984+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T15:40:29.829984+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T15:40:29.829984+0000', 'last_clean_scrub_stamp': '2024-05-15T15:40:29.829984+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-15T15:40:36.700 INFO:tasks.ceph.ceph_manager.ceph:PG 5.12 is not active+clean 2024-05-15T15:40:36.700 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-15T15:40:30.836484+0000', 'last_change': '2024-05-15T15:40:30.836484+0000', 'last_active': '2024-05-15T15:40:30.836484+0000', 'last_peered': '2024-05-15T15:40:30.836484+0000', 'last_clean': '2024-05-15T15:40:30.836484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T15:40:30.836484+0000', 'last_undegraded': '2024-05-15T15:40:30.836484+0000', 'last_fullsized': '2024-05-15T15:40:30.836484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_clean_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-15T15:40:36.700 INFO:tasks.ceph.ceph_manager.ceph:PG 4.13 is not active+clean 2024-05-15T15:40:36.700 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-15T15:40:29.829984+0000', 'last_change': '2024-05-15T15:40:29.829984+0000', 'last_active': '2024-05-15T15:40:29.829984+0000', 'last_peered': '2024-05-15T15:40:29.829984+0000', 'last_clean': '2024-05-15T15:40:29.829984+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T15:40:29.829984+0000', 'last_undegraded': '2024-05-15T15:40:29.829984+0000', 'last_fullsized': '2024-05-15T15:40:29.829984+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T15:40:29.829984+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T15:40:29.829984+0000', 'last_clean_scrub_stamp': '2024-05-15T15:40:29.829984+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-15T15:40:36.700 INFO:tasks.ceph.ceph_manager.ceph:PG 5.13 is not active+clean 2024-05-15T15:40:36.700 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-05-15T15:40:30.846550+0000', 'last_change': '2024-05-15T15:40:30.846550+0000', 'last_active': '2024-05-15T15:40:30.836484+0000', 'last_peered': '2024-05-15T15:40:30.836484+0000', 'last_clean': '2024-05-15T15:40:30.836484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T15:40:30.846550+0000', 'last_undegraded': '2024-05-15T15:40:30.846550+0000', 'last_fullsized': '2024-05-15T15:40:30.846550+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_clean_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-15T15:40:36.700 INFO:tasks.ceph.ceph_manager.ceph:PG 5.10 is not active+clean 2024-05-15T15:40:36.700 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-15T15:40:30.836484+0000', 'last_change': '2024-05-15T15:40:30.836484+0000', 'last_active': '2024-05-15T15:40:30.836484+0000', 'last_peered': '2024-05-15T15:40:30.836484+0000', 'last_clean': '2024-05-15T15:40:30.836484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T15:40:30.836484+0000', 'last_undegraded': '2024-05-15T15:40:30.836484+0000', 'last_fullsized': '2024-05-15T15:40:30.836484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_clean_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-15T15:40:36.701 INFO:tasks.ceph.ceph_manager.ceph:PG 5.11 is not active+clean 2024-05-15T15:40:36.701 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-15T15:40:30.836484+0000', 'last_change': '2024-05-15T15:40:30.836484+0000', 'last_active': '2024-05-15T15:40:30.836484+0000', 'last_peered': '2024-05-15T15:40:30.836484+0000', 'last_clean': '2024-05-15T15:40:30.836484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T15:40:30.836484+0000', 'last_undegraded': '2024-05-15T15:40:30.836484+0000', 'last_fullsized': '2024-05-15T15:40:30.836484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_clean_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-15T15:40:36.701 INFO:tasks.ceph.ceph_manager.ceph:PG 4.10 is not active+clean 2024-05-15T15:40:36.701 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-15T15:40:29.829984+0000', 'last_change': '2024-05-15T15:40:29.829984+0000', 'last_active': '2024-05-15T15:40:29.829984+0000', 'last_peered': '2024-05-15T15:40:29.829984+0000', 'last_clean': '2024-05-15T15:40:29.829984+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T15:40:29.829984+0000', 'last_undegraded': '2024-05-15T15:40:29.829984+0000', 'last_fullsized': '2024-05-15T15:40:29.829984+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T15:40:29.829984+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T15:40:29.829984+0000', 'last_clean_scrub_stamp': '2024-05-15T15:40:29.829984+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-15T15:40:36.701 INFO:tasks.ceph.ceph_manager.ceph:PG 5.e is not active+clean 2024-05-15T15:40:36.701 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-15T15:40:30.836484+0000', 'last_change': '2024-05-15T15:40:30.836484+0000', 'last_active': '2024-05-15T15:40:30.836484+0000', 'last_peered': '2024-05-15T15:40:30.836484+0000', 'last_clean': '2024-05-15T15:40:30.836484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T15:40:30.836484+0000', 'last_undegraded': '2024-05-15T15:40:30.836484+0000', 'last_fullsized': '2024-05-15T15:40:30.836484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_clean_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-15T15:40:36.701 INFO:tasks.ceph.ceph_manager.ceph:PG 4.f is not active+clean 2024-05-15T15:40:36.701 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-15T15:40:29.829984+0000', 'last_change': '2024-05-15T15:40:29.829984+0000', 'last_active': '2024-05-15T15:40:29.829984+0000', 'last_peered': '2024-05-15T15:40:29.829984+0000', 'last_clean': '2024-05-15T15:40:29.829984+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T15:40:29.829984+0000', 'last_undegraded': '2024-05-15T15:40:29.829984+0000', 'last_fullsized': '2024-05-15T15:40:29.829984+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T15:40:29.829984+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T15:40:29.829984+0000', 'last_clean_scrub_stamp': '2024-05-15T15:40:29.829984+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-15T15:40:36.701 INFO:tasks.ceph.ceph_manager.ceph:PG 5.f is not active+clean 2024-05-15T15:40:36.701 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-15T15:40:30.836484+0000', 'last_change': '2024-05-15T15:40:30.836484+0000', 'last_active': '2024-05-15T15:40:30.836484+0000', 'last_peered': '2024-05-15T15:40:30.836484+0000', 'last_clean': '2024-05-15T15:40:30.836484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T15:40:30.836484+0000', 'last_undegraded': '2024-05-15T15:40:30.836484+0000', 'last_fullsized': '2024-05-15T15:40:30.836484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_clean_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-15T15:40:36.701 INFO:tasks.ceph.ceph_manager.ceph:PG 4.e is not active+clean 2024-05-15T15:40:36.701 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-15T15:40:29.829984+0000', 'last_change': '2024-05-15T15:40:29.829984+0000', 'last_active': '2024-05-15T15:40:29.829984+0000', 'last_peered': '2024-05-15T15:40:29.829984+0000', 'last_clean': '2024-05-15T15:40:29.829984+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T15:40:29.829984+0000', 'last_undegraded': '2024-05-15T15:40:29.829984+0000', 'last_fullsized': '2024-05-15T15:40:29.829984+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T15:40:29.829984+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T15:40:29.829984+0000', 'last_clean_scrub_stamp': '2024-05-15T15:40:29.829984+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-15T15:40:36.702 INFO:tasks.ceph.ceph_manager.ceph:PG 5.c is not active+clean 2024-05-15T15:40:36.702 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-15T15:40:30.836484+0000', 'last_change': '2024-05-15T15:40:30.836484+0000', 'last_active': '2024-05-15T15:40:30.836484+0000', 'last_peered': '2024-05-15T15:40:30.836484+0000', 'last_clean': '2024-05-15T15:40:30.836484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T15:40:30.836484+0000', 'last_undegraded': '2024-05-15T15:40:30.836484+0000', 'last_fullsized': '2024-05-15T15:40:30.836484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_clean_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-15T15:40:36.702 INFO:tasks.ceph.ceph_manager.ceph:PG 4.d is not active+clean 2024-05-15T15:40:36.702 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-15T15:40:29.829984+0000', 'last_change': '2024-05-15T15:40:29.829984+0000', 'last_active': '2024-05-15T15:40:29.829984+0000', 'last_peered': '2024-05-15T15:40:29.829984+0000', 'last_clean': '2024-05-15T15:40:29.829984+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T15:40:29.829984+0000', 'last_undegraded': '2024-05-15T15:40:29.829984+0000', 'last_fullsized': '2024-05-15T15:40:29.829984+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T15:40:29.829984+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T15:40:29.829984+0000', 'last_clean_scrub_stamp': '2024-05-15T15:40:29.829984+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-15T15:40:36.702 INFO:tasks.ceph.ceph_manager.ceph:PG 5.d is not active+clean 2024-05-15T15:40:36.702 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-15T15:40:30.836484+0000', 'last_change': '2024-05-15T15:40:30.836484+0000', 'last_active': '2024-05-15T15:40:30.836484+0000', 'last_peered': '2024-05-15T15:40:30.836484+0000', 'last_clean': '2024-05-15T15:40:30.836484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T15:40:30.836484+0000', 'last_undegraded': '2024-05-15T15:40:30.836484+0000', 'last_fullsized': '2024-05-15T15:40:30.836484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_clean_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-15T15:40:36.702 INFO:tasks.ceph.ceph_manager.ceph:PG 4.c is not active+clean 2024-05-15T15:40:36.702 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-15T15:40:29.829984+0000', 'last_change': '2024-05-15T15:40:29.829984+0000', 'last_active': '2024-05-15T15:40:29.829984+0000', 'last_peered': '2024-05-15T15:40:29.829984+0000', 'last_clean': '2024-05-15T15:40:29.829984+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T15:40:29.829984+0000', 'last_undegraded': '2024-05-15T15:40:29.829984+0000', 'last_fullsized': '2024-05-15T15:40:29.829984+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T15:40:29.829984+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T15:40:29.829984+0000', 'last_clean_scrub_stamp': '2024-05-15T15:40:29.829984+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-15T15:40:36.702 INFO:tasks.ceph.ceph_manager.ceph:PG 5.a is not active+clean 2024-05-15T15:40:36.702 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-15T15:40:30.836484+0000', 'last_change': '2024-05-15T15:40:30.836484+0000', 'last_active': '2024-05-15T15:40:30.836484+0000', 'last_peered': '2024-05-15T15:40:30.836484+0000', 'last_clean': '2024-05-15T15:40:30.836484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T15:40:30.836484+0000', 'last_undegraded': '2024-05-15T15:40:30.836484+0000', 'last_fullsized': '2024-05-15T15:40:30.836484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_clean_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-15T15:40:36.702 INFO:tasks.ceph.ceph_manager.ceph:PG 4.b is not active+clean 2024-05-15T15:40:36.703 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-15T15:40:29.829984+0000', 'last_change': '2024-05-15T15:40:29.829984+0000', 'last_active': '2024-05-15T15:40:29.829984+0000', 'last_peered': '2024-05-15T15:40:29.829984+0000', 'last_clean': '2024-05-15T15:40:29.829984+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T15:40:29.829984+0000', 'last_undegraded': '2024-05-15T15:40:29.829984+0000', 'last_fullsized': '2024-05-15T15:40:29.829984+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T15:40:29.829984+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T15:40:29.829984+0000', 'last_clean_scrub_stamp': '2024-05-15T15:40:29.829984+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-15T15:40:36.703 INFO:tasks.ceph.ceph_manager.ceph:PG 5.b is not active+clean 2024-05-15T15:40:36.703 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-15T15:40:30.836484+0000', 'last_change': '2024-05-15T15:40:30.836484+0000', 'last_active': '2024-05-15T15:40:30.836484+0000', 'last_peered': '2024-05-15T15:40:30.836484+0000', 'last_clean': '2024-05-15T15:40:30.836484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T15:40:30.836484+0000', 'last_undegraded': '2024-05-15T15:40:30.836484+0000', 'last_fullsized': '2024-05-15T15:40:30.836484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_clean_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-15T15:40:36.703 INFO:tasks.ceph.ceph_manager.ceph:PG 4.a is not active+clean 2024-05-15T15:40:36.703 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-15T15:40:29.829984+0000', 'last_change': '2024-05-15T15:40:29.829984+0000', 'last_active': '2024-05-15T15:40:29.829984+0000', 'last_peered': '2024-05-15T15:40:29.829984+0000', 'last_clean': '2024-05-15T15:40:29.829984+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T15:40:29.829984+0000', 'last_undegraded': '2024-05-15T15:40:29.829984+0000', 'last_fullsized': '2024-05-15T15:40:29.829984+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T15:40:29.829984+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T15:40:29.829984+0000', 'last_clean_scrub_stamp': '2024-05-15T15:40:29.829984+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-15T15:40:36.703 INFO:tasks.ceph.ceph_manager.ceph:PG 5.8 is not active+clean 2024-05-15T15:40:36.703 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-15T15:40:30.836484+0000', 'last_change': '2024-05-15T15:40:30.836484+0000', 'last_active': '2024-05-15T15:40:30.836484+0000', 'last_peered': '2024-05-15T15:40:30.836484+0000', 'last_clean': '2024-05-15T15:40:30.836484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T15:40:30.836484+0000', 'last_undegraded': '2024-05-15T15:40:30.836484+0000', 'last_fullsized': '2024-05-15T15:40:30.836484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_clean_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-15T15:40:36.703 INFO:tasks.ceph.ceph_manager.ceph:PG 4.9 is not active+clean 2024-05-15T15:40:36.703 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-15T15:40:29.829984+0000', 'last_change': '2024-05-15T15:40:29.829984+0000', 'last_active': '2024-05-15T15:40:29.829984+0000', 'last_peered': '2024-05-15T15:40:29.829984+0000', 'last_clean': '2024-05-15T15:40:29.829984+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T15:40:29.829984+0000', 'last_undegraded': '2024-05-15T15:40:29.829984+0000', 'last_fullsized': '2024-05-15T15:40:29.829984+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T15:40:29.829984+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T15:40:29.829984+0000', 'last_clean_scrub_stamp': '2024-05-15T15:40:29.829984+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-15T15:40:36.703 INFO:tasks.ceph.ceph_manager.ceph:PG 5.9 is not active+clean 2024-05-15T15:40:36.703 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-15T15:40:30.836484+0000', 'last_change': '2024-05-15T15:40:30.836484+0000', 'last_active': '2024-05-15T15:40:30.836484+0000', 'last_peered': '2024-05-15T15:40:30.836484+0000', 'last_clean': '2024-05-15T15:40:30.836484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T15:40:30.836484+0000', 'last_undegraded': '2024-05-15T15:40:30.836484+0000', 'last_fullsized': '2024-05-15T15:40:30.836484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_clean_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-15T15:40:36.704 INFO:tasks.ceph.ceph_manager.ceph:PG 4.8 is not active+clean 2024-05-15T15:40:36.704 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-15T15:40:29.829984+0000', 'last_change': '2024-05-15T15:40:29.829984+0000', 'last_active': '2024-05-15T15:40:29.829984+0000', 'last_peered': '2024-05-15T15:40:29.829984+0000', 'last_clean': '2024-05-15T15:40:29.829984+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T15:40:29.829984+0000', 'last_undegraded': '2024-05-15T15:40:29.829984+0000', 'last_fullsized': '2024-05-15T15:40:29.829984+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T15:40:29.829984+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T15:40:29.829984+0000', 'last_clean_scrub_stamp': '2024-05-15T15:40:29.829984+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-15T15:40:36.704 INFO:tasks.ceph.ceph_manager.ceph:PG 5.6 is not active+clean 2024-05-15T15:40:36.704 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-15T15:40:30.836484+0000', 'last_change': '2024-05-15T15:40:30.836484+0000', 'last_active': '2024-05-15T15:40:30.836484+0000', 'last_peered': '2024-05-15T15:40:30.836484+0000', 'last_clean': '2024-05-15T15:40:30.836484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T15:40:30.836484+0000', 'last_undegraded': '2024-05-15T15:40:30.836484+0000', 'last_fullsized': '2024-05-15T15:40:30.836484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_clean_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-15T15:40:36.704 INFO:tasks.ceph.ceph_manager.ceph:PG 4.7 is not active+clean 2024-05-15T15:40:36.704 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-15T15:40:29.829984+0000', 'last_change': '2024-05-15T15:40:29.829984+0000', 'last_active': '2024-05-15T15:40:29.829984+0000', 'last_peered': '2024-05-15T15:40:29.829984+0000', 'last_clean': '2024-05-15T15:40:29.829984+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T15:40:29.829984+0000', 'last_undegraded': '2024-05-15T15:40:29.829984+0000', 'last_fullsized': '2024-05-15T15:40:29.829984+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T15:40:29.829984+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T15:40:29.829984+0000', 'last_clean_scrub_stamp': '2024-05-15T15:40:29.829984+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-15T15:40:36.704 INFO:tasks.ceph.ceph_manager.ceph:PG 5.7 is not active+clean 2024-05-15T15:40:36.704 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-15T15:40:30.836484+0000', 'last_change': '2024-05-15T15:40:30.836484+0000', 'last_active': '2024-05-15T15:40:30.836484+0000', 'last_peered': '2024-05-15T15:40:30.836484+0000', 'last_clean': '2024-05-15T15:40:30.836484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T15:40:30.836484+0000', 'last_undegraded': '2024-05-15T15:40:30.836484+0000', 'last_fullsized': '2024-05-15T15:40:30.836484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_clean_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-15T15:40:36.704 INFO:tasks.ceph.ceph_manager.ceph:PG 4.6 is not active+clean 2024-05-15T15:40:36.704 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-15T15:40:29.829984+0000', 'last_change': '2024-05-15T15:40:29.829984+0000', 'last_active': '2024-05-15T15:40:29.829984+0000', 'last_peered': '2024-05-15T15:40:29.829984+0000', 'last_clean': '2024-05-15T15:40:29.829984+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T15:40:29.829984+0000', 'last_undegraded': '2024-05-15T15:40:29.829984+0000', 'last_fullsized': '2024-05-15T15:40:29.829984+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T15:40:29.829984+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T15:40:29.829984+0000', 'last_clean_scrub_stamp': '2024-05-15T15:40:29.829984+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-15T15:40:36.704 INFO:tasks.ceph.ceph_manager.ceph:PG 5.5 is not active+clean 2024-05-15T15:40:36.705 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-15T15:40:30.836484+0000', 'last_change': '2024-05-15T15:40:30.836484+0000', 'last_active': '2024-05-15T15:40:30.836484+0000', 'last_peered': '2024-05-15T15:40:30.836484+0000', 'last_clean': '2024-05-15T15:40:30.836484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T15:40:30.836484+0000', 'last_undegraded': '2024-05-15T15:40:30.836484+0000', 'last_fullsized': '2024-05-15T15:40:30.836484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_clean_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-15T15:40:36.705 INFO:tasks.ceph.ceph_manager.ceph:PG 4.4 is not active+clean 2024-05-15T15:40:36.705 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-15T15:40:29.829984+0000', 'last_change': '2024-05-15T15:40:29.829984+0000', 'last_active': '2024-05-15T15:40:29.829984+0000', 'last_peered': '2024-05-15T15:40:29.829984+0000', 'last_clean': '2024-05-15T15:40:29.829984+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T15:40:29.829984+0000', 'last_undegraded': '2024-05-15T15:40:29.829984+0000', 'last_fullsized': '2024-05-15T15:40:29.829984+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T15:40:29.829984+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T15:40:29.829984+0000', 'last_clean_scrub_stamp': '2024-05-15T15:40:29.829984+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-15T15:40:36.705 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2 is not active+clean 2024-05-15T15:40:36.705 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-15T15:40:30.836484+0000', 'last_change': '2024-05-15T15:40:30.836484+0000', 'last_active': '2024-05-15T15:40:30.836484+0000', 'last_peered': '2024-05-15T15:40:30.836484+0000', 'last_clean': '2024-05-15T15:40:30.836484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T15:40:30.836484+0000', 'last_undegraded': '2024-05-15T15:40:30.836484+0000', 'last_fullsized': '2024-05-15T15:40:30.836484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_clean_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-15T15:40:36.705 INFO:tasks.ceph.ceph_manager.ceph:PG 4.3 is not active+clean 2024-05-15T15:40:36.705 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-15T15:40:29.829984+0000', 'last_change': '2024-05-15T15:40:29.829984+0000', 'last_active': '2024-05-15T15:40:29.829984+0000', 'last_peered': '2024-05-15T15:40:29.829984+0000', 'last_clean': '2024-05-15T15:40:29.829984+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T15:40:29.829984+0000', 'last_undegraded': '2024-05-15T15:40:29.829984+0000', 'last_fullsized': '2024-05-15T15:40:29.829984+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T15:40:29.829984+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T15:40:29.829984+0000', 'last_clean_scrub_stamp': '2024-05-15T15:40:29.829984+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-15T15:40:36.705 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3 is not active+clean 2024-05-15T15:40:36.705 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-05-15T15:40:30.845726+0000', 'last_change': '2024-05-15T15:40:30.845726+0000', 'last_active': '2024-05-15T15:40:30.836484+0000', 'last_peered': '2024-05-15T15:40:30.836484+0000', 'last_clean': '2024-05-15T15:40:30.836484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T15:40:30.845726+0000', 'last_undegraded': '2024-05-15T15:40:30.845726+0000', 'last_fullsized': '2024-05-15T15:40:30.845726+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_clean_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-15T15:40:36.705 INFO:tasks.ceph.ceph_manager.ceph:PG 4.2 is not active+clean 2024-05-15T15:40:36.705 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-15T15:40:29.829984+0000', 'last_change': '2024-05-15T15:40:29.829984+0000', 'last_active': '2024-05-15T15:40:29.829984+0000', 'last_peered': '2024-05-15T15:40:29.829984+0000', 'last_clean': '2024-05-15T15:40:29.829984+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T15:40:29.829984+0000', 'last_undegraded': '2024-05-15T15:40:29.829984+0000', 'last_fullsized': '2024-05-15T15:40:29.829984+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T15:40:29.829984+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T15:40:29.829984+0000', 'last_clean_scrub_stamp': '2024-05-15T15:40:29.829984+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-15T15:40:36.705 INFO:tasks.ceph.ceph_manager.ceph:PG 5.0 is not active+clean 2024-05-15T15:40:36.706 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-05-15T15:40:30.845709+0000', 'last_change': '2024-05-15T15:40:30.845709+0000', 'last_active': '2024-05-15T15:40:30.836484+0000', 'last_peered': '2024-05-15T15:40:30.836484+0000', 'last_clean': '2024-05-15T15:40:30.836484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T15:40:30.845709+0000', 'last_undegraded': '2024-05-15T15:40:30.845709+0000', 'last_fullsized': '2024-05-15T15:40:30.845709+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_clean_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-15T15:40:36.706 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1 is not active+clean 2024-05-15T15:40:36.706 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-15T15:40:29.829984+0000', 'last_change': '2024-05-15T15:40:29.829984+0000', 'last_active': '2024-05-15T15:40:29.829984+0000', 'last_peered': '2024-05-15T15:40:29.829984+0000', 'last_clean': '2024-05-15T15:40:29.829984+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T15:40:29.829984+0000', 'last_undegraded': '2024-05-15T15:40:29.829984+0000', 'last_fullsized': '2024-05-15T15:40:29.829984+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T15:40:29.829984+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T15:40:29.829984+0000', 'last_clean_scrub_stamp': '2024-05-15T15:40:29.829984+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-15T15:40:36.706 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1 is not active+clean 2024-05-15T15:40:36.706 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-15T15:40:30.836484+0000', 'last_change': '2024-05-15T15:40:30.836484+0000', 'last_active': '2024-05-15T15:40:30.836484+0000', 'last_peered': '2024-05-15T15:40:30.836484+0000', 'last_clean': '2024-05-15T15:40:30.836484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T15:40:30.836484+0000', 'last_undegraded': '2024-05-15T15:40:30.836484+0000', 'last_fullsized': '2024-05-15T15:40:30.836484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_clean_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-15T15:40:36.706 INFO:tasks.ceph.ceph_manager.ceph:PG 5.4 is not active+clean 2024-05-15T15:40:36.706 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-15T15:40:30.836484+0000', 'last_change': '2024-05-15T15:40:30.836484+0000', 'last_active': '2024-05-15T15:40:30.836484+0000', 'last_peered': '2024-05-15T15:40:30.836484+0000', 'last_clean': '2024-05-15T15:40:30.836484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T15:40:30.836484+0000', 'last_undegraded': '2024-05-15T15:40:30.836484+0000', 'last_fullsized': '2024-05-15T15:40:30.836484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'last_clean_scrub_stamp': '2024-05-15T15:40:30.836484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-15T15:40:36.707 INFO:tasks.ceph.ceph_manager.ceph:PG 4.5 is not active+clean 2024-05-15T15:40:36.707 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-15T15:40:29.829984+0000', 'last_change': '2024-05-15T15:40:29.829984+0000', 'last_active': '2024-05-15T15:40:29.829984+0000', 'last_peered': '2024-05-15T15:40:29.829984+0000', 'last_clean': '2024-05-15T15:40:29.829984+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T15:40:29.829984+0000', 'last_undegraded': '2024-05-15T15:40:29.829984+0000', 'last_fullsized': '2024-05-15T15:40:29.829984+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T15:40:29.829984+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T15:40:29.829984+0000', 'last_clean_scrub_stamp': '2024-05-15T15:40:29.829984+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-15T15:40:36.707 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-05-15T15:40:36.831 INFO:tasks.ceph.mds.c.smithi012.stderr:2024-05-15T15:40:36.829+0000 7f05d3796640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-15T15:40:36.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.836+0000 7fd7d4829640 1 Processor -- start 2024-05-15T15:40:36.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.836+0000 7fd7d4829640 1 -- start start 2024-05-15T15:40:36.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.837+0000 7fd7d4829640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fd7d00bc1c0 0x7fd7d00a0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:36.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.837+0000 7fd7d4829640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd7d014c8e0 0x7fd7d014ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:36.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.838+0000 7fd7d4829640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7d0071150 con 0x7fd7d0146380 2024-05-15T15:40:36.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.838+0000 7fd7d4829640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7fd7d014c450 con 0x7fd7d014c8e0 2024-05-15T15:40:36.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.838+0000 7fd7d4829640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fd7d014c120 con 0x7fd7d00bc1c0 2024-05-15T15:40:36.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.838+0000 7fd7cdd9b640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fd7d0146380 0x7fd7d0070a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:40088/0 (socket says 172.21.15.12:40088) 2024-05-15T15:40:36.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.838+0000 7fd7cdd9b640 1 -- 172.21.15.12:0/769400613 learned_addr learned my addr 172.21.15.12:0/769400613 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-05-15T15:40:36.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.838+0000 7fd7ced9d640 1 --2- 172.21.15.12:0/769400613 >> v2:172.21.15.84:3300/0 conn(0x7fd7d014c8e0 0x7fd7d014ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:36.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.838+0000 7fd7ce59c640 1 --2- 172.21.15.12:0/769400613 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fd7d00bc1c0 0x7fd7d00a0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:36.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.838+0000 7fd7cd59a640 1 -- 172.21.15.12:0/769400613 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1415144475 0 0) 0x7fd7b8001110 con 0x7fd7d0146380 2024-05-15T15:40:36.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.838+0000 7fd7cd59a640 1 -- 172.21.15.12:0/769400613 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd7bc003520 con 0x7fd7d0146380 2024-05-15T15:40:36.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.838+0000 7fd7ced9d640 1 -- 172.21.15.12:0/769400613 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fd7d00bc1c0 msgr2=0x7fd7d00a0ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:40:36.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.838+0000 7fd7ced9d640 1 --2- 172.21.15.12:0/769400613 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fd7d00bc1c0 0x7fd7d00a0ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:36.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.838+0000 7fd7ced9d640 1 -- 172.21.15.12:0/769400613 >> v1:172.21.15.12:6789/0 conn(0x7fd7d0146380 legacy=0x7fd7d0070a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:36.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.838+0000 7fd7ced9d640 1 -- 172.21.15.12:0/769400613 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7d0071e40 con 0x7fd7d014c8e0 2024-05-15T15:40:36.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.839+0000 7fd7ced9d640 1 --2- 172.21.15.12:0/769400613 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7d014c8e0 0x7fd7d014ccf0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd7c8009d90 tx=0x7fd7c802a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ac78a4ee9748768b server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:36.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.839+0000 7fd7cd59a640 1 -- 172.21.15.12:0/769400613 <== mon.1 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7c8007740 con 0x7fd7d014c8e0 2024-05-15T15:40:36.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.839+0000 7fd7cd59a640 1 -- 172.21.15.12:0/769400613 <== mon.1 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7c80078e0 con 0x7fd7d014c8e0 2024-05-15T15:40:36.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.839+0000 7fd7cd59a640 1 -- 172.21.15.12:0/769400613 <== mon.1 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7c8007c90 con 0x7fd7d014c8e0 2024-05-15T15:40:36.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.840+0000 7fd7d4829640 1 -- 172.21.15.12:0/769400613 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7d014c8e0 msgr2=0x7fd7d014ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:36.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.840+0000 7fd7d4829640 1 --2- 172.21.15.12:0/769400613 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7d014c8e0 0x7fd7d014ccf0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd7c8009d90 tx=0x7fd7c802a660 comp rx=0 tx=0).stop 2024-05-15T15:40:36.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.840+0000 7fd7d4829640 1 -- 172.21.15.12:0/769400613 shutdown_connections 2024-05-15T15:40:36.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.840+0000 7fd7d4829640 1 --2- 172.21.15.12:0/769400613 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7d014c8e0 0x7fd7d014ccf0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:36.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.840+0000 7fd7d4829640 1 --2- 172.21.15.12:0/769400613 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fd7d00bc1c0 0x7fd7d00a0ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:36.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.840+0000 7fd7d4829640 1 -- 172.21.15.12:0/769400613 >> 172.21.15.12:0/769400613 conn(0x7fd7d00c17c0 msgr2=0x7fd7d00c1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:36.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.840+0000 7fd7d4829640 1 -- 172.21.15.12:0/769400613 shutdown_connections 2024-05-15T15:40:36.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.840+0000 7fd7d4829640 1 -- 172.21.15.12:0/769400613 wait complete. 2024-05-15T15:40:36.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.842+0000 7fd7d4829640 1 Processor -- start 2024-05-15T15:40:36.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.842+0000 7fd7d4829640 1 -- start start 2024-05-15T15:40:36.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.843+0000 7fd7d4829640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fd7d00bc1c0 0x7fd7d009ff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:36.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.843+0000 7fd7d4829640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7d0146380 0x7fd7d006ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:36.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.843+0000 7fd7d4829640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7d014c8e0 0x7fd7d013f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:36.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.843+0000 7fd7d4829640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fd7d0146790 con 0x7fd7d014c8e0 2024-05-15T15:40:36.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.843+0000 7fd7d4829640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fd7d00716b0 con 0x7fd7d0146380 2024-05-15T15:40:36.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.843+0000 7fd7d4829640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fd7d00bd5f0 con 0x7fd7d00bc1c0 2024-05-15T15:40:36.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.843+0000 7fd7ced9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7d014c8e0 0x7fd7d013f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:36.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.843+0000 7fd7ced9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7d014c8e0 0x7fd7d013f9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43168/0 (socket says 172.21.15.12:43168) 2024-05-15T15:40:36.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.843+0000 7fd7ced9d640 1 -- 172.21.15.12:0/558457171 learned_addr learned my addr 172.21.15.12:0/558457171 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:36.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.843+0000 7fd7ce59c640 1 --2- 172.21.15.12:0/558457171 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fd7d00bc1c0 0x7fd7d009ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:36.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.843+0000 7fd7cdd9b640 1 --2- 172.21.15.12:0/558457171 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7d0146380 0x7fd7d006ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:36.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.844+0000 7fd7ced9d640 1 -- 172.21.15.12:0/558457171 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fd7d00bc1c0 msgr2=0x7fd7d009ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:36.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.844+0000 7fd7ced9d640 1 --2- 172.21.15.12:0/558457171 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fd7d00bc1c0 0x7fd7d009ff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:36.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.844+0000 7fd7ced9d640 1 -- 172.21.15.12:0/558457171 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7d0146380 msgr2=0x7fd7d006ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:36.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.844+0000 7fd7ced9d640 1 --2- 172.21.15.12:0/558457171 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7d0146380 0x7fd7d006ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:36.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.844+0000 7fd7ced9d640 1 -- 172.21.15.12:0/558457171 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7d00a0470 con 0x7fd7d014c8e0 2024-05-15T15:40:36.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.844+0000 7fd7ced9d640 1 --2- 172.21.15.12:0/558457171 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7d014c8e0 0x7fd7d013f9e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fd7c8009eb0 tx=0x7fd7c8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:36.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.844+0000 7fd7c6ffd640 1 -- 172.21.15.12:0/558457171 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7c8009450 con 0x7fd7d014c8e0 2024-05-15T15:40:36.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.844+0000 7fd7c6ffd640 1 -- 172.21.15.12:0/558457171 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7c8004240 con 0x7fd7d014c8e0 2024-05-15T15:40:36.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.844+0000 7fd7d4829640 1 -- 172.21.15.12:0/558457171 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7d006ef90 con 0x7fd7d014c8e0 2024-05-15T15:40:36.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.844+0000 7fd7c6ffd640 1 -- 172.21.15.12:0/558457171 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7c8004630 con 0x7fd7d014c8e0 2024-05-15T15:40:36.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.844+0000 7fd7d4829640 1 -- 172.21.15.12:0/558457171 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7d0148300 con 0x7fd7d014c8e0 2024-05-15T15:40:36.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.845+0000 7fd7d4829640 1 -- 172.21.15.12:0/558457171 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7d0149b20 con 0x7fd7d014c8e0 2024-05-15T15:40:36.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.846+0000 7fd7c6ffd640 1 -- 172.21.15.12:0/558457171 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd7c803b410 con 0x7fd7d014c8e0 2024-05-15T15:40:36.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.847+0000 7fd7c6ffd640 1 --2- 172.21.15.12:0/558457171 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fd7b00762d0 0x7fd7b00787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:36.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.847+0000 7fd7c6ffd640 1 -- 172.21.15.12:0/558457171 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fd7c80b84a0 con 0x7fd7d014c8e0 2024-05-15T15:40:36.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.847+0000 7fd7ce59c640 1 --2- 172.21.15.12:0/558457171 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fd7b00762d0 0x7fd7b00787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:36.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.847+0000 7fd7ce59c640 1 --2- 172.21.15.12:0/558457171 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fd7b00762d0 0x7fd7b00787e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd7c0009aa0 tx=0x7fd7c0009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:36.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:36.851+0000 7fd7c6ffd640 1 -- 172.21.15.12:0/558457171 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fd7c803f030 con 0x7fd7d014c8e0 2024-05-15T15:40:37.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:37.142+0000 7fd7d4829640 1 -- 172.21.15.12:0/558457171 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fd7d0145c10 con 0x7fd7d014c8e0 2024-05-15T15:40:37.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:37.142+0000 7fd7c6ffd640 1 -- 172.21.15.12:0/558457171 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+2453 (secure 0 0 0) 0x7fd7c8081870 con 0x7fd7d014c8e0 2024-05-15T15:40:37.145 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-05-15T15:40:37.145 INFO:teuthology.orchestra.run.smithi012.stdout:{"fsid":"3b7fc4b2-b85c-49b5-a5de-38444eeed40d","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":68,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":33,"num_osds":8,"num_up_osds":8,"osd_up_since":1715787579,"num_in_osds":8,"osd_in_since":1715787570,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":85},{"state_name":"creating+peering","count":12}],"num_pgs":97,"num_pools":3,"num_objects":23,"data_bytes":592778,"bytes_used":225476608,"bytes_avail":772868636672,"bytes_total":773094113280,"inactive_pgs_ratio":0.12371134012937546,"write_bytes_sec":2388,"read_op_per_sec":0,"write_op_per_sec":6},"fsmap":{"epoch":16,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"c","status":"up:active","gid":4759}],"up:standby":2},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":3,"modified":"2024-05-15T15:40:36.712117+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"osd":{"daemons":{"summary":"","0":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"1":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"3":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"5":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"6":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"7":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-05-15T15:40:37.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:37.145+0000 7fd7d4829640 1 -- 172.21.15.12:0/558457171 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fd7b00762d0 msgr2=0x7fd7b00787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:37.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:37.145+0000 7fd7d4829640 1 --2- 172.21.15.12:0/558457171 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fd7b00762d0 0x7fd7b00787e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd7c0009aa0 tx=0x7fd7c0009190 comp rx=0 tx=0).stop 2024-05-15T15:40:37.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:37.145+0000 7fd7d4829640 1 -- 172.21.15.12:0/558457171 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7d014c8e0 msgr2=0x7fd7d013f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:37.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:37.145+0000 7fd7d4829640 1 --2- 172.21.15.12:0/558457171 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7d014c8e0 0x7fd7d013f9e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fd7c8009eb0 tx=0x7fd7c8004a40 comp rx=0 tx=0).stop 2024-05-15T15:40:37.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:37.145+0000 7fd7d4829640 1 -- 172.21.15.12:0/558457171 shutdown_connections 2024-05-15T15:40:37.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:37.145+0000 7fd7d4829640 1 --2- 172.21.15.12:0/558457171 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fd7b00762d0 0x7fd7b00787e0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:37.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:37.145+0000 7fd7d4829640 1 --2- 172.21.15.12:0/558457171 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7d014c8e0 0x7fd7d013f9e0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:37.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:37.145+0000 7fd7d4829640 1 --2- 172.21.15.12:0/558457171 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7d0146380 0x7fd7d006ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:37.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:37.145+0000 7fd7d4829640 1 --2- 172.21.15.12:0/558457171 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fd7d00bc1c0 0x7fd7d009ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:37.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:37.145+0000 7fd7d4829640 1 -- 172.21.15.12:0/558457171 >> 172.21.15.12:0/558457171 conn(0x7fd7d00c17c0 msgr2=0x7fd7d0070a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:37.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:37.145+0000 7fd7d4829640 1 -- 172.21.15.12:0/558457171 shutdown_connections 2024-05-15T15:40:37.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:37.145+0000 7fd7d4829640 1 -- 172.21.15.12:0/558457171 wait complete. 2024-05-15T15:40:37.158 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-05-15T15:40:37.159 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-15T15:40:37.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:37.267+0000 7faf00c3b640 1 Processor -- start 2024-05-15T15:40:37.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:37.267+0000 7faf00c3b640 1 -- start start 2024-05-15T15:40:37.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:37.268+0000 7faf00c3b640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7faefc0bb490 0x7faefc0b57f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:37.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:37.268+0000 7faf00c3b640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7faefc0b9ee0 0x7faefc0a4080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:37.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:37.269+0000 7faf00c3b640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faefc0bba80 con 0x7faefc0b4500 2024-05-15T15:40:37.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:37.269+0000 7faf00c3b640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7faefc0bbd60 con 0x7faefc0bb490 2024-05-15T15:40:37.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:37.269+0000 7faf00c3b640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7faefc0b4ff0 con 0x7faefc0b9ee0 2024-05-15T15:40:37.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:37.269+0000 7faefa59c640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7faefc0bb490 0x7faefc0b57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:37.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:37.269+0000 7faefa59c640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7faefc0bb490 0x7faefc0b57f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43170/0 (socket says 172.21.15.12:43170) 2024-05-15T15:40:37.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:37.269+0000 7faefa59c640 1 -- 172.21.15.12:0/919841957 learned_addr learned my addr 172.21.15.12:0/919841957 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:37.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:37.269+0000 7faefad9d640 1 --2- 172.21.15.12:0/919841957 >> v2:172.21.15.84:3300/0 conn(0x7faefc0b9ee0 0x7faefc0a4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:37.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:37.269+0000 7faefa59c640 1 -- 172.21.15.12:0/919841957 >> v2:172.21.15.84:3300/0 conn(0x7faefc0b9ee0 msgr2=0x7faefc0a4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:40:37.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:37.269+0000 7faefa59c640 1 --2- 172.21.15.12:0/919841957 >> v2:172.21.15.84:3300/0 conn(0x7faefc0b9ee0 0x7faefc0a4080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:37.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:37.269+0000 7faefa59c640 1 -- 172.21.15.12:0/919841957 >> v1:172.21.15.84:6789/0 conn(0x7faefc0b4500 legacy=0x7faefc06faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:40:37.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:37.269+0000 7faefa59c640 1 -- 172.21.15.12:0/919841957 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faefc0b52d0 con 0x7faefc0bb490 2024-05-15T15:40:37.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:37.270+0000 7faefa59c640 1 --2- 172.21.15.12:0/919841957 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faefc0bb490 0x7faefc0b57f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7faefc0a0ce0 tx=0x7faeec02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=897f44e9df100239 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:37.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:37.270+0000 7faef9d9b640 1 -- 172.21.15.12:0/919841957 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeec037070 con 0x7faefc0bb490 2024-05-15T15:40:37.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:37.270+0000 7faef9d9b640 1 -- 172.21.15.12:0/919841957 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faeec032440 con 0x7faefc0bb490 2024-05-15T15:40:37.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:37.270+0000 7faef9d9b640 1 -- 172.21.15.12:0/919841957 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeec032810 con 0x7faefc0bb490 2024-05-15T15:40:37.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:37.270+0000 7faf00c3b640 1 -- 172.21.15.12:0/919841957 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faefc0bb490 msgr2=0x7faefc0b57f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:37.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:37.270+0000 7faf00c3b640 1 --2- 172.21.15.12:0/919841957 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faefc0bb490 0x7faefc0b57f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7faefc0a0ce0 tx=0x7faeec02a140 comp rx=0 tx=0).stop 2024-05-15T15:40:37.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:37.270+0000 7faf00c3b640 1 -- 172.21.15.12:0/919841957 shutdown_connections 2024-05-15T15:40:37.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:37.270+0000 7faf00c3b640 1 --2- 172.21.15.12:0/919841957 >> v2:172.21.15.84:3300/0 conn(0x7faefc0b9ee0 0x7faefc0a4080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:37.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:37.270+0000 7faf00c3b640 1 --2- 172.21.15.12:0/919841957 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faefc0bb490 0x7faefc0b57f0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:37.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:37.271+0000 7faf00c3b640 1 -- 172.21.15.12:0/919841957 >> 172.21.15.12:0/919841957 conn(0x7faefc0a1ac0 msgr2=0x7faefc0bbfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:37.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:37.271+0000 7faf00c3b640 1 -- 172.21.15.12:0/919841957 shutdown_connections 2024-05-15T15:40:37.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:37.271+0000 7faf00c3b640 1 -- 172.21.15.12:0/919841957 wait complete. 2024-05-15T15:40:37.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:37.272+0000 7faf00c3b640 1 Processor -- start 2024-05-15T15:40:37.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:37.272+0000 7faf00c3b640 1 -- start start 2024-05-15T15:40:37.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:37.273+0000 7faf00c3b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faefc0b4500 0x7faefc1435a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:37.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:37.273+0000 7faf00c3b640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7faefc0b9ee0 0x7faefc0b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:37.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:37.273+0000 7faf00c3b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faefc0bb490 0x7faefc13ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:37.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:37.273+0000 7faf00c3b640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7faefc0a45c0 con 0x7faefc0bb490 2024-05-15T15:40:37.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:37.273+0000 7faf00c3b640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7faefc0ba2f0 con 0x7faefc0b4500 2024-05-15T15:40:37.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:37.273+0000 7faf00c3b640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7faefc0a4740 con 0x7faefc0b9ee0 2024-05-15T15:40:37.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:37.273+0000 7faefad9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faefc0bb490 0x7faefc13ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:37.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:37.273+0000 7faefad9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faefc0bb490 0x7faefc13ede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43180/0 (socket says 172.21.15.12:43180) 2024-05-15T15:40:37.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:37.273+0000 7faefad9d640 1 -- 172.21.15.12:0/1522609696 learned_addr learned my addr 172.21.15.12:0/1522609696 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:37.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:37.274+0000 7faefa59c640 1 --2- 172.21.15.12:0/1522609696 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faefc0b4500 0x7faefc1435a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:37.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:37.274+0000 7faef3fff640 1 --2- 172.21.15.12:0/1522609696 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7faefc0b9ee0 0x7faefc0b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:37.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:37.274+0000 7faefad9d640 1 -- 172.21.15.12:0/1522609696 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7faefc0b9ee0 msgr2=0x7faefc0b8a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:37.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:37.274+0000 7faefad9d640 1 --2- 172.21.15.12:0/1522609696 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7faefc0b9ee0 0x7faefc0b8a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:37.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:37.274+0000 7faefad9d640 1 -- 172.21.15.12:0/1522609696 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faefc0b4500 msgr2=0x7faefc1435a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:37.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:37.274+0000 7faefad9d640 1 --2- 172.21.15.12:0/1522609696 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faefc0b4500 0x7faefc1435a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:37.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:37.274+0000 7faefad9d640 1 -- 172.21.15.12:0/1522609696 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faefc0b8f90 con 0x7faefc0bb490 2024-05-15T15:40:37.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:37.274+0000 7faefad9d640 1 --2- 172.21.15.12:0/1522609696 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faefc0bb490 0x7faefc13ede0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7faef4009fd0 tx=0x7faef400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:37.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:37.274+0000 7faef2ffd640 1 -- 172.21.15.12:0/1522609696 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faef4014420 con 0x7faefc0bb490 2024-05-15T15:40:37.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:37.274+0000 7faef2ffd640 1 -- 172.21.15.12:0/1522609696 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faef4019070 con 0x7faefc0bb490 2024-05-15T15:40:37.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:37.274+0000 7faef2ffd640 1 -- 172.21.15.12:0/1522609696 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faef4014800 con 0x7faefc0bb490 2024-05-15T15:40:37.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:37.274+0000 7faf00c3b640 1 -- 172.21.15.12:0/1522609696 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faefc0b73d0 con 0x7faefc0bb490 2024-05-15T15:40:37.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:37.274+0000 7faf00c3b640 1 -- 172.21.15.12:0/1522609696 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faefc13f320 con 0x7faefc0bb490 2024-05-15T15:40:37.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:37.275+0000 7faf00c3b640 1 -- 172.21.15.12:0/1522609696 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faefc069b20 con 0x7faefc0bb490 2024-05-15T15:40:37.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:37.276+0000 7faef2ffd640 1 -- 172.21.15.12:0/1522609696 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7faef40149a0 con 0x7faefc0bb490 2024-05-15T15:40:37.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:37.276+0000 7faef2ffd640 1 --2- 172.21.15.12:0/1522609696 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7faedc0762d0 0x7faedc0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:37.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:37.277+0000 7faef2ffd640 1 -- 172.21.15.12:0/1522609696 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7faef4097f60 con 0x7faefc0bb490 2024-05-15T15:40:37.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:37.277+0000 7faefa59c640 1 --2- 172.21.15.12:0/1522609696 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7faedc0762d0 0x7faedc0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:37.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:37.277+0000 7faefa59c640 1 --2- 172.21.15.12:0/1522609696 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7faedc0762d0 0x7faedc0787e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7faeec034000 tx=0x7faeec02e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:37.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:37.281+0000 7faef2ffd640 1 -- 172.21.15.12:0/1522609696 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7faefc0b73d0 con 0x7faefc0bb490 2024-05-15T15:40:37.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:37.490+0000 7faf00c3b640 1 -- 172.21.15.12:0/1522609696 --> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7faefc0a2690 con 0x7faedc0762d0 2024-05-15T15:40:37.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:37.497+0000 7faef2ffd640 1 -- 172.21.15.12:0/1522609696 <== mgr.4106 v2:172.21.15.84:6832/4173299311 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+250955 (secure 0 0 0) 0x7faefc0a2690 con 0x7faedc0762d0 2024-05-15T15:40:37.500 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-05-15T15:40:37.513 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-05-15T15:40:37.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:37.500+0000 7faf00c3b640 1 -- 172.21.15.12:0/1522609696 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7faedc0762d0 msgr2=0x7faedc0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:37.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:37.500+0000 7faf00c3b640 1 --2- 172.21.15.12:0/1522609696 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7faedc0762d0 0x7faedc0787e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7faeec034000 tx=0x7faeec02e000 comp rx=0 tx=0).stop 2024-05-15T15:40:37.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:37.500+0000 7faf00c3b640 1 -- 172.21.15.12:0/1522609696 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faefc0bb490 msgr2=0x7faefc13ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:37.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:37.500+0000 7faf00c3b640 1 --2- 172.21.15.12:0/1522609696 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faefc0bb490 0x7faefc13ede0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7faef4009fd0 tx=0x7faef400e4b0 comp rx=0 tx=0).stop 2024-05-15T15:40:37.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:37.500+0000 7faf00c3b640 1 -- 172.21.15.12:0/1522609696 shutdown_connections 2024-05-15T15:40:37.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:37.500+0000 7faf00c3b640 1 --2- 172.21.15.12:0/1522609696 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7faedc0762d0 0x7faedc0787e0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:37.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:37.500+0000 7faf00c3b640 1 --2- 172.21.15.12:0/1522609696 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faefc0bb490 0x7faefc13ede0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:37.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:37.500+0000 7faf00c3b640 1 --2- 172.21.15.12:0/1522609696 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7faefc0b9ee0 0x7faefc0b8a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:37.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:37.500+0000 7faf00c3b640 1 --2- 172.21.15.12:0/1522609696 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faefc0b4500 0x7faefc1435a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:37.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:37.500+0000 7faf00c3b640 1 -- 172.21.15.12:0/1522609696 >> 172.21.15.12:0/1522609696 conn(0x7faefc0a1ac0 msgr2=0x7faefc0a2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:37.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:37.501+0000 7faf00c3b640 1 -- 172.21.15.12:0/1522609696 shutdown_connections 2024-05-15T15:40:37.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:37.501+0000 7faf00c3b640 1 -- 172.21.15.12:0/1522609696 wait complete. 2024-05-15T15:40:37.516 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":56,"stamp":"2024-05-15T15:40:36.711893+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":143,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":108,"ondisk_log_size":108,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":115,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220192,"kb_used_data":4032,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754528,"statfs":{"total":773094113280,"available":772868636672,"internally_reserved":0,"allocated":4128768,"data_stored":2285871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001410"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:32.852840+0000","last_change":"2024-05-15T15:40:31.864247+0000","last_active":"2024-05-15T15:40:32.852840+0000","last_peered":"2024-05-15T15:40:32.852840+0000","last_clean":"2024-05-15T15:40:32.852840+0000","last_became_active":"2024-05-15T15:40:31.863887+0000","last_became_peered":"2024-05-15T15:40:31.863887+0000","last_unstale":"2024-05-15T15:40:32.852840+0000","last_undegraded":"2024-05-15T15:40:32.852840+0000","last_fullsized":"2024-05-15T15:40:32.852840+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:31:22.263338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:33.006568+0000","last_change":"2024-05-15T15:40:31.872908+0000","last_active":"2024-05-15T15:40:33.006568+0000","last_peered":"2024-05-15T15:40:33.006568+0000","last_clean":"2024-05-15T15:40:33.006568+0000","last_became_active":"2024-05-15T15:40:31.872537+0000","last_became_peered":"2024-05-15T15:40:31.872537+0000","last_unstale":"2024-05-15T15:40:33.006568+0000","last_undegraded":"2024-05-15T15:40:33.006568+0000","last_fullsized":"2024-05-15T15:40:33.006568+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:52:46.673917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:32.850588+0000","last_change":"2024-05-15T15:40:31.871036+0000","last_active":"2024-05-15T15:40:32.850588+0000","last_peered":"2024-05-15T15:40:32.850588+0000","last_clean":"2024-05-15T15:40:32.850588+0000","last_became_active":"2024-05-15T15:40:31.870689+0000","last_became_peered":"2024-05-15T15:40:31.870689+0000","last_unstale":"2024-05-15T15:40:32.850588+0000","last_undegraded":"2024-05-15T15:40:32.850588+0000","last_fullsized":"2024-05-15T15:40:32.850588+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:49:02.842629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-15T15:40:30.850054+0000","last_change":"2024-05-15T15:40:30.850054+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.850054+0000","last_undegraded":"2024-05-15T15:40:30.850054+0000","last_fullsized":"2024-05-15T15:40:30.850054+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:33.005466+0000","last_change":"2024-05-15T15:40:31.866418+0000","last_active":"2024-05-15T15:40:33.005466+0000","last_peered":"2024-05-15T15:40:33.005466+0000","last_clean":"2024-05-15T15:40:33.005466+0000","last_became_active":"2024-05-15T15:40:31.866037+0000","last_became_peered":"2024-05-15T15:40:31.866037+0000","last_unstale":"2024-05-15T15:40:33.005466+0000","last_undegraded":"2024-05-15T15:40:33.005466+0000","last_fullsized":"2024-05-15T15:40:33.005466+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:27:01.270998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:33.005011+0000","last_change":"2024-05-15T15:40:31.865532+0000","last_active":"2024-05-15T15:40:33.005011+0000","last_peered":"2024-05-15T15:40:33.005011+0000","last_clean":"2024-05-15T15:40:33.005011+0000","last_became_active":"2024-05-15T15:40:31.865223+0000","last_became_peered":"2024-05-15T15:40:31.865223+0000","last_unstale":"2024-05-15T15:40:33.005011+0000","last_undegraded":"2024-05-15T15:40:33.005011+0000","last_fullsized":"2024-05-15T15:40:33.005011+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:49:02.842629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:32.852504+0000","last_change":"2024-05-15T15:40:31.877441+0000","last_active":"2024-05-15T15:40:32.852504+0000","last_peered":"2024-05-15T15:40:32.852504+0000","last_clean":"2024-05-15T15:40:32.852504+0000","last_became_active":"2024-05-15T15:40:31.877133+0000","last_became_peered":"2024-05-15T15:40:31.877133+0000","last_unstale":"2024-05-15T15:40:32.852504+0000","last_undegraded":"2024-05-15T15:40:32.852504+0000","last_fullsized":"2024-05-15T15:40:32.852504+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:18:50.984099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:32.852429+0000","last_change":"2024-05-15T15:40:31.867999+0000","last_active":"2024-05-15T15:40:32.852429+0000","last_peered":"2024-05-15T15:40:32.852429+0000","last_clean":"2024-05-15T15:40:32.852429+0000","last_became_active":"2024-05-15T15:40:31.867647+0000","last_became_peered":"2024-05-15T15:40:31.867647+0000","last_unstale":"2024-05-15T15:40:32.852429+0000","last_undegraded":"2024-05-15T15:40:32.852429+0000","last_fullsized":"2024-05-15T15:40:32.852429+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:44:53.908859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:32.850660+0000","last_change":"2024-05-15T15:40:31.876517+0000","last_active":"2024-05-15T15:40:32.850660+0000","last_peered":"2024-05-15T15:40:32.850660+0000","last_clean":"2024-05-15T15:40:32.850660+0000","last_became_active":"2024-05-15T15:40:31.876179+0000","last_became_peered":"2024-05-15T15:40:31.876179+0000","last_unstale":"2024-05-15T15:40:32.850660+0000","last_undegraded":"2024-05-15T15:40:32.850660+0000","last_fullsized":"2024-05-15T15:40:32.850660+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:19:56.307191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-15T15:40:30.848792+0000","last_change":"2024-05-15T15:40:30.848792+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.848792+0000","last_undegraded":"2024-05-15T15:40:30.848792+0000","last_fullsized":"2024-05-15T15:40:30.848792+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:33.004610+0000","last_change":"2024-05-15T15:40:31.869941+0000","last_active":"2024-05-15T15:40:33.004610+0000","last_peered":"2024-05-15T15:40:33.004610+0000","last_clean":"2024-05-15T15:40:33.004610+0000","last_became_active":"2024-05-15T15:40:31.869544+0000","last_became_peered":"2024-05-15T15:40:31.869544+0000","last_unstale":"2024-05-15T15:40:33.004610+0000","last_undegraded":"2024-05-15T15:40:33.004610+0000","last_fullsized":"2024-05-15T15:40:33.004610+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:54:09.408845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:32.850528+0000","last_change":"2024-05-15T15:40:31.871800+0000","last_active":"2024-05-15T15:40:32.850528+0000","last_peered":"2024-05-15T15:40:32.850528+0000","last_clean":"2024-05-15T15:40:32.850528+0000","last_became_active":"2024-05-15T15:40:31.871505+0000","last_became_peered":"2024-05-15T15:40:31.871505+0000","last_unstale":"2024-05-15T15:40:32.850528+0000","last_undegraded":"2024-05-15T15:40:32.850528+0000","last_fullsized":"2024-05-15T15:40:32.850528+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:56:30.369155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:33.005629+0000","last_change":"2024-05-15T15:40:31.880793+0000","last_active":"2024-05-15T15:40:33.005629+0000","last_peered":"2024-05-15T15:40:33.005629+0000","last_clean":"2024-05-15T15:40:33.005629+0000","last_became_active":"2024-05-15T15:40:31.880486+0000","last_became_peered":"2024-05-15T15:40:31.880486+0000","last_unstale":"2024-05-15T15:40:33.005629+0000","last_undegraded":"2024-05-15T15:40:33.005629+0000","last_fullsized":"2024-05-15T15:40:33.005629+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:44:53.908859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-15T15:40:30.847400+0000","last_change":"2024-05-15T15:40:30.847400+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.847400+0000","last_undegraded":"2024-05-15T15:40:30.847400+0000","last_fullsized":"2024-05-15T15:40:30.847400+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:32.846836+0000","last_change":"2024-05-15T15:40:31.861275+0000","last_active":"2024-05-15T15:40:32.846836+0000","last_peered":"2024-05-15T15:40:32.846836+0000","last_clean":"2024-05-15T15:40:32.846836+0000","last_became_active":"2024-05-15T15:40:31.860781+0000","last_became_peered":"2024-05-15T15:40:31.860781+0000","last_unstale":"2024-05-15T15:40:32.846836+0000","last_undegraded":"2024-05-15T15:40:32.846836+0000","last_fullsized":"2024-05-15T15:40:32.846836+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:48:55.724035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:32.846831+0000","last_change":"2024-05-15T15:40:31.861226+0000","last_active":"2024-05-15T15:40:32.846831+0000","last_peered":"2024-05-15T15:40:32.846831+0000","last_clean":"2024-05-15T15:40:32.846831+0000","last_became_active":"2024-05-15T15:40:31.860767+0000","last_became_peered":"2024-05-15T15:40:31.860767+0000","last_unstale":"2024-05-15T15:40:32.846831+0000","last_undegraded":"2024-05-15T15:40:32.846831+0000","last_fullsized":"2024-05-15T15:40:32.846831+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:05:07.976225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:33.004503+0000","last_change":"2024-05-15T15:40:31.861363+0000","last_active":"2024-05-15T15:40:33.004503+0000","last_peered":"2024-05-15T15:40:33.004503+0000","last_clean":"2024-05-15T15:40:33.004503+0000","last_became_active":"2024-05-15T15:40:31.861041+0000","last_became_peered":"2024-05-15T15:40:31.861041+0000","last_unstale":"2024-05-15T15:40:33.004503+0000","last_undegraded":"2024-05-15T15:40:33.004503+0000","last_fullsized":"2024-05-15T15:40:33.004503+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:19:12.662557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:33.005103+0000","last_change":"2024-05-15T15:40:31.867339+0000","last_active":"2024-05-15T15:40:33.005103+0000","last_peered":"2024-05-15T15:40:33.005103+0000","last_clean":"2024-05-15T15:40:33.005103+0000","last_became_active":"2024-05-15T15:40:31.867019+0000","last_became_peered":"2024-05-15T15:40:31.867019+0000","last_unstale":"2024-05-15T15:40:33.005103+0000","last_undegraded":"2024-05-15T15:40:33.005103+0000","last_fullsized":"2024-05-15T15:40:33.005103+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:19:56.307191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:33.005497+0000","last_change":"2024-05-15T15:40:31.875798+0000","last_active":"2024-05-15T15:40:33.005497+0000","last_peered":"2024-05-15T15:40:33.005497+0000","last_clean":"2024-05-15T15:40:33.005497+0000","last_became_active":"2024-05-15T15:40:31.875424+0000","last_became_peered":"2024-05-15T15:40:31.875424+0000","last_unstale":"2024-05-15T15:40:33.005497+0000","last_undegraded":"2024-05-15T15:40:33.005497+0000","last_fullsized":"2024-05-15T15:40:33.005497+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:01:38.441362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:33.005665+0000","last_change":"2024-05-15T15:40:31.876081+0000","last_active":"2024-05-15T15:40:33.005665+0000","last_peered":"2024-05-15T15:40:33.005665+0000","last_clean":"2024-05-15T15:40:33.005665+0000","last_became_active":"2024-05-15T15:40:31.875743+0000","last_became_peered":"2024-05-15T15:40:31.875743+0000","last_unstale":"2024-05-15T15:40:33.005665+0000","last_undegraded":"2024-05-15T15:40:33.005665+0000","last_fullsized":"2024-05-15T15:40:33.005665+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:15:27.582772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:32.847200+0000","last_change":"2024-05-15T15:40:31.864302+0000","last_active":"2024-05-15T15:40:32.847200+0000","last_peered":"2024-05-15T15:40:32.847200+0000","last_clean":"2024-05-15T15:40:32.847200+0000","last_became_active":"2024-05-15T15:40:31.864000+0000","last_became_peered":"2024-05-15T15:40:31.864000+0000","last_unstale":"2024-05-15T15:40:32.847200+0000","last_undegraded":"2024-05-15T15:40:32.847200+0000","last_fullsized":"2024-05-15T15:40:32.847200+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:27:01.270998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:32.852604+0000","last_change":"2024-05-15T15:40:31.869450+0000","last_active":"2024-05-15T15:40:32.852604+0000","last_peered":"2024-05-15T15:40:32.852604+0000","last_clean":"2024-05-15T15:40:32.852604+0000","last_became_active":"2024-05-15T15:40:31.869145+0000","last_became_peered":"2024-05-15T15:40:31.869145+0000","last_unstale":"2024-05-15T15:40:32.852604+0000","last_undegraded":"2024-05-15T15:40:32.852604+0000","last_fullsized":"2024-05-15T15:40:32.852604+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:48:55.724035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:33.004858+0000","last_change":"2024-05-15T15:40:31.881401+0000","last_active":"2024-05-15T15:40:33.004858+0000","last_peered":"2024-05-15T15:40:33.004858+0000","last_clean":"2024-05-15T15:40:33.004858+0000","last_became_active":"2024-05-15T15:40:31.881104+0000","last_became_peered":"2024-05-15T15:40:31.881104+0000","last_unstale":"2024-05-15T15:40:33.004858+0000","last_undegraded":"2024-05-15T15:40:33.004858+0000","last_fullsized":"2024-05-15T15:40:33.004858+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:53:30.217027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:32.852445+0000","last_change":"2024-05-15T15:40:31.869187+0000","last_active":"2024-05-15T15:40:32.852445+0000","last_peered":"2024-05-15T15:40:32.852445+0000","last_clean":"2024-05-15T15:40:32.852445+0000","last_became_active":"2024-05-15T15:40:31.868885+0000","last_became_peered":"2024-05-15T15:40:31.868885+0000","last_unstale":"2024-05-15T15:40:32.852445+0000","last_undegraded":"2024-05-15T15:40:32.852445+0000","last_fullsized":"2024-05-15T15:40:32.852445+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:15:27.582772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-15T15:40:30.848183+0000","last_change":"2024-05-15T15:40:30.848183+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.848183+0000","last_undegraded":"2024-05-15T15:40:30.848183+0000","last_fullsized":"2024-05-15T15:40:30.848183+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-15T15:40:30.847665+0000","last_change":"2024-05-15T15:40:30.847665+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.847665+0000","last_undegraded":"2024-05-15T15:40:30.847665+0000","last_fullsized":"2024-05-15T15:40:30.847665+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:33.005215+0000","last_change":"2024-05-15T15:40:31.861451+0000","last_active":"2024-05-15T15:40:33.005215+0000","last_peered":"2024-05-15T15:40:33.005215+0000","last_clean":"2024-05-15T15:40:33.005215+0000","last_became_active":"2024-05-15T15:40:31.861147+0000","last_became_peered":"2024-05-15T15:40:31.861147+0000","last_unstale":"2024-05-15T15:40:33.005215+0000","last_undegraded":"2024-05-15T15:40:33.005215+0000","last_fullsized":"2024-05-15T15:40:33.005215+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:53:08.027972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:32.852913+0000","last_change":"2024-05-15T15:40:31.870103+0000","last_active":"2024-05-15T15:40:32.852913+0000","last_peered":"2024-05-15T15:40:32.852913+0000","last_clean":"2024-05-15T15:40:32.852913+0000","last_became_active":"2024-05-15T15:40:31.869774+0000","last_became_peered":"2024-05-15T15:40:31.869774+0000","last_unstale":"2024-05-15T15:40:32.852913+0000","last_undegraded":"2024-05-15T15:40:32.852913+0000","last_fullsized":"2024-05-15T15:40:32.852913+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:53:08.027972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:32.847102+0000","last_change":"2024-05-15T15:40:31.872123+0000","last_active":"2024-05-15T15:40:32.847102+0000","last_peered":"2024-05-15T15:40:32.847102+0000","last_clean":"2024-05-15T15:40:32.847102+0000","last_became_active":"2024-05-15T15:40:31.871752+0000","last_became_peered":"2024-05-15T15:40:31.871752+0000","last_unstale":"2024-05-15T15:40:32.847102+0000","last_undegraded":"2024-05-15T15:40:32.847102+0000","last_fullsized":"2024-05-15T15:40:32.847102+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:31:22.263338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:32.847054+0000","last_change":"2024-05-15T15:40:31.856188+0000","last_active":"2024-05-15T15:40:32.847054+0000","last_peered":"2024-05-15T15:40:32.847054+0000","last_clean":"2024-05-15T15:40:32.847054+0000","last_became_active":"2024-05-15T15:40:31.855149+0000","last_became_peered":"2024-05-15T15:40:31.855149+0000","last_unstale":"2024-05-15T15:40:32.847054+0000","last_undegraded":"2024-05-15T15:40:32.847054+0000","last_fullsized":"2024-05-15T15:40:32.847054+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:14:07.552265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:32.852518+0000","last_change":"2024-05-15T15:40:31.859800+0000","last_active":"2024-05-15T15:40:32.852518+0000","last_peered":"2024-05-15T15:40:32.852518+0000","last_clean":"2024-05-15T15:40:32.852518+0000","last_became_active":"2024-05-15T15:40:31.859498+0000","last_became_peered":"2024-05-15T15:40:31.859498+0000","last_unstale":"2024-05-15T15:40:32.852518+0000","last_undegraded":"2024-05-15T15:40:32.852518+0000","last_fullsized":"2024-05-15T15:40:32.852518+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:05:07.976225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:33.004369+0000","last_change":"2024-05-15T15:40:31.868970+0000","last_active":"2024-05-15T15:40:33.004369+0000","last_peered":"2024-05-15T15:40:33.004369+0000","last_clean":"2024-05-15T15:40:33.004369+0000","last_became_active":"2024-05-15T15:40:31.868649+0000","last_became_peered":"2024-05-15T15:40:31.868649+0000","last_unstale":"2024-05-15T15:40:33.004369+0000","last_undegraded":"2024-05-15T15:40:33.004369+0000","last_fullsized":"2024-05-15T15:40:33.004369+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:06:13.282015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:33.005457+0000","last_change":"2024-05-15T15:40:31.870910+0000","last_active":"2024-05-15T15:40:33.005457+0000","last_peered":"2024-05-15T15:40:33.005457+0000","last_clean":"2024-05-15T15:40:33.005457+0000","last_became_active":"2024-05-15T15:40:31.870504+0000","last_became_peered":"2024-05-15T15:40:31.870504+0000","last_unstale":"2024-05-15T15:40:33.005457+0000","last_undegraded":"2024-05-15T15:40:33.005457+0000","last_fullsized":"2024-05-15T15:40:33.005457+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:50:56.125640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:33.004638+0000","last_change":"2024-05-15T15:40:30.863025+0000","last_active":"2024-05-15T15:40:33.004638+0000","last_peered":"2024-05-15T15:40:33.004638+0000","last_clean":"2024-05-15T15:40:33.004638+0000","last_became_active":"2024-05-15T15:40:30.862679+0000","last_became_peered":"2024-05-15T15:40:30.862679+0000","last_unstale":"2024-05-15T15:40:33.004638+0000","last_undegraded":"2024-05-15T15:40:33.004638+0000","last_fullsized":"2024-05-15T15:40:33.004638+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:28:06.803331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:32.852995+0000","last_change":"2024-05-15T15:40:31.861298+0000","last_active":"2024-05-15T15:40:32.852995+0000","last_peered":"2024-05-15T15:40:32.852995+0000","last_clean":"2024-05-15T15:40:32.852995+0000","last_became_active":"2024-05-15T15:40:31.860969+0000","last_became_peered":"2024-05-15T15:40:31.860969+0000","last_unstale":"2024-05-15T15:40:32.852995+0000","last_undegraded":"2024-05-15T15:40:32.852995+0000","last_fullsized":"2024-05-15T15:40:32.852995+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:30:38.468087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T15:40:30.871791+0000","last_change":"2024-05-15T15:40:30.866859+0000","last_active":"2024-05-15T15:40:30.871791+0000","last_peered":"2024-05-15T15:40:30.871791+0000","last_clean":"2024-05-15T15:40:30.871791+0000","last_became_active":"2024-05-15T15:40:30.866428+0000","last_became_peered":"2024-05-15T15:40:30.866428+0000","last_unstale":"2024-05-15T15:40:30.871791+0000","last_undegraded":"2024-05-15T15:40:30.871791+0000","last_fullsized":"2024-05-15T15:40:30.871791+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:58:01.392397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:32.852964+0000","last_change":"2024-05-15T15:40:31.872546+0000","last_active":"2024-05-15T15:40:32.852964+0000","last_peered":"2024-05-15T15:40:32.852964+0000","last_clean":"2024-05-15T15:40:32.852964+0000","last_became_active":"2024-05-15T15:40:31.872114+0000","last_became_peered":"2024-05-15T15:40:31.872114+0000","last_unstale":"2024-05-15T15:40:32.852964+0000","last_undegraded":"2024-05-15T15:40:32.852964+0000","last_fullsized":"2024-05-15T15:40:32.852964+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:27:01.270998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:33.006107+0000","last_change":"2024-05-15T15:40:30.863147+0000","last_active":"2024-05-15T15:40:33.006107+0000","last_peered":"2024-05-15T15:40:33.006107+0000","last_clean":"2024-05-15T15:40:33.006107+0000","last_became_active":"2024-05-15T15:40:30.862740+0000","last_became_peered":"2024-05-15T15:40:30.862740+0000","last_unstale":"2024-05-15T15:40:33.006107+0000","last_undegraded":"2024-05-15T15:40:33.006107+0000","last_fullsized":"2024-05-15T15:40:33.006107+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:22:56.369287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-15T15:40:30.846972+0000","last_change":"2024-05-15T15:40:30.846972+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.846972+0000","last_undegraded":"2024-05-15T15:40:30.846972+0000","last_fullsized":"2024-05-15T15:40:30.846972+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T15:40:30.866089+0000","last_change":"2024-05-15T15:40:30.857947+0000","last_active":"2024-05-15T15:40:30.866089+0000","last_peered":"2024-05-15T15:40:30.866089+0000","last_clean":"2024-05-15T15:40:30.866089+0000","last_became_active":"2024-05-15T15:40:30.857649+0000","last_became_peered":"2024-05-15T15:40:30.857649+0000","last_unstale":"2024-05-15T15:40:30.866089+0000","last_undegraded":"2024-05-15T15:40:30.866089+0000","last_fullsized":"2024-05-15T15:40:30.866089+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:00:02.621628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:32.850402+0000","last_change":"2024-05-15T15:40:31.875875+0000","last_active":"2024-05-15T15:40:32.850402+0000","last_peered":"2024-05-15T15:40:32.850402+0000","last_clean":"2024-05-15T15:40:32.850402+0000","last_became_active":"2024-05-15T15:40:31.875491+0000","last_became_peered":"2024-05-15T15:40:31.875491+0000","last_unstale":"2024-05-15T15:40:32.850402+0000","last_undegraded":"2024-05-15T15:40:32.850402+0000","last_fullsized":"2024-05-15T15:40:32.850402+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:42:13.355007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"32'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:32.852654+0000","last_change":"2024-05-15T15:40:30.863942+0000","last_active":"2024-05-15T15:40:32.852654+0000","last_peered":"2024-05-15T15:40:32.852654+0000","last_clean":"2024-05-15T15:40:32.852654+0000","last_became_active":"2024-05-15T15:40:30.863610+0000","last_became_peered":"2024-05-15T15:40:30.863610+0000","last_unstale":"2024-05-15T15:40:32.852654+0000","last_undegraded":"2024-05-15T15:40:32.852654+0000","last_fullsized":"2024-05-15T15:40:32.852654+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:49:01.836129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:32.852618+0000","last_change":"2024-05-15T15:40:31.866857+0000","last_active":"2024-05-15T15:40:32.852618+0000","last_peered":"2024-05-15T15:40:32.852618+0000","last_clean":"2024-05-15T15:40:32.852618+0000","last_became_active":"2024-05-15T15:40:31.866539+0000","last_became_peered":"2024-05-15T15:40:31.866539+0000","last_unstale":"2024-05-15T15:40:32.852618+0000","last_undegraded":"2024-05-15T15:40:32.852618+0000","last_fullsized":"2024-05-15T15:40:32.852618+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:14:07.552265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"32'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:32.852514+0000","last_change":"2024-05-15T15:40:30.859874+0000","last_active":"2024-05-15T15:40:32.852514+0000","last_peered":"2024-05-15T15:40:32.852514+0000","last_clean":"2024-05-15T15:40:32.852514+0000","last_became_active":"2024-05-15T15:40:30.859544+0000","last_became_peered":"2024-05-15T15:40:30.859544+0000","last_unstale":"2024-05-15T15:40:32.852514+0000","last_undegraded":"2024-05-15T15:40:32.852514+0000","last_fullsized":"2024-05-15T15:40:32.852514+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:56:29.362654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:32.850291+0000","last_change":"2024-05-15T15:40:31.877406+0000","last_active":"2024-05-15T15:40:32.850291+0000","last_peered":"2024-05-15T15:40:32.850291+0000","last_clean":"2024-05-15T15:40:32.850291+0000","last_became_active":"2024-05-15T15:40:31.877078+0000","last_became_peered":"2024-05-15T15:40:31.877078+0000","last_unstale":"2024-05-15T15:40:32.850291+0000","last_undegraded":"2024-05-15T15:40:32.850291+0000","last_fullsized":"2024-05-15T15:40:32.850291+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:17:44.988809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:33.004849+0000","last_change":"2024-05-15T15:40:30.859033+0000","last_active":"2024-05-15T15:40:33.004849+0000","last_peered":"2024-05-15T15:40:33.004849+0000","last_clean":"2024-05-15T15:40:33.004849+0000","last_became_active":"2024-05-15T15:40:30.858683+0000","last_became_peered":"2024-05-15T15:40:30.858683+0000","last_unstale":"2024-05-15T15:40:33.004849+0000","last_undegraded":"2024-05-15T15:40:33.004849+0000","last_fullsized":"2024-05-15T15:40:33.004849+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:53:21.465544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-15T15:40:30.845746+0000","last_change":"2024-05-15T15:40:30.845746+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.845746+0000","last_undegraded":"2024-05-15T15:40:30.845746+0000","last_fullsized":"2024-05-15T15:40:30.845746+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:32.852735+0000","last_change":"2024-05-15T15:40:30.863030+0000","last_active":"2024-05-15T15:40:32.852735+0000","last_peered":"2024-05-15T15:40:32.852735+0000","last_clean":"2024-05-15T15:40:32.852735+0000","last_became_active":"2024-05-15T15:40:30.862654+0000","last_became_peered":"2024-05-15T15:40:30.862654+0000","last_unstale":"2024-05-15T15:40:32.852735+0000","last_undegraded":"2024-05-15T15:40:32.852735+0000","last_fullsized":"2024-05-15T15:40:32.852735+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:15:50.965918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:33.004405+0000","last_change":"2024-05-15T15:40:31.868060+0000","last_active":"2024-05-15T15:40:33.004405+0000","last_peered":"2024-05-15T15:40:33.004405+0000","last_clean":"2024-05-15T15:40:33.004405+0000","last_became_active":"2024-05-15T15:40:31.867733+0000","last_became_peered":"2024-05-15T15:40:31.867733+0000","last_unstale":"2024-05-15T15:40:33.004405+0000","last_undegraded":"2024-05-15T15:40:33.004405+0000","last_fullsized":"2024-05-15T15:40:33.004405+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:32:53.637391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:33.006152+0000","last_change":"2024-05-15T15:40:30.868248+0000","last_active":"2024-05-15T15:40:33.006152+0000","last_peered":"2024-05-15T15:40:33.006152+0000","last_clean":"2024-05-15T15:40:33.006152+0000","last_became_active":"2024-05-15T15:40:30.867984+0000","last_became_peered":"2024-05-15T15:40:30.867984+0000","last_unstale":"2024-05-15T15:40:33.006152+0000","last_undegraded":"2024-05-15T15:40:33.006152+0000","last_fullsized":"2024-05-15T15:40:33.006152+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:53:29.210527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-15T15:40:30.845968+0000","last_change":"2024-05-15T15:40:30.845968+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.845968+0000","last_undegraded":"2024-05-15T15:40:30.845968+0000","last_fullsized":"2024-05-15T15:40:30.845968+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:33.006691+0000","last_change":"2024-05-15T15:40:30.862948+0000","last_active":"2024-05-15T15:40:33.006691+0000","last_peered":"2024-05-15T15:40:33.006691+0000","last_clean":"2024-05-15T15:40:33.006691+0000","last_became_active":"2024-05-15T15:40:30.862642+0000","last_became_peered":"2024-05-15T15:40:30.862642+0000","last_unstale":"2024-05-15T15:40:33.006691+0000","last_undegraded":"2024-05-15T15:40:33.006691+0000","last_fullsized":"2024-05-15T15:40:33.006691+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:50:55.119139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-15T15:40:30.849029+0000","last_change":"2024-05-15T15:40:30.849029+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.849029+0000","last_undegraded":"2024-05-15T15:40:30.849029+0000","last_fullsized":"2024-05-15T15:40:30.849029+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.15","version":"32'3","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:33.004510+0000","last_change":"2024-05-15T15:40:30.864390+0000","last_active":"2024-05-15T15:40:33.004510+0000","last_peered":"2024-05-15T15:40:33.004510+0000","last_clean":"2024-05-15T15:40:33.004510+0000","last_became_active":"2024-05-15T15:40:30.864082+0000","last_became_peered":"2024-05-15T15:40:30.864082+0000","last_unstale":"2024-05-15T15:40:33.004510+0000","last_undegraded":"2024-05-15T15:40:33.004510+0000","last_fullsized":"2024-05-15T15:40:33.004510+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:52:45.667417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:33.004443+0000","last_change":"2024-05-15T15:40:31.869042+0000","last_active":"2024-05-15T15:40:33.004443+0000","last_peered":"2024-05-15T15:40:33.004443+0000","last_clean":"2024-05-15T15:40:33.004443+0000","last_became_active":"2024-05-15T15:40:31.868682+0000","last_became_peered":"2024-05-15T15:40:31.868682+0000","last_unstale":"2024-05-15T15:40:33.004443+0000","last_undegraded":"2024-05-15T15:40:33.004443+0000","last_fullsized":"2024-05-15T15:40:33.004443+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:17:12.322075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"32'6","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:33.005786+0000","last_change":"2024-05-15T15:40:30.857796+0000","last_active":"2024-05-15T15:40:33.005786+0000","last_peered":"2024-05-15T15:40:33.005786+0000","last_clean":"2024-05-15T15:40:33.005786+0000","last_became_active":"2024-05-15T15:40:30.857464+0000","last_became_peered":"2024-05-15T15:40:30.857464+0000","last_unstale":"2024-05-15T15:40:33.005786+0000","last_undegraded":"2024-05-15T15:40:33.005786+0000","last_fullsized":"2024-05-15T15:40:33.005786+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:29:31.530165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:33.006160+0000","last_change":"2024-05-15T15:40:31.877873+0000","last_active":"2024-05-15T15:40:33.006160+0000","last_peered":"2024-05-15T15:40:33.006160+0000","last_clean":"2024-05-15T15:40:33.006160+0000","last_became_active":"2024-05-15T15:40:31.876217+0000","last_became_peered":"2024-05-15T15:40:31.876217+0000","last_unstale":"2024-05-15T15:40:33.006160+0000","last_undegraded":"2024-05-15T15:40:33.006160+0000","last_fullsized":"2024-05-15T15:40:33.006160+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:18:50.984099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:32.852749+0000","last_change":"2024-05-15T15:40:30.857596+0000","last_active":"2024-05-15T15:40:32.852749+0000","last_peered":"2024-05-15T15:40:32.852749+0000","last_clean":"2024-05-15T15:40:32.852749+0000","last_became_active":"2024-05-15T15:40:30.857289+0000","last_became_peered":"2024-05-15T15:40:30.857289+0000","last_unstale":"2024-05-15T15:40:32.852749+0000","last_undegraded":"2024-05-15T15:40:32.852749+0000","last_fullsized":"2024-05-15T15:40:32.852749+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:10:13.648860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-15T15:40:30.846550+0000","last_change":"2024-05-15T15:40:30.846550+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.846550+0000","last_undegraded":"2024-05-15T15:40:30.846550+0000","last_fullsized":"2024-05-15T15:40:30.846550+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T15:40:30.866023+0000","last_change":"2024-05-15T15:40:30.856989+0000","last_active":"2024-05-15T15:40:30.866023+0000","last_peered":"2024-05-15T15:40:30.866023+0000","last_clean":"2024-05-15T15:40:30.866023+0000","last_became_active":"2024-05-15T15:40:30.856464+0000","last_became_peered":"2024-05-15T15:40:30.856464+0000","last_unstale":"2024-05-15T15:40:30.866023+0000","last_undegraded":"2024-05-15T15:40:30.866023+0000","last_fullsized":"2024-05-15T15:40:30.866023+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:01:01.491109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:32.852797+0000","last_change":"2024-05-15T15:40:31.876577+0000","last_active":"2024-05-15T15:40:32.852797+0000","last_peered":"2024-05-15T15:40:32.852797+0000","last_clean":"2024-05-15T15:40:32.852797+0000","last_became_active":"2024-05-15T15:40:31.876277+0000","last_became_peered":"2024-05-15T15:40:31.876277+0000","last_unstale":"2024-05-15T15:40:32.852797+0000","last_undegraded":"2024-05-15T15:40:32.852797+0000","last_fullsized":"2024-05-15T15:40:32.852797+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:14:09.635458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T15:40:30.865968+0000","last_change":"2024-05-15T15:40:30.856323+0000","last_active":"2024-05-15T15:40:30.865968+0000","last_peered":"2024-05-15T15:40:30.865968+0000","last_clean":"2024-05-15T15:40:30.865968+0000","last_became_active":"2024-05-15T15:40:30.856001+0000","last_became_peered":"2024-05-15T15:40:30.856001+0000","last_unstale":"2024-05-15T15:40:30.865968+0000","last_undegraded":"2024-05-15T15:40:30.865968+0000","last_fullsized":"2024-05-15T15:40:30.865968+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:50:04.108918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:33.004323+0000","last_change":"2024-05-15T15:40:31.861059+0000","last_active":"2024-05-15T15:40:33.004323+0000","last_peered":"2024-05-15T15:40:33.004323+0000","last_clean":"2024-05-15T15:40:33.004323+0000","last_became_active":"2024-05-15T15:40:31.860732+0000","last_became_peered":"2024-05-15T15:40:31.860732+0000","last_unstale":"2024-05-15T15:40:33.004323+0000","last_undegraded":"2024-05-15T15:40:33.004323+0000","last_fullsized":"2024-05-15T15:40:33.004323+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:43:59.631620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"32'8","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:33.004675+0000","last_change":"2024-05-15T15:40:30.861726+0000","last_active":"2024-05-15T15:40:33.004675+0000","last_peered":"2024-05-15T15:40:33.004675+0000","last_clean":"2024-05-15T15:40:33.004675+0000","last_became_active":"2024-05-15T15:40:30.861376+0000","last_became_peered":"2024-05-15T15:40:30.861376+0000","last_unstale":"2024-05-15T15:40:33.004675+0000","last_undegraded":"2024-05-15T15:40:33.004675+0000","last_fullsized":"2024-05-15T15:40:33.004675+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:49:31.489237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:33.004539+0000","last_change":"2024-05-15T15:40:31.870934+0000","last_active":"2024-05-15T15:40:33.004539+0000","last_peered":"2024-05-15T15:40:33.004539+0000","last_clean":"2024-05-15T15:40:33.004539+0000","last_became_active":"2024-05-15T15:40:31.870589+0000","last_became_peered":"2024-05-15T15:40:31.870589+0000","last_unstale":"2024-05-15T15:40:33.004539+0000","last_undegraded":"2024-05-15T15:40:33.004539+0000","last_fullsized":"2024-05-15T15:40:33.004539+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:21:35.394449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"32'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:33.005147+0000","last_change":"2024-05-15T15:40:30.862190+0000","last_active":"2024-05-15T15:40:33.005147+0000","last_peered":"2024-05-15T15:40:33.005147+0000","last_clean":"2024-05-15T15:40:33.005147+0000","last_became_active":"2024-05-15T15:40:30.861868+0000","last_became_peered":"2024-05-15T15:40:30.861868+0000","last_unstale":"2024-05-15T15:40:33.005147+0000","last_undegraded":"2024-05-15T15:40:33.005147+0000","last_fullsized":"2024-05-15T15:40:33.005147+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:19:30.305711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:32.850763+0000","last_change":"2024-05-15T15:40:31.876785+0000","last_active":"2024-05-15T15:40:32.850763+0000","last_peered":"2024-05-15T15:40:32.850763+0000","last_clean":"2024-05-15T15:40:32.850763+0000","last_became_active":"2024-05-15T15:40:31.876465+0000","last_became_peered":"2024-05-15T15:40:31.876465+0000","last_unstale":"2024-05-15T15:40:32.850763+0000","last_undegraded":"2024-05-15T15:40:32.850763+0000","last_fullsized":"2024-05-15T15:40:32.850763+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:10:14.655360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:32.852788+0000","last_change":"2024-05-15T15:40:30.858535+0000","last_active":"2024-05-15T15:40:32.852788+0000","last_peered":"2024-05-15T15:40:32.852788+0000","last_clean":"2024-05-15T15:40:32.852788+0000","last_became_active":"2024-05-15T15:40:30.858150+0000","last_became_peered":"2024-05-15T15:40:30.858150+0000","last_unstale":"2024-05-15T15:40:32.852788+0000","last_undegraded":"2024-05-15T15:40:32.852788+0000","last_fullsized":"2024-05-15T15:40:32.852788+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:17:43.982309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:33.005112+0000","last_change":"2024-05-15T15:40:31.871742+0000","last_active":"2024-05-15T15:40:33.005112+0000","last_peered":"2024-05-15T15:40:33.005112+0000","last_clean":"2024-05-15T15:40:33.005112+0000","last_became_active":"2024-05-15T15:40:31.871430+0000","last_became_peered":"2024-05-15T15:40:31.871430+0000","last_unstale":"2024-05-15T15:40:33.005112+0000","last_undegraded":"2024-05-15T15:40:33.005112+0000","last_fullsized":"2024-05-15T15:40:33.005112+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:31:22.263338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"32'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:33.004638+0000","last_change":"2024-05-15T15:40:30.868324+0000","last_active":"2024-05-15T15:40:33.004638+0000","last_peered":"2024-05-15T15:40:33.004638+0000","last_clean":"2024-05-15T15:40:33.004638+0000","last_became_active":"2024-05-15T15:40:30.867971+0000","last_became_peered":"2024-05-15T15:40:30.867971+0000","last_unstale":"2024-05-15T15:40:33.004638+0000","last_undegraded":"2024-05-15T15:40:33.004638+0000","last_fullsized":"2024-05-15T15:40:33.004638+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:45:32.375669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:33.005717+0000","last_change":"2024-05-15T15:40:31.877045+0000","last_active":"2024-05-15T15:40:33.005717+0000","last_peered":"2024-05-15T15:40:33.005717+0000","last_clean":"2024-05-15T15:40:33.005717+0000","last_became_active":"2024-05-15T15:40:31.876736+0000","last_became_peered":"2024-05-15T15:40:31.876736+0000","last_unstale":"2024-05-15T15:40:33.005717+0000","last_undegraded":"2024-05-15T15:40:33.005717+0000","last_fullsized":"2024-05-15T15:40:33.005717+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:29:32.536665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:32.847128+0000","last_change":"2024-05-15T15:40:30.858223+0000","last_active":"2024-05-15T15:40:32.847128+0000","last_peered":"2024-05-15T15:40:32.847128+0000","last_clean":"2024-05-15T15:40:32.847128+0000","last_became_active":"2024-05-15T15:40:30.857862+0000","last_became_peered":"2024-05-15T15:40:30.857862+0000","last_unstale":"2024-05-15T15:40:32.847128+0000","last_undegraded":"2024-05-15T15:40:32.847128+0000","last_fullsized":"2024-05-15T15:40:32.847128+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:52:59.167447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:33.006354+0000","last_change":"2024-05-15T15:40:31.880812+0000","last_active":"2024-05-15T15:40:33.006354+0000","last_peered":"2024-05-15T15:40:33.006354+0000","last_clean":"2024-05-15T15:40:33.006354+0000","last_became_active":"2024-05-15T15:40:31.879717+0000","last_became_peered":"2024-05-15T15:40:31.879717+0000","last_unstale":"2024-05-15T15:40:33.006354+0000","last_undegraded":"2024-05-15T15:40:33.006354+0000","last_fullsized":"2024-05-15T15:40:33.006354+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:05:07.976225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:33.005773+0000","last_change":"2024-05-15T15:40:30.866950+0000","last_active":"2024-05-15T15:40:33.005773+0000","last_peered":"2024-05-15T15:40:33.005773+0000","last_clean":"2024-05-15T15:40:33.005773+0000","last_became_active":"2024-05-15T15:40:30.866618+0000","last_became_peered":"2024-05-15T15:40:30.866618+0000","last_unstale":"2024-05-15T15:40:33.005773+0000","last_undegraded":"2024-05-15T15:40:33.005773+0000","last_fullsized":"2024-05-15T15:40:33.005773+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:15:26.576271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:33.005649+0000","last_change":"2024-05-15T15:40:31.860233+0000","last_active":"2024-05-15T15:40:33.005649+0000","last_peered":"2024-05-15T15:40:33.005649+0000","last_clean":"2024-05-15T15:40:33.005649+0000","last_became_active":"2024-05-15T15:40:31.859918+0000","last_became_peered":"2024-05-15T15:40:31.859918+0000","last_unstale":"2024-05-15T15:40:33.005649+0000","last_undegraded":"2024-05-15T15:40:33.005649+0000","last_fullsized":"2024-05-15T15:40:33.005649+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:30:38.468087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:32.852634+0000","last_change":"2024-05-15T15:40:30.856479+0000","last_active":"2024-05-15T15:40:32.852634+0000","last_peered":"2024-05-15T15:40:32.852634+0000","last_clean":"2024-05-15T15:40:32.852634+0000","last_became_active":"2024-05-15T15:40:30.856159+0000","last_became_peered":"2024-05-15T15:40:30.856159+0000","last_unstale":"2024-05-15T15:40:32.852634+0000","last_undegraded":"2024-05-15T15:40:32.852634+0000","last_fullsized":"2024-05-15T15:40:32.852634+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:19:55.300691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:33.006877+0000","last_change":"2024-05-15T15:40:31.875300+0000","last_active":"2024-05-15T15:40:33.006877+0000","last_peered":"2024-05-15T15:40:33.006877+0000","last_clean":"2024-05-15T15:40:33.006877+0000","last_became_active":"2024-05-15T15:40:31.874466+0000","last_became_peered":"2024-05-15T15:40:31.874466+0000","last_unstale":"2024-05-15T15:40:33.006877+0000","last_undegraded":"2024-05-15T15:40:33.006877+0000","last_fullsized":"2024-05-15T15:40:33.006877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:48:55.724035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:32.850334+0000","last_change":"2024-05-15T15:40:30.866538+0000","last_active":"2024-05-15T15:40:32.850334+0000","last_peered":"2024-05-15T15:40:32.850334+0000","last_clean":"2024-05-15T15:40:32.850334+0000","last_became_active":"2024-05-15T15:40:30.866059+0000","last_became_peered":"2024-05-15T15:40:30.866059+0000","last_unstale":"2024-05-15T15:40:32.850334+0000","last_undegraded":"2024-05-15T15:40:32.850334+0000","last_fullsized":"2024-05-15T15:40:32.850334+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:35:46.398149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:32.850350+0000","last_change":"2024-05-15T15:40:31.878043+0000","last_active":"2024-05-15T15:40:32.850350+0000","last_peered":"2024-05-15T15:40:32.850350+0000","last_clean":"2024-05-15T15:40:32.850350+0000","last_became_active":"2024-05-15T15:40:31.877699+0000","last_became_peered":"2024-05-15T15:40:31.877699+0000","last_unstale":"2024-05-15T15:40:32.850350+0000","last_undegraded":"2024-05-15T15:40:32.850350+0000","last_fullsized":"2024-05-15T15:40:32.850350+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:15:51.972418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:33.004178+0000","last_change":"2024-05-15T15:40:30.868700+0000","last_active":"2024-05-15T15:40:33.004178+0000","last_peered":"2024-05-15T15:40:33.004178+0000","last_clean":"2024-05-15T15:40:33.004178+0000","last_became_active":"2024-05-15T15:40:30.868332+0000","last_became_peered":"2024-05-15T15:40:30.868332+0000","last_unstale":"2024-05-15T15:40:33.004178+0000","last_undegraded":"2024-05-15T15:40:33.004178+0000","last_fullsized":"2024-05-15T15:40:33.004178+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:30:37.461586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:33.005234+0000","last_change":"2024-05-15T15:40:31.876290+0000","last_active":"2024-05-15T15:40:33.005234+0000","last_peered":"2024-05-15T15:40:33.005234+0000","last_clean":"2024-05-15T15:40:33.005234+0000","last_became_active":"2024-05-15T15:40:31.875975+0000","last_became_peered":"2024-05-15T15:40:31.875975+0000","last_unstale":"2024-05-15T15:40:33.005234+0000","last_undegraded":"2024-05-15T15:40:33.005234+0000","last_fullsized":"2024-05-15T15:40:33.005234+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:10:14.655360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:33.005278+0000","last_change":"2024-05-15T15:40:30.856757+0000","last_active":"2024-05-15T15:40:33.005278+0000","last_peered":"2024-05-15T15:40:33.005278+0000","last_clean":"2024-05-15T15:40:33.005278+0000","last_became_active":"2024-05-15T15:40:30.855959+0000","last_became_peered":"2024-05-15T15:40:30.855959+0000","last_unstale":"2024-05-15T15:40:33.005278+0000","last_undegraded":"2024-05-15T15:40:33.005278+0000","last_fullsized":"2024-05-15T15:40:33.005278+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:49:01.836129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:33.004512+0000","last_change":"2024-05-15T15:40:31.859303+0000","last_active":"2024-05-15T15:40:33.004512+0000","last_peered":"2024-05-15T15:40:33.004512+0000","last_clean":"2024-05-15T15:40:33.004512+0000","last_became_active":"2024-05-15T15:40:31.859014+0000","last_became_peered":"2024-05-15T15:40:31.859014+0000","last_unstale":"2024-05-15T15:40:33.004512+0000","last_undegraded":"2024-05-15T15:40:33.004512+0000","last_fullsized":"2024-05-15T15:40:33.004512+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:43:18.926547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"33'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:33.851407+0000","last_change":"2024-05-15T15:40:30.862323+0000","last_active":"2024-05-15T15:40:33.851407+0000","last_peered":"2024-05-15T15:40:33.851407+0000","last_clean":"2024-05-15T15:40:33.851407+0000","last_became_active":"2024-05-15T15:40:30.862008+0000","last_became_peered":"2024-05-15T15:40:30.862008+0000","last_unstale":"2024-05-15T15:40:33.851407+0000","last_undegraded":"2024-05-15T15:40:33.851407+0000","last_fullsized":"2024-05-15T15:40:33.851407+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:44:52.902358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:33.005935+0000","last_change":"2024-05-15T15:40:31.868768+0000","last_active":"2024-05-15T15:40:33.005935+0000","last_peered":"2024-05-15T15:40:33.005935+0000","last_clean":"2024-05-15T15:40:33.005935+0000","last_became_active":"2024-05-15T15:40:31.868448+0000","last_became_peered":"2024-05-15T15:40:31.868448+0000","last_unstale":"2024-05-15T15:40:33.005935+0000","last_undegraded":"2024-05-15T15:40:33.005935+0000","last_fullsized":"2024-05-15T15:40:33.005935+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:16:29.496330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:33.005888+0000","last_change":"2024-05-15T15:40:30.857910+0000","last_active":"2024-05-15T15:40:33.005888+0000","last_peered":"2024-05-15T15:40:33.005888+0000","last_clean":"2024-05-15T15:40:33.005888+0000","last_became_active":"2024-05-15T15:40:30.857570+0000","last_became_peered":"2024-05-15T15:40:30.857570+0000","last_unstale":"2024-05-15T15:40:33.005888+0000","last_undegraded":"2024-05-15T15:40:33.005888+0000","last_fullsized":"2024-05-15T15:40:33.005888+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:10:13.648860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:32.847074+0000","last_change":"2024-05-15T15:40:31.863460+0000","last_active":"2024-05-15T15:40:32.847074+0000","last_peered":"2024-05-15T15:40:32.847074+0000","last_clean":"2024-05-15T15:40:32.847074+0000","last_became_active":"2024-05-15T15:40:31.862443+0000","last_became_peered":"2024-05-15T15:40:31.862443+0000","last_unstale":"2024-05-15T15:40:32.847074+0000","last_undegraded":"2024-05-15T15:40:32.847074+0000","last_fullsized":"2024-05-15T15:40:32.847074+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:14:09.635458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:33.005406+0000","last_change":"2024-05-15T15:40:30.862014+0000","last_active":"2024-05-15T15:40:33.005406+0000","last_peered":"2024-05-15T15:40:33.005406+0000","last_clean":"2024-05-15T15:40:33.005406+0000","last_became_active":"2024-05-15T15:40:30.861647+0000","last_became_peered":"2024-05-15T15:40:30.861647+0000","last_unstale":"2024-05-15T15:40:33.005406+0000","last_undegraded":"2024-05-15T15:40:33.005406+0000","last_fullsized":"2024-05-15T15:40:33.005406+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:01:37.434862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-15T15:40:30.845726+0000","last_change":"2024-05-15T15:40:30.845726+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.845726+0000","last_undegraded":"2024-05-15T15:40:30.845726+0000","last_fullsized":"2024-05-15T15:40:30.845726+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:33.006570+0000","last_change":"2024-05-15T15:40:30.862351+0000","last_active":"2024-05-15T15:40:33.006570+0000","last_peered":"2024-05-15T15:40:33.006570+0000","last_clean":"2024-05-15T15:40:33.006570+0000","last_became_active":"2024-05-15T15:40:30.861872+0000","last_became_peered":"2024-05-15T15:40:30.861872+0000","last_unstale":"2024-05-15T15:40:33.006570+0000","last_undegraded":"2024-05-15T15:40:33.006570+0000","last_fullsized":"2024-05-15T15:40:33.006570+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:19:55.300691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-15T15:40:30.845709+0000","last_change":"2024-05-15T15:40:30.845709+0000","last_active":"2024-05-15T15:40:30.836484+0000","last_peered":"2024-05-15T15:40:30.836484+0000","last_clean":"2024-05-15T15:40:30.836484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T15:40:30.845709+0000","last_undegraded":"2024-05-15T15:40:30.845709+0000","last_fullsized":"2024-05-15T15:40:30.845709+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:32.852622+0000","last_change":"2024-05-15T15:40:30.859598+0000","last_active":"2024-05-15T15:40:32.852622+0000","last_peered":"2024-05-15T15:40:32.852622+0000","last_clean":"2024-05-15T15:40:32.852622+0000","last_became_active":"2024-05-15T15:40:30.858601+0000","last_became_peered":"2024-05-15T15:40:30.858601+0000","last_unstale":"2024-05-15T15:40:32.852622+0000","last_undegraded":"2024-05-15T15:40:32.852622+0000","last_fullsized":"2024-05-15T15:40:32.852622+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:42:12.348507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:33.004382+0000","last_change":"2024-05-15T15:40:31.860070+0000","last_active":"2024-05-15T15:40:33.004382+0000","last_peered":"2024-05-15T15:40:33.004382+0000","last_clean":"2024-05-15T15:40:33.004382+0000","last_became_active":"2024-05-15T15:40:31.859807+0000","last_became_peered":"2024-05-15T15:40:31.859807+0000","last_unstale":"2024-05-15T15:40:33.004382+0000","last_undegraded":"2024-05-15T15:40:33.004382+0000","last_fullsized":"2024-05-15T15:40:33.004382+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:09:35.016069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T15:40:30.871786+0000","last_change":"2024-05-15T15:40:30.866837+0000","last_active":"2024-05-15T15:40:30.871786+0000","last_peered":"2024-05-15T15:40:30.871786+0000","last_clean":"2024-05-15T15:40:30.871786+0000","last_became_active":"2024-05-15T15:40:30.866530+0000","last_became_peered":"2024-05-15T15:40:30.866530+0000","last_unstale":"2024-05-15T15:40:30.871786+0000","last_undegraded":"2024-05-15T15:40:30.871786+0000","last_fullsized":"2024-05-15T15:40:30.871786+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:12:17.658105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:32.847115+0000","last_change":"2024-05-15T15:40:31.867228+0000","last_active":"2024-05-15T15:40:32.847115+0000","last_peered":"2024-05-15T15:40:32.847115+0000","last_clean":"2024-05-15T15:40:32.847115+0000","last_became_active":"2024-05-15T15:40:31.866153+0000","last_became_peered":"2024-05-15T15:40:31.866153+0000","last_unstale":"2024-05-15T15:40:32.847115+0000","last_undegraded":"2024-05-15T15:40:32.847115+0000","last_fullsized":"2024-05-15T15:40:32.847115+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:53:08.027972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:33.004681+0000","last_change":"2024-05-15T15:40:30.867645+0000","last_active":"2024-05-15T15:40:33.004681+0000","last_peered":"2024-05-15T15:40:33.004681+0000","last_clean":"2024-05-15T15:40:33.004681+0000","last_became_active":"2024-05-15T15:40:30.867327+0000","last_became_peered":"2024-05-15T15:40:30.867327+0000","last_unstale":"2024-05-15T15:40:33.004681+0000","last_undegraded":"2024-05-15T15:40:33.004681+0000","last_fullsized":"2024-05-15T15:40:33.004681+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:07:51.613911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":129,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:32.850221+0000","last_change":"2024-05-15T15:39:42.584601+0000","last_active":"2024-05-15T15:40:32.850221+0000","last_peered":"2024-05-15T15:40:32.850221+0000","last_clean":"2024-05-15T15:40:32.850221+0000","last_became_active":"2024-05-15T15:39:42.584129+0000","last_became_peered":"2024-05-15T15:39:42.584129+0000","last_unstale":"2024-05-15T15:40:32.850221+0000","last_undegraded":"2024-05-15T15:40:32.850221+0000","last_fullsized":"2024-05-15T15:40:32.850221+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:41.378107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:41.378107+0000","last_clean_scrub_stamp":"2024-05-15T15:39:41.378107+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:23:25.285669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36,"ondisk_log_size":36,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509454,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":368640,"data_stored":139400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509454,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":376832,"data_stored":140990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509455,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27960,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343880,"statfs":{"total":96636764160,"available":96608133120,"internally_reserved":0,"allocated":962560,"data_stored":730328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509454,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":380928,"data_stored":140154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509454,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":368640,"data_stored":139412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509455,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27960,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343880,"statfs":{"total":96636764160,"available":96608133120,"internally_reserved":0,"allocated":962560,"data_stored":729816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509454,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":368640,"data_stored":139468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":339968,"data_stored":126303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-15T15:40:40.520 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-15T15:40:40.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:40.644+0000 7fa1a25ce640 1 Processor -- start 2024-05-15T15:40:40.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:40.644+0000 7fa1a25ce640 1 -- start start 2024-05-15T15:40:40.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:40.645+0000 7fa1a25ce640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa19c14e530 0x7fa19c0ba320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:40.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:40.645+0000 7fa1a25ce640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa19c0bd440 0x7fa19c0bd850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:40.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:40.645+0000 7fa1a25ce640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa19c0ba860 con 0x7fa19c0b8d70 2024-05-15T15:40:40.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:40.645+0000 7fa1a25ce640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fa19c0b88e0 con 0x7fa19c14e530 2024-05-15T15:40:40.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:40.645+0000 7fa1a25ce640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7fa19c14ece0 con 0x7fa19c0bd440 2024-05-15T15:40:40.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:40.645+0000 7fa19bfff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa19c14e530 0x7fa19c0ba320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:40.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:40.645+0000 7fa19bfff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa19c14e530 0x7fa19c0ba320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43192/0 (socket says 172.21.15.12:43192) 2024-05-15T15:40:40.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:40.645+0000 7fa19bfff640 1 -- 172.21.15.12:0/4294566076 learned_addr learned my addr 172.21.15.12:0/4294566076 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:40.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:40.645+0000 7fa19b7fe640 1 --2- 172.21.15.12:0/4294566076 >> v2:172.21.15.84:3300/0 conn(0x7fa19c0bd440 0x7fa19c0bd850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:40.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:40.645+0000 7fa19bfff640 1 -- 172.21.15.12:0/4294566076 >> v2:172.21.15.84:3300/0 conn(0x7fa19c0bd440 msgr2=0x7fa19c0bd850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:40:40.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:40.645+0000 7fa19bfff640 1 --2- 172.21.15.12:0/4294566076 >> v2:172.21.15.84:3300/0 conn(0x7fa19c0bd440 0x7fa19c0bd850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:40.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:40.646+0000 7fa19bfff640 1 -- 172.21.15.12:0/4294566076 >> v1:172.21.15.84:6789/0 conn(0x7fa19c0b8d70 legacy=0x7fa19c0b9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:40.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:40.646+0000 7fa19bfff640 1 -- 172.21.15.12:0/4294566076 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa19c0bdd90 con 0x7fa19c14e530 2024-05-15T15:40:40.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:40.646+0000 7fa19b7fe640 1 --2- 172.21.15.12:0/4294566076 >> v2:172.21.15.84:3300/0 conn(0x7fa19c0bd440 0x7fa19c0bd850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-15T15:40:40.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:40.646+0000 7fa19bfff640 1 --2- 172.21.15.12:0/4294566076 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa19c14e530 0x7fa19c0ba320 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fa19c0a96a0 tx=0x7fa18c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98ef890b4860e83e server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:40.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:40.646+0000 7fa19affd640 1 -- 172.21.15.12:0/4294566076 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa18c004030 con 0x7fa19c14e530 2024-05-15T15:40:40.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:40.646+0000 7fa19affd640 1 -- 172.21.15.12:0/4294566076 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa18c0041d0 con 0x7fa19c14e530 2024-05-15T15:40:40.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:40.647+0000 7fa19affd640 1 -- 172.21.15.12:0/4294566076 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa18c003610 con 0x7fa19c14e530 2024-05-15T15:40:40.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:40.647+0000 7fa1a25ce640 1 -- 172.21.15.12:0/4294566076 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa19c14e530 msgr2=0x7fa19c0ba320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:40.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:40.647+0000 7fa1a25ce640 1 --2- 172.21.15.12:0/4294566076 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa19c14e530 0x7fa19c0ba320 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fa19c0a96a0 tx=0x7fa18c02a270 comp rx=0 tx=0).stop 2024-05-15T15:40:40.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:40.647+0000 7fa1a25ce640 1 -- 172.21.15.12:0/4294566076 shutdown_connections 2024-05-15T15:40:40.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:40.647+0000 7fa1a25ce640 1 --2- 172.21.15.12:0/4294566076 >> v2:172.21.15.84:3300/0 conn(0x7fa19c0bd440 0x7fa19c0bd850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:40.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:40.647+0000 7fa1a25ce640 1 --2- 172.21.15.12:0/4294566076 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa19c14e530 0x7fa19c0ba320 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:40.651 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:40.647+0000 7fa1a25ce640 1 -- 172.21.15.12:0/4294566076 >> 172.21.15.12:0/4294566076 conn(0x7fa19c0c0570 msgr2=0x7fa19c0c0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:40.651 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:40.647+0000 7fa1a25ce640 1 -- 172.21.15.12:0/4294566076 shutdown_connections 2024-05-15T15:40:40.651 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:40.647+0000 7fa1a25ce640 1 -- 172.21.15.12:0/4294566076 wait complete. 2024-05-15T15:40:40.651 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:40.649+0000 7fa1a25ce640 1 Processor -- start 2024-05-15T15:40:40.651 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:40.649+0000 7fa1a25ce640 1 -- start start 2024-05-15T15:40:40.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:40.650+0000 7fa1a25ce640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa19c0b8d70 0x7fa19c1467f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:40.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:40.650+0000 7fa1a25ce640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa19c0bd440 0x7fa19c1e7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:40.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:40.650+0000 7fa1a25ce640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa19c14e530 0x7fa19c143a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:40.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:40.650+0000 7fa1a25ce640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa19c0bbb70 con 0x7fa19c0bd440 2024-05-15T15:40:40.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:40.650+0000 7fa1a25ce640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa19c14f2a0 con 0x7fa19c0b8d70 2024-05-15T15:40:40.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:40.650+0000 7fa1a25ce640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fa19c14e940 con 0x7fa19c14e530 2024-05-15T15:40:40.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:40.650+0000 7fa19b7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa19c0bd440 0x7fa19c1e7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:40.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:40.650+0000 7fa19b7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa19c0bd440 0x7fa19c1e7fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43202/0 (socket says 172.21.15.12:43202) 2024-05-15T15:40:40.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:40.650+0000 7fa19b7fe640 1 -- 172.21.15.12:0/1119737205 learned_addr learned my addr 172.21.15.12:0/1119737205 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:40.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:40.650+0000 7fa19bfff640 1 --2- 172.21.15.12:0/1119737205 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa19c0b8d70 0x7fa19c1467f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:40.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:40.650+0000 7fa1a0b6b640 1 --2- 172.21.15.12:0/1119737205 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa19c14e530 0x7fa19c143a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:40.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:40.651+0000 7fa19b7fe640 1 -- 172.21.15.12:0/1119737205 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa19c14e530 msgr2=0x7fa19c143a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:40.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:40.651+0000 7fa19b7fe640 1 --2- 172.21.15.12:0/1119737205 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa19c14e530 0x7fa19c143a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:40.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:40.651+0000 7fa19b7fe640 1 -- 172.21.15.12:0/1119737205 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa19c0b8d70 msgr2=0x7fa19c1467f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:40.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:40.651+0000 7fa19b7fe640 1 --2- 172.21.15.12:0/1119737205 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa19c0b8d70 0x7fa19c1467f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:40.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:40.651+0000 7fa19b7fe640 1 -- 172.21.15.12:0/1119737205 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa19c14a240 con 0x7fa19c0bd440 2024-05-15T15:40:40.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:40.651+0000 7fa1a0b6b640 1 --2- 172.21.15.12:0/1119737205 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa19c14e530 0x7fa19c143a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-15T15:40:40.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:40.651+0000 7fa19b7fe640 1 --2- 172.21.15.12:0/1119737205 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa19c0bd440 0x7fa19c1e7fb0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fa19000d800 tx=0x7fa19000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:40.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:40.651+0000 7fa198ff9640 1 -- 172.21.15.12:0/1119737205 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa190004030 con 0x7fa19c0bd440 2024-05-15T15:40:40.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:40.651+0000 7fa198ff9640 1 -- 172.21.15.12:0/1119737205 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1900041d0 con 0x7fa19c0bd440 2024-05-15T15:40:40.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:40.651+0000 7fa1a25ce640 1 -- 172.21.15.12:0/1119737205 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa19c146d30 con 0x7fa19c0bd440 2024-05-15T15:40:40.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:40.651+0000 7fa198ff9640 1 -- 172.21.15.12:0/1119737205 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1900096a0 con 0x7fa19c0bd440 2024-05-15T15:40:40.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:40.651+0000 7fa1a25ce640 1 -- 172.21.15.12:0/1119737205 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa19c1e84f0 con 0x7fa19c0bd440 2024-05-15T15:40:40.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:40.652+0000 7fa1a25ce640 1 -- 172.21.15.12:0/1119737205 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa19c050940 con 0x7fa19c0bd440 2024-05-15T15:40:40.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:40.653+0000 7fa198ff9640 1 -- 172.21.15.12:0/1119737205 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa190009840 con 0x7fa19c0bd440 2024-05-15T15:40:40.656 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:40.654+0000 7fa198ff9640 1 --2- 172.21.15.12:0/1119737205 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fa188076300 0x7fa188078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:40.656 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:40.654+0000 7fa198ff9640 1 -- 172.21.15.12:0/1119737205 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fa190097830 con 0x7fa19c0bd440 2024-05-15T15:40:40.656 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:40.654+0000 7fa19bfff640 1 --2- 172.21.15.12:0/1119737205 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fa188076300 0x7fa188078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:40.656 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:40.654+0000 7fa19bfff640 1 --2- 172.21.15.12:0/1119737205 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fa188076300 0x7fa188078810 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fa18c033000 tx=0x7fa18c02e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:40.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:40.659+0000 7fa198ff9640 1 -- 172.21.15.12:0/1119737205 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fa190061100 con 0x7fa19c0bd440 2024-05-15T15:40:40.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:40.848+0000 7fa1a25ce640 1 -- 172.21.15.12:0/1119737205 --> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa19c1e40d0 con 0x7fa188076300 2024-05-15T15:40:40.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:40.855+0000 7fa198ff9640 1 -- 172.21.15.12:0/1119737205 <== mgr.4106 v2:172.21.15.84:6832/4173299311 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251856 (secure 0 0 0) 0x7fa19c1e40d0 con 0x7fa188076300 2024-05-15T15:40:40.859 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-05-15T15:40:40.861 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-05-15T15:40:40.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:40.858+0000 7fa1a25ce640 1 -- 172.21.15.12:0/1119737205 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fa188076300 msgr2=0x7fa188078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:40.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:40.858+0000 7fa1a25ce640 1 --2- 172.21.15.12:0/1119737205 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fa188076300 0x7fa188078810 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fa18c033000 tx=0x7fa18c02e000 comp rx=0 tx=0).stop 2024-05-15T15:40:40.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:40.858+0000 7fa1a25ce640 1 -- 172.21.15.12:0/1119737205 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa19c0bd440 msgr2=0x7fa19c1e7fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:40.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:40.858+0000 7fa1a25ce640 1 --2- 172.21.15.12:0/1119737205 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa19c0bd440 0x7fa19c1e7fb0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fa19000d800 tx=0x7fa19000dcc0 comp rx=0 tx=0).stop 2024-05-15T15:40:40.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:40.858+0000 7fa1a25ce640 1 -- 172.21.15.12:0/1119737205 shutdown_connections 2024-05-15T15:40:40.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:40.858+0000 7fa1a25ce640 1 --2- 172.21.15.12:0/1119737205 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa19c14e530 0x7fa19c143a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:40.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:40.858+0000 7fa1a25ce640 1 --2- 172.21.15.12:0/1119737205 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fa188076300 0x7fa188078810 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:40.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:40.858+0000 7fa1a25ce640 1 --2- 172.21.15.12:0/1119737205 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa19c0bd440 0x7fa19c1e7fb0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:40.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:40.858+0000 7fa1a25ce640 1 --2- 172.21.15.12:0/1119737205 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa19c0b8d70 0x7fa19c1467f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:40.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:40.858+0000 7fa1a25ce640 1 -- 172.21.15.12:0/1119737205 >> 172.21.15.12:0/1119737205 conn(0x7fa19c0c0570 msgr2=0x7fa19c0bbf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:40.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:40.858+0000 7fa1a25ce640 1 -- 172.21.15.12:0/1119737205 shutdown_connections 2024-05-15T15:40:40.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:40.858+0000 7fa1a25ce640 1 -- 172.21.15.12:0/1119737205 wait complete. 2024-05-15T15:40:40.871 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":58,"stamp":"2024-05-15T15:40:40.713072+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220240,"kb_used_data":4072,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754480,"statfs":{"total":773094113280,"available":772868587520,"internally_reserved":0,"allocated":4169728,"data_stored":2300580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.864008"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:32.852840+0000","last_change":"2024-05-15T15:40:31.864247+0000","last_active":"2024-05-15T15:40:32.852840+0000","last_peered":"2024-05-15T15:40:32.852840+0000","last_clean":"2024-05-15T15:40:32.852840+0000","last_became_active":"2024-05-15T15:40:31.863887+0000","last_became_peered":"2024-05-15T15:40:31.863887+0000","last_unstale":"2024-05-15T15:40:32.852840+0000","last_undegraded":"2024-05-15T15:40:32.852840+0000","last_fullsized":"2024-05-15T15:40:32.852840+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:31:22.263338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:33.006568+0000","last_change":"2024-05-15T15:40:31.872908+0000","last_active":"2024-05-15T15:40:33.006568+0000","last_peered":"2024-05-15T15:40:33.006568+0000","last_clean":"2024-05-15T15:40:33.006568+0000","last_became_active":"2024-05-15T15:40:31.872537+0000","last_became_peered":"2024-05-15T15:40:31.872537+0000","last_unstale":"2024-05-15T15:40:33.006568+0000","last_undegraded":"2024-05-15T15:40:33.006568+0000","last_fullsized":"2024-05-15T15:40:33.006568+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:52:46.673917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:32.850588+0000","last_change":"2024-05-15T15:40:31.871036+0000","last_active":"2024-05-15T15:40:32.850588+0000","last_peered":"2024-05-15T15:40:32.850588+0000","last_clean":"2024-05-15T15:40:32.850588+0000","last_became_active":"2024-05-15T15:40:31.870689+0000","last_became_peered":"2024-05-15T15:40:31.870689+0000","last_unstale":"2024-05-15T15:40:32.850588+0000","last_undegraded":"2024-05-15T15:40:32.850588+0000","last_fullsized":"2024-05-15T15:40:32.850588+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:49:02.842629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:33.006695+0000","last_change":"2024-05-15T15:40:31.870526+0000","last_active":"2024-05-15T15:40:33.006695+0000","last_peered":"2024-05-15T15:40:33.006695+0000","last_clean":"2024-05-15T15:40:33.006695+0000","last_became_active":"2024-05-15T15:40:31.870177+0000","last_became_peered":"2024-05-15T15:40:31.870177+0000","last_unstale":"2024-05-15T15:40:33.006695+0000","last_undegraded":"2024-05-15T15:40:33.006695+0000","last_fullsized":"2024-05-15T15:40:33.006695+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:27:24.437549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:33.005466+0000","last_change":"2024-05-15T15:40:31.866418+0000","last_active":"2024-05-15T15:40:33.005466+0000","last_peered":"2024-05-15T15:40:33.005466+0000","last_clean":"2024-05-15T15:40:33.005466+0000","last_became_active":"2024-05-15T15:40:31.866037+0000","last_became_peered":"2024-05-15T15:40:31.866037+0000","last_unstale":"2024-05-15T15:40:33.005466+0000","last_undegraded":"2024-05-15T15:40:33.005466+0000","last_fullsized":"2024-05-15T15:40:33.005466+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:27:01.270998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:33.005011+0000","last_change":"2024-05-15T15:40:31.865532+0000","last_active":"2024-05-15T15:40:33.005011+0000","last_peered":"2024-05-15T15:40:33.005011+0000","last_clean":"2024-05-15T15:40:33.005011+0000","last_became_active":"2024-05-15T15:40:31.865223+0000","last_became_peered":"2024-05-15T15:40:31.865223+0000","last_unstale":"2024-05-15T15:40:33.005011+0000","last_undegraded":"2024-05-15T15:40:33.005011+0000","last_fullsized":"2024-05-15T15:40:33.005011+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:49:02.842629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:32.852504+0000","last_change":"2024-05-15T15:40:31.877441+0000","last_active":"2024-05-15T15:40:32.852504+0000","last_peered":"2024-05-15T15:40:32.852504+0000","last_clean":"2024-05-15T15:40:32.852504+0000","last_became_active":"2024-05-15T15:40:31.877133+0000","last_became_peered":"2024-05-15T15:40:31.877133+0000","last_unstale":"2024-05-15T15:40:32.852504+0000","last_undegraded":"2024-05-15T15:40:32.852504+0000","last_fullsized":"2024-05-15T15:40:32.852504+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:18:50.984099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:32.852429+0000","last_change":"2024-05-15T15:40:31.867999+0000","last_active":"2024-05-15T15:40:32.852429+0000","last_peered":"2024-05-15T15:40:32.852429+0000","last_clean":"2024-05-15T15:40:32.852429+0000","last_became_active":"2024-05-15T15:40:31.867647+0000","last_became_peered":"2024-05-15T15:40:31.867647+0000","last_unstale":"2024-05-15T15:40:32.852429+0000","last_undegraded":"2024-05-15T15:40:32.852429+0000","last_fullsized":"2024-05-15T15:40:32.852429+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:44:53.908859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:32.850660+0000","last_change":"2024-05-15T15:40:31.876517+0000","last_active":"2024-05-15T15:40:32.850660+0000","last_peered":"2024-05-15T15:40:32.850660+0000","last_clean":"2024-05-15T15:40:32.850660+0000","last_became_active":"2024-05-15T15:40:31.876179+0000","last_became_peered":"2024-05-15T15:40:31.876179+0000","last_unstale":"2024-05-15T15:40:32.850660+0000","last_undegraded":"2024-05-15T15:40:32.850660+0000","last_fullsized":"2024-05-15T15:40:32.850660+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:19:56.307191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:33.005939+0000","last_change":"2024-05-15T15:40:31.867301+0000","last_active":"2024-05-15T15:40:33.005939+0000","last_peered":"2024-05-15T15:40:33.005939+0000","last_clean":"2024-05-15T15:40:33.005939+0000","last_became_active":"2024-05-15T15:40:31.866725+0000","last_became_peered":"2024-05-15T15:40:31.866725+0000","last_unstale":"2024-05-15T15:40:33.005939+0000","last_undegraded":"2024-05-15T15:40:33.005939+0000","last_fullsized":"2024-05-15T15:40:33.005939+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:50:10.710862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:33.004610+0000","last_change":"2024-05-15T15:40:31.869941+0000","last_active":"2024-05-15T15:40:33.004610+0000","last_peered":"2024-05-15T15:40:33.004610+0000","last_clean":"2024-05-15T15:40:33.004610+0000","last_became_active":"2024-05-15T15:40:31.869544+0000","last_became_peered":"2024-05-15T15:40:31.869544+0000","last_unstale":"2024-05-15T15:40:33.004610+0000","last_undegraded":"2024-05-15T15:40:33.004610+0000","last_fullsized":"2024-05-15T15:40:33.004610+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:54:09.408845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:32.850528+0000","last_change":"2024-05-15T15:40:31.871800+0000","last_active":"2024-05-15T15:40:32.850528+0000","last_peered":"2024-05-15T15:40:32.850528+0000","last_clean":"2024-05-15T15:40:32.850528+0000","last_became_active":"2024-05-15T15:40:31.871505+0000","last_became_peered":"2024-05-15T15:40:31.871505+0000","last_unstale":"2024-05-15T15:40:32.850528+0000","last_undegraded":"2024-05-15T15:40:32.850528+0000","last_fullsized":"2024-05-15T15:40:32.850528+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:56:30.369155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:33.005629+0000","last_change":"2024-05-15T15:40:31.880793+0000","last_active":"2024-05-15T15:40:33.005629+0000","last_peered":"2024-05-15T15:40:33.005629+0000","last_clean":"2024-05-15T15:40:33.005629+0000","last_became_active":"2024-05-15T15:40:31.880486+0000","last_became_peered":"2024-05-15T15:40:31.880486+0000","last_unstale":"2024-05-15T15:40:33.005629+0000","last_undegraded":"2024-05-15T15:40:33.005629+0000","last_fullsized":"2024-05-15T15:40:33.005629+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:44:53.908859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:33.006696+0000","last_change":"2024-05-15T15:40:31.868582+0000","last_active":"2024-05-15T15:40:33.006696+0000","last_peered":"2024-05-15T15:40:33.006696+0000","last_clean":"2024-05-15T15:40:33.006696+0000","last_became_active":"2024-05-15T15:40:31.868186+0000","last_became_peered":"2024-05-15T15:40:31.868186+0000","last_unstale":"2024-05-15T15:40:33.006696+0000","last_undegraded":"2024-05-15T15:40:33.006696+0000","last_fullsized":"2024-05-15T15:40:33.006696+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:05:35.386344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:32.846836+0000","last_change":"2024-05-15T15:40:31.861275+0000","last_active":"2024-05-15T15:40:32.846836+0000","last_peered":"2024-05-15T15:40:32.846836+0000","last_clean":"2024-05-15T15:40:32.846836+0000","last_became_active":"2024-05-15T15:40:31.860781+0000","last_became_peered":"2024-05-15T15:40:31.860781+0000","last_unstale":"2024-05-15T15:40:32.846836+0000","last_undegraded":"2024-05-15T15:40:32.846836+0000","last_fullsized":"2024-05-15T15:40:32.846836+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:48:55.724035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:32.846831+0000","last_change":"2024-05-15T15:40:31.861226+0000","last_active":"2024-05-15T15:40:32.846831+0000","last_peered":"2024-05-15T15:40:32.846831+0000","last_clean":"2024-05-15T15:40:32.846831+0000","last_became_active":"2024-05-15T15:40:31.860767+0000","last_became_peered":"2024-05-15T15:40:31.860767+0000","last_unstale":"2024-05-15T15:40:32.846831+0000","last_undegraded":"2024-05-15T15:40:32.846831+0000","last_fullsized":"2024-05-15T15:40:32.846831+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:05:07.976225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:33.004503+0000","last_change":"2024-05-15T15:40:31.861363+0000","last_active":"2024-05-15T15:40:33.004503+0000","last_peered":"2024-05-15T15:40:33.004503+0000","last_clean":"2024-05-15T15:40:33.004503+0000","last_became_active":"2024-05-15T15:40:31.861041+0000","last_became_peered":"2024-05-15T15:40:31.861041+0000","last_unstale":"2024-05-15T15:40:33.004503+0000","last_undegraded":"2024-05-15T15:40:33.004503+0000","last_fullsized":"2024-05-15T15:40:33.004503+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:19:12.662557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:33.005103+0000","last_change":"2024-05-15T15:40:31.867339+0000","last_active":"2024-05-15T15:40:33.005103+0000","last_peered":"2024-05-15T15:40:33.005103+0000","last_clean":"2024-05-15T15:40:33.005103+0000","last_became_active":"2024-05-15T15:40:31.867019+0000","last_became_peered":"2024-05-15T15:40:31.867019+0000","last_unstale":"2024-05-15T15:40:33.005103+0000","last_undegraded":"2024-05-15T15:40:33.005103+0000","last_fullsized":"2024-05-15T15:40:33.005103+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:19:56.307191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:33.005497+0000","last_change":"2024-05-15T15:40:31.875798+0000","last_active":"2024-05-15T15:40:33.005497+0000","last_peered":"2024-05-15T15:40:33.005497+0000","last_clean":"2024-05-15T15:40:33.005497+0000","last_became_active":"2024-05-15T15:40:31.875424+0000","last_became_peered":"2024-05-15T15:40:31.875424+0000","last_unstale":"2024-05-15T15:40:33.005497+0000","last_undegraded":"2024-05-15T15:40:33.005497+0000","last_fullsized":"2024-05-15T15:40:33.005497+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:01:38.441362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:33.005665+0000","last_change":"2024-05-15T15:40:31.876081+0000","last_active":"2024-05-15T15:40:33.005665+0000","last_peered":"2024-05-15T15:40:33.005665+0000","last_clean":"2024-05-15T15:40:33.005665+0000","last_became_active":"2024-05-15T15:40:31.875743+0000","last_became_peered":"2024-05-15T15:40:31.875743+0000","last_unstale":"2024-05-15T15:40:33.005665+0000","last_undegraded":"2024-05-15T15:40:33.005665+0000","last_fullsized":"2024-05-15T15:40:33.005665+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:15:27.582772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:32.847200+0000","last_change":"2024-05-15T15:40:31.864302+0000","last_active":"2024-05-15T15:40:32.847200+0000","last_peered":"2024-05-15T15:40:32.847200+0000","last_clean":"2024-05-15T15:40:32.847200+0000","last_became_active":"2024-05-15T15:40:31.864000+0000","last_became_peered":"2024-05-15T15:40:31.864000+0000","last_unstale":"2024-05-15T15:40:32.847200+0000","last_undegraded":"2024-05-15T15:40:32.847200+0000","last_fullsized":"2024-05-15T15:40:32.847200+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:27:01.270998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:32.852604+0000","last_change":"2024-05-15T15:40:31.869450+0000","last_active":"2024-05-15T15:40:32.852604+0000","last_peered":"2024-05-15T15:40:32.852604+0000","last_clean":"2024-05-15T15:40:32.852604+0000","last_became_active":"2024-05-15T15:40:31.869145+0000","last_became_peered":"2024-05-15T15:40:31.869145+0000","last_unstale":"2024-05-15T15:40:32.852604+0000","last_undegraded":"2024-05-15T15:40:32.852604+0000","last_fullsized":"2024-05-15T15:40:32.852604+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:48:55.724035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:33.004858+0000","last_change":"2024-05-15T15:40:31.881401+0000","last_active":"2024-05-15T15:40:33.004858+0000","last_peered":"2024-05-15T15:40:33.004858+0000","last_clean":"2024-05-15T15:40:33.004858+0000","last_became_active":"2024-05-15T15:40:31.881104+0000","last_became_peered":"2024-05-15T15:40:31.881104+0000","last_unstale":"2024-05-15T15:40:33.004858+0000","last_undegraded":"2024-05-15T15:40:33.004858+0000","last_fullsized":"2024-05-15T15:40:33.004858+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:53:30.217027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:32.852445+0000","last_change":"2024-05-15T15:40:31.869187+0000","last_active":"2024-05-15T15:40:32.852445+0000","last_peered":"2024-05-15T15:40:32.852445+0000","last_clean":"2024-05-15T15:40:32.852445+0000","last_became_active":"2024-05-15T15:40:31.868885+0000","last_became_peered":"2024-05-15T15:40:31.868885+0000","last_unstale":"2024-05-15T15:40:32.852445+0000","last_undegraded":"2024-05-15T15:40:32.852445+0000","last_fullsized":"2024-05-15T15:40:32.852445+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:15:27.582772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:33.006245+0000","last_change":"2024-05-15T15:40:31.868829+0000","last_active":"2024-05-15T15:40:33.006245+0000","last_peered":"2024-05-15T15:40:33.006245+0000","last_clean":"2024-05-15T15:40:33.006245+0000","last_became_active":"2024-05-15T15:40:31.868452+0000","last_became_peered":"2024-05-15T15:40:31.868452+0000","last_unstale":"2024-05-15T15:40:33.006245+0000","last_undegraded":"2024-05-15T15:40:33.006245+0000","last_fullsized":"2024-05-15T15:40:33.006245+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:58:25.254812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:33.006153+0000","last_change":"2024-05-15T15:40:31.877148+0000","last_active":"2024-05-15T15:40:33.006153+0000","last_peered":"2024-05-15T15:40:33.006153+0000","last_clean":"2024-05-15T15:40:33.006153+0000","last_became_active":"2024-05-15T15:40:31.876782+0000","last_became_peered":"2024-05-15T15:40:31.876782+0000","last_unstale":"2024-05-15T15:40:33.006153+0000","last_undegraded":"2024-05-15T15:40:33.006153+0000","last_fullsized":"2024-05-15T15:40:33.006153+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:33:52.636099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:33.005215+0000","last_change":"2024-05-15T15:40:31.861451+0000","last_active":"2024-05-15T15:40:33.005215+0000","last_peered":"2024-05-15T15:40:33.005215+0000","last_clean":"2024-05-15T15:40:33.005215+0000","last_became_active":"2024-05-15T15:40:31.861147+0000","last_became_peered":"2024-05-15T15:40:31.861147+0000","last_unstale":"2024-05-15T15:40:33.005215+0000","last_undegraded":"2024-05-15T15:40:33.005215+0000","last_fullsized":"2024-05-15T15:40:33.005215+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:53:08.027972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:32.852913+0000","last_change":"2024-05-15T15:40:31.870103+0000","last_active":"2024-05-15T15:40:32.852913+0000","last_peered":"2024-05-15T15:40:32.852913+0000","last_clean":"2024-05-15T15:40:32.852913+0000","last_became_active":"2024-05-15T15:40:31.869774+0000","last_became_peered":"2024-05-15T15:40:31.869774+0000","last_unstale":"2024-05-15T15:40:32.852913+0000","last_undegraded":"2024-05-15T15:40:32.852913+0000","last_fullsized":"2024-05-15T15:40:32.852913+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:53:08.027972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:32.847102+0000","last_change":"2024-05-15T15:40:31.872123+0000","last_active":"2024-05-15T15:40:32.847102+0000","last_peered":"2024-05-15T15:40:32.847102+0000","last_clean":"2024-05-15T15:40:32.847102+0000","last_became_active":"2024-05-15T15:40:31.871752+0000","last_became_peered":"2024-05-15T15:40:31.871752+0000","last_unstale":"2024-05-15T15:40:32.847102+0000","last_undegraded":"2024-05-15T15:40:32.847102+0000","last_fullsized":"2024-05-15T15:40:32.847102+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:31:22.263338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:32.847054+0000","last_change":"2024-05-15T15:40:31.856188+0000","last_active":"2024-05-15T15:40:32.847054+0000","last_peered":"2024-05-15T15:40:32.847054+0000","last_clean":"2024-05-15T15:40:32.847054+0000","last_became_active":"2024-05-15T15:40:31.855149+0000","last_became_peered":"2024-05-15T15:40:31.855149+0000","last_unstale":"2024-05-15T15:40:32.847054+0000","last_undegraded":"2024-05-15T15:40:32.847054+0000","last_fullsized":"2024-05-15T15:40:32.847054+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:14:07.552265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:32.852518+0000","last_change":"2024-05-15T15:40:31.859800+0000","last_active":"2024-05-15T15:40:32.852518+0000","last_peered":"2024-05-15T15:40:32.852518+0000","last_clean":"2024-05-15T15:40:32.852518+0000","last_became_active":"2024-05-15T15:40:31.859498+0000","last_became_peered":"2024-05-15T15:40:31.859498+0000","last_unstale":"2024-05-15T15:40:32.852518+0000","last_undegraded":"2024-05-15T15:40:32.852518+0000","last_fullsized":"2024-05-15T15:40:32.852518+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:05:07.976225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:33.004369+0000","last_change":"2024-05-15T15:40:31.868970+0000","last_active":"2024-05-15T15:40:33.004369+0000","last_peered":"2024-05-15T15:40:33.004369+0000","last_clean":"2024-05-15T15:40:33.004369+0000","last_became_active":"2024-05-15T15:40:31.868649+0000","last_became_peered":"2024-05-15T15:40:31.868649+0000","last_unstale":"2024-05-15T15:40:33.004369+0000","last_undegraded":"2024-05-15T15:40:33.004369+0000","last_fullsized":"2024-05-15T15:40:33.004369+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:06:13.282015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:33.005457+0000","last_change":"2024-05-15T15:40:31.870910+0000","last_active":"2024-05-15T15:40:33.005457+0000","last_peered":"2024-05-15T15:40:33.005457+0000","last_clean":"2024-05-15T15:40:33.005457+0000","last_became_active":"2024-05-15T15:40:31.870504+0000","last_became_peered":"2024-05-15T15:40:31.870504+0000","last_unstale":"2024-05-15T15:40:33.005457+0000","last_undegraded":"2024-05-15T15:40:33.005457+0000","last_fullsized":"2024-05-15T15:40:33.005457+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:50:56.125640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:33.004638+0000","last_change":"2024-05-15T15:40:30.863025+0000","last_active":"2024-05-15T15:40:33.004638+0000","last_peered":"2024-05-15T15:40:33.004638+0000","last_clean":"2024-05-15T15:40:33.004638+0000","last_became_active":"2024-05-15T15:40:30.862679+0000","last_became_peered":"2024-05-15T15:40:30.862679+0000","last_unstale":"2024-05-15T15:40:33.004638+0000","last_undegraded":"2024-05-15T15:40:33.004638+0000","last_fullsized":"2024-05-15T15:40:33.004638+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:28:06.803331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:32.852995+0000","last_change":"2024-05-15T15:40:31.861298+0000","last_active":"2024-05-15T15:40:32.852995+0000","last_peered":"2024-05-15T15:40:32.852995+0000","last_clean":"2024-05-15T15:40:32.852995+0000","last_became_active":"2024-05-15T15:40:31.860969+0000","last_became_peered":"2024-05-15T15:40:31.860969+0000","last_unstale":"2024-05-15T15:40:32.852995+0000","last_undegraded":"2024-05-15T15:40:32.852995+0000","last_fullsized":"2024-05-15T15:40:32.852995+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:30:38.468087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"32'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:33.006281+0000","last_change":"2024-05-15T15:40:30.866859+0000","last_active":"2024-05-15T15:40:33.006281+0000","last_peered":"2024-05-15T15:40:33.006281+0000","last_clean":"2024-05-15T15:40:33.006281+0000","last_became_active":"2024-05-15T15:40:30.866428+0000","last_became_peered":"2024-05-15T15:40:30.866428+0000","last_unstale":"2024-05-15T15:40:33.006281+0000","last_undegraded":"2024-05-15T15:40:33.006281+0000","last_fullsized":"2024-05-15T15:40:33.006281+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:39:05.278223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:32.852964+0000","last_change":"2024-05-15T15:40:31.872546+0000","last_active":"2024-05-15T15:40:32.852964+0000","last_peered":"2024-05-15T15:40:32.852964+0000","last_clean":"2024-05-15T15:40:32.852964+0000","last_became_active":"2024-05-15T15:40:31.872114+0000","last_became_peered":"2024-05-15T15:40:31.872114+0000","last_unstale":"2024-05-15T15:40:32.852964+0000","last_undegraded":"2024-05-15T15:40:32.852964+0000","last_fullsized":"2024-05-15T15:40:32.852964+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:27:01.270998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:33.006107+0000","last_change":"2024-05-15T15:40:30.863147+0000","last_active":"2024-05-15T15:40:33.006107+0000","last_peered":"2024-05-15T15:40:33.006107+0000","last_clean":"2024-05-15T15:40:33.006107+0000","last_became_active":"2024-05-15T15:40:30.862740+0000","last_became_peered":"2024-05-15T15:40:30.862740+0000","last_unstale":"2024-05-15T15:40:33.006107+0000","last_undegraded":"2024-05-15T15:40:33.006107+0000","last_fullsized":"2024-05-15T15:40:33.006107+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:22:56.369287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:33.006192+0000","last_change":"2024-05-15T15:40:31.870011+0000","last_active":"2024-05-15T15:40:33.006192+0000","last_peered":"2024-05-15T15:40:33.006192+0000","last_clean":"2024-05-15T15:40:33.006192+0000","last_became_active":"2024-05-15T15:40:31.869707+0000","last_became_peered":"2024-05-15T15:40:31.869707+0000","last_unstale":"2024-05-15T15:40:33.006192+0000","last_undegraded":"2024-05-15T15:40:33.006192+0000","last_fullsized":"2024-05-15T15:40:33.006192+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:50:49.775952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:33.007024+0000","last_change":"2024-05-15T15:40:30.857947+0000","last_active":"2024-05-15T15:40:33.007024+0000","last_peered":"2024-05-15T15:40:33.007024+0000","last_clean":"2024-05-15T15:40:33.007024+0000","last_became_active":"2024-05-15T15:40:30.857649+0000","last_became_peered":"2024-05-15T15:40:30.857649+0000","last_unstale":"2024-05-15T15:40:33.007024+0000","last_undegraded":"2024-05-15T15:40:33.007024+0000","last_fullsized":"2024-05-15T15:40:33.007024+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:06:55.021990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:32.850402+0000","last_change":"2024-05-15T15:40:31.875875+0000","last_active":"2024-05-15T15:40:32.850402+0000","last_peered":"2024-05-15T15:40:32.850402+0000","last_clean":"2024-05-15T15:40:32.850402+0000","last_became_active":"2024-05-15T15:40:31.875491+0000","last_became_peered":"2024-05-15T15:40:31.875491+0000","last_unstale":"2024-05-15T15:40:32.850402+0000","last_undegraded":"2024-05-15T15:40:32.850402+0000","last_fullsized":"2024-05-15T15:40:32.850402+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:42:13.355007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"32'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:32.852654+0000","last_change":"2024-05-15T15:40:30.863942+0000","last_active":"2024-05-15T15:40:32.852654+0000","last_peered":"2024-05-15T15:40:32.852654+0000","last_clean":"2024-05-15T15:40:32.852654+0000","last_became_active":"2024-05-15T15:40:30.863610+0000","last_became_peered":"2024-05-15T15:40:30.863610+0000","last_unstale":"2024-05-15T15:40:32.852654+0000","last_undegraded":"2024-05-15T15:40:32.852654+0000","last_fullsized":"2024-05-15T15:40:32.852654+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:49:01.836129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:32.852618+0000","last_change":"2024-05-15T15:40:31.866857+0000","last_active":"2024-05-15T15:40:32.852618+0000","last_peered":"2024-05-15T15:40:32.852618+0000","last_clean":"2024-05-15T15:40:32.852618+0000","last_became_active":"2024-05-15T15:40:31.866539+0000","last_became_peered":"2024-05-15T15:40:31.866539+0000","last_unstale":"2024-05-15T15:40:32.852618+0000","last_undegraded":"2024-05-15T15:40:32.852618+0000","last_fullsized":"2024-05-15T15:40:32.852618+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:14:07.552265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"32'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:32.852514+0000","last_change":"2024-05-15T15:40:30.859874+0000","last_active":"2024-05-15T15:40:32.852514+0000","last_peered":"2024-05-15T15:40:32.852514+0000","last_clean":"2024-05-15T15:40:32.852514+0000","last_became_active":"2024-05-15T15:40:30.859544+0000","last_became_peered":"2024-05-15T15:40:30.859544+0000","last_unstale":"2024-05-15T15:40:32.852514+0000","last_undegraded":"2024-05-15T15:40:32.852514+0000","last_fullsized":"2024-05-15T15:40:32.852514+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:56:29.362654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:32.850291+0000","last_change":"2024-05-15T15:40:31.877406+0000","last_active":"2024-05-15T15:40:32.850291+0000","last_peered":"2024-05-15T15:40:32.850291+0000","last_clean":"2024-05-15T15:40:32.850291+0000","last_became_active":"2024-05-15T15:40:31.877078+0000","last_became_peered":"2024-05-15T15:40:31.877078+0000","last_unstale":"2024-05-15T15:40:32.850291+0000","last_undegraded":"2024-05-15T15:40:32.850291+0000","last_fullsized":"2024-05-15T15:40:32.850291+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:17:44.988809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:33.004849+0000","last_change":"2024-05-15T15:40:30.859033+0000","last_active":"2024-05-15T15:40:33.004849+0000","last_peered":"2024-05-15T15:40:33.004849+0000","last_clean":"2024-05-15T15:40:33.004849+0000","last_became_active":"2024-05-15T15:40:30.858683+0000","last_became_peered":"2024-05-15T15:40:30.858683+0000","last_unstale":"2024-05-15T15:40:33.004849+0000","last_undegraded":"2024-05-15T15:40:33.004849+0000","last_fullsized":"2024-05-15T15:40:33.004849+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:53:21.465544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:33.006606+0000","last_change":"2024-05-15T15:40:31.863872+0000","last_active":"2024-05-15T15:40:33.006606+0000","last_peered":"2024-05-15T15:40:33.006606+0000","last_clean":"2024-05-15T15:40:33.006606+0000","last_became_active":"2024-05-15T15:40:31.862630+0000","last_became_peered":"2024-05-15T15:40:31.862630+0000","last_unstale":"2024-05-15T15:40:33.006606+0000","last_undegraded":"2024-05-15T15:40:33.006606+0000","last_fullsized":"2024-05-15T15:40:33.006606+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:24:08.394914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:32.852735+0000","last_change":"2024-05-15T15:40:30.863030+0000","last_active":"2024-05-15T15:40:32.852735+0000","last_peered":"2024-05-15T15:40:32.852735+0000","last_clean":"2024-05-15T15:40:32.852735+0000","last_became_active":"2024-05-15T15:40:30.862654+0000","last_became_peered":"2024-05-15T15:40:30.862654+0000","last_unstale":"2024-05-15T15:40:32.852735+0000","last_undegraded":"2024-05-15T15:40:32.852735+0000","last_fullsized":"2024-05-15T15:40:32.852735+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:15:50.965918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:33.004405+0000","last_change":"2024-05-15T15:40:31.868060+0000","last_active":"2024-05-15T15:40:33.004405+0000","last_peered":"2024-05-15T15:40:33.004405+0000","last_clean":"2024-05-15T15:40:33.004405+0000","last_became_active":"2024-05-15T15:40:31.867733+0000","last_became_peered":"2024-05-15T15:40:31.867733+0000","last_unstale":"2024-05-15T15:40:33.004405+0000","last_undegraded":"2024-05-15T15:40:33.004405+0000","last_fullsized":"2024-05-15T15:40:33.004405+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:32:53.637391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:33.006152+0000","last_change":"2024-05-15T15:40:30.868248+0000","last_active":"2024-05-15T15:40:33.006152+0000","last_peered":"2024-05-15T15:40:33.006152+0000","last_clean":"2024-05-15T15:40:33.006152+0000","last_became_active":"2024-05-15T15:40:30.867984+0000","last_became_peered":"2024-05-15T15:40:30.867984+0000","last_unstale":"2024-05-15T15:40:33.006152+0000","last_undegraded":"2024-05-15T15:40:33.006152+0000","last_fullsized":"2024-05-15T15:40:33.006152+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:53:29.210527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:33.006725+0000","last_change":"2024-05-15T15:40:31.868452+0000","last_active":"2024-05-15T15:40:33.006725+0000","last_peered":"2024-05-15T15:40:33.006725+0000","last_clean":"2024-05-15T15:40:33.006725+0000","last_became_active":"2024-05-15T15:40:31.865906+0000","last_became_peered":"2024-05-15T15:40:31.865906+0000","last_unstale":"2024-05-15T15:40:33.006725+0000","last_undegraded":"2024-05-15T15:40:33.006725+0000","last_fullsized":"2024-05-15T15:40:33.006725+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:33:42.673848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:33.006691+0000","last_change":"2024-05-15T15:40:30.862948+0000","last_active":"2024-05-15T15:40:33.006691+0000","last_peered":"2024-05-15T15:40:33.006691+0000","last_clean":"2024-05-15T15:40:33.006691+0000","last_became_active":"2024-05-15T15:40:30.862642+0000","last_became_peered":"2024-05-15T15:40:30.862642+0000","last_unstale":"2024-05-15T15:40:33.006691+0000","last_undegraded":"2024-05-15T15:40:33.006691+0000","last_fullsized":"2024-05-15T15:40:33.006691+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:50:55.119139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:33.007021+0000","last_change":"2024-05-15T15:40:31.870911+0000","last_active":"2024-05-15T15:40:33.007021+0000","last_peered":"2024-05-15T15:40:33.007021+0000","last_clean":"2024-05-15T15:40:33.007021+0000","last_became_active":"2024-05-15T15:40:31.870175+0000","last_became_peered":"2024-05-15T15:40:31.870175+0000","last_unstale":"2024-05-15T15:40:33.007021+0000","last_undegraded":"2024-05-15T15:40:33.007021+0000","last_fullsized":"2024-05-15T15:40:33.007021+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:05:30.501969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.15","version":"32'3","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:33.004510+0000","last_change":"2024-05-15T15:40:30.864390+0000","last_active":"2024-05-15T15:40:33.004510+0000","last_peered":"2024-05-15T15:40:33.004510+0000","last_clean":"2024-05-15T15:40:33.004510+0000","last_became_active":"2024-05-15T15:40:30.864082+0000","last_became_peered":"2024-05-15T15:40:30.864082+0000","last_unstale":"2024-05-15T15:40:33.004510+0000","last_undegraded":"2024-05-15T15:40:33.004510+0000","last_fullsized":"2024-05-15T15:40:33.004510+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:52:45.667417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:33.004443+0000","last_change":"2024-05-15T15:40:31.869042+0000","last_active":"2024-05-15T15:40:33.004443+0000","last_peered":"2024-05-15T15:40:33.004443+0000","last_clean":"2024-05-15T15:40:33.004443+0000","last_became_active":"2024-05-15T15:40:31.868682+0000","last_became_peered":"2024-05-15T15:40:31.868682+0000","last_unstale":"2024-05-15T15:40:33.004443+0000","last_undegraded":"2024-05-15T15:40:33.004443+0000","last_fullsized":"2024-05-15T15:40:33.004443+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:17:12.322075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"32'6","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:33.005786+0000","last_change":"2024-05-15T15:40:30.857796+0000","last_active":"2024-05-15T15:40:33.005786+0000","last_peered":"2024-05-15T15:40:33.005786+0000","last_clean":"2024-05-15T15:40:33.005786+0000","last_became_active":"2024-05-15T15:40:30.857464+0000","last_became_peered":"2024-05-15T15:40:30.857464+0000","last_unstale":"2024-05-15T15:40:33.005786+0000","last_undegraded":"2024-05-15T15:40:33.005786+0000","last_fullsized":"2024-05-15T15:40:33.005786+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:29:31.530165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:33.006160+0000","last_change":"2024-05-15T15:40:31.877873+0000","last_active":"2024-05-15T15:40:33.006160+0000","last_peered":"2024-05-15T15:40:33.006160+0000","last_clean":"2024-05-15T15:40:33.006160+0000","last_became_active":"2024-05-15T15:40:31.876217+0000","last_became_peered":"2024-05-15T15:40:31.876217+0000","last_unstale":"2024-05-15T15:40:33.006160+0000","last_undegraded":"2024-05-15T15:40:33.006160+0000","last_fullsized":"2024-05-15T15:40:33.006160+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:18:50.984099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:32.852749+0000","last_change":"2024-05-15T15:40:30.857596+0000","last_active":"2024-05-15T15:40:32.852749+0000","last_peered":"2024-05-15T15:40:32.852749+0000","last_clean":"2024-05-15T15:40:32.852749+0000","last_became_active":"2024-05-15T15:40:30.857289+0000","last_became_peered":"2024-05-15T15:40:30.857289+0000","last_unstale":"2024-05-15T15:40:32.852749+0000","last_undegraded":"2024-05-15T15:40:32.852749+0000","last_fullsized":"2024-05-15T15:40:32.852749+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:10:13.648860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:33.006832+0000","last_change":"2024-05-15T15:40:31.870307+0000","last_active":"2024-05-15T15:40:33.006832+0000","last_peered":"2024-05-15T15:40:33.006832+0000","last_clean":"2024-05-15T15:40:33.006832+0000","last_became_active":"2024-05-15T15:40:31.869958+0000","last_became_peered":"2024-05-15T15:40:31.869958+0000","last_unstale":"2024-05-15T15:40:33.006832+0000","last_undegraded":"2024-05-15T15:40:33.006832+0000","last_fullsized":"2024-05-15T15:40:33.006832+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:26:07.047469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:33.006822+0000","last_change":"2024-05-15T15:40:30.856989+0000","last_active":"2024-05-15T15:40:33.006822+0000","last_peered":"2024-05-15T15:40:33.006822+0000","last_clean":"2024-05-15T15:40:33.006822+0000","last_became_active":"2024-05-15T15:40:30.856464+0000","last_became_peered":"2024-05-15T15:40:30.856464+0000","last_unstale":"2024-05-15T15:40:33.006822+0000","last_undegraded":"2024-05-15T15:40:33.006822+0000","last_fullsized":"2024-05-15T15:40:33.006822+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:35:49.341490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:32.852797+0000","last_change":"2024-05-15T15:40:31.876577+0000","last_active":"2024-05-15T15:40:32.852797+0000","last_peered":"2024-05-15T15:40:32.852797+0000","last_clean":"2024-05-15T15:40:32.852797+0000","last_became_active":"2024-05-15T15:40:31.876277+0000","last_became_peered":"2024-05-15T15:40:31.876277+0000","last_unstale":"2024-05-15T15:40:32.852797+0000","last_undegraded":"2024-05-15T15:40:32.852797+0000","last_fullsized":"2024-05-15T15:40:32.852797+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:14:09.635458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:33.006355+0000","last_change":"2024-05-15T15:40:30.856323+0000","last_active":"2024-05-15T15:40:33.006355+0000","last_peered":"2024-05-15T15:40:33.006355+0000","last_clean":"2024-05-15T15:40:33.006355+0000","last_became_active":"2024-05-15T15:40:30.856001+0000","last_became_peered":"2024-05-15T15:40:30.856001+0000","last_unstale":"2024-05-15T15:40:33.006355+0000","last_undegraded":"2024-05-15T15:40:33.006355+0000","last_fullsized":"2024-05-15T15:40:33.006355+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:22:08.100183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:33.004323+0000","last_change":"2024-05-15T15:40:31.861059+0000","last_active":"2024-05-15T15:40:33.004323+0000","last_peered":"2024-05-15T15:40:33.004323+0000","last_clean":"2024-05-15T15:40:33.004323+0000","last_became_active":"2024-05-15T15:40:31.860732+0000","last_became_peered":"2024-05-15T15:40:31.860732+0000","last_unstale":"2024-05-15T15:40:33.004323+0000","last_undegraded":"2024-05-15T15:40:33.004323+0000","last_fullsized":"2024-05-15T15:40:33.004323+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:43:59.631620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"32'8","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:33.004675+0000","last_change":"2024-05-15T15:40:30.861726+0000","last_active":"2024-05-15T15:40:33.004675+0000","last_peered":"2024-05-15T15:40:33.004675+0000","last_clean":"2024-05-15T15:40:33.004675+0000","last_became_active":"2024-05-15T15:40:30.861376+0000","last_became_peered":"2024-05-15T15:40:30.861376+0000","last_unstale":"2024-05-15T15:40:33.004675+0000","last_undegraded":"2024-05-15T15:40:33.004675+0000","last_fullsized":"2024-05-15T15:40:33.004675+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:49:31.489237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:33.004539+0000","last_change":"2024-05-15T15:40:31.870934+0000","last_active":"2024-05-15T15:40:33.004539+0000","last_peered":"2024-05-15T15:40:33.004539+0000","last_clean":"2024-05-15T15:40:33.004539+0000","last_became_active":"2024-05-15T15:40:31.870589+0000","last_became_peered":"2024-05-15T15:40:31.870589+0000","last_unstale":"2024-05-15T15:40:33.004539+0000","last_undegraded":"2024-05-15T15:40:33.004539+0000","last_fullsized":"2024-05-15T15:40:33.004539+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:21:35.394449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"32'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:33.005147+0000","last_change":"2024-05-15T15:40:30.862190+0000","last_active":"2024-05-15T15:40:33.005147+0000","last_peered":"2024-05-15T15:40:33.005147+0000","last_clean":"2024-05-15T15:40:33.005147+0000","last_became_active":"2024-05-15T15:40:30.861868+0000","last_became_peered":"2024-05-15T15:40:30.861868+0000","last_unstale":"2024-05-15T15:40:33.005147+0000","last_undegraded":"2024-05-15T15:40:33.005147+0000","last_fullsized":"2024-05-15T15:40:33.005147+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:19:30.305711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:32.850763+0000","last_change":"2024-05-15T15:40:31.876785+0000","last_active":"2024-05-15T15:40:32.850763+0000","last_peered":"2024-05-15T15:40:32.850763+0000","last_clean":"2024-05-15T15:40:32.850763+0000","last_became_active":"2024-05-15T15:40:31.876465+0000","last_became_peered":"2024-05-15T15:40:31.876465+0000","last_unstale":"2024-05-15T15:40:32.850763+0000","last_undegraded":"2024-05-15T15:40:32.850763+0000","last_fullsized":"2024-05-15T15:40:32.850763+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:10:14.655360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:32.852788+0000","last_change":"2024-05-15T15:40:30.858535+0000","last_active":"2024-05-15T15:40:32.852788+0000","last_peered":"2024-05-15T15:40:32.852788+0000","last_clean":"2024-05-15T15:40:32.852788+0000","last_became_active":"2024-05-15T15:40:30.858150+0000","last_became_peered":"2024-05-15T15:40:30.858150+0000","last_unstale":"2024-05-15T15:40:32.852788+0000","last_undegraded":"2024-05-15T15:40:32.852788+0000","last_fullsized":"2024-05-15T15:40:32.852788+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:17:43.982309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:33.005112+0000","last_change":"2024-05-15T15:40:31.871742+0000","last_active":"2024-05-15T15:40:33.005112+0000","last_peered":"2024-05-15T15:40:33.005112+0000","last_clean":"2024-05-15T15:40:33.005112+0000","last_became_active":"2024-05-15T15:40:31.871430+0000","last_became_peered":"2024-05-15T15:40:31.871430+0000","last_unstale":"2024-05-15T15:40:33.005112+0000","last_undegraded":"2024-05-15T15:40:33.005112+0000","last_fullsized":"2024-05-15T15:40:33.005112+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:31:22.263338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"32'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:33.004638+0000","last_change":"2024-05-15T15:40:30.868324+0000","last_active":"2024-05-15T15:40:33.004638+0000","last_peered":"2024-05-15T15:40:33.004638+0000","last_clean":"2024-05-15T15:40:33.004638+0000","last_became_active":"2024-05-15T15:40:30.867971+0000","last_became_peered":"2024-05-15T15:40:30.867971+0000","last_unstale":"2024-05-15T15:40:33.004638+0000","last_undegraded":"2024-05-15T15:40:33.004638+0000","last_fullsized":"2024-05-15T15:40:33.004638+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:45:32.375669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:33.005717+0000","last_change":"2024-05-15T15:40:31.877045+0000","last_active":"2024-05-15T15:40:33.005717+0000","last_peered":"2024-05-15T15:40:33.005717+0000","last_clean":"2024-05-15T15:40:33.005717+0000","last_became_active":"2024-05-15T15:40:31.876736+0000","last_became_peered":"2024-05-15T15:40:31.876736+0000","last_unstale":"2024-05-15T15:40:33.005717+0000","last_undegraded":"2024-05-15T15:40:33.005717+0000","last_fullsized":"2024-05-15T15:40:33.005717+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:29:32.536665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:32.847128+0000","last_change":"2024-05-15T15:40:30.858223+0000","last_active":"2024-05-15T15:40:32.847128+0000","last_peered":"2024-05-15T15:40:32.847128+0000","last_clean":"2024-05-15T15:40:32.847128+0000","last_became_active":"2024-05-15T15:40:30.857862+0000","last_became_peered":"2024-05-15T15:40:30.857862+0000","last_unstale":"2024-05-15T15:40:32.847128+0000","last_undegraded":"2024-05-15T15:40:32.847128+0000","last_fullsized":"2024-05-15T15:40:32.847128+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:52:59.167447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:33.006354+0000","last_change":"2024-05-15T15:40:31.880812+0000","last_active":"2024-05-15T15:40:33.006354+0000","last_peered":"2024-05-15T15:40:33.006354+0000","last_clean":"2024-05-15T15:40:33.006354+0000","last_became_active":"2024-05-15T15:40:31.879717+0000","last_became_peered":"2024-05-15T15:40:31.879717+0000","last_unstale":"2024-05-15T15:40:33.006354+0000","last_undegraded":"2024-05-15T15:40:33.006354+0000","last_fullsized":"2024-05-15T15:40:33.006354+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:05:07.976225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:33.005773+0000","last_change":"2024-05-15T15:40:30.866950+0000","last_active":"2024-05-15T15:40:33.005773+0000","last_peered":"2024-05-15T15:40:33.005773+0000","last_clean":"2024-05-15T15:40:33.005773+0000","last_became_active":"2024-05-15T15:40:30.866618+0000","last_became_peered":"2024-05-15T15:40:30.866618+0000","last_unstale":"2024-05-15T15:40:33.005773+0000","last_undegraded":"2024-05-15T15:40:33.005773+0000","last_fullsized":"2024-05-15T15:40:33.005773+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:15:26.576271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:33.005649+0000","last_change":"2024-05-15T15:40:31.860233+0000","last_active":"2024-05-15T15:40:33.005649+0000","last_peered":"2024-05-15T15:40:33.005649+0000","last_clean":"2024-05-15T15:40:33.005649+0000","last_became_active":"2024-05-15T15:40:31.859918+0000","last_became_peered":"2024-05-15T15:40:31.859918+0000","last_unstale":"2024-05-15T15:40:33.005649+0000","last_undegraded":"2024-05-15T15:40:33.005649+0000","last_fullsized":"2024-05-15T15:40:33.005649+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:30:38.468087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:32.852634+0000","last_change":"2024-05-15T15:40:30.856479+0000","last_active":"2024-05-15T15:40:32.852634+0000","last_peered":"2024-05-15T15:40:32.852634+0000","last_clean":"2024-05-15T15:40:32.852634+0000","last_became_active":"2024-05-15T15:40:30.856159+0000","last_became_peered":"2024-05-15T15:40:30.856159+0000","last_unstale":"2024-05-15T15:40:32.852634+0000","last_undegraded":"2024-05-15T15:40:32.852634+0000","last_fullsized":"2024-05-15T15:40:32.852634+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:19:55.300691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:33.006877+0000","last_change":"2024-05-15T15:40:31.875300+0000","last_active":"2024-05-15T15:40:33.006877+0000","last_peered":"2024-05-15T15:40:33.006877+0000","last_clean":"2024-05-15T15:40:33.006877+0000","last_became_active":"2024-05-15T15:40:31.874466+0000","last_became_peered":"2024-05-15T15:40:31.874466+0000","last_unstale":"2024-05-15T15:40:33.006877+0000","last_undegraded":"2024-05-15T15:40:33.006877+0000","last_fullsized":"2024-05-15T15:40:33.006877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:48:55.724035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:32.850334+0000","last_change":"2024-05-15T15:40:30.866538+0000","last_active":"2024-05-15T15:40:32.850334+0000","last_peered":"2024-05-15T15:40:32.850334+0000","last_clean":"2024-05-15T15:40:32.850334+0000","last_became_active":"2024-05-15T15:40:30.866059+0000","last_became_peered":"2024-05-15T15:40:30.866059+0000","last_unstale":"2024-05-15T15:40:32.850334+0000","last_undegraded":"2024-05-15T15:40:32.850334+0000","last_fullsized":"2024-05-15T15:40:32.850334+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:35:46.398149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:32.850350+0000","last_change":"2024-05-15T15:40:31.878043+0000","last_active":"2024-05-15T15:40:32.850350+0000","last_peered":"2024-05-15T15:40:32.850350+0000","last_clean":"2024-05-15T15:40:32.850350+0000","last_became_active":"2024-05-15T15:40:31.877699+0000","last_became_peered":"2024-05-15T15:40:31.877699+0000","last_unstale":"2024-05-15T15:40:32.850350+0000","last_undegraded":"2024-05-15T15:40:32.850350+0000","last_fullsized":"2024-05-15T15:40:32.850350+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:15:51.972418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:33.004178+0000","last_change":"2024-05-15T15:40:30.868700+0000","last_active":"2024-05-15T15:40:33.004178+0000","last_peered":"2024-05-15T15:40:33.004178+0000","last_clean":"2024-05-15T15:40:33.004178+0000","last_became_active":"2024-05-15T15:40:30.868332+0000","last_became_peered":"2024-05-15T15:40:30.868332+0000","last_unstale":"2024-05-15T15:40:33.004178+0000","last_undegraded":"2024-05-15T15:40:33.004178+0000","last_fullsized":"2024-05-15T15:40:33.004178+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:30:37.461586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:33.005234+0000","last_change":"2024-05-15T15:40:31.876290+0000","last_active":"2024-05-15T15:40:33.005234+0000","last_peered":"2024-05-15T15:40:33.005234+0000","last_clean":"2024-05-15T15:40:33.005234+0000","last_became_active":"2024-05-15T15:40:31.875975+0000","last_became_peered":"2024-05-15T15:40:31.875975+0000","last_unstale":"2024-05-15T15:40:33.005234+0000","last_undegraded":"2024-05-15T15:40:33.005234+0000","last_fullsized":"2024-05-15T15:40:33.005234+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:10:14.655360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:33.005278+0000","last_change":"2024-05-15T15:40:30.856757+0000","last_active":"2024-05-15T15:40:33.005278+0000","last_peered":"2024-05-15T15:40:33.005278+0000","last_clean":"2024-05-15T15:40:33.005278+0000","last_became_active":"2024-05-15T15:40:30.855959+0000","last_became_peered":"2024-05-15T15:40:30.855959+0000","last_unstale":"2024-05-15T15:40:33.005278+0000","last_undegraded":"2024-05-15T15:40:33.005278+0000","last_fullsized":"2024-05-15T15:40:33.005278+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:49:01.836129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:33.004512+0000","last_change":"2024-05-15T15:40:31.859303+0000","last_active":"2024-05-15T15:40:33.004512+0000","last_peered":"2024-05-15T15:40:33.004512+0000","last_clean":"2024-05-15T15:40:33.004512+0000","last_became_active":"2024-05-15T15:40:31.859014+0000","last_became_peered":"2024-05-15T15:40:31.859014+0000","last_unstale":"2024-05-15T15:40:33.004512+0000","last_undegraded":"2024-05-15T15:40:33.004512+0000","last_fullsized":"2024-05-15T15:40:33.004512+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:43:18.926547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"33'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:33.851407+0000","last_change":"2024-05-15T15:40:30.862323+0000","last_active":"2024-05-15T15:40:33.851407+0000","last_peered":"2024-05-15T15:40:33.851407+0000","last_clean":"2024-05-15T15:40:33.851407+0000","last_became_active":"2024-05-15T15:40:30.862008+0000","last_became_peered":"2024-05-15T15:40:30.862008+0000","last_unstale":"2024-05-15T15:40:33.851407+0000","last_undegraded":"2024-05-15T15:40:33.851407+0000","last_fullsized":"2024-05-15T15:40:33.851407+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:44:52.902358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:33.005935+0000","last_change":"2024-05-15T15:40:31.868768+0000","last_active":"2024-05-15T15:40:33.005935+0000","last_peered":"2024-05-15T15:40:33.005935+0000","last_clean":"2024-05-15T15:40:33.005935+0000","last_became_active":"2024-05-15T15:40:31.868448+0000","last_became_peered":"2024-05-15T15:40:31.868448+0000","last_unstale":"2024-05-15T15:40:33.005935+0000","last_undegraded":"2024-05-15T15:40:33.005935+0000","last_fullsized":"2024-05-15T15:40:33.005935+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:16:29.496330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:33.005888+0000","last_change":"2024-05-15T15:40:30.857910+0000","last_active":"2024-05-15T15:40:33.005888+0000","last_peered":"2024-05-15T15:40:33.005888+0000","last_clean":"2024-05-15T15:40:33.005888+0000","last_became_active":"2024-05-15T15:40:30.857570+0000","last_became_peered":"2024-05-15T15:40:30.857570+0000","last_unstale":"2024-05-15T15:40:33.005888+0000","last_undegraded":"2024-05-15T15:40:33.005888+0000","last_fullsized":"2024-05-15T15:40:33.005888+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:10:13.648860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:32.847074+0000","last_change":"2024-05-15T15:40:31.863460+0000","last_active":"2024-05-15T15:40:32.847074+0000","last_peered":"2024-05-15T15:40:32.847074+0000","last_clean":"2024-05-15T15:40:32.847074+0000","last_became_active":"2024-05-15T15:40:31.862443+0000","last_became_peered":"2024-05-15T15:40:31.862443+0000","last_unstale":"2024-05-15T15:40:32.847074+0000","last_undegraded":"2024-05-15T15:40:32.847074+0000","last_fullsized":"2024-05-15T15:40:32.847074+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:14:09.635458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:33.005406+0000","last_change":"2024-05-15T15:40:30.862014+0000","last_active":"2024-05-15T15:40:33.005406+0000","last_peered":"2024-05-15T15:40:33.005406+0000","last_clean":"2024-05-15T15:40:33.005406+0000","last_became_active":"2024-05-15T15:40:30.861647+0000","last_became_peered":"2024-05-15T15:40:30.861647+0000","last_unstale":"2024-05-15T15:40:33.005406+0000","last_undegraded":"2024-05-15T15:40:33.005406+0000","last_fullsized":"2024-05-15T15:40:33.005406+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:01:37.434862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:33.006943+0000","last_change":"2024-05-15T15:40:31.877222+0000","last_active":"2024-05-15T15:40:33.006943+0000","last_peered":"2024-05-15T15:40:33.006943+0000","last_clean":"2024-05-15T15:40:33.006943+0000","last_became_active":"2024-05-15T15:40:31.869941+0000","last_became_peered":"2024-05-15T15:40:31.869941+0000","last_unstale":"2024-05-15T15:40:33.006943+0000","last_undegraded":"2024-05-15T15:40:33.006943+0000","last_fullsized":"2024-05-15T15:40:33.006943+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:46:57.229193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:33.006570+0000","last_change":"2024-05-15T15:40:30.862351+0000","last_active":"2024-05-15T15:40:33.006570+0000","last_peered":"2024-05-15T15:40:33.006570+0000","last_clean":"2024-05-15T15:40:33.006570+0000","last_became_active":"2024-05-15T15:40:30.861872+0000","last_became_peered":"2024-05-15T15:40:30.861872+0000","last_unstale":"2024-05-15T15:40:33.006570+0000","last_undegraded":"2024-05-15T15:40:33.006570+0000","last_fullsized":"2024-05-15T15:40:33.006570+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:19:55.300691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:33.006405+0000","last_change":"2024-05-15T15:40:31.863882+0000","last_active":"2024-05-15T15:40:33.006405+0000","last_peered":"2024-05-15T15:40:33.006405+0000","last_clean":"2024-05-15T15:40:33.006405+0000","last_became_active":"2024-05-15T15:40:31.863541+0000","last_became_peered":"2024-05-15T15:40:31.863541+0000","last_unstale":"2024-05-15T15:40:33.006405+0000","last_undegraded":"2024-05-15T15:40:33.006405+0000","last_fullsized":"2024-05-15T15:40:33.006405+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:09:53.916411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:32.852622+0000","last_change":"2024-05-15T15:40:30.859598+0000","last_active":"2024-05-15T15:40:32.852622+0000","last_peered":"2024-05-15T15:40:32.852622+0000","last_clean":"2024-05-15T15:40:32.852622+0000","last_became_active":"2024-05-15T15:40:30.858601+0000","last_became_peered":"2024-05-15T15:40:30.858601+0000","last_unstale":"2024-05-15T15:40:32.852622+0000","last_undegraded":"2024-05-15T15:40:32.852622+0000","last_fullsized":"2024-05-15T15:40:32.852622+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:42:12.348507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:33.004382+0000","last_change":"2024-05-15T15:40:31.860070+0000","last_active":"2024-05-15T15:40:33.004382+0000","last_peered":"2024-05-15T15:40:33.004382+0000","last_clean":"2024-05-15T15:40:33.004382+0000","last_became_active":"2024-05-15T15:40:31.859807+0000","last_became_peered":"2024-05-15T15:40:31.859807+0000","last_unstale":"2024-05-15T15:40:33.004382+0000","last_undegraded":"2024-05-15T15:40:33.004382+0000","last_fullsized":"2024-05-15T15:40:33.004382+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:09:35.016069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:33.006529+0000","last_change":"2024-05-15T15:40:30.866837+0000","last_active":"2024-05-15T15:40:33.006529+0000","last_peered":"2024-05-15T15:40:33.006529+0000","last_clean":"2024-05-15T15:40:33.006529+0000","last_became_active":"2024-05-15T15:40:30.866530+0000","last_became_peered":"2024-05-15T15:40:30.866530+0000","last_unstale":"2024-05-15T15:40:33.006529+0000","last_undegraded":"2024-05-15T15:40:33.006529+0000","last_fullsized":"2024-05-15T15:40:33.006529+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:33:23.899790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:32.847115+0000","last_change":"2024-05-15T15:40:31.867228+0000","last_active":"2024-05-15T15:40:32.847115+0000","last_peered":"2024-05-15T15:40:32.847115+0000","last_clean":"2024-05-15T15:40:32.847115+0000","last_became_active":"2024-05-15T15:40:31.866153+0000","last_became_peered":"2024-05-15T15:40:31.866153+0000","last_unstale":"2024-05-15T15:40:32.847115+0000","last_undegraded":"2024-05-15T15:40:32.847115+0000","last_fullsized":"2024-05-15T15:40:32.847115+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:30.836484+0000","last_clean_scrub_stamp":"2024-05-15T15:40:30.836484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:53:08.027972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:33.004681+0000","last_change":"2024-05-15T15:40:30.867645+0000","last_active":"2024-05-15T15:40:33.004681+0000","last_peered":"2024-05-15T15:40:33.004681+0000","last_clean":"2024-05-15T15:40:33.004681+0000","last_became_active":"2024-05-15T15:40:30.867327+0000","last_became_peered":"2024-05-15T15:40:30.867327+0000","last_unstale":"2024-05-15T15:40:33.004681+0000","last_undegraded":"2024-05-15T15:40:33.004681+0000","last_fullsized":"2024-05-15T15:40:33.004681+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:40:29.829984+0000","last_clean_scrub_stamp":"2024-05-15T15:40:29.829984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:07:51.613911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":129,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-15T15:40:32.850221+0000","last_change":"2024-05-15T15:39:42.584601+0000","last_active":"2024-05-15T15:40:32.850221+0000","last_peered":"2024-05-15T15:40:32.850221+0000","last_clean":"2024-05-15T15:40:32.850221+0000","last_became_active":"2024-05-15T15:39:42.584129+0000","last_became_peered":"2024-05-15T15:39:42.584129+0000","last_unstale":"2024-05-15T15:40:32.850221+0000","last_undegraded":"2024-05-15T15:40:32.850221+0000","last_fullsized":"2024-05-15T15:40:32.850221+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:41.378107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:41.378107+0000","last_clean_scrub_stamp":"2024-05-15T15:39:41.378107+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:23:25.285669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509455,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":368640,"data_stored":139400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509455,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":376832,"data_stored":140990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509456,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27960,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343880,"statfs":{"total":96636764160,"available":96608133120,"internally_reserved":0,"allocated":962560,"data_stored":730328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509455,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":380928,"data_stored":140154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509455,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":368640,"data_stored":139412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509456,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27960,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343880,"statfs":{"total":96636764160,"available":96608133120,"internally_reserved":0,"allocated":962560,"data_stored":729816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509455,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":368640,"data_stored":139468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":380928,"data_stored":141012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-15T15:40:40.875 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-15T15:40:40.876 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-05-15T15:40:41.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.029+0000 7f9085d7d640 1 Processor -- start 2024-05-15T15:40:41.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.029+0000 7f9085d7d640 1 -- start start 2024-05-15T15:40:41.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.030+0000 7f9085d7d640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f9080148910 0x7f908014e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:41.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.030+0000 7f9085d7d640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f908014eba0 0x7f9080158db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:41.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.030+0000 7f9085d7d640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90800ba800 con 0x7f90800a9060 2024-05-15T15:40:41.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.030+0000 7f9085d7d640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f90800b8a30 con 0x7f9080148910 2024-05-15T15:40:41.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.030+0000 7f9085d7d640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f90800b8d10 con 0x7f908014eba0 2024-05-15T15:40:41.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.030+0000 7f907f7fe640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f90800a9060 0x7f90800ba0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:40092/0 (socket says 172.21.15.12:40092) 2024-05-15T15:40:41.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.030+0000 7f907f7fe640 1 -- 172.21.15.12:0/3585471299 learned_addr learned my addr 172.21.15.12:0/3585471299 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-05-15T15:40:41.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.030+0000 7f907effd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f9080148910 0x7f908014e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:41.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.030+0000 7f907ffff640 1 --2- 172.21.15.12:0/3585471299 >> v2:172.21.15.84:3300/0 conn(0x7f908014eba0 0x7f9080158db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:41.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.030+0000 7f907effd640 1 -- 172.21.15.12:0/3585471299 >> v2:172.21.15.84:3300/0 conn(0x7f908014eba0 msgr2=0x7f9080158db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:40:41.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.030+0000 7f907effd640 1 --2- 172.21.15.12:0/3585471299 >> v2:172.21.15.84:3300/0 conn(0x7f908014eba0 0x7f9080158db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:41.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.030+0000 7f907e7fc640 1 -- 172.21.15.12:0/3585471299 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3181082864 0 0) 0x7f9070001110 con 0x7f90800a9060 2024-05-15T15:40:41.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.030+0000 7f907effd640 1 -- 172.21.15.12:0/3585471299 >> v1:172.21.15.12:6789/0 conn(0x7f90800a9060 legacy=0x7f90800ba0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:41.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.030+0000 7f907effd640 1 -- 172.21.15.12:0/3585471299 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90800b8ff0 con 0x7f9080148910 2024-05-15T15:40:41.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.031+0000 7f907effd640 1 --2- 172.21.15.12:0/3585471299 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9080148910 0x7f908014e660 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f90800a9470 tx=0x7f907402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2f773b6fbc17060 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:41.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.031+0000 7f907e7fc640 1 -- 172.21.15.12:0/3585471299 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9074037070 con 0x7f9080148910 2024-05-15T15:40:41.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.031+0000 7f907e7fc640 1 -- 172.21.15.12:0/3585471299 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9074032440 con 0x7f9080148910 2024-05-15T15:40:41.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.031+0000 7f907e7fc640 1 -- 172.21.15.12:0/3585471299 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9074032810 con 0x7f9080148910 2024-05-15T15:40:41.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.032+0000 7f9085d7d640 1 -- 172.21.15.12:0/3585471299 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9080148910 msgr2=0x7f908014e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:41.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.032+0000 7f9085d7d640 1 --2- 172.21.15.12:0/3585471299 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9080148910 0x7f908014e660 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f90800a9470 tx=0x7f907402a230 comp rx=0 tx=0).stop 2024-05-15T15:40:41.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.032+0000 7f9085d7d640 1 -- 172.21.15.12:0/3585471299 shutdown_connections 2024-05-15T15:40:41.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.032+0000 7f9085d7d640 1 --2- 172.21.15.12:0/3585471299 >> v2:172.21.15.84:3300/0 conn(0x7f908014eba0 0x7f9080158db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:41.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.032+0000 7f9085d7d640 1 --2- 172.21.15.12:0/3585471299 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9080148910 0x7f908014e660 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:41.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.032+0000 7f9085d7d640 1 -- 172.21.15.12:0/3585471299 >> 172.21.15.12:0/3585471299 conn(0x7f90800c07c0 msgr2=0x7f90800c0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:41.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.032+0000 7f9085d7d640 1 -- 172.21.15.12:0/3585471299 shutdown_connections 2024-05-15T15:40:41.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.032+0000 7f9085d7d640 1 -- 172.21.15.12:0/3585471299 wait complete. 2024-05-15T15:40:41.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.033+0000 7f9085d7d640 1 Processor -- start 2024-05-15T15:40:41.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.034+0000 7f9085d7d640 1 -- start start 2024-05-15T15:40:41.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.035+0000 7f9085d7d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f90800a9060 0x7f90801e80e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:41.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.035+0000 7f9085d7d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9080148910 0x7f90800bf160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:41.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.035+0000 7f9085d7d640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f908014eba0 0x7f908013e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:41.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.035+0000 7f9085d7d640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f908008d400 con 0x7f9080148910 2024-05-15T15:40:41.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.035+0000 7f9085d7d640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f908014efb0 con 0x7f90800a9060 2024-05-15T15:40:41.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.035+0000 7f9085d7d640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f908008d580 con 0x7f908014eba0 2024-05-15T15:40:41.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.035+0000 7f907effd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9080148910 0x7f90800bf160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:41.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.035+0000 7f907effd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9080148910 0x7f90800bf160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43210/0 (socket says 172.21.15.12:43210) 2024-05-15T15:40:41.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.035+0000 7f907effd640 1 -- 172.21.15.12:0/74464976 learned_addr learned my addr 172.21.15.12:0/74464976 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:41.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.035+0000 7f907ffff640 1 --2- 172.21.15.12:0/74464976 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f908014eba0 0x7f908013e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:41.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.035+0000 7f907effd640 1 -- 172.21.15.12:0/74464976 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f908014eba0 msgr2=0x7f908013e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:41.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.035+0000 7f907effd640 1 --2- 172.21.15.12:0/74464976 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f908014eba0 0x7f908013e070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:41.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.035+0000 7f907effd640 1 -- 172.21.15.12:0/74464976 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f90800a9060 msgr2=0x7f90801e80e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:41.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.035+0000 7f907f7fe640 1 --2- 172.21.15.12:0/74464976 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f90800a9060 0x7f90801e80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:41.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.035+0000 7f907effd640 1 --2- 172.21.15.12:0/74464976 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f90800a9060 0x7f90801e80e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:41.040 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.035+0000 7f907effd640 1 -- 172.21.15.12:0/74464976 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90800bf6a0 con 0x7f9080148910 2024-05-15T15:40:41.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.035+0000 7f907effd640 1 --2- 172.21.15.12:0/74464976 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9080148910 0x7f90800bf160 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f9074000c00 tx=0x7f90740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:41.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.035+0000 7f9067fff640 1 -- 172.21.15.12:0/74464976 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9074037040 con 0x7f9080148910 2024-05-15T15:40:41.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.035+0000 7f9067fff640 1 -- 172.21.15.12:0/74464976 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9074042070 con 0x7f9080148910 2024-05-15T15:40:41.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.036+0000 7f9085d7d640 1 -- 172.21.15.12:0/74464976 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90801e88e0 con 0x7f9080148910 2024-05-15T15:40:41.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.036+0000 7f9067fff640 1 -- 172.21.15.12:0/74464976 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9074030a50 con 0x7f9080148910 2024-05-15T15:40:41.042 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.036+0000 7f9085d7d640 1 -- 172.21.15.12:0/74464976 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90801e4bc0 con 0x7f9080148910 2024-05-15T15:40:41.042 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.037+0000 7f9085d7d640 1 -- 172.21.15.12:0/74464976 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90801e86d0 con 0x7f9080148910 2024-05-15T15:40:41.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.037+0000 7f9067fff640 1 -- 172.21.15.12:0/74464976 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f9074030bf0 con 0x7f9080148910 2024-05-15T15:40:41.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.038+0000 7f9067fff640 1 --2- 172.21.15.12:0/74464976 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f906c076300 0x7f906c078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:41.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.038+0000 7f9067fff640 1 -- 172.21.15.12:0/74464976 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f90740b80b0 con 0x7f9080148910 2024-05-15T15:40:41.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.038+0000 7f907f7fe640 1 --2- 172.21.15.12:0/74464976 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f906c076300 0x7f906c078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:41.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.039+0000 7f907f7fe640 1 --2- 172.21.15.12:0/74464976 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f906c076300 0x7f906c078810 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f9070000f60 tx=0x7f9070009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:41.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.042+0000 7f9067fff640 1 -- 172.21.15.12:0/74464976 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f9074081a10 con 0x7f9080148910 2024-05-15T15:40:41.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.309+0000 7f9085d7d640 1 -- 172.21.15.12:0/74464976 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f9080050940 con 0x7f9080148910 2024-05-15T15:40:41.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.312+0000 7f9067fff640 1 -- 172.21.15.12:0/74464976 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) ==== 190+0+147 (secure 0 0 0) 0x7f9074081310 con 0x7f9080148910 2024-05-15T15:40:41.314 INFO:teuthology.orchestra.run.smithi012.stdout:[client.0] 2024-05-15T15:40:41.314 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQAP10RmgcqhJBAAq/xIvSfZmvkmH8pu4FHIBw== 2024-05-15T15:40:41.314 INFO:teuthology.orchestra.run.smithi012.stdout: caps mds = "allow" 2024-05-15T15:40:41.315 INFO:teuthology.orchestra.run.smithi012.stdout: caps mon = "allow r" 2024-05-15T15:40:41.315 INFO:teuthology.orchestra.run.smithi012.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-05-15T15:40:41.315 INFO:teuthology.orchestra.run.smithi012.stderr:updated caps for client.0 2024-05-15T15:40:41.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.314+0000 7f9085d7d640 1 -- 172.21.15.12:0/74464976 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f906c076300 msgr2=0x7f906c078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:41.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.314+0000 7f9085d7d640 1 --2- 172.21.15.12:0/74464976 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f906c076300 0x7f906c078810 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f9070000f60 tx=0x7f9070009040 comp rx=0 tx=0).stop 2024-05-15T15:40:41.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.314+0000 7f9085d7d640 1 -- 172.21.15.12:0/74464976 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9080148910 msgr2=0x7f90800bf160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:41.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.314+0000 7f9085d7d640 1 --2- 172.21.15.12:0/74464976 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9080148910 0x7f90800bf160 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f9074000c00 tx=0x7f90740046c0 comp rx=0 tx=0).stop 2024-05-15T15:40:41.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.314+0000 7f9085d7d640 1 -- 172.21.15.12:0/74464976 shutdown_connections 2024-05-15T15:40:41.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.314+0000 7f9085d7d640 1 --2- 172.21.15.12:0/74464976 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f908014eba0 0x7f908013e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:41.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.314+0000 7f9085d7d640 1 --2- 172.21.15.12:0/74464976 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f906c076300 0x7f906c078810 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:41.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.314+0000 7f9085d7d640 1 --2- 172.21.15.12:0/74464976 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9080148910 0x7f90800bf160 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:41.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.314+0000 7f9085d7d640 1 --2- 172.21.15.12:0/74464976 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f90800a9060 0x7f90801e80e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:41.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.314+0000 7f9085d7d640 1 -- 172.21.15.12:0/74464976 >> 172.21.15.12:0/74464976 conn(0x7f90800c07c0 msgr2=0x7f9080146e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:41.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.315+0000 7f9085d7d640 1 -- 172.21.15.12:0/74464976 shutdown_connections 2024-05-15T15:40:41.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.315+0000 7f9085d7d640 1 -- 172.21.15.12:0/74464976 wait complete. 2024-05-15T15:40:41.328 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-15T15:40:41.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.437+0000 7fcfc2253640 1 Processor -- start 2024-05-15T15:40:41.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.438+0000 7fcfc2253640 1 -- start start 2024-05-15T15:40:41.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.439+0000 7fcfc2253640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fcfbc0bf050 0x7fcfbc159ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:41.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.439+0000 7fcfc2253640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcfbc06e140 con 0x7fcfbc151fc0 2024-05-15T15:40:41.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.439+0000 7fcfc2253640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcfbc0c36f0 con 0x7fcfbc0bd6d0 2024-05-15T15:40:41.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.439+0000 7fcfc2253640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fcfbc152530 con 0x7fcfbc0bf050 2024-05-15T15:40:41.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.439+0000 7fcfbb7fe640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fcfbc151fc0 0x7fcfbc06da30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:40106/0 (socket says 172.21.15.12:40106) 2024-05-15T15:40:41.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.439+0000 7fcfbb7fe640 1 -- 172.21.15.12:0/3139188292 learned_addr learned my addr 172.21.15.12:0/3139188292 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-05-15T15:40:41.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.439+0000 7fcfbbfff640 1 --2- 172.21.15.12:0/3139188292 >> v2:172.21.15.12:3300/0 conn(0x7fcfbc0bf050 0x7fcfbc159ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:41.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.439+0000 7fcfba7fc640 1 -- 172.21.15.12:0/3139188292 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 164925014 0 0) 0x7fcfac001110 con 0x7fcfbc151fc0 2024-05-15T15:40:41.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.439+0000 7fcfba7fc640 1 -- 172.21.15.12:0/3139188292 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcfa4003520 con 0x7fcfbc151fc0 2024-05-15T15:40:41.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.439+0000 7fcfbbfff640 1 -- 172.21.15.12:0/3139188292 >> v1:172.21.15.84:6789/0 conn(0x7fcfbc0bd6d0 legacy=0x7fcfbc0be940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:41.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.439+0000 7fcfbbfff640 1 -- 172.21.15.12:0/3139188292 >> v1:172.21.15.12:6789/0 conn(0x7fcfbc151fc0 legacy=0x7fcfbc06da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:41.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.439+0000 7fcfbbfff640 1 -- 172.21.15.12:0/3139188292 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfbc152810 con 0x7fcfbc0bf050 2024-05-15T15:40:41.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.440+0000 7fcfbbfff640 1 --2- 172.21.15.12:0/3139188292 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcfbc0bf050 0x7fcfbc159ea0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fcfb4009d90 tx=0x7fcfb402a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22912fba498805 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:41.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.440+0000 7fcfba7fc640 1 -- 172.21.15.12:0/3139188292 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfb4007740 con 0x7fcfbc0bf050 2024-05-15T15:40:41.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.440+0000 7fcfba7fc640 1 -- 172.21.15.12:0/3139188292 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfb40078e0 con 0x7fcfbc0bf050 2024-05-15T15:40:41.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.440+0000 7fcfba7fc640 1 -- 172.21.15.12:0/3139188292 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfb4007cb0 con 0x7fcfbc0bf050 2024-05-15T15:40:41.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.441+0000 7fcfc2253640 1 -- 172.21.15.12:0/3139188292 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcfbc0bf050 msgr2=0x7fcfbc159ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:41.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.441+0000 7fcfc2253640 1 --2- 172.21.15.12:0/3139188292 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcfbc0bf050 0x7fcfbc159ea0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fcfb4009d90 tx=0x7fcfb402a6f0 comp rx=0 tx=0).stop 2024-05-15T15:40:41.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.441+0000 7fcfc2253640 1 -- 172.21.15.12:0/3139188292 shutdown_connections 2024-05-15T15:40:41.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.441+0000 7fcfc2253640 1 --2- 172.21.15.12:0/3139188292 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcfbc0bf050 0x7fcfbc159ea0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:41.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.441+0000 7fcfc2253640 1 -- 172.21.15.12:0/3139188292 >> 172.21.15.12:0/3139188292 conn(0x7fcfbc0c3d20 msgr2=0x7fcfbc0c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:41.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.441+0000 7fcfc2253640 1 -- 172.21.15.12:0/3139188292 shutdown_connections 2024-05-15T15:40:41.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.441+0000 7fcfc2253640 1 -- 172.21.15.12:0/3139188292 wait complete. 2024-05-15T15:40:41.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.442+0000 7fcfc2253640 1 Processor -- start 2024-05-15T15:40:41.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.443+0000 7fcfc2253640 1 -- start start 2024-05-15T15:40:41.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.444+0000 7fcfc2253640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcfbc0bd6d0 0x7fcfbc1e8400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:41.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.444+0000 7fcfc2253640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fcfbc0bf050 0x7fcfbc14e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:41.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.444+0000 7fcfc2253640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcfbc151fc0 0x7fcfbc14b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:41.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.444+0000 7fcfc2253640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fcfbc0a2ed0 con 0x7fcfbc151fc0 2024-05-15T15:40:41.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.444+0000 7fcfc2253640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fcfbc0bdae0 con 0x7fcfbc0bd6d0 2024-05-15T15:40:41.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.444+0000 7fcfc2253640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fcfbc0a3050 con 0x7fcfbc0bf050 2024-05-15T15:40:41.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.444+0000 7fcfbbfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcfbc151fc0 0x7fcfbc14b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:41.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.444+0000 7fcfbbfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcfbc151fc0 0x7fcfbc14b580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43222/0 (socket says 172.21.15.12:43222) 2024-05-15T15:40:41.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.444+0000 7fcfbbfff640 1 -- 172.21.15.12:0/636353959 learned_addr learned my addr 172.21.15.12:0/636353959 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:41.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.444+0000 7fcfbb7fe640 1 --2- 172.21.15.12:0/636353959 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcfbc0bd6d0 0x7fcfbc1e8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:41.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.444+0000 7fcfbaffd640 1 --2- 172.21.15.12:0/636353959 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fcfbc0bf050 0x7fcfbc14e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:41.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.444+0000 7fcfbbfff640 1 -- 172.21.15.12:0/636353959 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fcfbc0bf050 msgr2=0x7fcfbc14e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:41.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.444+0000 7fcfbbfff640 1 --2- 172.21.15.12:0/636353959 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fcfbc0bf050 0x7fcfbc14e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:41.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.444+0000 7fcfbbfff640 1 -- 172.21.15.12:0/636353959 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcfbc0bd6d0 msgr2=0x7fcfbc1e8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:41.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.444+0000 7fcfbbfff640 1 --2- 172.21.15.12:0/636353959 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcfbc0bd6d0 0x7fcfbc1e8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:41.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.444+0000 7fcfbbfff640 1 -- 172.21.15.12:0/636353959 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfbc14ee10 con 0x7fcfbc151fc0 2024-05-15T15:40:41.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.444+0000 7fcfbbfff640 1 --2- 172.21.15.12:0/636353959 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcfbc151fc0 0x7fcfbc14b580 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fcfb4009d90 tx=0x7fcfb4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:41.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.444+0000 7fcfa3fff640 1 -- 172.21.15.12:0/636353959 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfb403f070 con 0x7fcfbc151fc0 2024-05-15T15:40:41.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.444+0000 7fcfa3fff640 1 -- 172.21.15.12:0/636353959 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfb4031bc0 con 0x7fcfbc151fc0 2024-05-15T15:40:41.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.444+0000 7fcfc2253640 1 -- 172.21.15.12:0/636353959 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfbc0b98a0 con 0x7fcfbc151fc0 2024-05-15T15:40:41.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.444+0000 7fcfa3fff640 1 -- 172.21.15.12:0/636353959 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfb4009450 con 0x7fcfbc151fc0 2024-05-15T15:40:41.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.445+0000 7fcfc2253640 1 -- 172.21.15.12:0/636353959 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfbc0ba250 con 0x7fcfbc151fc0 2024-05-15T15:40:41.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.446+0000 7fcfc2253640 1 -- 172.21.15.12:0/636353959 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcfbc0b9d80 con 0x7fcfbc151fc0 2024-05-15T15:40:41.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.446+0000 7fcfa3fff640 1 -- 172.21.15.12:0/636353959 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fcfb403b410 con 0x7fcfbc151fc0 2024-05-15T15:40:41.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.447+0000 7fcfa3fff640 1 --2- 172.21.15.12:0/636353959 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fcfa80762d0 0x7fcfa80787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:41.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.447+0000 7fcfa3fff640 1 -- 172.21.15.12:0/636353959 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fcfb40b8aa0 con 0x7fcfbc151fc0 2024-05-15T15:40:41.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.447+0000 7fcfbb7fe640 1 --2- 172.21.15.12:0/636353959 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fcfa80762d0 0x7fcfa80787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:41.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.448+0000 7fcfbb7fe640 1 --2- 172.21.15.12:0/636353959 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fcfa80762d0 0x7fcfa80787e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fcfac007fd0 tx=0x7fcfac009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:41.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.452+0000 7fcfa3fff640 1 -- 172.21.15.12:0/636353959 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fcfb4081db0 con 0x7fcfbc151fc0 2024-05-15T15:40:41.683 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.680+0000 7fcfc2253640 1 -- 172.21.15.12:0/636353959 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcfbc06eb40 con 0x7fcfbc151fc0 2024-05-15T15:40:41.683 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.680+0000 7fcfa3fff640 1 -- 172.21.15.12:0/636353959 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+4350 (secure 0 0 0) 0x7fcfb40860b0 con 0x7fcfbc151fc0 2024-05-15T15:40:41.683 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-05-15T15:40:41.683 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4577,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/1749847216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1749847216},{"type":"v1","addr":"172.21.15.84:6835","nonce":1749847216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4580,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/3678098513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6833","nonce":3678098513},{"type":"v1","addr":"172.21.15.12:6835","nonce":3678098513}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-15T15:40:31.243097+0000","modified":"2024-05-15T15:40:34.253461+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4759},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4759":{"gid":4759,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.12:6834/32438370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":32438370},{"type":"v1","addr":"172.21.15.12:6834","nonce":32438370}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4759,"qdb_cluster":[4759]},"id":2}]} 2024-05-15T15:40:41.683 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 16 2024-05-15T15:40:41.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.683+0000 7fcfc2253640 1 -- 172.21.15.12:0/636353959 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fcfa80762d0 msgr2=0x7fcfa80787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:41.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.683+0000 7fcfc2253640 1 --2- 172.21.15.12:0/636353959 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fcfa80762d0 0x7fcfa80787e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fcfac007fd0 tx=0x7fcfac009040 comp rx=0 tx=0).stop 2024-05-15T15:40:41.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.683+0000 7fcfc2253640 1 -- 172.21.15.12:0/636353959 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcfbc151fc0 msgr2=0x7fcfbc14b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:41.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.683+0000 7fcfc2253640 1 --2- 172.21.15.12:0/636353959 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcfbc151fc0 0x7fcfbc14b580 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fcfb4009d90 tx=0x7fcfb4004a40 comp rx=0 tx=0).stop 2024-05-15T15:40:41.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.683+0000 7fcfc2253640 1 -- 172.21.15.12:0/636353959 shutdown_connections 2024-05-15T15:40:41.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.683+0000 7fcfc2253640 1 --2- 172.21.15.12:0/636353959 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fcfa80762d0 0x7fcfa80787e0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:41.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.683+0000 7fcfc2253640 1 --2- 172.21.15.12:0/636353959 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcfbc151fc0 0x7fcfbc14b580 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:41.686 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.683+0000 7fcfc2253640 1 --2- 172.21.15.12:0/636353959 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fcfbc0bf050 0x7fcfbc14e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:41.686 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.683+0000 7fcfc2253640 1 --2- 172.21.15.12:0/636353959 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcfbc0bd6d0 0x7fcfbc1e8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:41.686 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.683+0000 7fcfc2253640 1 -- 172.21.15.12:0/636353959 >> 172.21.15.12:0/636353959 conn(0x7fcfbc0c3d20 msgr2=0x7fcfbc0a4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:41.686 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.683+0000 7fcfc2253640 1 -- 172.21.15.12:0/636353959 shutdown_connections 2024-05-15T15:40:41.686 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:41.683+0000 7fcfc2253640 1 -- 172.21.15.12:0/636353959 wait complete. 2024-05-15T15:40:41.999 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-15T15:40:31.243097+0000', 'modified': '2024-05-15T15:40:34.253461+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4759}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4759': {'gid': 4759, 'name': 'c', 'rank': 0, 'incarnation': 12, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.12:6834/32438370', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.12:6832', 'nonce': 32438370}, {'type': 'v1', 'addr': '172.21.15.12:6834', 'nonce': 32438370}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4759, 'qdb_cluster': [4759]} 2024-05-15T15:40:41.999 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-15T15:40:41.999 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-05-15T15:40:42.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.113+0000 7f884e6b6640 1 Processor -- start 2024-05-15T15:40:42.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.113+0000 7f884e6b6640 1 -- start start 2024-05-15T15:40:42.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.114+0000 7f884e6b6640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8848148770 0x7f88480c0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:42.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.114+0000 7f884e6b6640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f88480bf9b0 0x7f88480bfdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:42.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.114+0000 7f884e6b6640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88480c0620 con 0x7f884814e360 2024-05-15T15:40:42.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.114+0000 7f884e6b6640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f8848151e40 con 0x7f8848148770 2024-05-15T15:40:42.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.114+0000 7f884e6b6640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f8848151ad0 con 0x7f88480bf9b0 2024-05-15T15:40:42.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.114+0000 7f88477fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8848148770 0x7f88480c0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:42.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.114+0000 7f88477fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8848148770 0x7f88480c0c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43236/0 (socket says 172.21.15.12:43236) 2024-05-15T15:40:42.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.114+0000 7f88477fe640 1 -- 172.21.15.12:0/3483162762 learned_addr learned my addr 172.21.15.12:0/3483162762 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:42.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.114+0000 7f884cc53640 1 --2- 172.21.15.12:0/3483162762 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f88480bf9b0 0x7f88480bfdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:42.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.115+0000 7f88477fe640 1 -- 172.21.15.12:0/3483162762 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f88480bf9b0 msgr2=0x7f88480bfdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:40:42.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.115+0000 7f88477fe640 1 --2- 172.21.15.12:0/3483162762 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f88480bf9b0 0x7f88480bfdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:42.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.115+0000 7f88477fe640 1 -- 172.21.15.12:0/3483162762 >> v1:172.21.15.84:6789/0 conn(0x7f884814e360 legacy=0x7f88481522d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:42.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.115+0000 7f88477fe640 1 -- 172.21.15.12:0/3483162762 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88480c0300 con 0x7f8848148770 2024-05-15T15:40:42.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.115+0000 7f88477fe640 1 --2- 172.21.15.12:0/3483162762 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8848148770 0x7f88480c0c80 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f883c009870 tx=0x7f883c02a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57251d4caeba3f3f server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:42.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.115+0000 7f8846ffd640 1 -- 172.21.15.12:0/3483162762 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f883c037070 con 0x7f8848148770 2024-05-15T15:40:42.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.115+0000 7f8846ffd640 1 -- 172.21.15.12:0/3483162762 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f883c02ae50 con 0x7f8848148770 2024-05-15T15:40:42.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.116+0000 7f8846ffd640 1 -- 172.21.15.12:0/3483162762 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f883c032860 con 0x7f8848148770 2024-05-15T15:40:42.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.116+0000 7f884e6b6640 1 -- 172.21.15.12:0/3483162762 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8848148770 msgr2=0x7f88480c0c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:42.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.116+0000 7f884e6b6640 1 --2- 172.21.15.12:0/3483162762 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8848148770 0x7f88480c0c80 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f883c009870 tx=0x7f883c02a300 comp rx=0 tx=0).stop 2024-05-15T15:40:42.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.116+0000 7f884e6b6640 1 -- 172.21.15.12:0/3483162762 shutdown_connections 2024-05-15T15:40:42.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.116+0000 7f884e6b6640 1 --2- 172.21.15.12:0/3483162762 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f88480bf9b0 0x7f88480bfdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:42.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.116+0000 7f884e6b6640 1 --2- 172.21.15.12:0/3483162762 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8848148770 0x7f88480c0c80 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:42.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.116+0000 7f884e6b6640 1 -- 172.21.15.12:0/3483162762 >> 172.21.15.12:0/3483162762 conn(0x7f88480c17c0 msgr2=0x7f88480c1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:42.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.116+0000 7f884e6b6640 1 -- 172.21.15.12:0/3483162762 shutdown_connections 2024-05-15T15:40:42.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.116+0000 7f884e6b6640 1 -- 172.21.15.12:0/3483162762 wait complete. 2024-05-15T15:40:42.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.118+0000 7f884e6b6640 1 Processor -- start 2024-05-15T15:40:42.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.118+0000 7f884e6b6640 1 -- start start 2024-05-15T15:40:42.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.119+0000 7f884e6b6640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f88480bf9b0 0x7f884806ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:42.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.119+0000 7f884e6b6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8848148770 0x7f884813d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:42.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.119+0000 7f884e6b6640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f884814e360 0x7f884813df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:42.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.119+0000 7f884e6b6640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f8848158cc0 con 0x7f8848148770 2024-05-15T15:40:42.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.119+0000 7f884e6b6640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f88480c13d0 con 0x7f884814e360 2024-05-15T15:40:42.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.119+0000 7f884e6b6640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f8848158e40 con 0x7f88480bf9b0 2024-05-15T15:40:42.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.119+0000 7f88477fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8848148770 0x7f884813d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:42.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.119+0000 7f88477fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8848148770 0x7f884813d9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43244/0 (socket says 172.21.15.12:43244) 2024-05-15T15:40:42.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.119+0000 7f88477fe640 1 -- 172.21.15.12:0/4233738195 learned_addr learned my addr 172.21.15.12:0/4233738195 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:42.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.119+0000 7f8847fff640 1 --2- 172.21.15.12:0/4233738195 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f88480bf9b0 0x7f884806ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:42.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.119+0000 7f884cc53640 1 --2- 172.21.15.12:0/4233738195 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f884814e360 0x7f884813df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:42.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.119+0000 7f88477fe640 1 -- 172.21.15.12:0/4233738195 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f88480bf9b0 msgr2=0x7f884806ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:42.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.119+0000 7f88477fe640 1 --2- 172.21.15.12:0/4233738195 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f88480bf9b0 0x7f884806ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:42.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.119+0000 7f88477fe640 1 -- 172.21.15.12:0/4233738195 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f884814e360 msgr2=0x7f884813df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:42.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.119+0000 7f88477fe640 1 --2- 172.21.15.12:0/4233738195 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f884814e360 0x7f884813df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:42.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.119+0000 7f88477fe640 1 -- 172.21.15.12:0/4233738195 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f884806f1c0 con 0x7f8848148770 2024-05-15T15:40:42.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.120+0000 7f88477fe640 1 --2- 172.21.15.12:0/4233738195 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8848148770 0x7f884813d9c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f883c02a340 tx=0x7f883c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:42.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.120+0000 7f8844ff9640 1 -- 172.21.15.12:0/4233738195 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f883c041020 con 0x7f8848148770 2024-05-15T15:40:42.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.120+0000 7f8844ff9640 1 -- 172.21.15.12:0/4233738195 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f883c03c870 con 0x7f8848148770 2024-05-15T15:40:42.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.120+0000 7f884e6b6640 1 -- 172.21.15.12:0/4233738195 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88481424a0 con 0x7f8848148770 2024-05-15T15:40:42.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.120+0000 7f8844ff9640 1 -- 172.21.15.12:0/4233738195 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f883c037040 con 0x7f8848148770 2024-05-15T15:40:42.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.120+0000 7f884e6b6640 1 -- 172.21.15.12:0/4233738195 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8848142ca0 con 0x7f8848148770 2024-05-15T15:40:42.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.122+0000 7f8844ff9640 1 -- 172.21.15.12:0/4233738195 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f883c044020 con 0x7f8848148770 2024-05-15T15:40:42.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.122+0000 7f8844ff9640 1 --2- 172.21.15.12:0/4233738195 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f8834076300 0x7f8834078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:42.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.122+0000 7f8844ff9640 1 -- 172.21.15.12:0/4233738195 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f883c0b7da0 con 0x7f8848148770 2024-05-15T15:40:42.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.122+0000 7f8847fff640 1 --2- 172.21.15.12:0/4233738195 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f8834076300 0x7f8834078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:42.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.123+0000 7f8847fff640 1 --2- 172.21.15.12:0/4233738195 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f8834076300 0x7f8834078810 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f88480bef30 tx=0x7f8838009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:42.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.123+0000 7f885556d740 1 Processor -- start 2024-05-15T15:40:42.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.123+0000 7f885556d740 1 -- start start 2024-05-15T15:40:42.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.124+0000 7f885556d740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56139502c270 0x5613954051b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:42.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.124+0000 7f885556d740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5613950033b0 0x5613953c9670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:42.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.124+0000 7f885556d740 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x56139500b590 0x5613953fa2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:42.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.124+0000 7f885556d740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56139533ff10 con 0x56139502c270 2024-05-15T15:40:42.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.124+0000 7f885556d740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56139532fab0 con 0x5613950033b0 2024-05-15T15:40:42.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.124+0000 7f885556d740 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x561395333af0 con 0x56139500b590 2024-05-15T15:40:42.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.124+0000 7f8847fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56139502c270 0x5613954051b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:42.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.124+0000 7f8847fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56139502c270 0x5613954051b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43246/0 (socket says 172.21.15.12:43246) 2024-05-15T15:40:42.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.124+0000 7f88477fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5613950033b0 0x5613953c9670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:42.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.124+0000 7f8847fff640 1 -- 172.21.15.12:0/2795879726 learned_addr learned my addr 172.21.15.12:0/2795879726 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:42.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.124+0000 7f884cc53640 1 --2- 172.21.15.12:0/2795879726 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x56139500b590 0x5613953fa2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:42.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.125+0000 7f8847fff640 1 -- 172.21.15.12:0/2795879726 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x56139500b590 msgr2=0x5613953fa2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:40:42.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.125+0000 7f8847fff640 1 --2- 172.21.15.12:0/2795879726 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x56139500b590 0x5613953fa2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:42.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.125+0000 7f8847fff640 1 -- 172.21.15.12:0/2795879726 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5613950033b0 msgr2=0x5613953c9670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:40:42.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.125+0000 7f8847fff640 1 --2- 172.21.15.12:0/2795879726 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5613950033b0 0x5613953c9670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:42.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.125+0000 7f8847fff640 1 -- 172.21.15.12:0/2795879726 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613952f35d0 con 0x56139502c270 2024-05-15T15:40:42.139 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.125+0000 7f8847fff640 1 --2- 172.21.15.12:0/2795879726 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56139502c270 0x5613954051b0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f88380072a0 tx=0x7f8838012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea5d3a1ff3b4efc9 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:42.139 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.125+0000 7f882dffb640 1 -- 172.21.15.12:0/2795879726 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8838026070 con 0x56139502c270 2024-05-15T15:40:42.139 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.125+0000 7f882dffb640 1 -- 172.21.15.12:0/2795879726 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f883800f800 con 0x56139502c270 2024-05-15T15:40:42.139 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.125+0000 7f882dffb640 1 -- 172.21.15.12:0/2795879726 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f883800fbd0 con 0x56139502c270 2024-05-15T15:40:42.139 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.126+0000 7f885556d740 1 -- 172.21.15.12:0/2795879726 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56139502c270 msgr2=0x5613954051b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:42.139 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.126+0000 7f885556d740 1 --2- 172.21.15.12:0/2795879726 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56139502c270 0x5613954051b0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f88380072a0 tx=0x7f8838012000 comp rx=0 tx=0).stop 2024-05-15T15:40:42.139 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.126+0000 7f885556d740 1 -- 172.21.15.12:0/2795879726 shutdown_connections 2024-05-15T15:40:42.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.126+0000 7f885556d740 1 --2- 172.21.15.12:0/2795879726 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x56139500b590 0x5613953fa2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:42.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.126+0000 7f885556d740 1 --2- 172.21.15.12:0/2795879726 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5613950033b0 0x5613953c9670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:42.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.126+0000 7f885556d740 1 --2- 172.21.15.12:0/2795879726 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56139502c270 0x5613954051b0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:42.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.126+0000 7f885556d740 1 -- 172.21.15.12:0/2795879726 >> 172.21.15.12:0/2795879726 conn(0x5613950203c0 msgr2=0x5613954048b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:42.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.126+0000 7f885556d740 1 -- 172.21.15.12:0/2795879726 shutdown_connections 2024-05-15T15:40:42.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.126+0000 7f885556d740 1 -- 172.21.15.12:0/2795879726 wait complete. 2024-05-15T15:40:42.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.126+0000 7f885556d740 1 -- start start 2024-05-15T15:40:42.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.127+0000 7f885556d740 1 Processor -- start 2024-05-15T15:40:42.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.128+0000 7f885556d740 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x5613950033b0 0x5613953f9880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:42.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.128+0000 7f885556d740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56139500b590 0x5613953fcab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:42.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.128+0000 7f885556d740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56139502c270 0x5613953fcff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:42.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.128+0000 7f885556d740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x561395015850 con 0x56139502c270 2024-05-15T15:40:42.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.128+0000 7f885556d740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5613952ebc10 con 0x56139500b590 2024-05-15T15:40:42.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.128+0000 7f885556d740 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x5613953ca080 con 0x5613950033b0 2024-05-15T15:40:42.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.128+0000 7f885556d740 10 client.0 _ll_register_callbacks cb 0x5613952ef150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-15T15:40:42.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.128+0000 7f884cc53640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56139502c270 0x5613953fcff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:42.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.128+0000 7f884cc53640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56139502c270 0x5613953fcff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43262/0 (socket says 172.21.15.12:43262) 2024-05-15T15:40:42.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.128+0000 7f884cc53640 1 -- 172.21.15.12:0/1486441283 learned_addr learned my addr 172.21.15.12:0/1486441283 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:42.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.128+0000 7f88477fe640 1 --2- 172.21.15.12:0/1486441283 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56139500b590 0x5613953fcab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:42.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.128+0000 7f8847fff640 1 --2- 172.21.15.12:0/1486441283 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x5613950033b0 0x5613953f9880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:42.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.128+0000 7f884cc53640 1 -- 172.21.15.12:0/1486441283 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x5613950033b0 msgr2=0x5613953f9880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:40:42.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.128+0000 7f884cc53640 1 --2- 172.21.15.12:0/1486441283 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x5613950033b0 0x5613953f9880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:42.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.128+0000 7f884cc53640 1 -- 172.21.15.12:0/1486441283 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56139500b590 msgr2=0x5613953fcab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:40:42.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.128+0000 7f884cc53640 1 --2- 172.21.15.12:0/1486441283 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56139500b590 0x5613953fcab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:42.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.128+0000 7f884cc53640 1 -- 172.21.15.12:0/1486441283 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5613950442d0 con 0x56139502c270 2024-05-15T15:40:42.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.128+0000 7f88477fe640 1 --2- 172.21.15.12:0/1486441283 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56139500b590 0x5613953fcab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-15T15:40:42.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.128+0000 7f8847fff640 1 --2- 172.21.15.12:0/1486441283 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x5613950033b0 0x5613953f9880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-15T15:40:42.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.128+0000 7f884cc53640 1 --2- 172.21.15.12:0/1486441283 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56139502c270 0x5613953fcff0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f88480a0fb0 tx=0x7f8840012670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56c3994babfd9391 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:42.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.128+0000 7f8826ffd640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-05-15T15:40:42.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.128+0000 7f8826ffd640 1 -- 172.21.15.12:0/1486441283 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8840003b90 con 0x56139502c270 2024-05-15T15:40:42.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.129+0000 7f8826ffd640 1 -- 172.21.15.12:0/1486441283 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f8840003d30 con 0x56139502c270 2024-05-15T15:40:42.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.129+0000 7f885556d740 1 -- 172.21.15.12:0/1486441283 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f883800f800 con 0x56139502c270 2024-05-15T15:40:42.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.129+0000 7f8826ffd640 1 -- 172.21.15.12:0/1486441283 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7f8840027050 con 0x56139502c270 2024-05-15T15:40:42.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.129+0000 7f885556d740 10 client.4986 fetch_fsmap learned FSMap version 16 2024-05-15T15:40:42.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.129+0000 7f885556d740 1 -- 172.21.15.12:0/1486441283 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) -- 0x56139510e6b0 con 0x56139502c270 2024-05-15T15:40:42.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.129+0000 7f8826ffd640 1 -- 172.21.15.12:0/1486441283 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f883800f800 con 0x56139502c270 2024-05-15T15:40:42.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.129+0000 7f8826ffd640 1 -- 172.21.15.12:0/1486441283 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 16) ==== 2889+0+0 (secure 0 0 0) 0x7f884002a020 con 0x56139502c270 2024-05-15T15:40:42.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.129+0000 7f885556d740 10 client.4986 fetch_fsmap finished waiting for FSMap version 16 2024-05-15T15:40:42.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.129+0000 7f885556d740 10 client.4986 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-15T15:40:42.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.129+0000 7f885556d740 20 client.4986 populate_metadata read hostname 'smithi012' 2024-05-15T15:40:42.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.129+0000 7f885556d740 1 --2- 172.21.15.12:0/1486441283 >> [v2:172.21.15.12:6832/32438370,v1:172.21.15.12:6834/32438370] conn(0x561394feae40 0x5613954202d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:42.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.129+0000 7f885556d740 4 client.4986 mds_command: new command op to 4759 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-15T15:40:42.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.129+0000 7f885556d740 1 -- 172.21.15.12:0/1486441283 --> [v2:172.21.15.12:6832/32438370,v1:172.21.15.12:6834/32438370] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561395341e60 con 0x561394feae40 2024-05-15T15:40:42.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.129+0000 7f8847fff640 1 --2- 172.21.15.12:0/1486441283 >> [v2:172.21.15.12:6832/32438370,v1:172.21.15.12:6834/32438370] conn(0x561394feae40 0x5613954202d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:42.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.130+0000 7f8826ffd640 10 client.4986 ms_handle_connect on v2:172.21.15.12:6832/32438370 2024-05-15T15:40:42.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.130+0000 7f8847fff640 1 --2- 172.21.15.12:0/1486441283 >> [v2:172.21.15.12:6832/32438370,v1:172.21.15.12:6834/32438370] conn(0x561394feae40 0x5613954202d0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5dfc3527ba1c3c91 server_cookie=419f434977791802 in_seq=0 out_seq=0 2024-05-15T15:40:42.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.130+0000 7f8826ffd640 1 -- 172.21.15.12:0/1486441283 <== mds.0 v2:172.21.15.12:6832/32438370 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x561395341e60 con 0x561394feae40 2024-05-15T15:40:42.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.130+0000 7f8826ffd640 10 client.4986 handle_command_reply: tid=0 2024-05-15T15:40:42.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.130+0000 7f885556d740 1 client.4986 shutdown 2024-05-15T15:40:42.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.131+0000 7f885556d740 1 -- 172.21.15.12:0/1486441283 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56139502c270 msgr2=0x5613953fcff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:42.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.131+0000 7f885556d740 1 --2- 172.21.15.12:0/1486441283 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56139502c270 0x5613953fcff0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f88480a0fb0 tx=0x7f8840012670 comp rx=0 tx=0).stop 2024-05-15T15:40:42.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.131+0000 7f885556d740 1 -- 172.21.15.12:0/1486441283 shutdown_connections 2024-05-15T15:40:42.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.131+0000 7f885556d740 1 --2- 172.21.15.12:0/1486441283 >> [v2:172.21.15.12:6832/32438370,v1:172.21.15.12:6834/32438370] conn(0x561394feae40 0x5613954202d0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:42.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.131+0000 7f885556d740 1 --2- 172.21.15.12:0/1486441283 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56139502c270 0x5613953fcff0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:42.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.131+0000 7f885556d740 1 --2- 172.21.15.12:0/1486441283 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56139500b590 0x5613953fcab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:42.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.131+0000 7f885556d740 1 --2- 172.21.15.12:0/1486441283 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x5613950033b0 0x5613953f9880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:42.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.131+0000 7f8826ffd640 0 client.4986 ms_handle_reset on v2:172.21.15.12:6832/32438370 2024-05-15T15:40:42.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.131+0000 7f885556d740 1 -- 172.21.15.12:0/1486441283 >> 172.21.15.12:0/1486441283 conn(0x5613950203c0 msgr2=0x5613953ce660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:42.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.131+0000 7f885556d740 1 -- 172.21.15.12:0/1486441283 shutdown_connections 2024-05-15T15:40:42.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.131+0000 7f885556d740 1 -- 172.21.15.12:0/1486441283 wait complete. 2024-05-15T15:40:42.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.131+0000 7f885556d740 20 client.4986 trim_cache size 0 max 16384 2024-05-15T15:40:42.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.150+0000 7f885556d740 1 Processor -- start 2024-05-15T15:40:42.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.150+0000 7f885556d740 1 -- start start 2024-05-15T15:40:42.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.151+0000 7f885556d740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5613950033b0 0x5613953f5f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:42.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.151+0000 7f885556d740 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x56139500b590 0x5613953c7a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:42.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.151+0000 7f885556d740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56139502c270 0x5613953c7f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:42.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.151+0000 7f885556d740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f88481f1140 con 0x5613950033b0 2024-05-15T15:40:42.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.151+0000 7f885556d740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f8848071590 con 0x56139502c270 2024-05-15T15:40:42.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.151+0000 7f885556d740 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f88481f01c0 con 0x56139500b590 2024-05-15T15:40:42.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.151+0000 7f8847fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5613950033b0 0x5613953f5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:42.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.151+0000 7f8847fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5613950033b0 0x5613953f5f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43274/0 (socket says 172.21.15.12:43274) 2024-05-15T15:40:42.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.151+0000 7f8847fff640 1 -- 172.21.15.12:0/2643839571 learned_addr learned my addr 172.21.15.12:0/2643839571 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:42.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.151+0000 7f884cc53640 1 --2- 172.21.15.12:0/2643839571 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56139502c270 0x5613953c7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:42.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.151+0000 7f88477fe640 1 --2- 172.21.15.12:0/2643839571 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x56139500b590 0x5613953c7a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:42.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.151+0000 7f8847fff640 1 -- 172.21.15.12:0/2643839571 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x56139500b590 msgr2=0x5613953c7a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:40:42.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.151+0000 7f8847fff640 1 --2- 172.21.15.12:0/2643839571 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x56139500b590 0x5613953c7a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:42.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.151+0000 7f8847fff640 1 -- 172.21.15.12:0/2643839571 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56139502c270 msgr2=0x5613953c7f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:40:42.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.151+0000 7f8847fff640 1 --2- 172.21.15.12:0/2643839571 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56139502c270 0x5613953c7f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:42.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.151+0000 7f8847fff640 1 -- 172.21.15.12:0/2643839571 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613953fe090 con 0x5613950033b0 2024-05-15T15:40:42.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.151+0000 7f884cc53640 1 --2- 172.21.15.12:0/2643839571 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56139502c270 0x5613953c7f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-15T15:40:42.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.151+0000 7f88477fe640 1 --2- 172.21.15.12:0/2643839571 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x56139500b590 0x5613953c7a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-15T15:40:42.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.151+0000 7f8847fff640 1 --2- 172.21.15.12:0/2643839571 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5613950033b0 0x5613953f5f20 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f8838008fd0 tx=0x7f8838014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=565cc2f96e9767ce server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:42.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.152+0000 7f882d7fa640 1 -- 172.21.15.12:0/2643839571 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8838039070 con 0x5613950033b0 2024-05-15T15:40:42.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.152+0000 7f882d7fa640 1 -- 172.21.15.12:0/2643839571 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8838027040 con 0x5613950033b0 2024-05-15T15:40:42.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.152+0000 7f882d7fa640 1 -- 172.21.15.12:0/2643839571 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8838026040 con 0x5613950033b0 2024-05-15T15:40:42.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.152+0000 7f885556d740 1 -- 172.21.15.12:0/2643839571 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5613950033b0 msgr2=0x5613953f5f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:42.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.152+0000 7f885556d740 1 --2- 172.21.15.12:0/2643839571 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5613950033b0 0x5613953f5f20 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f8838008fd0 tx=0x7f8838014000 comp rx=0 tx=0).stop 2024-05-15T15:40:42.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.152+0000 7f885556d740 1 -- 172.21.15.12:0/2643839571 shutdown_connections 2024-05-15T15:40:42.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.152+0000 7f885556d740 1 --2- 172.21.15.12:0/2643839571 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56139502c270 0x5613953c7f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:42.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.152+0000 7f885556d740 1 --2- 172.21.15.12:0/2643839571 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x56139500b590 0x5613953c7a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:42.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.152+0000 7f885556d740 1 --2- 172.21.15.12:0/2643839571 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5613950033b0 0x5613953f5f20 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:42.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.152+0000 7f885556d740 1 -- 172.21.15.12:0/2643839571 >> 172.21.15.12:0/2643839571 conn(0x5613950203c0 msgr2=0x5613953f9690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:42.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.152+0000 7f885556d740 1 -- 172.21.15.12:0/2643839571 shutdown_connections 2024-05-15T15:40:42.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.152+0000 7f885556d740 1 -- 172.21.15.12:0/2643839571 wait complete. 2024-05-15T15:40:42.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.153+0000 7f885556d740 1 -- start start 2024-05-15T15:40:42.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.153+0000 7f885556d740 1 Processor -- start 2024-05-15T15:40:42.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.154+0000 7f885556d740 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x5613950033b0 0x56139540e420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:42.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.154+0000 7f885556d740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56139500b590 0x561395477f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:42.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.154+0000 7f885556d740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56139502c270 0x561395478490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:42.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.154+0000 7f885556d740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x561395411ab0 con 0x56139500b590 2024-05-15T15:40:42.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.155+0000 7f885556d740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5613953fe260 con 0x56139502c270 2024-05-15T15:40:42.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.155+0000 7f885556d740 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x5613952ebc10 con 0x5613950033b0 2024-05-15T15:40:42.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.155+0000 7f885556d740 10 client.0 _ll_register_callbacks cb 0x7f8840009e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-15T15:40:42.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.155+0000 7f88477fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56139500b590 0x561395477f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:42.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.155+0000 7f88477fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56139500b590 0x561395477f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43280/0 (socket says 172.21.15.12:43280) 2024-05-15T15:40:42.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.155+0000 7f88477fe640 1 -- 172.21.15.12:0/1214992312 learned_addr learned my addr 172.21.15.12:0/1214992312 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:42.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.155+0000 7f8847fff640 1 --2- 172.21.15.12:0/1214992312 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x5613950033b0 0x56139540e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:42.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.155+0000 7f884cc53640 1 --2- 172.21.15.12:0/1214992312 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56139502c270 0x561395478490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:42.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.155+0000 7f88477fe640 1 -- 172.21.15.12:0/1214992312 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x5613950033b0 msgr2=0x56139540e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:40:42.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.155+0000 7f88477fe640 1 --2- 172.21.15.12:0/1214992312 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x5613950033b0 0x56139540e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:42.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.155+0000 7f88477fe640 1 -- 172.21.15.12:0/1214992312 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56139502c270 msgr2=0x561395478490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:40:42.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.155+0000 7f88477fe640 1 --2- 172.21.15.12:0/1214992312 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56139502c270 0x561395478490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:42.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.155+0000 7f88477fe640 1 -- 172.21.15.12:0/1214992312 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56139540e960 con 0x56139500b590 2024-05-15T15:40:42.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.155+0000 7f8847fff640 1 --2- 172.21.15.12:0/1214992312 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x5613950033b0 0x56139540e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-15T15:40:42.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.155+0000 7f88477fe640 1 --2- 172.21.15.12:0/1214992312 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56139500b590 0x561395477f50 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f883c07d610 tx=0x7f883c03cfa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fb8f75ed20d80a7 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:42.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.155+0000 7f8826ffd640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-05-15T15:40:42.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.155+0000 7f8826ffd640 1 -- 172.21.15.12:0/1214992312 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f883c081020 con 0x56139500b590 2024-05-15T15:40:42.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.155+0000 7f8826ffd640 1 -- 172.21.15.12:0/1214992312 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f883c080280 con 0x56139500b590 2024-05-15T15:40:42.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.155+0000 7f885556d740 1 -- 172.21.15.12:0/1214992312 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8838027040 con 0x56139500b590 2024-05-15T15:40:42.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.155+0000 7f8826ffd640 1 -- 172.21.15.12:0/1214992312 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7f883c085320 con 0x56139500b590 2024-05-15T15:40:42.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.155+0000 7f885556d740 10 client.4992 fetch_fsmap learned FSMap version 16 2024-05-15T15:40:42.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.155+0000 7f885556d740 1 -- 172.21.15.12:0/1214992312 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) -- 0x5613953cdda0 con 0x56139500b590 2024-05-15T15:40:42.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.156+0000 7f8826ffd640 1 -- 172.21.15.12:0/1214992312 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8838027040 con 0x56139500b590 2024-05-15T15:40:42.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.156+0000 7f8826ffd640 1 -- 172.21.15.12:0/1214992312 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 16) ==== 2889+0+0 (secure 0 0 0) 0x7f883c07c990 con 0x56139500b590 2024-05-15T15:40:42.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.156+0000 7f885556d740 10 client.4992 fetch_fsmap finished waiting for FSMap version 16 2024-05-15T15:40:42.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.156+0000 7f885556d740 10 client.4992 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-15T15:40:42.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.156+0000 7f885556d740 20 client.4992 populate_metadata read hostname 'smithi012' 2024-05-15T15:40:42.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.156+0000 7f885556d740 1 --2- 172.21.15.12:0/1214992312 >> [v2:172.21.15.12:6832/32438370,v1:172.21.15.12:6834/32438370] conn(0x5613953fa190 0x5613953fa5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:42.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.156+0000 7f885556d740 4 client.4992 mds_command: new command op to 4759 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-15T15:40:42.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.156+0000 7f885556d740 1 -- 172.21.15.12:0/1214992312 --> [v2:172.21.15.12:6832/32438370,v1:172.21.15.12:6834/32438370] -- command(tid 0: {"prefix": "status"}) -- 0x561395414ea0 con 0x5613953fa190 2024-05-15T15:40:42.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.156+0000 7f8847fff640 1 --2- 172.21.15.12:0/1214992312 >> [v2:172.21.15.12:6832/32438370,v1:172.21.15.12:6834/32438370] conn(0x5613953fa190 0x5613953fa5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:42.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.156+0000 7f8826ffd640 10 client.4992 ms_handle_connect on v2:172.21.15.12:6832/32438370 2024-05-15T15:40:42.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.156+0000 7f8847fff640 1 --2- 172.21.15.12:0/1214992312 >> [v2:172.21.15.12:6832/32438370,v1:172.21.15.12:6834/32438370] conn(0x5613953fa190 0x5613953fa5a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7aac40a69ae1eb5a server_cookie=4d690b58a12ce715 in_seq=0 out_seq=0 2024-05-15T15:40:42.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.157+0000 7f8826ffd640 1 -- 172.21.15.12:0/1214992312 <== mds.0 v2:172.21.15.12:6832/32438370 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x561395414ea0 con 0x5613953fa190 2024-05-15T15:40:42.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.157+0000 7f8826ffd640 10 client.4992 handle_command_reply: tid=0 2024-05-15T15:40:42.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.157+0000 7f885556d740 1 client.4992 shutdown 2024-05-15T15:40:42.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.157+0000 7f885556d740 1 -- 172.21.15.12:0/1214992312 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56139500b590 msgr2=0x561395477f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:42.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.157+0000 7f885556d740 1 --2- 172.21.15.12:0/1214992312 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56139500b590 0x561395477f50 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f883c07d610 tx=0x7f883c03cfa0 comp rx=0 tx=0).stop 2024-05-15T15:40:42.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.157+0000 7f885556d740 1 -- 172.21.15.12:0/1214992312 shutdown_connections 2024-05-15T15:40:42.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.157+0000 7f885556d740 1 --2- 172.21.15.12:0/1214992312 >> [v2:172.21.15.12:6832/32438370,v1:172.21.15.12:6834/32438370] conn(0x5613953fa190 0x5613953fa5a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:42.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.157+0000 7f885556d740 1 --2- 172.21.15.12:0/1214992312 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56139502c270 0x561395478490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:42.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.157+0000 7f885556d740 1 --2- 172.21.15.12:0/1214992312 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56139500b590 0x561395477f50 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:42.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.157+0000 7f885556d740 1 --2- 172.21.15.12:0/1214992312 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x5613950033b0 0x56139540e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:42.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.157+0000 7f885556d740 1 -- 172.21.15.12:0/1214992312 >> 172.21.15.12:0/1214992312 conn(0x5613950203c0 msgr2=0x5613953f93e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:42.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.157+0000 7f8826ffd640 0 client.4992 ms_handle_reset on v2:172.21.15.12:6832/32438370 2024-05-15T15:40:42.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.157+0000 7f885556d740 1 -- 172.21.15.12:0/1214992312 shutdown_connections 2024-05-15T15:40:42.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.157+0000 7f885556d740 1 -- 172.21.15.12:0/1214992312 wait complete. 2024-05-15T15:40:42.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.157+0000 7f885556d740 20 client.4992 trim_cache size 0 max 16384 2024-05-15T15:40:42.168 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-05-15T15:40:42.168 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_fsid": "3b7fc4b2-b85c-49b5-a5de-38444eeed40d", 2024-05-15T15:40:42.168 INFO:teuthology.orchestra.run.smithi012.stdout: "whoami": 0, 2024-05-15T15:40:42.168 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 4759, 2024-05-15T15:40:42.168 INFO:teuthology.orchestra.run.smithi012.stdout: "want_state": "up:active", 2024-05-15T15:40:42.168 INFO:teuthology.orchestra.run.smithi012.stdout: "state": "up:active", 2024-05-15T15:40:42.168 INFO:teuthology.orchestra.run.smithi012.stdout: "fs_name": "cephfs", 2024-05-15T15:40:42.169 INFO:teuthology.orchestra.run.smithi012.stdout: "rank_uptime": 10.313279415, 2024-05-15T15:40:42.169 INFO:teuthology.orchestra.run.smithi012.stdout: "mdsmap_epoch": 16, 2024-05-15T15:40:42.169 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch": 33, 2024-05-15T15:40:42.169 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch_barrier": 33, 2024-05-15T15:40:42.169 INFO:teuthology.orchestra.run.smithi012.stdout: "uptime": 17.168603564000001 2024-05-15T15:40:42.169 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-05-15T15:40:42.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.157+0000 7f884e6b6640 1 -- 172.21.15.12:0/4233738195 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f8834076300 msgr2=0x7f8834078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:42.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.157+0000 7f884e6b6640 1 --2- 172.21.15.12:0/4233738195 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f8834076300 0x7f8834078810 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f88480bef30 tx=0x7f8838009040 comp rx=0 tx=0).stop 2024-05-15T15:40:42.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.157+0000 7f884e6b6640 1 -- 172.21.15.12:0/4233738195 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8848148770 msgr2=0x7f884813d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:42.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.157+0000 7f884e6b6640 1 --2- 172.21.15.12:0/4233738195 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8848148770 0x7f884813d9c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f883c02a340 tx=0x7f883c0046c0 comp rx=0 tx=0).stop 2024-05-15T15:40:42.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.158+0000 7f884e6b6640 1 -- 172.21.15.12:0/4233738195 shutdown_connections 2024-05-15T15:40:42.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.158+0000 7f884e6b6640 1 --2- 172.21.15.12:0/4233738195 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f884814e360 0x7f884813df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:42.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.158+0000 7f884e6b6640 1 --2- 172.21.15.12:0/4233738195 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f8834076300 0x7f8834078810 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:42.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.158+0000 7f884e6b6640 1 --2- 172.21.15.12:0/4233738195 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8848148770 0x7f884813d9c0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:42.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.158+0000 7f884e6b6640 1 --2- 172.21.15.12:0/4233738195 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f88480bf9b0 0x7f884806ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:42.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.158+0000 7f884e6b6640 1 -- 172.21.15.12:0/4233738195 >> 172.21.15.12:0/4233738195 conn(0x7f88480c17c0 msgr2=0x7f88481406f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:42.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.158+0000 7f884e6b6640 1 -- 172.21.15.12:0/4233738195 shutdown_connections 2024-05-15T15:40:42.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.158+0000 7f884e6b6640 1 -- 172.21.15.12:0/4233738195 wait complete. 2024-05-15T15:40:42.172 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-15T15:40:42.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.281+0000 7f55e6538640 1 Processor -- start 2024-05-15T15:40:42.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.281+0000 7f55e6538640 1 -- start start 2024-05-15T15:40:42.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.282+0000 7f55e6538640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f55e0151fc0 0x7f55e00bd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:42.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.282+0000 7f55e6538640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55e00c36f0 con 0x7f55e006da30 2024-05-15T15:40:42.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.282+0000 7f55e6538640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55e0152530 con 0x7f55e00bf050 2024-05-15T15:40:42.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.282+0000 7f55e6538640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f55e00bdc10 con 0x7f55e0151fc0 2024-05-15T15:40:42.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.283+0000 7f55df7fe640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f55e006da30 0x7f55e00be940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:40114/0 (socket says 172.21.15.12:40114) 2024-05-15T15:40:42.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.283+0000 7f55df7fe640 1 -- 172.21.15.12:0/1297288256 learned_addr learned my addr 172.21.15.12:0/1297288256 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-05-15T15:40:42.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.283+0000 7f55dffff640 1 --2- 172.21.15.12:0/1297288256 >> v2:172.21.15.84:3300/0 conn(0x7f55e0151fc0 0x7f55e00bd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:42.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.283+0000 7f55deffd640 1 -- 172.21.15.12:0/1297288256 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2983109668 0 0) 0x7f55e00c36f0 con 0x7f55e006da30 2024-05-15T15:40:42.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.283+0000 7f55deffd640 1 -- 172.21.15.12:0/1297288256 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f55c8003520 con 0x7f55e006da30 2024-05-15T15:40:42.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.283+0000 7f55dffff640 1 -- 172.21.15.12:0/1297288256 >> v1:172.21.15.84:6789/0 conn(0x7f55e00bf050 legacy=0x7f55e0158e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:42.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.283+0000 7f55dffff640 1 -- 172.21.15.12:0/1297288256 >> v1:172.21.15.12:6789/0 conn(0x7f55e006da30 legacy=0x7f55e00be940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:42.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.283+0000 7f55dffff640 1 -- 172.21.15.12:0/1297288256 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55e0152810 con 0x7f55e0151fc0 2024-05-15T15:40:42.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.284+0000 7f55dffff640 1 --2- 172.21.15.12:0/1297288256 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55e0151fc0 0x7f55e00bd6d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f55d00097a0 tx=0x7f55d002a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=610488335d032380 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:42.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.284+0000 7f55deffd640 1 -- 172.21.15.12:0/1297288256 <== mon.1 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55d0037070 con 0x7f55e0151fc0 2024-05-15T15:40:42.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.284+0000 7f55deffd640 1 -- 172.21.15.12:0/1297288256 <== mon.1 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55d0032440 con 0x7f55e0151fc0 2024-05-15T15:40:42.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.284+0000 7f55deffd640 1 -- 172.21.15.12:0/1297288256 <== mon.1 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55d00327f0 con 0x7f55e0151fc0 2024-05-15T15:40:42.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.285+0000 7f55e6538640 1 -- 172.21.15.12:0/1297288256 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55e0151fc0 msgr2=0x7f55e00bd6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:42.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.285+0000 7f55e6538640 1 --2- 172.21.15.12:0/1297288256 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55e0151fc0 0x7f55e00bd6d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f55d00097a0 tx=0x7f55d002a230 comp rx=0 tx=0).stop 2024-05-15T15:40:42.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.285+0000 7f55e6538640 1 -- 172.21.15.12:0/1297288256 shutdown_connections 2024-05-15T15:40:42.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.285+0000 7f55e6538640 1 --2- 172.21.15.12:0/1297288256 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55e0151fc0 0x7f55e00bd6d0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:42.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.285+0000 7f55e6538640 1 -- 172.21.15.12:0/1297288256 >> 172.21.15.12:0/1297288256 conn(0x7f55e00c3d20 msgr2=0x7f55e00c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:42.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.285+0000 7f55e6538640 1 -- 172.21.15.12:0/1297288256 shutdown_connections 2024-05-15T15:40:42.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.285+0000 7f55e6538640 1 -- 172.21.15.12:0/1297288256 wait complete. 2024-05-15T15:40:42.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.286+0000 7f55e6538640 1 Processor -- start 2024-05-15T15:40:42.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.286+0000 7f55e6538640 1 -- start start 2024-05-15T15:40:42.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.287+0000 7f55e6538640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55e006da30 0x7f55e00b99f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:42.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.287+0000 7f55e6538640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f55e00bf050 0x7f55e00b8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:42.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.287+0000 7f55e6538640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55e0151fc0 0x7f55e014e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:42.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.287+0000 7f55e6538640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f55e00a3050 con 0x7f55e0151fc0 2024-05-15T15:40:42.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.287+0000 7f55e6538640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f55e00a2ed0 con 0x7f55e006da30 2024-05-15T15:40:42.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.287+0000 7f55e6538640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f55e006de40 con 0x7f55e00bf050 2024-05-15T15:40:42.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.288+0000 7f55e4ad5640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55e0151fc0 0x7f55e014e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:42.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.288+0000 7f55e4ad5640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55e0151fc0 0x7f55e014e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43294/0 (socket says 172.21.15.12:43294) 2024-05-15T15:40:42.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.288+0000 7f55e4ad5640 1 -- 172.21.15.12:0/2407502725 learned_addr learned my addr 172.21.15.12:0/2407502725 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:40:42.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.288+0000 7f55dffff640 1 --2- 172.21.15.12:0/2407502725 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55e006da30 0x7f55e00b99f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:42.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.288+0000 7f55df7fe640 1 --2- 172.21.15.12:0/2407502725 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f55e00bf050 0x7f55e00b8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:42.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.288+0000 7f55e4ad5640 1 -- 172.21.15.12:0/2407502725 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f55e00bf050 msgr2=0x7f55e00b8bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:42.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.288+0000 7f55e4ad5640 1 --2- 172.21.15.12:0/2407502725 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f55e00bf050 0x7f55e00b8bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:42.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.288+0000 7f55e4ad5640 1 -- 172.21.15.12:0/2407502725 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55e006da30 msgr2=0x7f55e00b99f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:42.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.288+0000 7f55e4ad5640 1 --2- 172.21.15.12:0/2407502725 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55e006da30 0x7f55e00b99f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:42.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.288+0000 7f55e4ad5640 1 -- 172.21.15.12:0/2407502725 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55e014f3b0 con 0x7f55e0151fc0 2024-05-15T15:40:42.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.288+0000 7f55e4ad5640 1 --2- 172.21.15.12:0/2407502725 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55e0151fc0 0x7f55e014e4e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f55d800c700 tx=0x7f55d800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:42.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.288+0000 7f55dcff9640 1 -- 172.21.15.12:0/2407502725 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55d8003b70 con 0x7f55e0151fc0 2024-05-15T15:40:42.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.288+0000 7f55dcff9640 1 -- 172.21.15.12:0/2407502725 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55d8003d10 con 0x7f55e0151fc0 2024-05-15T15:40:42.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.288+0000 7f55e6538640 1 -- 172.21.15.12:0/2407502725 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55e00b9130 con 0x7f55e0151fc0 2024-05-15T15:40:42.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.288+0000 7f55dcff9640 1 -- 172.21.15.12:0/2407502725 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55d800aa10 con 0x7f55e0151fc0 2024-05-15T15:40:42.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.288+0000 7f55e6538640 1 -- 172.21.15.12:0/2407502725 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55e00b7680 con 0x7f55e0151fc0 2024-05-15T15:40:42.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.289+0000 7f55e6538640 1 -- 172.21.15.12:0/2407502725 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55e0050940 con 0x7f55e0151fc0 2024-05-15T15:40:42.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.290+0000 7f55dcff9640 1 -- 172.21.15.12:0/2407502725 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f55d800abb0 con 0x7f55e0151fc0 2024-05-15T15:40:42.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.290+0000 7f55dcff9640 1 --2- 172.21.15.12:0/2407502725 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f55cc076300 0x7f55cc078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:40:42.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.290+0000 7f55dcff9640 1 -- 172.21.15.12:0/2407502725 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f55d8097470 con 0x7f55e0151fc0 2024-05-15T15:40:42.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.290+0000 7f55dffff640 1 --2- 172.21.15.12:0/2407502725 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f55cc076300 0x7f55cc078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:40:42.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.291+0000 7f55dffff640 1 --2- 172.21.15.12:0/2407502725 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f55cc076300 0x7f55cc078810 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f55d0034000 tx=0x7f55d002e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:40:42.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.295+0000 7f55dcff9640 1 -- 172.21.15.12:0/2407502725 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f55d8060dc0 con 0x7f55e0151fc0 2024-05-15T15:40:42.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.528+0000 7f55e6538640 1 -- 172.21.15.12:0/2407502725 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f55e006eb40 con 0x7f55e0151fc0 2024-05-15T15:40:42.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.529+0000 7f55dcff9640 1 -- 172.21.15.12:0/2407502725 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) ==== 53+0+73 (secure 0 0 0) 0x7f55d80606c0 con 0x7f55e0151fc0 2024-05-15T15:40:42.531 INFO:teuthology.orchestra.run.smithi012.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-15T15:40:42.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.531+0000 7f55e6538640 1 -- 172.21.15.12:0/2407502725 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f55cc076300 msgr2=0x7f55cc078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:42.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.531+0000 7f55e6538640 1 --2- 172.21.15.12:0/2407502725 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f55cc076300 0x7f55cc078810 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f55d0034000 tx=0x7f55d002e000 comp rx=0 tx=0).stop 2024-05-15T15:40:42.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.531+0000 7f55e6538640 1 -- 172.21.15.12:0/2407502725 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55e0151fc0 msgr2=0x7f55e014e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:40:42.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.531+0000 7f55e6538640 1 --2- 172.21.15.12:0/2407502725 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55e0151fc0 0x7f55e014e4e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f55d800c700 tx=0x7f55d800cbc0 comp rx=0 tx=0).stop 2024-05-15T15:40:42.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.531+0000 7f55e6538640 1 -- 172.21.15.12:0/2407502725 shutdown_connections 2024-05-15T15:40:42.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.531+0000 7f55e6538640 1 --2- 172.21.15.12:0/2407502725 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f55cc076300 0x7f55cc078810 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:42.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.531+0000 7f55e6538640 1 --2- 172.21.15.12:0/2407502725 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55e0151fc0 0x7f55e014e4e0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:42.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.531+0000 7f55e6538640 1 --2- 172.21.15.12:0/2407502725 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f55e00bf050 0x7f55e00b8bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:42.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.531+0000 7f55e6538640 1 --2- 172.21.15.12:0/2407502725 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55e006da30 0x7f55e00b99f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:40:42.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.531+0000 7f55e6538640 1 -- 172.21.15.12:0/2407502725 >> 172.21.15.12:0/2407502725 conn(0x7f55e00c3d20 msgr2=0x7f55e00c09d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:40:42.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.531+0000 7f55e6538640 1 -- 172.21.15.12:0/2407502725 shutdown_connections 2024-05-15T15:40:42.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:40:42.531+0000 7f55e6538640 1 -- 172.21.15.12:0/2407502725 wait complete. 2024-05-15T15:40:42.544 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-05-15T15:40:42.544 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-15T15:40:42.545 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi104.front.sepia.ceph.com 2024-05-15T15:40:42.545 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-15T15:40:42.545 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-15T15:40:42.545 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-05-15T15:40:42.545 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-05-15T15:40:42.545 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-15T15:40:42.545 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-15T15:40:42.545 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-15T15:40:42.545 DEBUG:teuthology.orchestra.run.smithi104:> ip addr 2024-05-15T15:40:42.603 INFO:teuthology.orchestra.run.smithi104.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-15T15:40:42.603 INFO:teuthology.orchestra.run.smithi104.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-15T15:40:42.603 INFO:teuthology.orchestra.run.smithi104.stdout: inet 127.0.0.1/8 scope host lo 2024-05-15T15:40:42.603 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-05-15T15:40:42.603 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 ::1/128 scope host 2024-05-15T15:40:42.603 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-05-15T15:40:42.603 INFO:teuthology.orchestra.run.smithi104.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-15T15:40:42.604 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 0c:c4:7a:d8:a1:1c brd ff:ff:ff:ff:ff:ff 2024-05-15T15:40:42.604 INFO:teuthology.orchestra.run.smithi104.stdout: altname enp7s0f0 2024-05-15T15:40:42.604 INFO:teuthology.orchestra.run.smithi104.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-15T15:40:42.604 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 0c:c4:7a:d8:a1:1d brd ff:ff:ff:ff:ff:ff 2024-05-15T15:40:42.604 INFO:teuthology.orchestra.run.smithi104.stdout: altname enp7s0f1 2024-05-15T15:40:42.604 INFO:teuthology.orchestra.run.smithi104.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-15T15:40:42.604 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 0c:c4:7a:8f:ce:88 brd ff:ff:ff:ff:ff:ff 2024-05-15T15:40:42.605 INFO:teuthology.orchestra.run.smithi104.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-15T15:40:42.605 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 0c:c4:7a:8f:ce:89 brd ff:ff:ff:ff:ff:ff 2024-05-15T15:40:42.605 INFO:teuthology.orchestra.run.smithi104.stdout: inet 172.21.15.104/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-05-15T15:40:42.605 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft 42595sec preferred_lft 42595sec 2024-05-15T15:40:42.605 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 fe80::ec4:7aff:fe8f:ce89/64 scope link 2024-05-15T15:40:42.605 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-05-15T15:40:42.605 INFO:teuthology.orchestra.run.smithi104.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-15T15:40:42.605 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 0a:bd:75:89:b8:c6 brd ff:ff:ff:ff:ff:ff 2024-05-15T15:40:42.605 INFO:teuthology.orchestra.run.smithi104.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-15T15:40:42.605 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-05-15T15:40:42.605 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 fe80::ccd5:12ff:fef0:546d/64 scope link 2024-05-15T15:40:42.605 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-05-15T15:40:42.605 INFO:teuthology.orchestra.run.smithi104.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-15T15:40:42.606 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 0a:bd:75:89:b8:c6 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-15T15:40:42.606 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 fe80::8bd:75ff:fe89:b8c6/64 scope link 2024-05-15T15:40:42.606 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-05-15T15:40:42.607 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-15T15:40:42.607 DEBUG:teuthology.orchestra.run.smithi104:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-15T15:40:42.689 INFO:teuthology.orchestra.run.smithi104.stdout:1 2024-05-15T15:40:42.693 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-15T15:40:42.693 DEBUG:teuthology.orchestra.run.smithi104:> route 2024-05-15T15:40:42.744 INFO:teuthology.orchestra.run.smithi104.stdout:Kernel IP routing table 2024-05-15T15:40:42.744 INFO:teuthology.orchestra.run.smithi104.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-15T15:40:42.744 INFO:teuthology.orchestra.run.smithi104.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-15T15:40:42.744 INFO:teuthology.orchestra.run.smithi104.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-15T15:40:42.744 INFO:teuthology.orchestra.run.smithi104.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-15T15:40:42.745 DEBUG:teuthology.orchestra.run.smithi104:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-15T15:40:42.745 DEBUG:teuthology.orchestra.run.smithi104:> set -e 2024-05-15T15:40:42.745 DEBUG:teuthology.orchestra.run.smithi104:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-15T15:40:42.745 DEBUG:teuthology.orchestra.run.smithi104:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-15T15:40:42.745 DEBUG:teuthology.orchestra.run.smithi104:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-15T15:40:42.745 DEBUG:teuthology.orchestra.run.smithi104:> ') 2024-05-15T15:40:42.852 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-15T15:40:42 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-15T15:40:42.948 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-15T15:40:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-15T15:40:42.960 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-15T15:40:42.960 DEBUG:teuthology.orchestra.run.smithi104:> ip netns list 2024-05-15T15:40:43.010 INFO:teuthology.orchestra.run.smithi104.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-15T15:40:43.010 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-15T15:40:43.010 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-15T15:40:43.011 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip link set brx.0 up 2024-05-15T15:40:43.137 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-15T15:40:43.137 DEBUG:teuthology.orchestra.run.smithi104:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-15T15:40:43.190 INFO:teuthology.orchestra.run.smithi104.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-15T15:40:43.190 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-15T15:40:43.190 DEBUG:teuthology.orchestra.run.smithi104:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-15T15:40:43.243 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-05-15T15:40:43.243 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-15T15:40:43.243 DEBUG:teuthology.orchestra.run.smithi104:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-15T15:40:43.444 INFO:teuthology.orchestra.run.smithi104.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-15T15:40:43.444 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-15T15:40:43.444 INFO:teuthology.orchestra.run.smithi104.stdout:invalid new device string format 2024-05-15T15:40:43.470 INFO:teuthology.orchestra.run.smithi104.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-15T15:40:43.471 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-15T15:40:43.471 INFO:teuthology.orchestra.run.smithi104.stdout:invalid new device string format 2024-05-15T15:40:43.471 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: resolved to: "172.21.15.12:3300,172.21.15.84:3300,172.21.15.84:3301" 2024-05-15T15:40:43.471 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-15T15:40:43.506 INFO:teuthology.orchestra.run.smithi104.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-15T15:40:43.506 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-15T15:40:43.506 INFO:teuthology.orchestra.run.smithi104.stdout:invalid new device string format 2024-05-15T15:40:43.506 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: resolved to: "172.21.15.12:3300,172.21.15.84:3300,172.21.15.84:3301" 2024-05-15T15:40:43.506 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-15T15:40:43.506 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: resolved to: "172.21.15.12:6789,172.21.15.84:6789,172.21.15.84:6790" 2024-05-15T15:40:43.506 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.12:6789,172.21.15.84:6789,172.21.15.84:6790:/ 2024-05-15T15:40:43.506 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=3b7fc4b2-b85c-49b5-a5de-38444eeed40d" will pass to kernel 2024-05-15T15:40:43.508 INFO:teuthology.orchestra.run.smithi104.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-05-15T15:40:43.508 INFO:teuthology.orchestra.run.smithi104.stdout: You just mounted a file system that supports labels which does not 2024-05-15T15:40:43.508 INFO:teuthology.orchestra.run.smithi104.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-15T15:40:43.508 INFO:teuthology.orchestra.run.smithi104.stdout: applications will generate AVC messages and not be allowed access to 2024-05-15T15:40:43.508 INFO:teuthology.orchestra.run.smithi104.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-15T15:40:43.511 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-15T15:40:43.512 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-15T15:40:43.512 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-15T15:40:43.579 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-15T15:40:43.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-15T15:40:43 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-15T15:40:43.685 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-15T15:40:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-15T15:40:43.694 INFO:teuthology.orchestra.run.smithi104.stdout:client4915 2024-05-15T15:40:43.695 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-05-15T15:40:43.695 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-15T15:40:43.739 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'sudo fscrypt setup --quiet') 2024-05-15T15:40:43.884 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-15T15:40:43 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-15T15:40:47.196 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-15T15:40:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-15T15:40:47.204 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'sudo fscrypt status') 2024-05-15T15:40:47.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-15T15:40:47 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-15T15:40:47.332 INFO:teuthology.orchestra.run.smithi104.stdout:filesystems supporting encryption: 0 2024-05-15T15:40:47.332 INFO:teuthology.orchestra.run.smithi104.stdout:filesystems with fscrypt metadata: 1 2024-05-15T15:40:47.332 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-15T15:40:47.332 INFO:teuthology.orchestra.run.smithi104.stdout:MOUNTPOINT DEVICE FILESYSTEM ENCRYPTION FSCRYPT 2024-05-15T15:40:47.332 INFO:teuthology.orchestra.run.smithi104.stdout:/ /dev/sda1 ext4 not enabled Yes 2024-05-15T15:40:47.333 INFO:teuthology.orchestra.run.smithi104.stdout:/var/lib/ceph /dev/dm-4 xfs not supported No 2024-05-15T15:40:47.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-15T15:40:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-15T15:40:47.344 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'sudo fscrypt setup --quiet /home/ubuntu/cephtest/mnt.0') 2024-05-15T15:40:47.433 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-15T15:40:47 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-15T15:40:47.499 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-15T15:40:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-15T15:40:47.509 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'sudo fscrypt status') 2024-05-15T15:40:47.606 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-15T15:40:47 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-15T15:40:47.644 INFO:teuthology.orchestra.run.smithi104.stdout:filesystems supporting encryption: 1 2024-05-15T15:40:47.645 INFO:teuthology.orchestra.run.smithi104.stdout:filesystems with fscrypt metadata: 2 2024-05-15T15:40:47.645 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-15T15:40:47.645 INFO:teuthology.orchestra.run.smithi104.stdout:MOUNTPOINT DEVICE FILESYSTEM ENCRYPTION FSCRYPT 2024-05-15T15:40:47.645 INFO:teuthology.orchestra.run.smithi104.stdout:/ /dev/sda1 ext4 not enabled Yes 2024-05-15T15:40:47.645 INFO:teuthology.orchestra.run.smithi104.stdout:/home/ubuntu/cephtest/mnt.0 ceph supported Yes 2024-05-15T15:40:47.645 INFO:teuthology.orchestra.run.smithi104.stdout:/var/lib/ceph /dev/dm-4 xfs not supported No 2024-05-15T15:40:47.648 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-15T15:40:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-15T15:40:47.657 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'sudo dd if=/dev/urandom of=/tmp/key bs=32 count=1') 2024-05-15T15:40:47.747 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-15T15:40:47 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-15T15:40:47.775 INFO:teuthology.orchestra.run.smithi104.stderr:1+0 records in 2024-05-15T15:40:47.775 INFO:teuthology.orchestra.run.smithi104.stderr:1+0 records out 2024-05-15T15:40:47.775 INFO:teuthology.orchestra.run.smithi104.stderr:32 bytes copied, 0.000127264 s, 251 kB/s 2024-05-15T15:40:47.778 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-15T15:40:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-15T15:40:47.787 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'mkdir -p dir/') 2024-05-15T15:40:47.882 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-15T15:40:47 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-15T15:40:47.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-15T15:40:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-15T15:40:47.896 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'sudo fscrypt encrypt --quiet --source=raw_key --name=BMiKjhiU --no-recovery --skip-unlock --key=/tmp/key dir/') 2024-05-15T15:40:48.000 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-15T15:40:47 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-15T15:40:48.079 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-15T15:40:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-15T15:40:48.089 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'sudo fscrypt unlock --quiet --key=/tmp/key dir/') 2024-05-15T15:40:48.188 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-15T15:40:48 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-15T15:40:48.238 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-15T15:40:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-15T15:40:48.247 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'cp -av /usr/bin dir/') 2024-05-15T15:40:48.329 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-15T15:40:48 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-15T15:40:48.832 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin' -> 'dir/bin' 2024-05-15T15:40:48.832 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/podman' -> 'dir/bin/podman' 2024-05-15T15:40:48.832 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/k5srvutil' -> 'dir/bin/k5srvutil' 2024-05-15T15:40:48.832 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/kadmin' -> 'dir/bin/kadmin' 2024-05-15T15:40:48.832 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/kdestroy' -> 'dir/bin/kdestroy' 2024-05-15T15:40:48.833 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/kinit' -> 'dir/bin/kinit' 2024-05-15T15:40:48.833 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/klist' -> 'dir/bin/klist' 2024-05-15T15:40:48.833 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/kpasswd' -> 'dir/bin/kpasswd' 2024-05-15T15:40:48.833 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ksu' -> 'dir/bin/ksu' 2024-05-15T15:40:48.833 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/kswitch' -> 'dir/bin/kswitch' 2024-05-15T15:40:48.833 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ktutil' -> 'dir/bin/ktutil' 2024-05-15T15:40:48.833 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/kvno' -> 'dir/bin/kvno' 2024-05-15T15:40:48.833 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/chage' -> 'dir/bin/chage' 2024-05-15T15:40:48.833 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/gencat' -> 'dir/bin/gencat' 2024-05-15T15:40:48.833 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/getconf' -> 'dir/bin/getconf' 2024-05-15T15:40:48.833 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/getent' -> 'dir/bin/getent' 2024-05-15T15:40:48.833 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/iconv' -> 'dir/bin/iconv' 2024-05-15T15:40:48.833 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ld.so' -> 'dir/bin/ld.so' 2024-05-15T15:40:48.834 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ldd' -> 'dir/bin/ldd' 2024-05-15T15:40:48.834 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/locale' -> 'dir/bin/locale' 2024-05-15T15:40:48.834 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/localedef' -> 'dir/bin/localedef' 2024-05-15T15:40:48.834 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/pldd' -> 'dir/bin/pldd' 2024-05-15T15:40:48.834 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/sotruss' -> 'dir/bin/sotruss' 2024-05-15T15:40:48.834 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/sprof' -> 'dir/bin/sprof' 2024-05-15T15:40:48.834 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/tzselect' -> 'dir/bin/tzselect' 2024-05-15T15:40:48.834 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/zdump' -> 'dir/bin/zdump' 2024-05-15T15:40:48.834 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/alias' -> 'dir/bin/alias' 2024-05-15T15:40:48.834 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/bash' -> 'dir/bin/bash' 2024-05-15T15:40:48.834 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/bashbug-64' -> 'dir/bin/bashbug-64' 2024-05-15T15:40:48.834 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/bg' -> 'dir/bin/bg' 2024-05-15T15:40:48.834 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/cd' -> 'dir/bin/cd' 2024-05-15T15:40:48.835 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/command' -> 'dir/bin/command' 2024-05-15T15:40:48.835 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/fc' -> 'dir/bin/fc' 2024-05-15T15:40:48.835 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/fg' -> 'dir/bin/fg' 2024-05-15T15:40:48.835 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/getopts' -> 'dir/bin/getopts' 2024-05-15T15:40:48.835 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/hash' -> 'dir/bin/hash' 2024-05-15T15:40:48.835 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/jobs' -> 'dir/bin/jobs' 2024-05-15T15:40:48.835 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/read' -> 'dir/bin/read' 2024-05-15T15:40:48.835 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/sh' -> 'dir/bin/sh' 2024-05-15T15:40:48.835 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/type' -> 'dir/bin/type' 2024-05-15T15:40:48.835 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ulimit' -> 'dir/bin/ulimit' 2024-05-15T15:40:48.835 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/umask' -> 'dir/bin/umask' 2024-05-15T15:40:48.835 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/unalias' -> 'dir/bin/unalias' 2024-05-15T15:40:48.835 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/wait' -> 'dir/bin/wait' 2024-05-15T15:40:48.836 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/catchsegv' -> 'dir/bin/catchsegv' 2024-05-15T15:40:48.836 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/xmllint' -> 'dir/bin/xmllint' 2024-05-15T15:40:48.836 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/xmlcatalog' -> 'dir/bin/xmlcatalog' 2024-05-15T15:40:48.836 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/which' -> 'dir/bin/which' 2024-05-15T15:40:48.836 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/gpg-error' -> 'dir/bin/gpg-error' 2024-05-15T15:40:48.836 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/sed' -> 'dir/bin/sed' 2024-05-15T15:40:48.836 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/xargs' -> 'dir/bin/xargs' 2024-05-15T15:40:48.836 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/gpasswd' -> 'dir/bin/gpasswd' 2024-05-15T15:40:48.836 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/lastlog' -> 'dir/bin/lastlog' 2024-05-15T15:40:48.836 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/newgidmap' -> 'dir/bin/newgidmap' 2024-05-15T15:40:48.836 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/newgrp' -> 'dir/bin/newgrp' 2024-05-15T15:40:48.836 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/newuidmap' -> 'dir/bin/newuidmap' 2024-05-15T15:40:48.836 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/sg' -> 'dir/bin/sg' 2024-05-15T15:40:48.836 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/busctl' -> 'dir/bin/busctl' 2024-05-15T15:40:48.837 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/file' -> 'dir/bin/file' 2024-05-15T15:40:48.837 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/xmlwf' -> 'dir/bin/xmlwf' 2024-05-15T15:40:48.837 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/gmake' -> 'dir/bin/gmake' 2024-05-15T15:40:48.837 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/eqn' -> 'dir/bin/eqn' 2024-05-15T15:40:48.837 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/geqn' -> 'dir/bin/geqn' 2024-05-15T15:40:48.837 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/gneqn' -> 'dir/bin/gneqn' 2024-05-15T15:40:48.837 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/gnroff' -> 'dir/bin/gnroff' 2024-05-15T15:40:48.837 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/gpic' -> 'dir/bin/gpic' 2024-05-15T15:40:48.837 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/groff' -> 'dir/bin/groff' 2024-05-15T15:40:48.837 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/grops' -> 'dir/bin/grops' 2024-05-15T15:40:48.837 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/grotty' -> 'dir/bin/grotty' 2024-05-15T15:40:48.837 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/gsoelim' -> 'dir/bin/gsoelim' 2024-05-15T15:40:48.837 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/gtbl' -> 'dir/bin/gtbl' 2024-05-15T15:40:48.837 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/gtroff' -> 'dir/bin/gtroff' 2024-05-15T15:40:48.838 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/neqn' -> 'dir/bin/neqn' 2024-05-15T15:40:48.838 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/nroff' -> 'dir/bin/nroff' 2024-05-15T15:40:48.838 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/pic' -> 'dir/bin/pic' 2024-05-15T15:40:48.838 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/post-grohtml' -> 'dir/bin/post-grohtml' 2024-05-15T15:40:48.838 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/pre-grohtml' -> 'dir/bin/pre-grohtml' 2024-05-15T15:40:48.838 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/preconv' -> 'dir/bin/preconv' 2024-05-15T15:40:48.838 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/soelim.groff' -> 'dir/bin/soelim.groff' 2024-05-15T15:40:48.838 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/tbl' -> 'dir/bin/tbl' 2024-05-15T15:40:48.838 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/troff' -> 'dir/bin/troff' 2024-05-15T15:40:48.838 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/zsoelim' -> 'dir/bin/zsoelim' 2024-05-15T15:40:48.838 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/soelim' -> 'dir/bin/soelim' 2024-05-15T15:40:48.838 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/cpio' -> 'dir/bin/cpio' 2024-05-15T15:40:48.838 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/awk' -> 'dir/bin/awk' 2024-05-15T15:40:48.839 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/gawk' -> 'dir/bin/gawk' 2024-05-15T15:40:48.839 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/make' -> 'dir/bin/make' 2024-05-15T15:40:48.839 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/zip' -> 'dir/bin/zip' 2024-05-15T15:40:48.839 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/egrep' -> 'dir/bin/egrep' 2024-05-15T15:40:48.839 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/fgrep' -> 'dir/bin/fgrep' 2024-05-15T15:40:48.839 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/grep' -> 'dir/bin/grep' 2024-05-15T15:40:48.839 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/arch' -> 'dir/bin/arch' 2024-05-15T15:40:48.839 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/b2sum' -> 'dir/bin/b2sum' 2024-05-15T15:40:48.839 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/base32' -> 'dir/bin/base32' 2024-05-15T15:40:48.839 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/base64' -> 'dir/bin/base64' 2024-05-15T15:40:48.839 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/basename' -> 'dir/bin/basename' 2024-05-15T15:40:48.839 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/basenc' -> 'dir/bin/basenc' 2024-05-15T15:40:48.839 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/cat' -> 'dir/bin/cat' 2024-05-15T15:40:48.839 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/chcon' -> 'dir/bin/chcon' 2024-05-15T15:40:48.840 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/chgrp' -> 'dir/bin/chgrp' 2024-05-15T15:40:48.840 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/chmod' -> 'dir/bin/chmod' 2024-05-15T15:40:48.840 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/chown' -> 'dir/bin/chown' 2024-05-15T15:40:48.840 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/cksum' -> 'dir/bin/cksum' 2024-05-15T15:40:48.840 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/comm' -> 'dir/bin/comm' 2024-05-15T15:40:48.840 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/cp' -> 'dir/bin/cp' 2024-05-15T15:40:48.840 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/csplit' -> 'dir/bin/csplit' 2024-05-15T15:40:48.840 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/cut' -> 'dir/bin/cut' 2024-05-15T15:40:48.841 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/date' -> 'dir/bin/date' 2024-05-15T15:40:48.841 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/dd' -> 'dir/bin/dd' 2024-05-15T15:40:48.841 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/df' -> 'dir/bin/df' 2024-05-15T15:40:48.841 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/dir' -> 'dir/bin/dir' 2024-05-15T15:40:49.158 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/dircolors' -> 'dir/bin/dircolors' 2024-05-15T15:40:49.159 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/dirname' -> 'dir/bin/dirname' 2024-05-15T15:40:49.159 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/du' -> 'dir/bin/du' 2024-05-15T15:40:49.159 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/echo' -> 'dir/bin/echo' 2024-05-15T15:40:49.159 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/env' -> 'dir/bin/env' 2024-05-15T15:40:49.159 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/expand' -> 'dir/bin/expand' 2024-05-15T15:40:49.159 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/expr' -> 'dir/bin/expr' 2024-05-15T15:40:49.159 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/factor' -> 'dir/bin/factor' 2024-05-15T15:40:49.159 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/false' -> 'dir/bin/false' 2024-05-15T15:40:49.159 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/fmt' -> 'dir/bin/fmt' 2024-05-15T15:40:49.159 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/fold' -> 'dir/bin/fold' 2024-05-15T15:40:49.159 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/groups' -> 'dir/bin/groups' 2024-05-15T15:40:49.159 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/head' -> 'dir/bin/head' 2024-05-15T15:40:49.160 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/hostid' -> 'dir/bin/hostid' 2024-05-15T15:40:49.160 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/id' -> 'dir/bin/id' 2024-05-15T15:40:49.160 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/install' -> 'dir/bin/install' 2024-05-15T15:40:49.160 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/join' -> 'dir/bin/join' 2024-05-15T15:40:49.160 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/link' -> 'dir/bin/link' 2024-05-15T15:40:49.160 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ln' -> 'dir/bin/ln' 2024-05-15T15:40:49.160 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/logname' -> 'dir/bin/logname' 2024-05-15T15:40:49.160 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ls' -> 'dir/bin/ls' 2024-05-15T15:40:49.160 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/md5sum' -> 'dir/bin/md5sum' 2024-05-15T15:40:49.160 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/mkdir' -> 'dir/bin/mkdir' 2024-05-15T15:40:49.160 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/mkfifo' -> 'dir/bin/mkfifo' 2024-05-15T15:40:49.160 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/mknod' -> 'dir/bin/mknod' 2024-05-15T15:40:49.160 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/mktemp' -> 'dir/bin/mktemp' 2024-05-15T15:40:49.161 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/mv' -> 'dir/bin/mv' 2024-05-15T15:40:49.161 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/nice' -> 'dir/bin/nice' 2024-05-15T15:40:49.161 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/nl' -> 'dir/bin/nl' 2024-05-15T15:40:49.161 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/nohup' -> 'dir/bin/nohup' 2024-05-15T15:40:49.161 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/nproc' -> 'dir/bin/nproc' 2024-05-15T15:40:49.161 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/numfmt' -> 'dir/bin/numfmt' 2024-05-15T15:40:49.161 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/od' -> 'dir/bin/od' 2024-05-15T15:40:49.161 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/paste' -> 'dir/bin/paste' 2024-05-15T15:40:49.161 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/pathchk' -> 'dir/bin/pathchk' 2024-05-15T15:40:49.161 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/pinky' -> 'dir/bin/pinky' 2024-05-15T15:40:49.161 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/pr' -> 'dir/bin/pr' 2024-05-15T15:40:49.161 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/printenv' -> 'dir/bin/printenv' 2024-05-15T15:40:49.161 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/printf' -> 'dir/bin/printf' 2024-05-15T15:40:49.162 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ptx' -> 'dir/bin/ptx' 2024-05-15T15:40:49.162 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/pwd' -> 'dir/bin/pwd' 2024-05-15T15:40:49.162 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/readlink' -> 'dir/bin/readlink' 2024-05-15T15:40:49.162 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/realpath' -> 'dir/bin/realpath' 2024-05-15T15:40:49.162 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/rm' -> 'dir/bin/rm' 2024-05-15T15:40:49.162 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/rmdir' -> 'dir/bin/rmdir' 2024-05-15T15:40:49.162 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/runcon' -> 'dir/bin/runcon' 2024-05-15T15:40:49.162 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/seq' -> 'dir/bin/seq' 2024-05-15T15:40:49.162 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/sha1sum' -> 'dir/bin/sha1sum' 2024-05-15T15:40:49.162 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/sha224sum' -> 'dir/bin/sha224sum' 2024-05-15T15:40:49.162 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/sha256sum' -> 'dir/bin/sha256sum' 2024-05-15T15:40:49.162 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/sha384sum' -> 'dir/bin/sha384sum' 2024-05-15T15:40:49.162 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/sha512sum' -> 'dir/bin/sha512sum' 2024-05-15T15:40:49.162 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/shred' -> 'dir/bin/shred' 2024-05-15T15:40:49.163 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/shuf' -> 'dir/bin/shuf' 2024-05-15T15:40:49.163 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/sleep' -> 'dir/bin/sleep' 2024-05-15T15:40:49.163 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/sort' -> 'dir/bin/sort' 2024-05-15T15:40:49.163 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/split' -> 'dir/bin/split' 2024-05-15T15:40:49.163 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/stat' -> 'dir/bin/stat' 2024-05-15T15:40:49.163 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/stdbuf' -> 'dir/bin/stdbuf' 2024-05-15T15:40:49.163 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/stty' -> 'dir/bin/stty' 2024-05-15T15:40:49.163 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/sum' -> 'dir/bin/sum' 2024-05-15T15:40:49.163 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/sync' -> 'dir/bin/sync' 2024-05-15T15:40:49.163 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/tac' -> 'dir/bin/tac' 2024-05-15T15:40:49.163 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/tail' -> 'dir/bin/tail' 2024-05-15T15:40:49.163 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/tee' -> 'dir/bin/tee' 2024-05-15T15:40:49.163 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/test' -> 'dir/bin/test' 2024-05-15T15:40:49.164 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/timeout' -> 'dir/bin/timeout' 2024-05-15T15:40:49.164 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/touch' -> 'dir/bin/touch' 2024-05-15T15:40:49.164 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/tr' -> 'dir/bin/tr' 2024-05-15T15:40:49.164 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/true' -> 'dir/bin/true' 2024-05-15T15:40:49.164 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/truncate' -> 'dir/bin/truncate' 2024-05-15T15:40:49.164 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/tsort' -> 'dir/bin/tsort' 2024-05-15T15:40:49.164 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/tty' -> 'dir/bin/tty' 2024-05-15T15:40:49.164 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/uname' -> 'dir/bin/uname' 2024-05-15T15:40:49.164 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/unexpand' -> 'dir/bin/unexpand' 2024-05-15T15:40:49.164 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/uniq' -> 'dir/bin/uniq' 2024-05-15T15:40:49.164 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/unlink' -> 'dir/bin/unlink' 2024-05-15T15:40:49.164 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/users' -> 'dir/bin/users' 2024-05-15T15:40:49.164 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/vdir' -> 'dir/bin/vdir' 2024-05-15T15:40:49.164 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/wc' -> 'dir/bin/wc' 2024-05-15T15:40:49.165 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/who' -> 'dir/bin/who' 2024-05-15T15:40:49.165 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/whoami' -> 'dir/bin/whoami' 2024-05-15T15:40:49.165 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/yes' -> 'dir/bin/yes' 2024-05-15T15:40:49.165 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ca-legacy' -> 'dir/bin/ca-legacy' 2024-05-15T15:40:49.165 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/update-ca-trust' -> 'dir/bin/update-ca-trust' 2024-05-15T15:40:49.165 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/gunzip' -> 'dir/bin/gunzip' 2024-05-15T15:40:49.165 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/gzexe' -> 'dir/bin/gzexe' 2024-05-15T15:40:49.165 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/gzip' -> 'dir/bin/gzip' 2024-05-15T15:40:49.165 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/zcat' -> 'dir/bin/zcat' 2024-05-15T15:40:49.165 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/zcmp' -> 'dir/bin/zcmp' 2024-05-15T15:40:49.165 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/zdiff' -> 'dir/bin/zdiff' 2024-05-15T15:40:49.165 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/zegrep' -> 'dir/bin/zegrep' 2024-05-15T15:40:49.165 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/zfgrep' -> 'dir/bin/zfgrep' 2024-05-15T15:40:49.165 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/zforce' -> 'dir/bin/zforce' 2024-05-15T15:40:49.166 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/zgrep' -> 'dir/bin/zgrep' 2024-05-15T15:40:49.166 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/zless' -> 'dir/bin/zless' 2024-05-15T15:40:49.166 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/zmore' -> 'dir/bin/zmore' 2024-05-15T15:40:49.166 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/znew' -> 'dir/bin/znew' 2024-05-15T15:40:49.166 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/gdbus' -> 'dir/bin/gdbus' 2024-05-15T15:40:49.166 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/gio' -> 'dir/bin/gio' 2024-05-15T15:40:49.166 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/gio-querymodules-64' -> 'dir/bin/gio-querymodules-64' 2024-05-15T15:40:49.166 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/glib-compile-schemas' -> 'dir/bin/glib-compile-schemas' 2024-05-15T15:40:49.166 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/gsettings' -> 'dir/bin/gsettings' 2024-05-15T15:40:49.166 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/chrt' -> 'dir/bin/chrt' 2024-05-15T15:40:49.166 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/update-mime-database' -> 'dir/bin/update-mime-database' 2024-05-15T15:40:49.166 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/dmesg' -> 'dir/bin/dmesg' 2024-05-15T15:40:49.166 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/findmnt' -> 'dir/bin/findmnt' 2024-05-15T15:40:49.167 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/flock' -> 'dir/bin/flock' 2024-05-15T15:40:49.167 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/hardlink' -> 'dir/bin/hardlink' 2024-05-15T15:40:49.167 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ionice' -> 'dir/bin/ionice' 2024-05-15T15:40:49.167 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ipcmk' -> 'dir/bin/ipcmk' 2024-05-15T15:40:49.570 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ipcrm' -> 'dir/bin/ipcrm' 2024-05-15T15:40:49.570 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ipcs' -> 'dir/bin/ipcs' 2024-05-15T15:40:49.570 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/kill' -> 'dir/bin/kill' 2024-05-15T15:40:49.570 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/logger' -> 'dir/bin/logger' 2024-05-15T15:40:49.570 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/more' -> 'dir/bin/more' 2024-05-15T15:40:49.571 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/mount' -> 'dir/bin/mount' 2024-05-15T15:40:49.571 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/mountpoint' -> 'dir/bin/mountpoint' 2024-05-15T15:40:49.571 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/nsenter' -> 'dir/bin/nsenter' 2024-05-15T15:40:49.571 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/renice' -> 'dir/bin/renice' 2024-05-15T15:40:49.571 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/setsid' -> 'dir/bin/setsid' 2024-05-15T15:40:49.571 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/taskset' -> 'dir/bin/taskset' 2024-05-15T15:40:49.571 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/umount' -> 'dir/bin/umount' 2024-05-15T15:40:49.571 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/unshare' -> 'dir/bin/unshare' 2024-05-15T15:40:49.571 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/fscrypt' -> 'dir/bin/fscrypt' 2024-05-15T15:40:49.571 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/wsdump' -> 'dir/bin/wsdump' 2024-05-15T15:40:49.571 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/natsort' -> 'dir/bin/natsort' 2024-05-15T15:40:49.571 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/gunicorn_pecan' -> 'dir/bin/gunicorn_pecan' 2024-05-15T15:40:49.571 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/pecan' -> 'dir/bin/pecan' 2024-05-15T15:40:49.572 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/unxz' -> 'dir/bin/unxz' 2024-05-15T15:40:49.572 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/xz' -> 'dir/bin/xz' 2024-05-15T15:40:49.572 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/xzcat' -> 'dir/bin/xzcat' 2024-05-15T15:40:49.572 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/xzcmp' -> 'dir/bin/xzcmp' 2024-05-15T15:40:49.572 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/xzdec' -> 'dir/bin/xzdec' 2024-05-15T15:40:49.572 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/xzdiff' -> 'dir/bin/xzdiff' 2024-05-15T15:40:49.572 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/xzegrep' -> 'dir/bin/xzegrep' 2024-05-15T15:40:49.572 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/xzfgrep' -> 'dir/bin/xzfgrep' 2024-05-15T15:40:49.572 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/xzgrep' -> 'dir/bin/xzgrep' 2024-05-15T15:40:49.572 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/xzless' -> 'dir/bin/xzless' 2024-05-15T15:40:49.572 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/xzmore' -> 'dir/bin/xzmore' 2024-05-15T15:40:49.572 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/desktop-file-edit' -> 'dir/bin/desktop-file-edit' 2024-05-15T15:40:49.572 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/desktop-file-install' -> 'dir/bin/desktop-file-install' 2024-05-15T15:40:49.572 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/desktop-file-validate' -> 'dir/bin/desktop-file-validate' 2024-05-15T15:40:49.573 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/update-desktop-database' -> 'dir/bin/update-desktop-database' 2024-05-15T15:40:49.573 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/xdg-desktop-icon' -> 'dir/bin/xdg-desktop-icon' 2024-05-15T15:40:49.573 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/xdg-desktop-menu' -> 'dir/bin/xdg-desktop-menu' 2024-05-15T15:40:49.573 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/xdg-email' -> 'dir/bin/xdg-email' 2024-05-15T15:40:49.573 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/xdg-icon-resource' -> 'dir/bin/xdg-icon-resource' 2024-05-15T15:40:49.573 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/xdg-mime' -> 'dir/bin/xdg-mime' 2024-05-15T15:40:49.573 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/xdg-open' -> 'dir/bin/xdg-open' 2024-05-15T15:40:49.573 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/xdg-screensaver' -> 'dir/bin/xdg-screensaver' 2024-05-15T15:40:49.573 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/xdg-settings' -> 'dir/bin/xdg-settings' 2024-05-15T15:40:49.573 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/pgrep' -> 'dir/bin/pgrep' 2024-05-15T15:40:49.574 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/pidof' -> 'dir/bin/pidof' 2024-05-15T15:40:49.574 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/pidwait' -> 'dir/bin/pidwait' 2024-05-15T15:40:49.574 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/pkill' -> 'dir/bin/pkill' 2024-05-15T15:40:49.574 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/pmap' -> 'dir/bin/pmap' 2024-05-15T15:40:49.574 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ps' -> 'dir/bin/ps' 2024-05-15T15:40:49.574 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/pwdx' -> 'dir/bin/pwdx' 2024-05-15T15:40:49.574 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/skill' -> 'dir/bin/skill' 2024-05-15T15:40:49.575 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/slabtop' -> 'dir/bin/slabtop' 2024-05-15T15:40:49.575 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/snice' -> 'dir/bin/snice' 2024-05-15T15:40:49.575 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/tload' -> 'dir/bin/tload' 2024-05-15T15:40:49.575 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/top' -> 'dir/bin/top' 2024-05-15T15:40:49.575 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/uptime' -> 'dir/bin/uptime' 2024-05-15T15:40:49.575 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/vmstat' -> 'dir/bin/vmstat' 2024-05-15T15:40:49.575 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/w' -> 'dir/bin/w' 2024-05-15T15:40:49.576 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/watch' -> 'dir/bin/watch' 2024-05-15T15:40:49.576 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/python' -> 'dir/bin/python' 2024-05-15T15:40:49.576 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/pydoc' -> 'dir/bin/pydoc' 2024-05-15T15:40:49.576 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/pydoc3' -> 'dir/bin/pydoc3' 2024-05-15T15:40:49.576 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/pydoc3.9' -> 'dir/bin/pydoc3.9' 2024-05-15T15:40:49.576 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/python3' -> 'dir/bin/python3' 2024-05-15T15:40:49.577 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/python3.9' -> 'dir/bin/python3.9' 2024-05-15T15:40:49.577 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/cockpit-bridge' -> 'dir/bin/cockpit-bridge' 2024-05-15T15:40:49.577 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/distro' -> 'dir/bin/distro' 2024-05-15T15:40:49.577 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/chardetect' -> 'dir/bin/chardetect' 2024-05-15T15:40:49.577 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/rsync' -> 'dir/bin/rsync' 2024-05-15T15:40:49.577 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/rsync-ssl' -> 'dir/bin/rsync-ssl' 2024-05-15T15:40:49.577 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/sscg' -> 'dir/bin/sscg' 2024-05-15T15:40:49.578 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/cpp' -> 'dir/bin/cpp' 2024-05-15T15:40:49.578 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/tar' -> 'dir/bin/tar' 2024-05-15T15:40:49.578 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ex' -> 'dir/bin/ex' 2024-05-15T15:40:49.578 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/idiag-socket-details' -> 'dir/bin/idiag-socket-details' 2024-05-15T15:40:49.578 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/nf-ct-add' -> 'dir/bin/nf-ct-add' 2024-05-15T15:40:49.578 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/nf-ct-events' -> 'dir/bin/nf-ct-events' 2024-05-15T15:40:49.579 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/nf-ct-list' -> 'dir/bin/nf-ct-list' 2024-05-15T15:40:49.579 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/nf-exp-add' -> 'dir/bin/nf-exp-add' 2024-05-15T15:40:49.579 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/nf-exp-delete' -> 'dir/bin/nf-exp-delete' 2024-05-15T15:40:49.579 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/nf-exp-list' -> 'dir/bin/nf-exp-list' 2024-05-15T15:40:49.579 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/nf-log' -> 'dir/bin/nf-log' 2024-05-15T15:40:49.579 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/nf-monitor' -> 'dir/bin/nf-monitor' 2024-05-15T15:40:49.580 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/nf-queue' -> 'dir/bin/nf-queue' 2024-05-15T15:40:49.580 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/nl-addr-add' -> 'dir/bin/nl-addr-add' 2024-05-15T15:40:49.580 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/nl-addr-delete' -> 'dir/bin/nl-addr-delete' 2024-05-15T15:40:49.580 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/nl-addr-list' -> 'dir/bin/nl-addr-list' 2024-05-15T15:40:49.580 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/nl-class-add' -> 'dir/bin/nl-class-add' 2024-05-15T15:40:49.580 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/nl-class-delete' -> 'dir/bin/nl-class-delete' 2024-05-15T15:40:49.580 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/nl-class-list' -> 'dir/bin/nl-class-list' 2024-05-15T15:40:49.581 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/nl-classid-lookup' -> 'dir/bin/nl-classid-lookup' 2024-05-15T15:40:49.581 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/nl-cls-add' -> 'dir/bin/nl-cls-add' 2024-05-15T15:40:49.581 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/nl-cls-delete' -> 'dir/bin/nl-cls-delete' 2024-05-15T15:40:49.581 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/nl-cls-list' -> 'dir/bin/nl-cls-list' 2024-05-15T15:40:49.582 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/nl-fib-lookup' -> 'dir/bin/nl-fib-lookup' 2024-05-15T15:40:49.582 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/nl-link-enslave' -> 'dir/bin/nl-link-enslave' 2024-05-15T15:40:49.582 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/nl-link-ifindex2name' -> 'dir/bin/nl-link-ifindex2name' 2024-05-15T15:40:49.864 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/nl-link-list' -> 'dir/bin/nl-link-list' 2024-05-15T15:40:49.864 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/nl-link-name2ifindex' -> 'dir/bin/nl-link-name2ifindex' 2024-05-15T15:40:49.864 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/nl-link-release' -> 'dir/bin/nl-link-release' 2024-05-15T15:40:49.864 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/nl-link-set' -> 'dir/bin/nl-link-set' 2024-05-15T15:40:49.864 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/nl-link-stats' -> 'dir/bin/nl-link-stats' 2024-05-15T15:40:49.864 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/nl-list-caches' -> 'dir/bin/nl-list-caches' 2024-05-15T15:40:49.864 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/nl-list-sockets' -> 'dir/bin/nl-list-sockets' 2024-05-15T15:40:49.864 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/nl-monitor' -> 'dir/bin/nl-monitor' 2024-05-15T15:40:49.865 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/nl-neigh-add' -> 'dir/bin/nl-neigh-add' 2024-05-15T15:40:49.865 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/nl-neigh-delete' -> 'dir/bin/nl-neigh-delete' 2024-05-15T15:40:49.865 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/nl-neigh-list' -> 'dir/bin/nl-neigh-list' 2024-05-15T15:40:49.865 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/nl-neightbl-list' -> 'dir/bin/nl-neightbl-list' 2024-05-15T15:40:49.865 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/nl-nh-list' -> 'dir/bin/nl-nh-list' 2024-05-15T15:40:49.865 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/nl-qdisc-add' -> 'dir/bin/nl-qdisc-add' 2024-05-15T15:40:49.865 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/nl-qdisc-delete' -> 'dir/bin/nl-qdisc-delete' 2024-05-15T15:40:49.865 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/nl-qdisc-list' -> 'dir/bin/nl-qdisc-list' 2024-05-15T15:40:49.865 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/nl-route-add' -> 'dir/bin/nl-route-add' 2024-05-15T15:40:49.865 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/nl-route-delete' -> 'dir/bin/nl-route-delete' 2024-05-15T15:40:49.865 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/nl-route-get' -> 'dir/bin/nl-route-get' 2024-05-15T15:40:49.865 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/nl-route-list' -> 'dir/bin/nl-route-list' 2024-05-15T15:40:49.865 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/nl-rule-list' -> 'dir/bin/nl-rule-list' 2024-05-15T15:40:49.866 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/nl-tctree-list' -> 'dir/bin/nl-tctree-list' 2024-05-15T15:40:49.866 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/nl-util-addr' -> 'dir/bin/nl-util-addr' 2024-05-15T15:40:49.866 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/gtar' -> 'dir/bin/gtar' 2024-05-15T15:40:49.866 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/teamnl' -> 'dir/bin/teamnl' 2024-05-15T15:40:49.866 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/getfacl' -> 'dir/bin/getfacl' 2024-05-15T15:40:49.866 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/setfacl' -> 'dir/bin/setfacl' 2024-05-15T15:40:49.866 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/envsubst' -> 'dir/bin/envsubst' 2024-05-15T15:40:49.866 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/gettext' -> 'dir/bin/gettext' 2024-05-15T15:40:49.866 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/gettext.sh' -> 'dir/bin/gettext.sh' 2024-05-15T15:40:49.866 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/msgattrib' -> 'dir/bin/msgattrib' 2024-05-15T15:40:49.866 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/msgcat' -> 'dir/bin/msgcat' 2024-05-15T15:40:49.866 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/msgcmp' -> 'dir/bin/msgcmp' 2024-05-15T15:40:49.866 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/msgcomm' -> 'dir/bin/msgcomm' 2024-05-15T15:40:49.867 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/msgconv' -> 'dir/bin/msgconv' 2024-05-15T15:40:49.867 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/msgen' -> 'dir/bin/msgen' 2024-05-15T15:40:49.867 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/msgexec' -> 'dir/bin/msgexec' 2024-05-15T15:40:49.867 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/msgfilter' -> 'dir/bin/msgfilter' 2024-05-15T15:40:49.867 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/msgfmt' -> 'dir/bin/msgfmt' 2024-05-15T15:40:49.867 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/msggrep' -> 'dir/bin/msggrep' 2024-05-15T15:40:49.867 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/msginit' -> 'dir/bin/msginit' 2024-05-15T15:40:49.867 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/msgmerge' -> 'dir/bin/msgmerge' 2024-05-15T15:40:49.867 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/msgunfmt' -> 'dir/bin/msgunfmt' 2024-05-15T15:40:49.867 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/msguniq' -> 'dir/bin/msguniq' 2024-05-15T15:40:49.867 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ngettext' -> 'dir/bin/ngettext' 2024-05-15T15:40:49.867 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/recode-sr-latin' -> 'dir/bin/recode-sr-latin' 2024-05-15T15:40:49.867 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/xgettext' -> 'dir/bin/xgettext' 2024-05-15T15:40:49.867 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/attr' -> 'dir/bin/attr' 2024-05-15T15:40:49.868 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/getfattr' -> 'dir/bin/getfattr' 2024-05-15T15:40:49.868 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/setfattr' -> 'dir/bin/setfattr' 2024-05-15T15:40:49.868 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/dwz' -> 'dir/bin/dwz' 2024-05-15T15:40:49.868 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/xsltproc' -> 'dir/bin/xsltproc' 2024-05-15T15:40:49.868 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/chacl' -> 'dir/bin/chacl' 2024-05-15T15:40:49.868 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/bunzip2' -> 'dir/bin/bunzip2' 2024-05-15T15:40:49.868 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/bzcat' -> 'dir/bin/bzcat' 2024-05-15T15:40:49.868 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/bzcmp' -> 'dir/bin/bzcmp' 2024-05-15T15:40:49.868 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/bzdiff' -> 'dir/bin/bzdiff' 2024-05-15T15:40:49.868 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/bzegrep' -> 'dir/bin/bzegrep' 2024-05-15T15:40:49.868 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/bzfgrep' -> 'dir/bin/bzfgrep' 2024-05-15T15:40:49.868 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/bzgrep' -> 'dir/bin/bzgrep' 2024-05-15T15:40:49.868 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/bzip2' -> 'dir/bin/bzip2' 2024-05-15T15:40:49.868 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/bzip2recover' -> 'dir/bin/bzip2recover' 2024-05-15T15:40:49.869 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/bzless' -> 'dir/bin/bzless' 2024-05-15T15:40:49.869 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/bzmore' -> 'dir/bin/bzmore' 2024-05-15T15:40:49.869 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/dtrace' -> 'dir/bin/dtrace' 2024-05-15T15:40:49.869 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/funzip' -> 'dir/bin/funzip' 2024-05-15T15:40:49.869 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/unzipsfx' -> 'dir/bin/unzipsfx' 2024-05-15T15:40:49.869 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/zipgrep' -> 'dir/bin/zipgrep' 2024-05-15T15:40:49.869 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/zipinfo' -> 'dir/bin/zipinfo' 2024-05-15T15:40:49.869 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/unzip' -> 'dir/bin/unzip' 2024-05-15T15:40:49.869 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/zipcloak' -> 'dir/bin/zipcloak' 2024-05-15T15:40:49.869 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/zipnote' -> 'dir/bin/zipnote' 2024-05-15T15:40:49.869 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/zipsplit' -> 'dir/bin/zipsplit' 2024-05-15T15:40:49.869 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/checkmodule' -> 'dir/bin/checkmodule' 2024-05-15T15:40:49.869 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/gr2fonttest' -> 'dir/bin/gr2fonttest' 2024-05-15T15:40:49.869 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/fc-cache' -> 'dir/bin/fc-cache' 2024-05-15T15:40:49.870 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/fc-cache-64' -> 'dir/bin/fc-cache-64' 2024-05-15T15:40:49.870 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/fc-cat' -> 'dir/bin/fc-cat' 2024-05-15T15:40:49.870 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/fc-conflist' -> 'dir/bin/fc-conflist' 2024-05-15T15:40:49.870 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/fc-list' -> 'dir/bin/fc-list' 2024-05-15T15:40:49.870 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/fc-match' -> 'dir/bin/fc-match' 2024-05-15T15:40:49.870 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/fc-pattern' -> 'dir/bin/fc-pattern' 2024-05-15T15:40:49.870 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/fc-query' -> 'dir/bin/fc-query' 2024-05-15T15:40:49.870 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/fc-scan' -> 'dir/bin/fc-scan' 2024-05-15T15:40:49.870 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/fc-validate' -> 'dir/bin/fc-validate' 2024-05-15T15:40:49.870 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/info' -> 'dir/bin/info' 2024-05-15T15:40:49.870 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/unpigz' -> 'dir/bin/unpigz' 2024-05-15T15:40:49.871 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/pigz' -> 'dir/bin/pigz' 2024-05-15T15:40:49.871 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/dnsdomainname' -> 'dir/bin/dnsdomainname' 2024-05-15T15:40:49.871 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/domainname' -> 'dir/bin/domainname' 2024-05-15T15:40:49.871 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/hostname' -> 'dir/bin/hostname' 2024-05-15T15:40:49.871 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/nisdomainname' -> 'dir/bin/nisdomainname' 2024-05-15T15:40:49.871 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ypdomainname' -> 'dir/bin/ypdomainname' 2024-05-15T15:40:50.166 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/cpupower' -> 'dir/bin/cpupower' 2024-05-15T15:40:50.166 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/gpio-event-mon' -> 'dir/bin/gpio-event-mon' 2024-05-15T15:40:50.167 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/gpio-hammer' -> 'dir/bin/gpio-hammer' 2024-05-15T15:40:50.167 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/gpio-watch' -> 'dir/bin/gpio-watch' 2024-05-15T15:40:50.167 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/iio_event_monitor' -> 'dir/bin/iio_event_monitor' 2024-05-15T15:40:50.167 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/iio_generic_buffer' -> 'dir/bin/iio_generic_buffer' 2024-05-15T15:40:50.167 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/intel-speed-select' -> 'dir/bin/intel-speed-select' 2024-05-15T15:40:50.167 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/kvm_stat' -> 'dir/bin/kvm_stat' 2024-05-15T15:40:50.167 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/lsgpio' -> 'dir/bin/lsgpio' 2024-05-15T15:40:50.167 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/lsiio' -> 'dir/bin/lsiio' 2024-05-15T15:40:50.167 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/page_owner_sort' -> 'dir/bin/page_owner_sort' 2024-05-15T15:40:50.167 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/powernow-k8-decode' -> 'dir/bin/powernow-k8-decode' 2024-05-15T15:40:50.167 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/slabinfo' -> 'dir/bin/slabinfo' 2024-05-15T15:40:50.167 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/tmon' -> 'dir/bin/tmon' 2024-05-15T15:40:50.167 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/turbostat' -> 'dir/bin/turbostat' 2024-05-15T15:40:50.167 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/x86_energy_perf_policy' -> 'dir/bin/x86_energy_perf_policy' 2024-05-15T15:40:50.168 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/pflags' -> 'dir/bin/pflags' 2024-05-15T15:40:50.168 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/lessecho' -> 'dir/bin/lessecho' 2024-05-15T15:40:50.168 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/lesskey' -> 'dir/bin/lesskey' 2024-05-15T15:40:50.168 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/lesspipe.sh' -> 'dir/bin/lesspipe.sh' 2024-05-15T15:40:50.168 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/captoinfo' -> 'dir/bin/captoinfo' 2024-05-15T15:40:50.168 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/xxd' -> 'dir/bin/xxd' 2024-05-15T15:40:50.168 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/clear' -> 'dir/bin/clear' 2024-05-15T15:40:50.168 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/infocmp' -> 'dir/bin/infocmp' 2024-05-15T15:40:50.168 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/infotocap' -> 'dir/bin/infotocap' 2024-05-15T15:40:50.168 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/reset' -> 'dir/bin/reset' 2024-05-15T15:40:50.168 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/tabs' -> 'dir/bin/tabs' 2024-05-15T15:40:50.168 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/tic' -> 'dir/bin/tic' 2024-05-15T15:40:50.168 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/toe' -> 'dir/bin/toe' 2024-05-15T15:40:50.168 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/tput' -> 'dir/bin/tput' 2024-05-15T15:40:50.169 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/tset' -> 'dir/bin/tset' 2024-05-15T15:40:50.169 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/pod2usage' -> 'dir/bin/pod2usage' 2024-05-15T15:40:50.169 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/pod2man' -> 'dir/bin/pod2man' 2024-05-15T15:40:50.169 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/pod2text' -> 'dir/bin/pod2text' 2024-05-15T15:40:50.169 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/encguess' -> 'dir/bin/encguess' 2024-05-15T15:40:50.169 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/piconv' -> 'dir/bin/piconv' 2024-05-15T15:40:50.169 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/perl5.32.1' -> 'dir/bin/perl5.32.1' 2024-05-15T15:40:50.169 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/perl' -> 'dir/bin/perl' 2024-05-15T15:40:50.169 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/perldoc' -> 'dir/bin/perldoc' 2024-05-15T15:40:50.169 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/pod2html' -> 'dir/bin/pod2html' 2024-05-15T15:40:50.169 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/xsubpp' -> 'dir/bin/xsubpp' 2024-05-15T15:40:50.169 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/shasum' -> 'dir/bin/shasum' 2024-05-15T15:40:50.169 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/libnetcfg' -> 'dir/bin/libnetcfg' 2024-05-15T15:40:50.169 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/prove' -> 'dir/bin/prove' 2024-05-15T15:40:50.170 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/streamzip' -> 'dir/bin/streamzip' 2024-05-15T15:40:50.170 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/zipdetails' -> 'dir/bin/zipdetails' 2024-05-15T15:40:50.170 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/json_pp' -> 'dir/bin/json_pp' 2024-05-15T15:40:50.170 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/corelist' -> 'dir/bin/corelist' 2024-05-15T15:40:50.170 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/crc32' -> 'dir/bin/crc32' 2024-05-15T15:40:50.170 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/splain' -> 'dir/bin/splain' 2024-05-15T15:40:50.170 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/podchecker' -> 'dir/bin/podchecker' 2024-05-15T15:40:50.170 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/h2ph' -> 'dir/bin/h2ph' 2024-05-15T15:40:50.170 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/pl2pm' -> 'dir/bin/pl2pm' 2024-05-15T15:40:50.170 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/perlbug' -> 'dir/bin/perlbug' 2024-05-15T15:40:50.170 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/perlthanks' -> 'dir/bin/perlthanks' 2024-05-15T15:40:50.170 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ptar' -> 'dir/bin/ptar' 2024-05-15T15:40:50.170 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ptardiff' -> 'dir/bin/ptardiff' 2024-05-15T15:40:50.171 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ptargrep' -> 'dir/bin/ptargrep' 2024-05-15T15:40:50.171 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/killall' -> 'dir/bin/killall' 2024-05-15T15:40:50.171 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/peekfd' -> 'dir/bin/peekfd' 2024-05-15T15:40:50.171 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/prtstat' -> 'dir/bin/prtstat' 2024-05-15T15:40:50.171 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/pslog' -> 'dir/bin/pslog' 2024-05-15T15:40:50.171 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/pstree' -> 'dir/bin/pstree' 2024-05-15T15:40:50.171 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/pstree.x11' -> 'dir/bin/pstree.x11' 2024-05-15T15:40:50.171 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/cmp' -> 'dir/bin/cmp' 2024-05-15T15:40:50.171 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/diff' -> 'dir/bin/diff' 2024-05-15T15:40:50.171 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/diff3' -> 'dir/bin/diff3' 2024-05-15T15:40:50.171 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/sdiff' -> 'dir/bin/sdiff' 2024-05-15T15:40:50.171 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/bond2team' -> 'dir/bin/bond2team' 2024-05-15T15:40:50.171 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/team2bond' -> 'dir/bin/team2bond' 2024-05-15T15:40:50.171 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/teamd' -> 'dir/bin/teamd' 2024-05-15T15:40:50.171 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/teamdctl' -> 'dir/bin/teamdctl' 2024-05-15T15:40:50.172 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/pwmake' -> 'dir/bin/pwmake' 2024-05-15T15:40:50.172 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/pwscore' -> 'dir/bin/pwscore' 2024-05-15T15:40:50.172 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/cal' -> 'dir/bin/cal' 2024-05-15T15:40:50.172 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/chmem' -> 'dir/bin/chmem' 2024-05-15T15:40:50.172 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/choom' -> 'dir/bin/choom' 2024-05-15T15:40:50.172 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/col' -> 'dir/bin/col' 2024-05-15T15:40:50.172 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/colcrt' -> 'dir/bin/colcrt' 2024-05-15T15:40:50.172 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/colrm' -> 'dir/bin/colrm' 2024-05-15T15:40:50.172 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/column' -> 'dir/bin/column' 2024-05-15T15:40:50.172 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/eject' -> 'dir/bin/eject' 2024-05-15T15:40:50.172 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/fallocate' -> 'dir/bin/fallocate' 2024-05-15T15:40:50.172 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/fincore' -> 'dir/bin/fincore' 2024-05-15T15:40:50.172 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/getopt' -> 'dir/bin/getopt' 2024-05-15T15:40:50.172 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/hexdump' -> 'dir/bin/hexdump' 2024-05-15T15:40:50.173 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/i386' -> 'dir/bin/i386' 2024-05-15T15:40:50.173 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/irqtop' -> 'dir/bin/irqtop' 2024-05-15T15:40:50.173 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/isosize' -> 'dir/bin/isosize' 2024-05-15T15:40:50.173 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/last' -> 'dir/bin/last' 2024-05-15T15:40:50.173 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/lastb' -> 'dir/bin/lastb' 2024-05-15T15:40:50.173 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/linux32' -> 'dir/bin/linux32' 2024-05-15T15:40:50.173 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/linux64' -> 'dir/bin/linux64' 2024-05-15T15:40:50.173 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/login' -> 'dir/bin/login' 2024-05-15T15:40:50.173 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/look' -> 'dir/bin/look' 2024-05-15T15:40:50.173 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/lsblk' -> 'dir/bin/lsblk' 2024-05-15T15:40:50.173 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/lscpu' -> 'dir/bin/lscpu' 2024-05-15T15:40:50.173 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/lsipc' -> 'dir/bin/lsipc' 2024-05-15T15:40:50.173 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/lsirq' -> 'dir/bin/lsirq' 2024-05-15T15:40:50.173 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/lslocks' -> 'dir/bin/lslocks' 2024-05-15T15:40:50.173 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/lslogins' -> 'dir/bin/lslogins' 2024-05-15T15:40:50.174 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/lsmem' -> 'dir/bin/lsmem' 2024-05-15T15:40:50.491 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/lsns' -> 'dir/bin/lsns' 2024-05-15T15:40:50.491 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/mcookie' -> 'dir/bin/mcookie' 2024-05-15T15:40:50.491 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/mesg' -> 'dir/bin/mesg' 2024-05-15T15:40:50.491 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/namei' -> 'dir/bin/namei' 2024-05-15T15:40:50.491 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/prlimit' -> 'dir/bin/prlimit' 2024-05-15T15:40:50.491 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/rename' -> 'dir/bin/rename' 2024-05-15T15:40:50.491 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/rev' -> 'dir/bin/rev' 2024-05-15T15:40:50.491 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/script' -> 'dir/bin/script' 2024-05-15T15:40:50.491 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/scriptlive' -> 'dir/bin/scriptlive' 2024-05-15T15:40:50.491 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/scriptreplay' -> 'dir/bin/scriptreplay' 2024-05-15T15:40:50.492 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/setarch' -> 'dir/bin/setarch' 2024-05-15T15:40:50.492 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/setpriv' -> 'dir/bin/setpriv' 2024-05-15T15:40:50.492 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/setterm' -> 'dir/bin/setterm' 2024-05-15T15:40:50.492 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/su' -> 'dir/bin/su' 2024-05-15T15:40:50.492 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ul' -> 'dir/bin/ul' 2024-05-15T15:40:50.492 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/uname26' -> 'dir/bin/uname26' 2024-05-15T15:40:50.492 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/utmpdump' -> 'dir/bin/utmpdump' 2024-05-15T15:40:50.492 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/uuidgen' -> 'dir/bin/uuidgen' 2024-05-15T15:40:50.492 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/uuidparse' -> 'dir/bin/uuidparse' 2024-05-15T15:40:50.492 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/wall' -> 'dir/bin/wall' 2024-05-15T15:40:50.493 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/wdctl' -> 'dir/bin/wdctl' 2024-05-15T15:40:50.493 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/whereis' -> 'dir/bin/whereis' 2024-05-15T15:40:50.493 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/write' -> 'dir/bin/write' 2024-05-15T15:40:50.493 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/x86_64' -> 'dir/bin/x86_64' 2024-05-15T15:40:50.493 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ssh-keygen' -> 'dir/bin/ssh-keygen' 2024-05-15T15:40:50.493 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/hostnamectl' -> 'dir/bin/hostnamectl' 2024-05-15T15:40:50.493 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/journalctl' -> 'dir/bin/journalctl' 2024-05-15T15:40:50.493 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/localectl' -> 'dir/bin/localectl' 2024-05-15T15:40:50.493 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/loginctl' -> 'dir/bin/loginctl' 2024-05-15T15:40:50.493 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/systemctl' -> 'dir/bin/systemctl' 2024-05-15T15:40:50.493 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/systemd-analyze' -> 'dir/bin/systemd-analyze' 2024-05-15T15:40:50.493 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/systemd-ask-password' -> 'dir/bin/systemd-ask-password' 2024-05-15T15:40:50.493 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/systemd-cat' -> 'dir/bin/systemd-cat' 2024-05-15T15:40:50.494 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/systemd-cgls' -> 'dir/bin/systemd-cgls' 2024-05-15T15:40:50.494 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/systemd-cgtop' -> 'dir/bin/systemd-cgtop' 2024-05-15T15:40:50.494 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/systemd-creds' -> 'dir/bin/systemd-creds' 2024-05-15T15:40:50.494 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/systemd-delta' -> 'dir/bin/systemd-delta' 2024-05-15T15:40:50.494 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/systemd-detect-virt' -> 'dir/bin/systemd-detect-virt' 2024-05-15T15:40:50.494 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/systemd-dissect' -> 'dir/bin/systemd-dissect' 2024-05-15T15:40:50.494 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/systemd-escape' -> 'dir/bin/systemd-escape' 2024-05-15T15:40:50.494 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/systemd-firstboot' -> 'dir/bin/systemd-firstboot' 2024-05-15T15:40:50.494 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/systemd-id128' -> 'dir/bin/systemd-id128' 2024-05-15T15:40:50.494 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/systemd-inhibit' -> 'dir/bin/systemd-inhibit' 2024-05-15T15:40:50.494 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/systemd-machine-id-setup' -> 'dir/bin/systemd-machine-id-setup' 2024-05-15T15:40:50.494 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/systemd-mount' -> 'dir/bin/systemd-mount' 2024-05-15T15:40:50.494 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/systemd-notify' -> 'dir/bin/systemd-notify' 2024-05-15T15:40:50.495 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/systemd-path' -> 'dir/bin/systemd-path' 2024-05-15T15:40:50.495 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/systemd-run' -> 'dir/bin/systemd-run' 2024-05-15T15:40:50.495 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/systemd-socket-activate' -> 'dir/bin/systemd-socket-activate' 2024-05-15T15:40:50.495 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/systemd-stdio-bridge' -> 'dir/bin/systemd-stdio-bridge' 2024-05-15T15:40:50.495 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/systemd-sysext' -> 'dir/bin/systemd-sysext' 2024-05-15T15:40:50.495 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/systemd-sysusers' -> 'dir/bin/systemd-sysusers' 2024-05-15T15:40:50.495 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/systemd-tmpfiles' -> 'dir/bin/systemd-tmpfiles' 2024-05-15T15:40:50.495 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/systemd-tty-ask-password-agent' -> 'dir/bin/systemd-tty-ask-password-agent' 2024-05-15T15:40:50.495 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/systemd-umount' -> 'dir/bin/systemd-umount' 2024-05-15T15:40:50.495 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/timedatectl' -> 'dir/bin/timedatectl' 2024-05-15T15:40:50.495 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/dbus-broker' -> 'dir/bin/dbus-broker' 2024-05-15T15:40:50.495 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/dbus-broker-launch' -> 'dir/bin/dbus-broker-launch' 2024-05-15T15:40:50.495 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/pkcheck' -> 'dir/bin/pkcheck' 2024-05-15T15:40:50.495 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/pkexec' -> 'dir/bin/pkexec' 2024-05-15T15:40:50.495 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/pkttyagent' -> 'dir/bin/pkttyagent' 2024-05-15T15:40:50.496 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/pkla-admin-identities' -> 'dir/bin/pkla-admin-identities' 2024-05-15T15:40:50.496 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/pkla-check-authorization' -> 'dir/bin/pkla-check-authorization' 2024-05-15T15:40:50.496 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/cronnext' -> 'dir/bin/cronnext' 2024-05-15T15:40:50.496 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/crontab' -> 'dir/bin/crontab' 2024-05-15T15:40:50.496 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/run-parts' -> 'dir/bin/run-parts' 2024-05-15T15:40:50.496 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/grub2-editenv' -> 'dir/bin/grub2-editenv' 2024-05-15T15:40:50.496 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/grub2-mkpasswd-pbkdf2' -> 'dir/bin/grub2-mkpasswd-pbkdf2' 2024-05-15T15:40:50.496 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/grub2-mount' -> 'dir/bin/grub2-mount' 2024-05-15T15:40:50.496 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/aulast' -> 'dir/bin/aulast' 2024-05-15T15:40:50.496 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/authselect' -> 'dir/bin/authselect' 2024-05-15T15:40:50.496 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/debuginfod-find' -> 'dir/bin/debuginfod-find' 2024-05-15T15:40:50.496 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/clockdiff' -> 'dir/bin/clockdiff' 2024-05-15T15:40:50.496 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ping' -> 'dir/bin/ping' 2024-05-15T15:40:50.496 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/tracepath' -> 'dir/bin/tracepath' 2024-05-15T15:40:50.497 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/sim_lsmplugin' -> 'dir/bin/sim_lsmplugin' 2024-05-15T15:40:50.497 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/lsmcli' -> 'dir/bin/lsmcli' 2024-05-15T15:40:50.497 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/lsmd' -> 'dir/bin/lsmd' 2024-05-15T15:40:50.497 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/simc_lsmplugin' -> 'dir/bin/simc_lsmplugin' 2024-05-15T15:40:50.497 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/deallocvt' -> 'dir/bin/deallocvt' 2024-05-15T15:40:50.497 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/dumpkeys' -> 'dir/bin/dumpkeys' 2024-05-15T15:40:50.497 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/fgconsole' -> 'dir/bin/fgconsole' 2024-05-15T15:40:50.497 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/getkeycodes' -> 'dir/bin/getkeycodes' 2024-05-15T15:40:50.497 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/kbd_mode' -> 'dir/bin/kbd_mode' 2024-05-15T15:40:50.497 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/kbdinfo' -> 'dir/bin/kbdinfo' 2024-05-15T15:40:50.497 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/kbdrate' -> 'dir/bin/kbdrate' 2024-05-15T15:40:50.940 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/loadkeys' -> 'dir/bin/loadkeys' 2024-05-15T15:40:50.941 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/loadunimap' -> 'dir/bin/loadunimap' 2024-05-15T15:40:50.941 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/mapscrn' -> 'dir/bin/mapscrn' 2024-05-15T15:40:50.941 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/openvt' -> 'dir/bin/openvt' 2024-05-15T15:40:50.941 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/psfaddtable' -> 'dir/bin/psfaddtable' 2024-05-15T15:40:50.941 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/psfgettable' -> 'dir/bin/psfgettable' 2024-05-15T15:40:50.941 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/psfstriptable' -> 'dir/bin/psfstriptable' 2024-05-15T15:40:50.941 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/psfxtable' -> 'dir/bin/psfxtable' 2024-05-15T15:40:50.941 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/resizecons' -> 'dir/bin/resizecons' 2024-05-15T15:40:50.941 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/setfont' -> 'dir/bin/setfont' 2024-05-15T15:40:50.941 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/setkeycodes' -> 'dir/bin/setkeycodes' 2024-05-15T15:40:50.941 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/setleds' -> 'dir/bin/setleds' 2024-05-15T15:40:50.941 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/setmetamode' -> 'dir/bin/setmetamode' 2024-05-15T15:40:50.941 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/setvtrgb' -> 'dir/bin/setvtrgb' 2024-05-15T15:40:50.942 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/showconsolefont' -> 'dir/bin/showconsolefont' 2024-05-15T15:40:50.942 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/showkey' -> 'dir/bin/showkey' 2024-05-15T15:40:50.942 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/unicode_start' -> 'dir/bin/unicode_start' 2024-05-15T15:40:50.942 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/unicode_stop' -> 'dir/bin/unicode_stop' 2024-05-15T15:40:50.942 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/vlock' -> 'dir/bin/vlock' 2024-05-15T15:40:50.942 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/bootctl' -> 'dir/bin/bootctl' 2024-05-15T15:40:50.942 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ndptool' -> 'dir/bin/ndptool' 2024-05-15T15:40:50.942 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/pkgconf' -> 'dir/bin/pkgconf' 2024-05-15T15:40:50.942 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/pkg-config' -> 'dir/bin/pkg-config' 2024-05-15T15:40:50.942 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/x86_64-redhat-linux-gnu-pkg-config' -> 'dir/bin/x86_64-redhat-linux-gnu-pkg-config' 2024-05-15T15:40:50.942 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/cyrusbdb2current' -> 'dir/bin/cyrusbdb2current' 2024-05-15T15:40:50.942 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/lchsh' -> 'dir/bin/lchsh' 2024-05-15T15:40:50.943 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/cvtsudoers' -> 'dir/bin/cvtsudoers' 2024-05-15T15:40:50.943 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ld.gold' -> 'dir/bin/ld.gold' 2024-05-15T15:40:50.943 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/addr2line' -> 'dir/bin/addr2line' 2024-05-15T15:40:50.943 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ar' -> 'dir/bin/ar' 2024-05-15T15:40:50.943 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/as' -> 'dir/bin/as' 2024-05-15T15:40:50.943 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/c++filt' -> 'dir/bin/c++filt' 2024-05-15T15:40:50.943 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/dwp' -> 'dir/bin/dwp' 2024-05-15T15:40:50.943 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/elfedit' -> 'dir/bin/elfedit' 2024-05-15T15:40:50.943 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/gprof' -> 'dir/bin/gprof' 2024-05-15T15:40:50.943 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ld.bfd' -> 'dir/bin/ld.bfd' 2024-05-15T15:40:50.943 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/nm' -> 'dir/bin/nm' 2024-05-15T15:40:50.943 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/objcopy' -> 'dir/bin/objcopy' 2024-05-15T15:40:50.944 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/objdump' -> 'dir/bin/objdump' 2024-05-15T15:40:50.944 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ranlib' -> 'dir/bin/ranlib' 2024-05-15T15:40:50.944 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/readelf' -> 'dir/bin/readelf' 2024-05-15T15:40:50.944 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/size' -> 'dir/bin/size' 2024-05-15T15:40:50.944 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/strings' -> 'dir/bin/strings' 2024-05-15T15:40:50.944 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/strip' -> 'dir/bin/strip' 2024-05-15T15:40:50.944 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ld' -> 'dir/bin/ld' 2024-05-15T15:40:50.944 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/dirmngr' -> 'dir/bin/dirmngr' 2024-05-15T15:40:50.944 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/coredumpctl' -> 'dir/bin/coredumpctl' 2024-05-15T15:40:50.944 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/kernel-install' -> 'dir/bin/kernel-install' 2024-05-15T15:40:50.944 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/systemd-cryptenroll' -> 'dir/bin/systemd-cryptenroll' 2024-05-15T15:40:50.944 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/systemd-hwdb' -> 'dir/bin/systemd-hwdb' 2024-05-15T15:40:50.944 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/systemd-repart' -> 'dir/bin/systemd-repart' 2024-05-15T15:40:50.944 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/udevadm' -> 'dir/bin/udevadm' 2024-05-15T15:40:50.945 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/dracut' -> 'dir/bin/dracut' 2024-05-15T15:40:50.945 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/lsinitrd' -> 'dir/bin/lsinitrd' 2024-05-15T15:40:50.945 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/linux-boot-prober' -> 'dir/bin/linux-boot-prober' 2024-05-15T15:40:50.945 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/os-prober' -> 'dir/bin/os-prober' 2024-05-15T15:40:50.945 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/grub2-file' -> 'dir/bin/grub2-file' 2024-05-15T15:40:50.945 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/evmctl' -> 'dir/bin/evmctl' 2024-05-15T15:40:50.945 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/rpm' -> 'dir/bin/rpm' 2024-05-15T15:40:50.945 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/rpm2archive' -> 'dir/bin/rpm2archive' 2024-05-15T15:40:50.945 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/rpm2cpio' -> 'dir/bin/rpm2cpio' 2024-05-15T15:40:50.945 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/rpmdb' -> 'dir/bin/rpmdb' 2024-05-15T15:40:50.945 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/rpmkeys' -> 'dir/bin/rpmkeys' 2024-05-15T15:40:50.945 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/rpmquery' -> 'dir/bin/rpmquery' 2024-05-15T15:40:50.945 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/rpmverify' -> 'dir/bin/rpmverify' 2024-05-15T15:40:50.945 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/semodule_expand' -> 'dir/bin/semodule_expand' 2024-05-15T15:40:50.946 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/semodule_link' -> 'dir/bin/semodule_link' 2024-05-15T15:40:50.946 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/semodule_package' -> 'dir/bin/semodule_package' 2024-05-15T15:40:50.946 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/semodule_unpackage' -> 'dir/bin/semodule_unpackage' 2024-05-15T15:40:50.946 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/sestatus' -> 'dir/bin/sestatus' 2024-05-15T15:40:50.946 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/qemu-img' -> 'dir/bin/qemu-img' 2024-05-15T15:40:50.946 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/grub2-menulst2cfg' -> 'dir/bin/grub2-menulst2cfg' 2024-05-15T15:40:50.946 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/grub2-mkimage' -> 'dir/bin/grub2-mkimage' 2024-05-15T15:40:50.946 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/grub2-mkrelpath' -> 'dir/bin/grub2-mkrelpath' 2024-05-15T15:40:50.946 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/grub2-script-check' -> 'dir/bin/grub2-script-check' 2024-05-15T15:40:50.946 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/fips-mode-setup' -> 'dir/bin/fips-mode-setup' 2024-05-15T15:40:50.946 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/update-crypto-policies' -> 'dir/bin/update-crypto-policies' 2024-05-15T15:40:50.946 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/setup-nsssysinit' -> 'dir/bin/setup-nsssysinit' 2024-05-15T15:40:50.946 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/setup-nsssysinit.sh' -> 'dir/bin/setup-nsssysinit.sh' 2024-05-15T15:40:50.947 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/kdumpctl' -> 'dir/bin/kdumpctl' 2024-05-15T15:40:50.947 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/vdodmeventd' -> 'dir/bin/vdodmeventd' 2024-05-15T15:40:50.947 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/fprintd-delete' -> 'dir/bin/fprintd-delete' 2024-05-15T15:40:50.947 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/fprintd-enroll' -> 'dir/bin/fprintd-enroll' 2024-05-15T15:40:50.947 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/fprintd-list' -> 'dir/bin/fprintd-list' 2024-05-15T15:40:50.947 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/fprintd-verify' -> 'dir/bin/fprintd-verify' 2024-05-15T15:40:50.947 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/plymouth' -> 'dir/bin/plymouth' 2024-05-15T15:40:50.947 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/sudo' -> 'dir/bin/sudo' 2024-05-15T15:40:50.948 INFO:teuthology.orchestra.run.smithi104.stderr:cp: cannot open '/usr/bin/sudo' for reading: Permission denied 2024-05-15T15:40:50.948 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/sudoedit' -> 'dir/bin/sudoedit' 2024-05-15T15:40:50.948 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/sudoreplay' -> 'dir/bin/sudoreplay' 2024-05-15T15:40:50.949 INFO:teuthology.orchestra.run.smithi104.stderr:cp: cannot open '/usr/bin/sudoreplay' for reading: Permission denied 2024-05-15T15:40:51.507 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/aulastlog' -> 'dir/bin/aulastlog' 2024-05-15T15:40:51.507 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ausyscall' -> 'dir/bin/ausyscall' 2024-05-15T15:40:51.507 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/auvirt' -> 'dir/bin/auvirt' 2024-05-15T15:40:51.507 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/sss_ssh_knownhostsproxy' -> 'dir/bin/sss_ssh_knownhostsproxy' 2024-05-15T15:40:51.508 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/curl' -> 'dir/bin/curl' 2024-05-15T15:40:51.508 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/modulemd-validator' -> 'dir/bin/modulemd-validator' 2024-05-15T15:40:51.508 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/dirmngr-client' -> 'dir/bin/dirmngr-client' 2024-05-15T15:40:51.508 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/g13' -> 'dir/bin/g13' 2024-05-15T15:40:51.509 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/gpg' -> 'dir/bin/gpg' 2024-05-15T15:40:51.509 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/gpg-agent' -> 'dir/bin/gpg-agent' 2024-05-15T15:40:51.509 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/gpg-card' -> 'dir/bin/gpg-card' 2024-05-15T15:40:51.509 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/gpg-connect-agent' -> 'dir/bin/gpg-connect-agent' 2024-05-15T15:40:51.509 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/gpg-wks-client' -> 'dir/bin/gpg-wks-client' 2024-05-15T15:40:51.509 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/gpg-wks-server' -> 'dir/bin/gpg-wks-server' 2024-05-15T15:40:51.510 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/gpg2' -> 'dir/bin/gpg2' 2024-05-15T15:40:51.510 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/gpgconf' -> 'dir/bin/gpgconf' 2024-05-15T15:40:51.510 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/gpgparsemail' -> 'dir/bin/gpgparsemail' 2024-05-15T15:40:51.510 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/gpgsplit' -> 'dir/bin/gpgsplit' 2024-05-15T15:40:51.510 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/gpgtar' -> 'dir/bin/gpgtar' 2024-05-15T15:40:51.511 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/gpgv' -> 'dir/bin/gpgv' 2024-05-15T15:40:51.511 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/gpgv2' -> 'dir/bin/gpgv2' 2024-05-15T15:40:51.511 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/watchgnupg' -> 'dir/bin/watchgnupg' 2024-05-15T15:40:51.511 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/gpgme-json' -> 'dir/bin/gpgme-json' 2024-05-15T15:40:51.511 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/slirp4netns' -> 'dir/bin/slirp4netns' 2024-05-15T15:40:51.512 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/pkcon' -> 'dir/bin/pkcon' 2024-05-15T15:40:51.512 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/dnf' -> 'dir/bin/dnf' 2024-05-15T15:40:51.512 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/tracer' -> 'dir/bin/tracer' 2024-05-15T15:40:51.512 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/sealert' -> 'dir/bin/sealert' 2024-05-15T15:40:51.512 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/cpansign' -> 'dir/bin/cpansign' 2024-05-15T15:40:51.512 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/whiptail' -> 'dir/bin/whiptail' 2024-05-15T15:40:51.512 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/checkpolicy' -> 'dir/bin/checkpolicy' 2024-05-15T15:40:51.513 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/sedismod' -> 'dir/bin/sedismod' 2024-05-15T15:40:51.514 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/sedispol' -> 'dir/bin/sedispol' 2024-05-15T15:40:51.514 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/audit2allow' -> 'dir/bin/audit2allow' 2024-05-15T15:40:51.515 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/audit2why' -> 'dir/bin/audit2why' 2024-05-15T15:40:51.515 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/chcat' -> 'dir/bin/chcat' 2024-05-15T15:40:51.515 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/arping' -> 'dir/bin/arping' 2024-05-15T15:40:51.515 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/fribidi' -> 'dir/bin/fribidi' 2024-05-15T15:40:51.516 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/c99' -> 'dir/bin/c99' 2024-05-15T15:40:51.516 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/cc' -> 'dir/bin/cc' 2024-05-15T15:40:51.516 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/gcc-ar' -> 'dir/bin/gcc-ar' 2024-05-15T15:40:51.516 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/gcc-nm' -> 'dir/bin/gcc-nm' 2024-05-15T15:40:51.517 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/gcc-ranlib' -> 'dir/bin/gcc-ranlib' 2024-05-15T15:40:51.517 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/gcov' -> 'dir/bin/gcov' 2024-05-15T15:40:51.517 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/gcov-dump' -> 'dir/bin/gcov-dump' 2024-05-15T15:40:51.518 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/gcov-tool' -> 'dir/bin/gcov-tool' 2024-05-15T15:40:51.518 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/lto-dump' -> 'dir/bin/lto-dump' 2024-05-15T15:40:51.518 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/gcc' -> 'dir/bin/gcc' 2024-05-15T15:40:51.518 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/x86_64-redhat-linux-gcc-11' -> 'dir/bin/x86_64-redhat-linux-gcc-11' 2024-05-15T15:40:51.518 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/x86_64-redhat-linux-gcc' -> 'dir/bin/x86_64-redhat-linux-gcc' 2024-05-15T15:40:51.518 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/h2xs' -> 'dir/bin/h2xs' 2024-05-15T15:40:51.519 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/perlivp' -> 'dir/bin/perlivp' 2024-05-15T15:40:51.519 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/cpan' -> 'dir/bin/cpan' 2024-05-15T15:40:51.519 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/instmodsh' -> 'dir/bin/instmodsh' 2024-05-15T15:40:51.519 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/config_data' -> 'dir/bin/config_data' 2024-05-15T15:40:51.519 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/enc2xs' -> 'dir/bin/enc2xs' 2024-05-15T15:40:51.520 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/pango-list' -> 'dir/bin/pango-list' 2024-05-15T15:40:51.520 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/pango-segmentation' -> 'dir/bin/pango-segmentation' 2024-05-15T15:40:51.520 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/pango-view' -> 'dir/bin/pango-view' 2024-05-15T15:40:51.520 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/cpan-mirrors' -> 'dir/bin/cpan-mirrors' 2024-05-15T15:40:51.520 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/chvt' -> 'dir/bin/chvt' 2024-05-15T15:40:51.521 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/gdk-pixbuf-query-loaders-64' -> 'dir/bin/gdk-pixbuf-query-loaders-64' 2024-05-15T15:40:51.521 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/gdk-pixbuf-thumbnailer' -> 'dir/bin/gdk-pixbuf-thumbnailer' 2024-05-15T15:40:51.521 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/mmdblookup' -> 'dir/bin/mmdblookup' 2024-05-15T15:40:51.521 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/appstream-compose' -> 'dir/bin/appstream-compose' 2024-05-15T15:40:51.521 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/appstream-util' -> 'dir/bin/appstream-util' 2024-05-15T15:40:51.521 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/pkmon' -> 'dir/bin/pkmon' 2024-05-15T15:40:51.522 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/arpaname' -> 'dir/bin/arpaname' 2024-05-15T15:40:51.522 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/delv' -> 'dir/bin/delv' 2024-05-15T15:40:51.522 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/dig' -> 'dir/bin/dig' 2024-05-15T15:40:51.522 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/dnstap-read' -> 'dir/bin/dnstap-read' 2024-05-15T15:40:51.522 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/host' -> 'dir/bin/host' 2024-05-15T15:40:51.523 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/nslookup' -> 'dir/bin/nslookup' 2024-05-15T15:40:51.523 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/nsupdate' -> 'dir/bin/nsupdate' 2024-05-15T15:40:51.523 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/free' -> 'dir/bin/free' 2024-05-15T15:40:51.523 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/chfn' -> 'dir/bin/chfn' 2024-05-15T15:40:51.524 INFO:teuthology.orchestra.run.smithi104.stderr:cp: cannot open '/usr/bin/chfn' for reading: Permission denied 2024-05-15T15:40:51.751 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/blkiomon' -> 'dir/bin/blkiomon' 2024-05-15T15:40:51.752 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/blkparse' -> 'dir/bin/blkparse' 2024-05-15T15:40:51.752 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/blkrawverify' -> 'dir/bin/blkrawverify' 2024-05-15T15:40:51.752 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/blktrace' -> 'dir/bin/blktrace' 2024-05-15T15:40:51.752 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/bno_plot.py' -> 'dir/bin/bno_plot.py' 2024-05-15T15:40:51.752 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/btrace' -> 'dir/bin/btrace' 2024-05-15T15:40:51.752 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/btrecord' -> 'dir/bin/btrecord' 2024-05-15T15:40:51.752 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/btreplay' -> 'dir/bin/btreplay' 2024-05-15T15:40:51.752 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/btt' -> 'dir/bin/btt' 2024-05-15T15:40:51.753 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/verify_blkparse' -> 'dir/bin/verify_blkparse' 2024-05-15T15:40:51.753 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/vim' -> 'dir/bin/vim' 2024-05-15T15:40:51.753 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/vimdiff' -> 'dir/bin/vimdiff' 2024-05-15T15:40:51.753 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/vimtutor' -> 'dir/bin/vimtutor' 2024-05-15T15:40:51.753 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/yum' -> 'dir/bin/yum' 2024-05-15T15:40:51.753 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/initdb' -> 'dir/bin/initdb' 2024-05-15T15:40:51.753 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/rvim' -> 'dir/bin/rvim' 2024-05-15T15:40:51.753 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/g++' -> 'dir/bin/g++' 2024-05-15T15:40:51.753 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/x86_64-redhat-linux-c++' -> 'dir/bin/x86_64-redhat-linux-c++' 2024-05-15T15:40:51.753 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/c++' -> 'dir/bin/c++' 2024-05-15T15:40:51.753 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/x86_64-redhat-linux-g++' -> 'dir/bin/x86_64-redhat-linux-g++' 2024-05-15T15:40:51.753 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/git' -> 'dir/bin/git' 2024-05-15T15:40:51.754 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/git-receive-pack' -> 'dir/bin/git-receive-pack' 2024-05-15T15:40:51.754 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/sftp' -> 'dir/bin/sftp' 2024-05-15T15:40:51.754 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ssh' -> 'dir/bin/ssh' 2024-05-15T15:40:51.754 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ssh-add' -> 'dir/bin/ssh-add' 2024-05-15T15:40:51.754 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ssh-agent' -> 'dir/bin/ssh-agent' 2024-05-15T15:40:51.754 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ssh-copy-id' -> 'dir/bin/ssh-copy-id' 2024-05-15T15:40:51.754 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ssh-keyscan' -> 'dir/bin/ssh-keyscan' 2024-05-15T15:40:51.754 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/git-shell' -> 'dir/bin/git-shell' 2024-05-15T15:40:51.754 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/vdodumpconfig' -> 'dir/bin/vdodumpconfig' 2024-05-15T15:40:51.754 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/vdoforcerebuild' -> 'dir/bin/vdoforcerebuild' 2024-05-15T15:40:51.754 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/vdoformat' -> 'dir/bin/vdoformat' 2024-05-15T15:40:51.754 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/vdosetuuid' -> 'dir/bin/vdosetuuid' 2024-05-15T15:40:51.754 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/vdostats' -> 'dir/bin/vdostats' 2024-05-15T15:40:51.755 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/grub2-glue-efi' -> 'dir/bin/grub2-glue-efi' 2024-05-15T15:40:51.755 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/passwd' -> 'dir/bin/passwd' 2024-05-15T15:40:51.755 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/chsh' -> 'dir/bin/chsh' 2024-05-15T15:40:51.755 INFO:teuthology.orchestra.run.smithi104.stderr:cp: cannot open '/usr/bin/chsh' for reading: Permission denied 2024-05-15T15:40:51.993 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/lsof' -> 'dir/bin/lsof' 2024-05-15T15:40:51.993 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/quota' -> 'dir/bin/quota' 2024-05-15T15:40:51.993 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/quotasync' -> 'dir/bin/quotasync' 2024-05-15T15:40:51.993 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/apropos.man-db' -> 'dir/bin/apropos.man-db' 2024-05-15T15:40:51.994 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/catman' -> 'dir/bin/catman' 2024-05-15T15:40:51.994 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/lexgrog' -> 'dir/bin/lexgrog' 2024-05-15T15:40:51.994 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/man-recode' -> 'dir/bin/man-recode' 2024-05-15T15:40:51.994 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/man.man-db' -> 'dir/bin/man.man-db' 2024-05-15T15:40:51.994 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/mandb' -> 'dir/bin/mandb' 2024-05-15T15:40:51.994 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/manpath' -> 'dir/bin/manpath' 2024-05-15T15:40:51.995 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/whatis.man-db' -> 'dir/bin/whatis.man-db' 2024-05-15T15:40:51.995 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/man' -> 'dir/bin/man' 2024-05-15T15:40:51.995 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/apropos' -> 'dir/bin/apropos' 2024-05-15T15:40:51.995 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/whatis' -> 'dir/bin/whatis' 2024-05-15T15:40:51.995 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/firewall-offline-cmd' -> 'dir/bin/firewall-offline-cmd' 2024-05-15T15:40:51.995 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/git-upload-archive' -> 'dir/bin/git-upload-archive' 2024-05-15T15:40:51.995 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/git-upload-pack' -> 'dir/bin/git-upload-pack' 2024-05-15T15:40:51.995 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/scalar' -> 'dir/bin/scalar' 2024-05-15T15:40:51.996 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/chronyc' -> 'dir/bin/chronyc' 2024-05-15T15:40:51.996 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/strace' -> 'dir/bin/strace' 2024-05-15T15:40:51.996 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/strace-log-merge' -> 'dir/bin/strace-log-merge' 2024-05-15T15:40:51.996 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/at' -> 'dir/bin/at' 2024-05-15T15:40:51.996 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/atq' -> 'dir/bin/atq' 2024-05-15T15:40:51.996 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/atrm' -> 'dir/bin/atrm' 2024-05-15T15:40:51.996 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/batch' -> 'dir/bin/batch' 2024-05-15T15:40:51.996 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/avinfo' -> 'dir/bin/avinfo' 2024-05-15T15:40:51.997 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/bluemoon' -> 'dir/bin/bluemoon' 2024-05-15T15:40:51.997 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/bluetoothctl' -> 'dir/bin/bluetoothctl' 2024-05-15T15:40:51.997 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/btattach' -> 'dir/bin/btattach' 2024-05-15T15:40:51.997 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/btmgmt' -> 'dir/bin/btmgmt' 2024-05-15T15:40:51.997 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/btmon' -> 'dir/bin/btmon' 2024-05-15T15:40:51.997 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/hex2hcd' -> 'dir/bin/hex2hcd' 2024-05-15T15:40:51.997 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/l2ping' -> 'dir/bin/l2ping' 2024-05-15T15:40:51.997 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/l2test' -> 'dir/bin/l2test' 2024-05-15T15:40:51.998 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/mpris-proxy' -> 'dir/bin/mpris-proxy' 2024-05-15T15:40:51.998 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/rctest' -> 'dir/bin/rctest' 2024-05-15T15:40:51.998 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/firewall-cmd' -> 'dir/bin/firewall-cmd' 2024-05-15T15:40:51.998 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/locate' -> 'dir/bin/locate' 2024-05-15T15:40:51.998 INFO:teuthology.orchestra.run.smithi104.stderr:cp: cannot open '/usr/bin/locate' for reading: Permission denied 2024-05-15T15:40:52.397 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/updatedb' -> 'dir/bin/updatedb' 2024-05-15T15:40:52.397 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/netstat' -> 'dir/bin/netstat' 2024-05-15T15:40:52.397 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ac' -> 'dir/bin/ac' 2024-05-15T15:40:52.397 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/lastcomm' -> 'dir/bin/lastcomm' 2024-05-15T15:40:52.397 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/lsusb' -> 'dir/bin/lsusb' 2024-05-15T15:40:52.397 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ed' -> 'dir/bin/ed' 2024-05-15T15:40:52.397 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/red' -> 'dir/bin/red' 2024-05-15T15:40:52.397 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/fuse2fs' -> 'dir/bin/fuse2fs' 2024-05-15T15:40:52.397 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/lsattr' -> 'dir/bin/lsattr' 2024-05-15T15:40:52.397 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/nc' -> 'dir/bin/nc' 2024-05-15T15:40:52.398 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/pip-3' -> 'dir/bin/pip-3' 2024-05-15T15:40:52.398 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/pip-3.9' -> 'dir/bin/pip-3.9' 2024-05-15T15:40:52.398 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/pip3' -> 'dir/bin/pip3' 2024-05-15T15:40:52.398 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/pip3.9' -> 'dir/bin/pip3.9' 2024-05-15T15:40:52.398 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/rsvg-convert' -> 'dir/bin/rsvg-convert' 2024-05-15T15:40:52.398 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/lsusb.py' -> 'dir/bin/lsusb.py' 2024-05-15T15:40:52.398 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/usb-devices' -> 'dir/bin/usb-devices' 2024-05-15T15:40:52.398 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/usbhid-dump' -> 'dir/bin/usbhid-dump' 2024-05-15T15:40:52.398 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/pip' -> 'dir/bin/pip' 2024-05-15T15:40:52.398 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/pinfo' -> 'dir/bin/pinfo' 2024-05-15T15:40:52.398 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ncat' -> 'dir/bin/ncat' 2024-05-15T15:40:52.398 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/rescan-scsi-bus.sh' -> 'dir/bin/rescan-scsi-bus.sh' 2024-05-15T15:40:52.398 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/scsi-rescan' -> 'dir/bin/scsi-rescan' 2024-05-15T15:40:52.399 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/scsi_logging_level' -> 'dir/bin/scsi_logging_level' 2024-05-15T15:40:52.399 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/scsi_mandat' -> 'dir/bin/scsi_mandat' 2024-05-15T15:40:52.399 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/scsi_readcap' -> 'dir/bin/scsi_readcap' 2024-05-15T15:40:52.399 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/scsi_ready' -> 'dir/bin/scsi_ready' 2024-05-15T15:40:52.399 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/scsi_satl' -> 'dir/bin/scsi_satl' 2024-05-15T15:40:52.399 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/scsi_start' -> 'dir/bin/scsi_start' 2024-05-15T15:40:52.399 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/scsi_stop' -> 'dir/bin/scsi_stop' 2024-05-15T15:40:52.399 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/scsi_temperature' -> 'dir/bin/scsi_temperature' 2024-05-15T15:40:52.399 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/sg_bg_ctl' -> 'dir/bin/sg_bg_ctl' 2024-05-15T15:40:52.399 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/sg_compare_and_write' -> 'dir/bin/sg_compare_and_write' 2024-05-15T15:40:52.399 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/sg_copy_results' -> 'dir/bin/sg_copy_results' 2024-05-15T15:40:52.399 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/sg_dd' -> 'dir/bin/sg_dd' 2024-05-15T15:40:52.399 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/sg_decode_sense' -> 'dir/bin/sg_decode_sense' 2024-05-15T15:40:52.399 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/sg_emc_trespass' -> 'dir/bin/sg_emc_trespass' 2024-05-15T15:40:52.400 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/sg_format' -> 'dir/bin/sg_format' 2024-05-15T15:40:52.400 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/sg_get_config' -> 'dir/bin/sg_get_config' 2024-05-15T15:40:52.400 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/sg_get_elem_status' -> 'dir/bin/sg_get_elem_status' 2024-05-15T15:40:52.400 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/sg_get_lba_status' -> 'dir/bin/sg_get_lba_status' 2024-05-15T15:40:52.400 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/sg_ident' -> 'dir/bin/sg_ident' 2024-05-15T15:40:52.400 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/sg_inq' -> 'dir/bin/sg_inq' 2024-05-15T15:40:52.400 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/sg_logs' -> 'dir/bin/sg_logs' 2024-05-15T15:40:52.400 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/sg_luns' -> 'dir/bin/sg_luns' 2024-05-15T15:40:52.400 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/sg_map' -> 'dir/bin/sg_map' 2024-05-15T15:40:52.400 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/sg_map26' -> 'dir/bin/sg_map26' 2024-05-15T15:40:52.400 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/sg_modes' -> 'dir/bin/sg_modes' 2024-05-15T15:40:52.400 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/sg_opcodes' -> 'dir/bin/sg_opcodes' 2024-05-15T15:40:52.400 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/sg_persist' -> 'dir/bin/sg_persist' 2024-05-15T15:40:52.401 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/sg_prevent' -> 'dir/bin/sg_prevent' 2024-05-15T15:40:52.401 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/sg_raw' -> 'dir/bin/sg_raw' 2024-05-15T15:40:52.401 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/sg_rbuf' -> 'dir/bin/sg_rbuf' 2024-05-15T15:40:52.401 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/sg_rdac' -> 'dir/bin/sg_rdac' 2024-05-15T15:40:52.401 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/sg_read' -> 'dir/bin/sg_read' 2024-05-15T15:40:52.401 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/sg_read_attr' -> 'dir/bin/sg_read_attr' 2024-05-15T15:40:52.401 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/sg_read_block_limits' -> 'dir/bin/sg_read_block_limits' 2024-05-15T15:40:52.401 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/sg_read_buffer' -> 'dir/bin/sg_read_buffer' 2024-05-15T15:40:52.401 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/sg_read_long' -> 'dir/bin/sg_read_long' 2024-05-15T15:40:52.401 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/sg_readcap' -> 'dir/bin/sg_readcap' 2024-05-15T15:40:52.401 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/sg_reassign' -> 'dir/bin/sg_reassign' 2024-05-15T15:40:52.401 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/sg_referrals' -> 'dir/bin/sg_referrals' 2024-05-15T15:40:52.402 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/sg_rep_pip' -> 'dir/bin/sg_rep_pip' 2024-05-15T15:40:52.402 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/sg_rep_zones' -> 'dir/bin/sg_rep_zones' 2024-05-15T15:40:52.402 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/sg_requests' -> 'dir/bin/sg_requests' 2024-05-15T15:40:52.402 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/sg_reset' -> 'dir/bin/sg_reset' 2024-05-15T15:40:52.402 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/sg_reset_wp' -> 'dir/bin/sg_reset_wp' 2024-05-15T15:40:52.402 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/sg_rmsn' -> 'dir/bin/sg_rmsn' 2024-05-15T15:40:52.402 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/sg_rtpg' -> 'dir/bin/sg_rtpg' 2024-05-15T15:40:52.402 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/sg_safte' -> 'dir/bin/sg_safte' 2024-05-15T15:40:52.402 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/sg_sanitize' -> 'dir/bin/sg_sanitize' 2024-05-15T15:40:52.402 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/sg_sat_identify' -> 'dir/bin/sg_sat_identify' 2024-05-15T15:40:52.402 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/sg_sat_phy_event' -> 'dir/bin/sg_sat_phy_event' 2024-05-15T15:40:52.402 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/sg_sat_read_gplog' -> 'dir/bin/sg_sat_read_gplog' 2024-05-15T15:40:52.402 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/sg_sat_set_features' -> 'dir/bin/sg_sat_set_features' 2024-05-15T15:40:52.402 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/sg_scan' -> 'dir/bin/sg_scan' 2024-05-15T15:40:52.402 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/sg_seek' -> 'dir/bin/sg_seek' 2024-05-15T15:40:52.403 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/sg_senddiag' -> 'dir/bin/sg_senddiag' 2024-05-15T15:40:52.403 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/sg_ses' -> 'dir/bin/sg_ses' 2024-05-15T15:40:52.403 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/sg_ses_microcode' -> 'dir/bin/sg_ses_microcode' 2024-05-15T15:40:52.403 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/sg_start' -> 'dir/bin/sg_start' 2024-05-15T15:40:52.403 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/sg_stpg' -> 'dir/bin/sg_stpg' 2024-05-15T15:40:52.403 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/sg_stream_ctl' -> 'dir/bin/sg_stream_ctl' 2024-05-15T15:40:52.403 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/sg_sync' -> 'dir/bin/sg_sync' 2024-05-15T15:40:52.403 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/sg_test_rwbuf' -> 'dir/bin/sg_test_rwbuf' 2024-05-15T15:40:52.403 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/sg_timestamp' -> 'dir/bin/sg_timestamp' 2024-05-15T15:40:52.403 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/sg_turs' -> 'dir/bin/sg_turs' 2024-05-15T15:40:52.403 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/sg_unmap' -> 'dir/bin/sg_unmap' 2024-05-15T15:40:52.403 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/sg_verify' -> 'dir/bin/sg_verify' 2024-05-15T15:40:52.403 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/sg_vpd' -> 'dir/bin/sg_vpd' 2024-05-15T15:40:52.643 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:40:52.646 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:40:52.648 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:40:53.202 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/sg_wr_mode' -> 'dir/bin/sg_wr_mode' 2024-05-15T15:40:53.203 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/sg_write_buffer' -> 'dir/bin/sg_write_buffer' 2024-05-15T15:40:53.203 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/sg_write_long' -> 'dir/bin/sg_write_long' 2024-05-15T15:40:53.203 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/sg_write_same' -> 'dir/bin/sg_write_same' 2024-05-15T15:40:53.203 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/sg_write_verify' -> 'dir/bin/sg_write_verify' 2024-05-15T15:40:53.203 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/sg_write_x' -> 'dir/bin/sg_write_x' 2024-05-15T15:40:53.203 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/sg_xcopy' -> 'dir/bin/sg_xcopy' 2024-05-15T15:40:53.203 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/sg_zone' -> 'dir/bin/sg_zone' 2024-05-15T15:40:53.203 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/sginfo' -> 'dir/bin/sginfo' 2024-05-15T15:40:53.203 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/sgm_dd' -> 'dir/bin/sgm_dd' 2024-05-15T15:40:53.203 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/sgp_dd' -> 'dir/bin/sgp_dd' 2024-05-15T15:40:53.203 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/wget' -> 'dir/bin/wget' 2024-05-15T15:40:53.204 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/nano' -> 'dir/bin/nano' 2024-05-15T15:40:53.204 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/rnano' -> 'dir/bin/rnano' 2024-05-15T15:40:53.204 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/rvi' -> 'dir/bin/rvi' 2024-05-15T15:40:53.204 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/rview' -> 'dir/bin/rview' 2024-05-15T15:40:53.204 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/vi' -> 'dir/bin/vi' 2024-05-15T15:40:53.204 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/view' -> 'dir/bin/view' 2024-05-15T15:40:53.204 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/bc' -> 'dir/bin/bc' 2024-05-15T15:40:53.204 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/dc' -> 'dir/bin/dc' 2024-05-15T15:40:53.204 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/less' -> 'dir/bin/less' 2024-05-15T15:40:53.204 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/dos2unix' -> 'dir/bin/dos2unix' 2024-05-15T15:40:53.204 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/mac2unix' -> 'dir/bin/mac2unix' 2024-05-15T15:40:53.204 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/unix2dos' -> 'dir/bin/unix2dos' 2024-05-15T15:40:53.204 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/unix2mac' -> 'dir/bin/unix2mac' 2024-05-15T15:40:53.204 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/lsscsi' -> 'dir/bin/lsscsi' 2024-05-15T15:40:53.205 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/symlinks' -> 'dir/bin/symlinks' 2024-05-15T15:40:53.205 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/time' -> 'dir/bin/time' 2024-05-15T15:40:53.205 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/tree' -> 'dir/bin/tree' 2024-05-15T15:40:53.205 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/bashbug' -> 'dir/bin/bashbug' 2024-05-15T15:40:53.205 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/find' -> 'dir/bin/find' 2024-05-15T15:40:53.205 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/p11-kit' -> 'dir/bin/p11-kit' 2024-05-15T15:40:53.205 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/trust' -> 'dir/bin/trust' 2024-05-15T15:40:53.205 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/jq' -> 'dir/bin/jq' 2024-05-15T15:40:53.205 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/[' -> 'dir/bin/[' 2024-05-15T15:40:53.205 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/kmod' -> 'dir/bin/kmod' 2024-05-15T15:40:53.205 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/gapplication' -> 'dir/bin/gapplication' 2024-05-15T15:40:53.205 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/centrino-decode' -> 'dir/bin/centrino-decode' 2024-05-15T15:40:53.205 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/sss_ssh_authorizedkeys' -> 'dir/bin/sss_ssh_authorizedkeys' 2024-05-15T15:40:53.205 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/pkaction' -> 'dir/bin/pkaction' 2024-05-15T15:40:53.206 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/secon' -> 'dir/bin/secon' 2024-05-15T15:40:53.206 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/lchfn' -> 'dir/bin/lchfn' 2024-05-15T15:40:53.206 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/c89' -> 'dir/bin/c89' 2024-05-15T15:40:53.206 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/dnf-3' -> 'dir/bin/dnf-3' 2024-05-15T15:40:53.206 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/sha512hmac' -> 'dir/bin/sha512hmac' 2024-05-15T15:40:53.206 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/sha256hmac' -> 'dir/bin/sha256hmac' 2024-05-15T15:40:53.206 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/sha224hmac' -> 'dir/bin/sha224hmac' 2024-05-15T15:40:53.206 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/sha1hmac' -> 'dir/bin/sha1hmac' 2024-05-15T15:40:53.206 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/sha384hmac' -> 'dir/bin/sha384hmac' 2024-05-15T15:40:53.206 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/sm3hmac' -> 'dir/bin/sm3hmac' 2024-05-15T15:40:53.206 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/fips-finish-install' -> 'dir/bin/fips-finish-install' 2024-05-15T15:40:53.206 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/scp' -> 'dir/bin/scp' 2024-05-15T15:40:53.207 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/grub2-render-label' -> 'dir/bin/grub2-render-label' 2024-05-15T15:40:53.207 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/grub2-fstest' -> 'dir/bin/grub2-fstest' 2024-05-15T15:40:53.207 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/grub2-kbdcomp' -> 'dir/bin/grub2-kbdcomp' 2024-05-15T15:40:53.207 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/grub2-mkfont' -> 'dir/bin/grub2-mkfont' 2024-05-15T15:40:53.207 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/grub2-mklayout' -> 'dir/bin/grub2-mklayout' 2024-05-15T15:40:53.207 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/grub2-mknetdir' -> 'dir/bin/grub2-mknetdir' 2024-05-15T15:40:53.207 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/grub2-mkrescue' -> 'dir/bin/grub2-mkrescue' 2024-05-15T15:40:53.207 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/grub2-mkstandalone' -> 'dir/bin/grub2-mkstandalone' 2024-05-15T15:40:53.207 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/grub2-syslinux2cfg' -> 'dir/bin/grub2-syslinux2cfg' 2024-05-15T15:40:53.207 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/chattr' -> 'dir/bin/chattr' 2024-05-15T15:40:53.207 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/genl-ctrl-list' -> 'dir/bin/genl-ctrl-list' 2024-05-15T15:40:53.208 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/nl-pktloc-lookup' -> 'dir/bin/nl-pktloc-lookup' 2024-05-15T15:40:53.208 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/json_reformat' -> 'dir/bin/json_reformat' 2024-05-15T15:40:53.208 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/json_verify' -> 'dir/bin/json_verify' 2024-05-15T15:40:53.208 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/m4' -> 'dir/bin/m4' 2024-05-15T15:40:53.208 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/crun' -> 'dir/bin/crun' 2024-05-15T15:40:53.208 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/qemu-io' -> 'dir/bin/qemu-io' 2024-05-15T15:40:53.208 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/qemu-nbd' -> 'dir/bin/qemu-nbd' 2024-05-15T15:40:53.208 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/qemu-storage-daemon' -> 'dir/bin/qemu-storage-daemon' 2024-05-15T15:40:53.208 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/conmon' -> 'dir/bin/conmon' 2024-05-15T15:40:53.208 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/cstool' -> 'dir/bin/cstool' 2024-05-15T15:40:53.208 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/check-regexp' -> 'dir/bin/check-regexp' 2024-05-15T15:40:53.208 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/cpp2html' -> 'dir/bin/cpp2html' 2024-05-15T15:40:53.208 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/java2html' -> 'dir/bin/java2html' 2024-05-15T15:40:53.209 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/source-highlight' -> 'dir/bin/source-highlight' 2024-05-15T15:40:53.209 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/source-highlight-esc.sh' -> 'dir/bin/source-highlight-esc.sh' 2024-05-15T15:40:53.209 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/source-highlight-settings' -> 'dir/bin/source-highlight-settings' 2024-05-15T15:40:53.209 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/src-hilite-lesspipe.sh' -> 'dir/bin/src-hilite-lesspipe.sh' 2024-05-15T15:40:53.209 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/gdb-add-index' -> 'dir/bin/gdb-add-index' 2024-05-15T15:40:53.209 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/passt' -> 'dir/bin/passt' 2024-05-15T15:40:53.209 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/getsubids' -> 'dir/bin/getsubids' 2024-05-15T15:40:53.209 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/rpcbind' -> 'dir/bin/rpcbind' 2024-05-15T15:40:53.209 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/rpcinfo' -> 'dir/bin/rpcinfo' 2024-05-15T15:40:53.209 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/keyctl' -> 'dir/bin/keyctl' 2024-05-15T15:40:53.209 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/fusermount3' -> 'dir/bin/fusermount3' 2024-05-15T15:40:53.209 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/fuse-overlayfs' -> 'dir/bin/fuse-overlayfs' 2024-05-15T15:40:53.209 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/daemon-helper' -> 'dir/bin/daemon-helper' 2024-05-15T15:40:53.210 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/gcore' -> 'dir/bin/gcore' 2024-05-15T15:40:53.210 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/gdb' -> 'dir/bin/gdb' 2024-05-15T15:40:53.210 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/gstack' -> 'dir/bin/gstack' 2024-05-15T15:40:53.600 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/pstack' -> 'dir/bin/pstack' 2024-05-15T15:40:53.600 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/passt.avx2' -> 'dir/bin/passt.avx2' 2024-05-15T15:40:53.600 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/cifsiostat' -> 'dir/bin/cifsiostat' 2024-05-15T15:40:53.600 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/iostat' -> 'dir/bin/iostat' 2024-05-15T15:40:53.600 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/mpstat' -> 'dir/bin/mpstat' 2024-05-15T15:40:53.600 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/pidstat' -> 'dir/bin/pidstat' 2024-05-15T15:40:53.601 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/sadf' -> 'dir/bin/sadf' 2024-05-15T15:40:53.601 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/sar' -> 'dir/bin/sar' 2024-05-15T15:40:53.601 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/tapestat' -> 'dir/bin/tapestat' 2024-05-15T15:40:53.601 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/autoconf' -> 'dir/bin/autoconf' 2024-05-15T15:40:53.601 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/autoheader' -> 'dir/bin/autoheader' 2024-05-15T15:40:53.601 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/autom4te' -> 'dir/bin/autom4te' 2024-05-15T15:40:53.601 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/autoreconf' -> 'dir/bin/autoreconf' 2024-05-15T15:40:53.601 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/autoscan' -> 'dir/bin/autoscan' 2024-05-15T15:40:53.601 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/autoupdate' -> 'dir/bin/autoupdate' 2024-05-15T15:40:53.601 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ifnames' -> 'dir/bin/ifnames' 2024-05-15T15:40:53.601 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ncurses6-config' -> 'dir/bin/ncurses6-config' 2024-05-15T15:40:53.601 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ncursesw6-config' -> 'dir/bin/ncursesw6-config' 2024-05-15T15:40:53.602 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/genisoimage' -> 'dir/bin/genisoimage' 2024-05-15T15:40:53.602 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/isodebug' -> 'dir/bin/isodebug' 2024-05-15T15:40:53.602 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/isodump' -> 'dir/bin/isodump' 2024-05-15T15:40:53.602 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/isoinfo' -> 'dir/bin/isoinfo' 2024-05-15T15:40:53.602 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/isovfy' -> 'dir/bin/isovfy' 2024-05-15T15:40:53.602 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/pitchplay' -> 'dir/bin/pitchplay' 2024-05-15T15:40:53.602 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/readmult' -> 'dir/bin/readmult' 2024-05-15T15:40:53.602 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/mkisofs' -> 'dir/bin/mkisofs' 2024-05-15T15:40:53.602 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/mkhybrid' -> 'dir/bin/mkhybrid' 2024-05-15T15:40:53.602 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/iozone' -> 'dir/bin/iozone' 2024-05-15T15:40:53.602 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/callgrind_annotate' -> 'dir/bin/callgrind_annotate' 2024-05-15T15:40:53.602 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/callgrind_control' -> 'dir/bin/callgrind_control' 2024-05-15T15:40:53.603 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/cg_annotate' -> 'dir/bin/cg_annotate' 2024-05-15T15:40:53.603 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/cg_diff' -> 'dir/bin/cg_diff' 2024-05-15T15:40:53.603 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/cg_merge' -> 'dir/bin/cg_merge' 2024-05-15T15:40:53.603 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ms_print' -> 'dir/bin/ms_print' 2024-05-15T15:40:53.603 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/valgrind' -> 'dir/bin/valgrind' 2024-05-15T15:40:53.603 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/valgrind-di-server' -> 'dir/bin/valgrind-di-server' 2024-05-15T15:40:53.603 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/valgrind-listener' -> 'dir/bin/valgrind-listener' 2024-05-15T15:40:53.603 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/vgdb' -> 'dir/bin/vgdb' 2024-05-15T15:40:53.603 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/debuginfo-install' -> 'dir/bin/debuginfo-install' 2024-05-15T15:40:53.603 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/find-repos-of-install' -> 'dir/bin/find-repos-of-install' 2024-05-15T15:40:53.603 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/needs-restarting' -> 'dir/bin/needs-restarting' 2024-05-15T15:40:53.604 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/package-cleanup' -> 'dir/bin/package-cleanup' 2024-05-15T15:40:53.604 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/repo-graph' -> 'dir/bin/repo-graph' 2024-05-15T15:40:53.604 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/repoclosure' -> 'dir/bin/repoclosure' 2024-05-15T15:40:53.604 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/repodiff' -> 'dir/bin/repodiff' 2024-05-15T15:40:53.604 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/repomanage' -> 'dir/bin/repomanage' 2024-05-15T15:40:53.604 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/repoquery' -> 'dir/bin/repoquery' 2024-05-15T15:40:53.604 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/reposync' -> 'dir/bin/reposync' 2024-05-15T15:40:53.604 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/repotrack' -> 'dir/bin/repotrack' 2024-05-15T15:40:53.604 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/yum-builddep' -> 'dir/bin/yum-builddep' 2024-05-15T15:40:53.604 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/yum-config-manager' -> 'dir/bin/yum-config-manager' 2024-05-15T15:40:53.604 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/yum-debug-dump' -> 'dir/bin/yum-debug-dump' 2024-05-15T15:40:53.604 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/yum-debug-restore' -> 'dir/bin/yum-debug-restore' 2024-05-15T15:40:53.604 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/yum-groups-manager' -> 'dir/bin/yum-groups-manager' 2024-05-15T15:40:53.604 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/yumdownloader' -> 'dir/bin/yumdownloader' 2024-05-15T15:40:53.605 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/dbench' -> 'dir/bin/dbench' 2024-05-15T15:40:53.605 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/tbench' -> 'dir/bin/tbench' 2024-05-15T15:40:53.605 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/tbench_srv' -> 'dir/bin/tbench_srv' 2024-05-15T15:40:53.605 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/lspci' -> 'dir/bin/lspci' 2024-05-15T15:40:53.605 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/nm-online' -> 'dir/bin/nm-online' 2024-05-15T15:40:53.605 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/nmcli' -> 'dir/bin/nmcli' 2024-05-15T15:40:53.605 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/xmlstarlet' -> 'dir/bin/xmlstarlet' 2024-05-15T15:40:53.605 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/uuid' -> 'dir/bin/uuid' 2024-05-15T15:40:53.605 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/calc-prorate' -> 'dir/bin/calc-prorate' 2024-05-15T15:40:53.605 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/jsonpointer' -> 'dir/bin/jsonpointer' 2024-05-15T15:40:53.605 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/jsonpointer-3' -> 'dir/bin/jsonpointer-3' 2024-05-15T15:40:53.605 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/jsonpointer-3.9' -> 'dir/bin/jsonpointer-3.9' 2024-05-15T15:40:53.605 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/jsondiff' -> 'dir/bin/jsondiff' 2024-05-15T15:40:53.606 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/jsondiff-3' -> 'dir/bin/jsondiff-3' 2024-05-15T15:40:53.606 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/jsondiff-3.9' -> 'dir/bin/jsondiff-3.9' 2024-05-15T15:40:53.606 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/jsonpatch' -> 'dir/bin/jsonpatch' 2024-05-15T15:40:53.606 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/jsonpatch-3' -> 'dir/bin/jsonpatch-3' 2024-05-15T15:40:53.606 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/jsonpatch-3.9' -> 'dir/bin/jsonpatch-3.9' 2024-05-15T15:40:53.606 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/2to3' -> 'dir/bin/2to3' 2024-05-15T15:40:53.606 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/msgfmt.py' -> 'dir/bin/msgfmt.py' 2024-05-15T15:40:53.606 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/msgfmt3.9.py' -> 'dir/bin/msgfmt3.9.py' 2024-05-15T15:40:53.606 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/msgfmt3.py' -> 'dir/bin/msgfmt3.py' 2024-05-15T15:40:53.606 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/pathfix.py' -> 'dir/bin/pathfix.py' 2024-05-15T15:40:53.606 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/pathfix3.9.py' -> 'dir/bin/pathfix3.9.py' 2024-05-15T15:40:53.606 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/pygettext.py' -> 'dir/bin/pygettext.py' 2024-05-15T15:40:53.606 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/pygettext3.9.py' -> 'dir/bin/pygettext3.9.py' 2024-05-15T15:40:53.607 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/pygettext3.py' -> 'dir/bin/pygettext3.py' 2024-05-15T15:40:53.607 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/python-config' -> 'dir/bin/python-config' 2024-05-15T15:40:53.607 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/python3-config' -> 'dir/bin/python3-config' 2024-05-15T15:40:53.607 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/python3.9-config' -> 'dir/bin/python3.9-config' 2024-05-15T15:40:53.607 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/python3.9-x86_64-config' -> 'dir/bin/python3.9-x86_64-config' 2024-05-15T15:40:53.607 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/lua' -> 'dir/bin/lua' 2024-05-15T15:40:53.607 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/luac' -> 'dir/bin/luac' 2024-05-15T15:40:54.443 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/stdin-killer' -> 'dir/bin/stdin-killer' 2024-05-15T15:40:54.444 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/pg_basebackup' -> 'dir/bin/pg_basebackup' 2024-05-15T15:40:54.444 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/pasta' -> 'dir/bin/pasta' 2024-05-15T15:40:54.444 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/pasta.avx2' -> 'dir/bin/pasta.avx2' 2024-05-15T15:40:54.444 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/adjust-ulimits' -> 'dir/bin/adjust-ulimits' 2024-05-15T15:40:54.444 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/thrift' -> 'dir/bin/thrift' 2024-05-15T15:40:54.444 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/clusterdb' -> 'dir/bin/clusterdb' 2024-05-15T15:40:54.444 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/createdb' -> 'dir/bin/createdb' 2024-05-15T15:40:54.444 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/createuser' -> 'dir/bin/createuser' 2024-05-15T15:40:54.444 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/dropdb' -> 'dir/bin/dropdb' 2024-05-15T15:40:54.444 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/dropuser' -> 'dir/bin/dropuser' 2024-05-15T15:40:54.444 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/pg_dump' -> 'dir/bin/pg_dump' 2024-05-15T15:40:54.444 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/pg_dumpall' -> 'dir/bin/pg_dumpall' 2024-05-15T15:40:54.444 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/pg_isready' -> 'dir/bin/pg_isready' 2024-05-15T15:40:54.445 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/pg_restore' -> 'dir/bin/pg_restore' 2024-05-15T15:40:54.445 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/pg_upgrade' -> 'dir/bin/pg_upgrade' 2024-05-15T15:40:54.445 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/psql' -> 'dir/bin/psql' 2024-05-15T15:40:54.445 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/reindexdb' -> 'dir/bin/reindexdb' 2024-05-15T15:40:54.445 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/vacuumdb' -> 'dir/bin/vacuumdb' 2024-05-15T15:40:54.445 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/qrap' -> 'dir/bin/qrap' 2024-05-15T15:40:54.445 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/luarocks' -> 'dir/bin/luarocks' 2024-05-15T15:40:54.445 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/luarocks-admin' -> 'dir/bin/luarocks-admin' 2024-05-15T15:40:54.445 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/protoc' -> 'dir/bin/protoc' 2024-05-15T15:40:54.445 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/mako-render' -> 'dir/bin/mako-render' 2024-05-15T15:40:54.445 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/mako-render-3' -> 'dir/bin/mako-render-3' 2024-05-15T15:40:54.445 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/mako-render-3.9' -> 'dir/bin/mako-render-3.9' 2024-05-15T15:40:54.445 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/pyrsa-decrypt' -> 'dir/bin/pyrsa-decrypt' 2024-05-15T15:40:54.445 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/pyrsa-decrypt-3' -> 'dir/bin/pyrsa-decrypt-3' 2024-05-15T15:40:54.445 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/pyrsa-encrypt' -> 'dir/bin/pyrsa-encrypt' 2024-05-15T15:40:54.446 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/pyrsa-encrypt-3' -> 'dir/bin/pyrsa-encrypt-3' 2024-05-15T15:40:54.446 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/pyrsa-keygen' -> 'dir/bin/pyrsa-keygen' 2024-05-15T15:40:54.446 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/podmansh' -> 'dir/bin/podmansh' 2024-05-15T15:40:54.446 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/pyrsa-keygen-3' -> 'dir/bin/pyrsa-keygen-3' 2024-05-15T15:40:54.446 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/pyrsa-priv2pub' -> 'dir/bin/pyrsa-priv2pub' 2024-05-15T15:40:54.446 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/pyrsa-priv2pub-3' -> 'dir/bin/pyrsa-priv2pub-3' 2024-05-15T15:40:54.446 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/pyrsa-sign' -> 'dir/bin/pyrsa-sign' 2024-05-15T15:40:54.446 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/pyrsa-sign-3' -> 'dir/bin/pyrsa-sign-3' 2024-05-15T15:40:54.446 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/pyrsa-verify' -> 'dir/bin/pyrsa-verify' 2024-05-15T15:40:54.446 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/pyrsa-verify-3' -> 'dir/bin/pyrsa-verify-3' 2024-05-15T15:40:54.446 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/librados-config' -> 'dir/bin/librados-config' 2024-05-15T15:40:54.446 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/filan' -> 'dir/bin/filan' 2024-05-15T15:40:54.446 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/procan' -> 'dir/bin/procan' 2024-05-15T15:40:54.447 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/socat' -> 'dir/bin/socat' 2024-05-15T15:40:54.447 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/make-dummy-cert' -> 'dir/bin/make-dummy-cert' 2024-05-15T15:40:54.447 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/openssl' -> 'dir/bin/openssl' 2024-05-15T15:40:54.447 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/renew-dummy-cert' -> 'dir/bin/renew-dummy-cert' 2024-05-15T15:40:54.447 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph-mon' -> 'dir/bin/ceph-mon' 2024-05-15T15:40:54.447 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/flexiblas' -> 'dir/bin/flexiblas' 2024-05-15T15:40:54.447 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/f2py' -> 'dir/bin/f2py' 2024-05-15T15:40:54.447 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/f2py.numpy' -> 'dir/bin/f2py.numpy' 2024-05-15T15:40:54.447 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/f2py3' -> 'dir/bin/f2py3' 2024-05-15T15:40:54.447 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/f2py3.9' -> 'dir/bin/f2py3.9' 2024-05-15T15:40:54.447 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/pg_checksums' -> 'dir/bin/pg_checksums' 2024-05-15T15:40:54.447 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph' -> 'dir/bin/ceph' 2024-05-15T15:40:54.447 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/pg_controldata' -> 'dir/bin/pg_controldata' 2024-05-15T15:40:54.448 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph-authtool' -> 'dir/bin/ceph-authtool' 2024-05-15T15:40:54.448 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph-conf' -> 'dir/bin/ceph-conf' 2024-05-15T15:40:54.448 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph-dencoder' -> 'dir/bin/ceph-dencoder' 2024-05-15T15:40:54.448 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph-post-file' -> 'dir/bin/ceph-post-file' 2024-05-15T15:40:54.448 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph-rbdnamer' -> 'dir/bin/ceph-rbdnamer' 2024-05-15T15:40:54.448 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph-syn' -> 'dir/bin/ceph-syn' 2024-05-15T15:40:54.448 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/cephfs-data-scan' -> 'dir/bin/cephfs-data-scan' 2024-05-15T15:40:54.448 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/cephfs-journal-tool' -> 'dir/bin/cephfs-journal-tool' 2024-05-15T15:40:54.448 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/cephfs-table-tool' -> 'dir/bin/cephfs-table-tool' 2024-05-15T15:40:54.448 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/crushdiff' -> 'dir/bin/crushdiff' 2024-05-15T15:40:54.448 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/rados' -> 'dir/bin/rados' 2024-05-15T15:40:54.448 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/radosgw-admin' -> 'dir/bin/radosgw-admin' 2024-05-15T15:40:54.448 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/rbd' -> 'dir/bin/rbd' 2024-05-15T15:40:54.449 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/rbd-replay' -> 'dir/bin/rbd-replay' 2024-05-15T15:40:54.449 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/rbd-replay-many' -> 'dir/bin/rbd-replay-many' 2024-05-15T15:40:54.449 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/rbd-replay-prep' -> 'dir/bin/rbd-replay-prep' 2024-05-15T15:40:54.449 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/rbdmap' -> 'dir/bin/rbdmap' 2024-05-15T15:40:54.449 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/rgw-gap-list' -> 'dir/bin/rgw-gap-list' 2024-05-15T15:40:54.449 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/rgw-gap-list-comparator' -> 'dir/bin/rgw-gap-list-comparator' 2024-05-15T15:40:54.449 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/rgw-orphan-list' -> 'dir/bin/rgw-orphan-list' 2024-05-15T15:40:54.449 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/rgw-restore-bucket-index' -> 'dir/bin/rgw-restore-bucket-index' 2024-05-15T15:40:54.449 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph-crash' -> 'dir/bin/ceph-crash' 2024-05-15T15:40:54.449 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph-kvstore-tool' -> 'dir/bin/ceph-kvstore-tool' 2024-05-15T15:40:54.449 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph-run' -> 'dir/bin/ceph-run' 2024-05-15T15:40:54.449 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/crushtool' -> 'dir/bin/crushtool' 2024-05-15T15:40:54.449 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/monmaptool' -> 'dir/bin/monmaptool' 2024-05-15T15:40:54.449 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/osdmaptool' -> 'dir/bin/osdmaptool' 2024-05-15T15:40:54.450 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph-bluestore-tool' -> 'dir/bin/ceph-bluestore-tool' 2024-05-15T15:40:54.450 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph-clsinfo' -> 'dir/bin/ceph-clsinfo' 2024-05-15T15:40:54.450 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph-erasure-code-tool' -> 'dir/bin/ceph-erasure-code-tool' 2024-05-15T15:40:55.118 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph-objectstore-tool' -> 'dir/bin/ceph-objectstore-tool' 2024-05-15T15:40:55.118 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph-osd' -> 'dir/bin/ceph-osd' 2024-05-15T15:40:55.118 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph-osdomap-tool' -> 'dir/bin/ceph-osdomap-tool' 2024-05-15T15:40:55.118 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph-mds' -> 'dir/bin/ceph-mds' 2024-05-15T15:40:55.118 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph-monstore-tool' -> 'dir/bin/ceph-monstore-tool' 2024-05-15T15:40:55.118 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/radosgw-es' -> 'dir/bin/radosgw-es' 2024-05-15T15:40:55.118 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/aclocal' -> 'dir/bin/aclocal' 2024-05-15T15:40:55.118 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/aclocal-1.16' -> 'dir/bin/aclocal-1.16' 2024-05-15T15:40:55.118 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/automake-1.16' -> 'dir/bin/automake-1.16' 2024-05-15T15:40:55.119 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/automake' -> 'dir/bin/automake' 2024-05-15T15:40:55.119 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/cheroot' -> 'dir/bin/cheroot' 2024-05-15T15:40:55.119 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/cherryd' -> 'dir/bin/cherryd' 2024-05-15T15:40:55.119 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/fusermount' -> 'dir/bin/fusermount' 2024-05-15T15:40:55.119 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ulockmgr_server' -> 'dir/bin/ulockmgr_server' 2024-05-15T15:40:55.119 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph-mgr' -> 'dir/bin/ceph-mgr' 2024-05-15T15:40:55.119 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/pg_ctl' -> 'dir/bin/pg_ctl' 2024-05-15T15:40:55.119 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph-fuse' -> 'dir/bin/ceph-fuse' 2024-05-15T15:40:55.119 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/libtool' -> 'dir/bin/libtool' 2024-05-15T15:40:55.119 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/libtoolize' -> 'dir/bin/libtoolize' 2024-05-15T15:40:55.119 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph-diff-sorted' -> 'dir/bin/ceph-diff-sorted' 2024-05-15T15:40:55.119 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/radosgw' -> 'dir/bin/radosgw' 2024-05-15T15:40:55.119 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/radosgw-object-expirer' -> 'dir/bin/radosgw-object-expirer' 2024-05-15T15:40:55.119 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/radosgw-token' -> 'dir/bin/radosgw-token' 2024-05-15T15:40:55.119 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/rgw-policy-check' -> 'dir/bin/rgw-policy-check' 2024-05-15T15:40:55.120 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph-immutable-object-cache' -> 'dir/bin/ceph-immutable-object-cache' 2024-05-15T15:40:55.120 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/cephfs-mirror' -> 'dir/bin/cephfs-mirror' 2024-05-15T15:40:55.120 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/rbd-mirror' -> 'dir/bin/rbd-mirror' 2024-05-15T15:40:55.120 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph-client-debug' -> 'dir/bin/ceph-client-debug' 2024-05-15T15:40:55.120 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph-coverage' -> 'dir/bin/ceph-coverage' 2024-05-15T15:40:55.120 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph-debugpack' -> 'dir/bin/ceph-debugpack' 2024-05-15T15:40:55.120 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph-dedup-daemon' -> 'dir/bin/ceph-dedup-daemon' 2024-05-15T15:40:55.120 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph-dedup-tool' -> 'dir/bin/ceph-dedup-tool' 2024-05-15T15:40:55.120 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph_bench_log' -> 'dir/bin/ceph_bench_log' 2024-05-15T15:40:55.120 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph_erasure_code_benchmark' -> 'dir/bin/ceph_erasure_code_benchmark' 2024-05-15T15:40:55.120 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph_multi_stress_watch' -> 'dir/bin/ceph_multi_stress_watch' 2024-05-15T15:40:55.120 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph_objectstore_bench' -> 'dir/bin/ceph_objectstore_bench' 2024-05-15T15:40:55.120 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph_omapbench' -> 'dir/bin/ceph_omapbench' 2024-05-15T15:40:55.120 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph_perf_local' -> 'dir/bin/ceph_perf_local' 2024-05-15T15:40:55.121 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph_perf_msgr_client' -> 'dir/bin/ceph_perf_msgr_client' 2024-05-15T15:40:55.121 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph_perf_msgr_server' -> 'dir/bin/ceph_perf_msgr_server' 2024-05-15T15:40:55.121 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph_perf_objectstore' -> 'dir/bin/ceph_perf_objectstore' 2024-05-15T15:40:55.121 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph_psim' -> 'dir/bin/ceph_psim' 2024-05-15T15:40:55.121 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph_radosacl' -> 'dir/bin/ceph_radosacl' 2024-05-15T15:40:55.121 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph_rgw_jsonparser' -> 'dir/bin/ceph_rgw_jsonparser' 2024-05-15T15:40:55.121 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph_rgw_multiparser' -> 'dir/bin/ceph_rgw_multiparser' 2024-05-15T15:40:55.121 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph_scratchtool' -> 'dir/bin/ceph_scratchtool' 2024-05-15T15:40:55.121 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph_scratchtoolpp' -> 'dir/bin/ceph_scratchtoolpp' 2024-05-15T15:40:55.121 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph_test_admin_socket_output' -> 'dir/bin/ceph_test_admin_socket_output' 2024-05-15T15:40:55.121 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph_test_alloc_replay' -> 'dir/bin/ceph_test_alloc_replay' 2024-05-15T15:40:55.121 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph_test_async_driver' -> 'dir/bin/ceph_test_async_driver' 2024-05-15T15:40:55.121 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph_test_async_networkstack' -> 'dir/bin/ceph_test_async_networkstack' 2024-05-15T15:40:55.121 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph_test_c2c' -> 'dir/bin/ceph_test_c2c' 2024-05-15T15:40:55.121 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph_test_client' -> 'dir/bin/ceph_test_client' 2024-05-15T15:40:55.121 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph_test_cls_2pc_queue' -> 'dir/bin/ceph_test_cls_2pc_queue' 2024-05-15T15:40:55.122 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph_test_cls_cas' -> 'dir/bin/ceph_test_cls_cas' 2024-05-15T15:40:55.122 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph_test_cls_cmpomap' -> 'dir/bin/ceph_test_cls_cmpomap' 2024-05-15T15:40:55.122 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph_test_cls_hello' -> 'dir/bin/ceph_test_cls_hello' 2024-05-15T15:40:55.122 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph_test_cls_journal' -> 'dir/bin/ceph_test_cls_journal' 2024-05-15T15:40:55.122 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph_test_cls_lock' -> 'dir/bin/ceph_test_cls_lock' 2024-05-15T15:40:55.122 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph_test_cls_log' -> 'dir/bin/ceph_test_cls_log' 2024-05-15T15:40:55.122 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph_test_cls_lua' -> 'dir/bin/ceph_test_cls_lua' 2024-05-15T15:40:55.122 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph_test_cls_numops' -> 'dir/bin/ceph_test_cls_numops' 2024-05-15T15:40:55.122 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph_test_cls_queue' -> 'dir/bin/ceph_test_cls_queue' 2024-05-15T15:40:55.122 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph_test_cls_rbd' -> 'dir/bin/ceph_test_cls_rbd' 2024-05-15T15:40:55.122 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph_test_cls_refcount' -> 'dir/bin/ceph_test_cls_refcount' 2024-05-15T15:40:55.122 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph_test_cls_rgw' -> 'dir/bin/ceph_test_cls_rgw' 2024-05-15T15:40:55.122 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph_test_cls_rgw_gc' -> 'dir/bin/ceph_test_cls_rgw_gc' 2024-05-15T15:40:55.123 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph_test_cls_rgw_meta' -> 'dir/bin/ceph_test_cls_rgw_meta' 2024-05-15T15:40:55.123 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph_test_cls_rgw_stats' -> 'dir/bin/ceph_test_cls_rgw_stats' 2024-05-15T15:40:55.123 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph_test_cls_sdk' -> 'dir/bin/ceph_test_cls_sdk' 2024-05-15T15:40:55.506 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph_test_cls_user' -> 'dir/bin/ceph_test_cls_user' 2024-05-15T15:40:55.506 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph_test_immutable_obj_cache' -> 'dir/bin/ceph_test_immutable_obj_cache' 2024-05-15T15:40:55.506 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph_test_ino_release_cb' -> 'dir/bin/ceph_test_ino_release_cb' 2024-05-15T15:40:55.506 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph_test_keyvaluedb' -> 'dir/bin/ceph_test_keyvaluedb' 2024-05-15T15:40:55.506 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph_test_lazy_omap_stats' -> 'dir/bin/ceph_test_lazy_omap_stats' 2024-05-15T15:40:55.507 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph_test_libcephfs' -> 'dir/bin/ceph_test_libcephfs' 2024-05-15T15:40:55.507 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph_test_libcephfs_access' -> 'dir/bin/ceph_test_libcephfs_access' 2024-05-15T15:40:55.507 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph_test_libcephfs_lazyio' -> 'dir/bin/ceph_test_libcephfs_lazyio' 2024-05-15T15:40:55.507 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph_test_libcephfs_newops' -> 'dir/bin/ceph_test_libcephfs_newops' 2024-05-15T15:40:55.507 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph_test_libcephfs_reclaim' -> 'dir/bin/ceph_test_libcephfs_reclaim' 2024-05-15T15:40:55.507 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph_test_libcephfs_snapdiff' -> 'dir/bin/ceph_test_libcephfs_snapdiff' 2024-05-15T15:40:55.507 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph_test_libcephfs_suidsgid' -> 'dir/bin/ceph_test_libcephfs_suidsgid' 2024-05-15T15:40:55.510 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph_test_libcephsqlite' -> 'dir/bin/ceph_test_libcephsqlite' 2024-05-15T15:40:55.510 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph_test_librbd' -> 'dir/bin/ceph_test_librbd' 2024-05-15T15:40:55.510 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph_test_librbd_fsx' -> 'dir/bin/ceph_test_librbd_fsx' 2024-05-15T15:40:55.510 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph_test_librgw_file' -> 'dir/bin/ceph_test_librgw_file' 2024-05-15T15:40:55.510 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph_test_librgw_file_aw' -> 'dir/bin/ceph_test_librgw_file_aw' 2024-05-15T15:40:55.510 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph_test_librgw_file_cd' -> 'dir/bin/ceph_test_librgw_file_cd' 2024-05-15T15:40:55.510 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph_test_librgw_file_gp' -> 'dir/bin/ceph_test_librgw_file_gp' 2024-05-15T15:40:55.510 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph_test_librgw_file_marker' -> 'dir/bin/ceph_test_librgw_file_marker' 2024-05-15T15:40:55.510 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph_test_librgw_file_nfsns' -> 'dir/bin/ceph_test_librgw_file_nfsns' 2024-05-15T15:40:55.510 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph_test_librgw_file_rename' -> 'dir/bin/ceph_test_librgw_file_rename' 2024-05-15T15:40:55.510 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph_test_log_rss_usage' -> 'dir/bin/ceph_test_log_rss_usage' 2024-05-15T15:40:55.510 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph_test_mon_memory_target' -> 'dir/bin/ceph_test_mon_memory_target' 2024-05-15T15:40:55.510 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph_test_mon_rss_usage' -> 'dir/bin/ceph_test_mon_rss_usage' 2024-05-15T15:40:55.511 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph_test_mon_workloadgen' -> 'dir/bin/ceph_test_mon_workloadgen' 2024-05-15T15:40:55.511 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph_test_msgr' -> 'dir/bin/ceph_test_msgr' 2024-05-15T15:40:55.511 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph_test_neorados_cls' -> 'dir/bin/ceph_test_neorados_cls' 2024-05-15T15:40:55.511 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph_test_neorados_cmd' -> 'dir/bin/ceph_test_neorados_cmd' 2024-05-15T15:40:55.511 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph_test_neorados_ec_io' -> 'dir/bin/ceph_test_neorados_ec_io' 2024-05-15T15:40:55.511 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph_test_neorados_ec_list' -> 'dir/bin/ceph_test_neorados_ec_list' 2024-05-15T15:40:55.511 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph_test_neorados_handler_error' -> 'dir/bin/ceph_test_neorados_handler_error' 2024-05-15T15:40:55.511 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph_test_neorados_io' -> 'dir/bin/ceph_test_neorados_io' 2024-05-15T15:40:55.511 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph_test_neorados_list' -> 'dir/bin/ceph_test_neorados_list' 2024-05-15T15:40:55.511 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph_test_neorados_misc' -> 'dir/bin/ceph_test_neorados_misc' 2024-05-15T15:40:55.511 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph_test_neorados_pool' -> 'dir/bin/ceph_test_neorados_pool' 2024-05-15T15:40:55.511 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph_test_neorados_read_operations' -> 'dir/bin/ceph_test_neorados_read_operations' 2024-05-15T15:40:55.512 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph_test_neorados_snapshots' -> 'dir/bin/ceph_test_neorados_snapshots' 2024-05-15T15:40:55.512 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph_test_neorados_watch_notify' -> 'dir/bin/ceph_test_neorados_watch_notify' 2024-05-15T15:40:55.512 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph_test_neorados_write_operations' -> 'dir/bin/ceph_test_neorados_write_operations' 2024-05-15T15:40:55.512 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph_test_objectcacher_stress' -> 'dir/bin/ceph_test_objectcacher_stress' 2024-05-15T15:40:55.512 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph_test_objectstore' -> 'dir/bin/ceph_test_objectstore' 2024-05-15T15:40:55.512 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph_test_osd_stale_read' -> 'dir/bin/ceph_test_osd_stale_read' 2024-05-15T15:40:55.512 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph_test_rados' -> 'dir/bin/ceph_test_rados' 2024-05-15T15:40:55.512 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph_test_rados_api_aio' -> 'dir/bin/ceph_test_rados_api_aio' 2024-05-15T15:40:55.512 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph_test_rados_api_aio_pp' -> 'dir/bin/ceph_test_rados_api_aio_pp' 2024-05-15T15:40:55.512 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph_test_rados_api_asio' -> 'dir/bin/ceph_test_rados_api_asio' 2024-05-15T15:40:55.512 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph_test_rados_api_c_read_operations' -> 'dir/bin/ceph_test_rados_api_c_read_operations' 2024-05-15T15:40:55.512 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph_test_rados_api_c_write_operations' -> 'dir/bin/ceph_test_rados_api_c_write_operations' 2024-05-15T15:40:55.512 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph_test_rados_api_cmd' -> 'dir/bin/ceph_test_rados_api_cmd' 2024-05-15T15:40:55.512 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph_test_rados_api_cmd_pp' -> 'dir/bin/ceph_test_rados_api_cmd_pp' 2024-05-15T15:40:55.513 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph_test_rados_api_io' -> 'dir/bin/ceph_test_rados_api_io' 2024-05-15T15:40:55.513 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph_test_rados_api_io_pp' -> 'dir/bin/ceph_test_rados_api_io_pp' 2024-05-15T15:40:55.513 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph_test_rados_api_list' -> 'dir/bin/ceph_test_rados_api_list' 2024-05-15T15:40:55.900 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph_test_rados_api_lock' -> 'dir/bin/ceph_test_rados_api_lock' 2024-05-15T15:40:55.900 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph_test_rados_api_lock_pp' -> 'dir/bin/ceph_test_rados_api_lock_pp' 2024-05-15T15:40:55.900 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph_test_rados_api_misc' -> 'dir/bin/ceph_test_rados_api_misc' 2024-05-15T15:40:55.900 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph_test_rados_api_misc_pp' -> 'dir/bin/ceph_test_rados_api_misc_pp' 2024-05-15T15:40:55.900 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph_test_rados_api_pool' -> 'dir/bin/ceph_test_rados_api_pool' 2024-05-15T15:40:55.900 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph_test_rados_api_service' -> 'dir/bin/ceph_test_rados_api_service' 2024-05-15T15:40:55.900 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph_test_rados_api_service_pp' -> 'dir/bin/ceph_test_rados_api_service_pp' 2024-05-15T15:40:55.900 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph_test_rados_api_snapshots' -> 'dir/bin/ceph_test_rados_api_snapshots' 2024-05-15T15:40:55.900 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph_test_rados_api_snapshots_pp' -> 'dir/bin/ceph_test_rados_api_snapshots_pp' 2024-05-15T15:40:55.900 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph_test_rados_api_stat' -> 'dir/bin/ceph_test_rados_api_stat' 2024-05-15T15:40:55.900 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph_test_rados_api_stat_pp' -> 'dir/bin/ceph_test_rados_api_stat_pp' 2024-05-15T15:40:55.901 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph_test_rados_api_tier_pp' -> 'dir/bin/ceph_test_rados_api_tier_pp' 2024-05-15T15:40:55.901 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph_test_rados_api_watch_notify' -> 'dir/bin/ceph_test_rados_api_watch_notify' 2024-05-15T15:40:55.901 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph_test_rados_api_watch_notify_pp' -> 'dir/bin/ceph_test_rados_api_watch_notify_pp' 2024-05-15T15:40:55.901 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph_test_rados_delete_pools_parallel' -> 'dir/bin/ceph_test_rados_delete_pools_parallel' 2024-05-15T15:40:55.901 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph_test_rados_list_parallel' -> 'dir/bin/ceph_test_rados_list_parallel' 2024-05-15T15:40:55.901 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph_test_rados_open_pools_parallel' -> 'dir/bin/ceph_test_rados_open_pools_parallel' 2024-05-15T15:40:55.901 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph_test_rados_striper_api_aio' -> 'dir/bin/ceph_test_rados_striper_api_aio' 2024-05-15T15:40:55.901 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph_test_rados_striper_api_io' -> 'dir/bin/ceph_test_rados_striper_api_io' 2024-05-15T15:40:55.901 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph_test_rados_striper_api_striping' -> 'dir/bin/ceph_test_rados_striper_api_striping' 2024-05-15T15:40:55.901 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph_test_rbd_mirror' -> 'dir/bin/ceph_test_rbd_mirror' 2024-05-15T15:40:55.901 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph_test_rbd_mirror_random_write' -> 'dir/bin/ceph_test_rbd_mirror_random_write' 2024-05-15T15:40:55.901 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph_test_rgw_d4n_directory' -> 'dir/bin/ceph_test_rgw_d4n_directory' 2024-05-15T15:40:55.901 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph_test_rgw_d4n_policy' -> 'dir/bin/ceph_test_rgw_d4n_policy' 2024-05-15T15:40:55.901 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph_test_rgw_gc_log' -> 'dir/bin/ceph_test_rgw_gc_log' 2024-05-15T15:40:55.902 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph_test_rgw_obj' -> 'dir/bin/ceph_test_rgw_obj' 2024-05-15T15:40:55.902 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph_test_rgw_redis_driver' -> 'dir/bin/ceph_test_rgw_redis_driver' 2024-05-15T15:40:55.902 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph_test_rgw_ssd_driver' -> 'dir/bin/ceph_test_rgw_ssd_driver' 2024-05-15T15:40:55.902 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph_test_snap_mapper' -> 'dir/bin/ceph_test_snap_mapper' 2024-05-15T15:40:55.902 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph_test_stress_watch' -> 'dir/bin/ceph_test_stress_watch' 2024-05-15T15:40:55.902 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/ceph_test_trim_caps' -> 'dir/bin/ceph_test_trim_caps' 2024-05-15T15:40:55.902 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/rbd-fuse' -> 'dir/bin/rbd-fuse' 2024-05-15T15:40:55.902 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/rbd-nbd' -> 'dir/bin/rbd-nbd' 2024-05-15T15:40:55.902 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/cephfs-shell' -> 'dir/bin/cephfs-shell' 2024-05-15T15:40:55.902 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/oid2name' -> 'dir/bin/oid2name' 2024-05-15T15:40:55.902 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/pg_archivecleanup' -> 'dir/bin/pg_archivecleanup' 2024-05-15T15:40:55.902 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/pg_standby' -> 'dir/bin/pg_standby' 2024-05-15T15:40:55.902 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/pg_test_fsync' -> 'dir/bin/pg_test_fsync' 2024-05-15T15:40:55.903 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/pg_test_timing' -> 'dir/bin/pg_test_timing' 2024-05-15T15:40:55.903 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/pg_waldump' -> 'dir/bin/pg_waldump' 2024-05-15T15:40:55.903 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/pgbench' -> 'dir/bin/pgbench' 2024-05-15T15:40:55.903 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/vacuumlo' -> 'dir/bin/vacuumlo' 2024-05-15T15:40:55.903 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/nmtui' -> 'dir/bin/nmtui' 2024-05-15T15:40:55.903 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/nmtui-connect' -> 'dir/bin/nmtui-connect' 2024-05-15T15:40:55.903 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/nmtui-edit' -> 'dir/bin/nmtui-edit' 2024-05-15T15:40:55.903 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/nmtui-hostname' -> 'dir/bin/nmtui-hostname' 2024-05-15T15:40:55.903 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/pg_receivewal' -> 'dir/bin/pg_receivewal' 2024-05-15T15:40:55.903 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/pg_recvlogical' -> 'dir/bin/pg_recvlogical' 2024-05-15T15:40:55.903 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/pg_resetwal' -> 'dir/bin/pg_resetwal' 2024-05-15T15:40:55.903 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/pg_rewind' -> 'dir/bin/pg_rewind' 2024-05-15T15:40:55.903 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/pg_verifybackup' -> 'dir/bin/pg_verifybackup' 2024-05-15T15:40:55.904 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/postgres' -> 'dir/bin/postgres' 2024-05-15T15:40:55.904 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/postgresql-setup' -> 'dir/bin/postgresql-setup' 2024-05-15T15:40:55.904 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/postgresql-upgrade' -> 'dir/bin/postgresql-upgrade' 2024-05-15T15:40:55.904 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/postmaster' -> 'dir/bin/postmaster' 2024-05-15T15:40:55.904 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/cephfs-top' -> 'dir/bin/cephfs-top' 2024-05-15T15:40:55.904 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/flex' -> 'dir/bin/flex' 2024-05-15T15:40:55.904 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/flex++' -> 'dir/bin/flex++' 2024-05-15T15:40:55.904 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/lex' -> 'dir/bin/lex' 2024-05-15T15:40:55.904 INFO:teuthology.orchestra.run.smithi104.stdout:'/usr/bin/bison' -> 'dir/bin/bison' 2024-05-15T15:40:55.904 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-15T15:40:55 stdin-killer INFO: command exited with status 1: exiting normally with same code! 2024-05-15T15:40:55.910 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-15T15:40:55.911 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'sudo fscrypt lock --quiet dir/') 2024-05-15T15:40:56.007 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-15T15:40:56 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-15T15:41:22.778 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:41:22.782 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:41:22.784 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:41:38.300 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-15T15:41:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-15T15:41:38.309 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-05-15T15:41:38.309 DEBUG:teuthology.orchestra.run.smithi012:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-15T15:41:38.337 DEBUG:teuthology.orchestra.run.smithi084:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-15T15:41:38.364 DEBUG:teuthology.orchestra.run.smithi104:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-15T15:41:38.467 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-05-15T15:41:38.467 INFO:tasks.cephfs.mount:Terminating background process 2024-05-15T15:41:38.467 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-05-15T15:41:38.467 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-15T15:41:38.516 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-05-15T15:41:38.516 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-15T15:41:38.613 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-15T15:41:38.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:38.739+0000 7f5b8c5d6640 1 Processor -- start 2024-05-15T15:41:38.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:38.739+0000 7f5b8c5d6640 1 -- start start 2024-05-15T15:41:38.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:38.740+0000 7f5b8c5d6640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5b840a3bd0 0x7f5b840bb940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:41:38.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:38.740+0000 7f5b8c5d6640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f5b8414fa20 0x7f5b8414fe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:41:38.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:38.740+0000 7f5b8c5d6640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b841469c0 con 0x7f5b840bc8d0 2024-05-15T15:41:38.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:38.740+0000 7f5b8c5d6640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f5b840a49e0 con 0x7f5b840a3bd0 2024-05-15T15:41:38.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:38.740+0000 7f5b8c5d6640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f5b840a40b0 con 0x7f5b8414fa20 2024-05-15T15:41:38.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:38.740+0000 7f5b8a372640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5b840a3bd0 0x7f5b840bb940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:41:38.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:38.740+0000 7f5b8a372640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5b840a3bd0 0x7f5b840bb940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45962/0 (socket says 172.21.15.12:45962) 2024-05-15T15:41:38.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:38.740+0000 7f5b8a372640 1 -- 172.21.15.12:0/1866529941 learned_addr learned my addr 172.21.15.12:0/1866529941 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:41:38.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:38.740+0000 7f5b8ab73640 1 --2- 172.21.15.12:0/1866529941 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f5b8414fa20 0x7f5b8414fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:41:38.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:38.740+0000 7f5b8a372640 1 -- 172.21.15.12:0/1866529941 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f5b8414fa20 msgr2=0x7f5b8414fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:41:38.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:38.740+0000 7f5b8a372640 1 --2- 172.21.15.12:0/1866529941 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f5b8414fa20 0x7f5b8414fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:41:38.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:38.741+0000 7f5b8a372640 1 -- 172.21.15.12:0/1866529941 >> v1:172.21.15.84:6789/0 conn(0x7f5b840bc8d0 legacy=0x7f5b841462b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:41:38.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:38.741+0000 7f5b8a372640 1 -- 172.21.15.12:0/1866529941 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b840a4390 con 0x7f5b840a3bd0 2024-05-15T15:41:38.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:38.741+0000 7f5b8ab73640 1 --2- 172.21.15.12:0/1866529941 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f5b8414fa20 0x7f5b8414fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-15T15:41:38.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:38.741+0000 7f5b8a372640 1 --2- 172.21.15.12:0/1866529941 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5b840a3bd0 0x7f5b840bb940 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f5b80009870 tx=0x7f5b8002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b66eb628633a2987 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:41:38.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:38.741+0000 7f5b89370640 1 -- 172.21.15.12:0/1866529941 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b80037070 con 0x7f5b840a3bd0 2024-05-15T15:41:38.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:38.742+0000 7f5b89370640 1 -- 172.21.15.12:0/1866529941 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b80032440 con 0x7f5b840a3bd0 2024-05-15T15:41:38.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:38.742+0000 7f5b89370640 1 -- 172.21.15.12:0/1866529941 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b80032810 con 0x7f5b840a3bd0 2024-05-15T15:41:38.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:38.742+0000 7f5b8c5d6640 1 -- 172.21.15.12:0/1866529941 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5b840a3bd0 msgr2=0x7f5b840bb940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:41:38.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:38.742+0000 7f5b8c5d6640 1 --2- 172.21.15.12:0/1866529941 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5b840a3bd0 0x7f5b840bb940 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f5b80009870 tx=0x7f5b8002a270 comp rx=0 tx=0).stop 2024-05-15T15:41:38.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:38.742+0000 7f5b8c5d6640 1 -- 172.21.15.12:0/1866529941 shutdown_connections 2024-05-15T15:41:38.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:38.742+0000 7f5b8c5d6640 1 --2- 172.21.15.12:0/1866529941 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f5b8414fa20 0x7f5b8414fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:41:38.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:38.742+0000 7f5b8c5d6640 1 --2- 172.21.15.12:0/1866529941 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5b840a3bd0 0x7f5b840bb940 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:41:38.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:38.742+0000 7f5b8c5d6640 1 -- 172.21.15.12:0/1866529941 >> 172.21.15.12:0/1866529941 conn(0x7f5b840a1ac0 msgr2=0x7f5b840bbfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:41:38.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:38.742+0000 7f5b8c5d6640 1 -- 172.21.15.12:0/1866529941 shutdown_connections 2024-05-15T15:41:38.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:38.742+0000 7f5b8c5d6640 1 -- 172.21.15.12:0/1866529941 wait complete. 2024-05-15T15:41:38.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:38.744+0000 7f5b8c5d6640 1 Processor -- start 2024-05-15T15:41:38.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:38.744+0000 7f5b8c5d6640 1 -- start start 2024-05-15T15:41:38.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:38.745+0000 7f5b8c5d6640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b840a3bd0 0x7f5b841440a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:41:38.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:38.745+0000 7f5b8c5d6640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f5b840bc8d0 0x7f5b8414c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:41:38.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:38.745+0000 7f5b8c5d6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5b8414fa20 0x7f5b8414d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:41:38.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:38.745+0000 7f5b8c5d6640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f5b840bcce0 con 0x7f5b8414fa20 2024-05-15T15:41:38.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:38.745+0000 7f5b8c5d6640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f5b84150370 con 0x7f5b840a3bd0 2024-05-15T15:41:38.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:38.745+0000 7f5b8c5d6640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f5b840bce60 con 0x7f5b840bc8d0 2024-05-15T15:41:38.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:38.745+0000 7f5b8ab73640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5b8414fa20 0x7f5b8414d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:41:38.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:38.745+0000 7f5b8ab73640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5b8414fa20 0x7f5b8414d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45976/0 (socket says 172.21.15.12:45976) 2024-05-15T15:41:38.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:38.745+0000 7f5b8ab73640 1 -- 172.21.15.12:0/2184132148 learned_addr learned my addr 172.21.15.12:0/2184132148 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:41:38.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:38.745+0000 7f5b89b71640 1 --2- 172.21.15.12:0/2184132148 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f5b840bc8d0 0x7f5b8414c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:41:38.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:38.745+0000 7f5b8a372640 1 --2- 172.21.15.12:0/2184132148 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b840a3bd0 0x7f5b841440a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:41:38.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:38.746+0000 7f5b8ab73640 1 -- 172.21.15.12:0/2184132148 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f5b840bc8d0 msgr2=0x7f5b8414c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:41:38.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:38.746+0000 7f5b8ab73640 1 --2- 172.21.15.12:0/2184132148 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f5b840bc8d0 0x7f5b8414c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:41:38.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:38.746+0000 7f5b8ab73640 1 -- 172.21.15.12:0/2184132148 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b840a3bd0 msgr2=0x7f5b841440a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:41:38.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:38.746+0000 7f5b8ab73640 1 --2- 172.21.15.12:0/2184132148 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b840a3bd0 0x7f5b841440a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:41:38.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:38.746+0000 7f5b8ab73640 1 -- 172.21.15.12:0/2184132148 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b841445e0 con 0x7f5b8414fa20 2024-05-15T15:41:38.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:38.746+0000 7f5b8ab73640 1 --2- 172.21.15.12:0/2184132148 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5b8414fa20 0x7f5b8414d3d0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c007e30 tx=0x7f5b7c00d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:41:38.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:38.746+0000 7f5b7affd640 1 -- 172.21.15.12:0/2184132148 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b7c01a070 con 0x7f5b8414fa20 2024-05-15T15:41:38.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:38.746+0000 7f5b7affd640 1 -- 172.21.15.12:0/2184132148 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b7c015400 con 0x7f5b8414fa20 2024-05-15T15:41:38.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:38.746+0000 7f5b7affd640 1 -- 172.21.15.12:0/2184132148 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b7c0157d0 con 0x7f5b8414fa20 2024-05-15T15:41:38.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:38.746+0000 7f5b8c5d6640 1 -- 172.21.15.12:0/2184132148 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b8413ff70 con 0x7f5b8414fa20 2024-05-15T15:41:38.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:38.746+0000 7f5b8c5d6640 1 -- 172.21.15.12:0/2184132148 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b841e5d40 con 0x7f5b8414fa20 2024-05-15T15:41:38.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:38.747+0000 7f5b8c5d6640 1 -- 172.21.15.12:0/2184132148 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b8413fd80 con 0x7f5b8414fa20 2024-05-15T15:41:38.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:38.748+0000 7f5b7affd640 1 -- 172.21.15.12:0/2184132148 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f5b7c01d070 con 0x7f5b8414fa20 2024-05-15T15:41:38.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:38.748+0000 7f5b7affd640 1 --2- 172.21.15.12:0/2184132148 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f5b680762d0 0x7f5b680787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:41:38.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:38.749+0000 7f5b7affd640 1 -- 172.21.15.12:0/2184132148 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 5825+0+0 (secure 0 0 0) 0x7f5b7c0977b0 con 0x7f5b8414fa20 2024-05-15T15:41:38.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:38.749+0000 7f5b8a372640 1 --2- 172.21.15.12:0/2184132148 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f5b680762d0 0x7f5b680787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:41:38.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:38.749+0000 7f5b8a372640 1 --2- 172.21.15.12:0/2184132148 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f5b680762d0 0x7f5b680787e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f5b80034000 tx=0x7f5b8002e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:41:38.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:38.753+0000 7f5b7affd640 1 -- 172.21.15.12:0/2184132148 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f5b7c010070 con 0x7f5b8414fa20 2024-05-15T15:41:38.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:38.957+0000 7f5b8c5d6640 1 -- 172.21.15.12:0/2184132148 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f5b84150150 con 0x7f5b8414fa20 2024-05-15T15:41:38.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:38.958+0000 7f5b7affd640 1 -- 172.21.15.12:0/2184132148 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v38) ==== 80+0+0 (secure 0 0 0) 0x7f5b7c060a30 con 0x7f5b8414fa20 2024-05-15T15:41:38.960 INFO:teuthology.orchestra.run.smithi012.stderr:listed 0 entries 2024-05-15T15:41:38.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:38.960+0000 7f5b8c5d6640 1 -- 172.21.15.12:0/2184132148 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f5b680762d0 msgr2=0x7f5b680787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:41:38.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:38.960+0000 7f5b8c5d6640 1 --2- 172.21.15.12:0/2184132148 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f5b680762d0 0x7f5b680787e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f5b80034000 tx=0x7f5b8002e000 comp rx=0 tx=0).stop 2024-05-15T15:41:38.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:38.960+0000 7f5b8c5d6640 1 -- 172.21.15.12:0/2184132148 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5b8414fa20 msgr2=0x7f5b8414d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:41:38.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:38.960+0000 7f5b8c5d6640 1 --2- 172.21.15.12:0/2184132148 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5b8414fa20 0x7f5b8414d3d0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c007e30 tx=0x7f5b7c00d4a0 comp rx=0 tx=0).stop 2024-05-15T15:41:38.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:38.960+0000 7f5b8c5d6640 1 -- 172.21.15.12:0/2184132148 shutdown_connections 2024-05-15T15:41:38.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:38.960+0000 7f5b8c5d6640 1 --2- 172.21.15.12:0/2184132148 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f5b680762d0 0x7f5b680787e0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:41:38.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:38.960+0000 7f5b8c5d6640 1 --2- 172.21.15.12:0/2184132148 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5b8414fa20 0x7f5b8414d3d0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:41:38.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:38.960+0000 7f5b8c5d6640 1 --2- 172.21.15.12:0/2184132148 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f5b840bc8d0 0x7f5b8414c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:41:38.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:38.960+0000 7f5b8c5d6640 1 --2- 172.21.15.12:0/2184132148 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b840a3bd0 0x7f5b841440a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:41:38.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:38.960+0000 7f5b8c5d6640 1 -- 172.21.15.12:0/2184132148 >> 172.21.15.12:0/2184132148 conn(0x7f5b840a1ac0 msgr2=0x7f5b840bb730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:41:38.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:38.960+0000 7f5b8c5d6640 1 -- 172.21.15.12:0/2184132148 shutdown_connections 2024-05-15T15:41:38.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:38.960+0000 7f5b8c5d6640 1 -- 172.21.15.12:0/2184132148 wait complete. 2024-05-15T15:41:38.973 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-05-15T15:41:38.973 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-15T15:41:38.973 DEBUG:teuthology.orchestra.run.smithi104:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-05-15T15:41:39.098 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi104.front.sepia.ceph.com 2024-05-15T15:41:39.098 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-15T15:41:39.098 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-15T15:41:39.150 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-15T15:41:39.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.273+0000 7f7242d14640 1 Processor -- start 2024-05-15T15:41:39.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.273+0000 7f7242d14640 1 -- start start 2024-05-15T15:41:39.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.274+0000 7f7242d14640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f723c0bcb00 0x7f723c14b650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:41:39.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.274+0000 7f7242d14640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f723c14bb90 0x7f723c155a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:41:39.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.274+0000 7f7242d14640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f723c0bb700 con 0x7f723c145580 2024-05-15T15:41:39.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.274+0000 7f7242d14640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f723c0bcf10 con 0x7f723c14bb90 2024-05-15T15:41:39.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.274+0000 7f7242d14640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f723c0a5b60 con 0x7f723c0bcb00 2024-05-15T15:41:39.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.275+0000 7f7240ab0640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f723c145580 0x7f723c0baff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:49684/0 (socket says 172.21.15.12:49684) 2024-05-15T15:41:39.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.275+0000 7f7240ab0640 1 -- 172.21.15.12:0/491805076 learned_addr learned my addr 172.21.15.12:0/491805076 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-05-15T15:41:39.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.275+0000 7f723bfff640 1 --2- 172.21.15.12:0/491805076 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f723c0bcb00 0x7f723c14b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:41:39.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.275+0000 7f72412b1640 1 --2- 172.21.15.12:0/491805076 >> v2:172.21.15.84:3300/0 conn(0x7f723c14bb90 0x7f723c155a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:41:39.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.275+0000 7f723b7fe640 1 -- 172.21.15.12:0/491805076 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2198908376 0 0) 0x7f722c001110 con 0x7f723c145580 2024-05-15T15:41:39.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.275+0000 7f723b7fe640 1 -- 172.21.15.12:0/491805076 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7228003520 con 0x7f723c145580 2024-05-15T15:41:39.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.275+0000 7f723bfff640 1 -- 172.21.15.12:0/491805076 >> v2:172.21.15.84:3300/0 conn(0x7f723c14bb90 msgr2=0x7f723c155a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:41:39.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.275+0000 7f723bfff640 1 --2- 172.21.15.12:0/491805076 >> v2:172.21.15.84:3300/0 conn(0x7f723c14bb90 0x7f723c155a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:41:39.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.275+0000 7f723bfff640 1 -- 172.21.15.12:0/491805076 >> v1:172.21.15.12:6789/0 conn(0x7f723c145580 legacy=0x7f723c0baff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:41:39.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.275+0000 7f723bfff640 1 -- 172.21.15.12:0/491805076 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f723c14eef0 con 0x7f723c0bcb00 2024-05-15T15:41:39.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.275+0000 7f72412b1640 1 --2- 172.21.15.12:0/491805076 >> v2:172.21.15.84:3300/0 conn(0x7f723c14bb90 0x7f723c155a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-15T15:41:39.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.276+0000 7f723bfff640 1 --2- 172.21.15.12:0/491805076 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f723c0bcb00 0x7f723c14b650 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f72240097a0 tx=0x7f722402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fffb3f4810063d2b server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:41:39.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.276+0000 7f723b7fe640 1 -- 172.21.15.12:0/491805076 <== mon.2 v2:172.21.15.84:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7224037070 con 0x7f723c0bcb00 2024-05-15T15:41:39.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.276+0000 7f723b7fe640 1 -- 172.21.15.12:0/491805076 <== mon.2 v2:172.21.15.84:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7224032440 con 0x7f723c0bcb00 2024-05-15T15:41:39.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.276+0000 7f723b7fe640 1 -- 172.21.15.12:0/491805076 <== mon.2 v2:172.21.15.84:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7224032810 con 0x7f723c0bcb00 2024-05-15T15:41:39.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.277+0000 7f7242d14640 1 -- 172.21.15.12:0/491805076 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f723c0bcb00 msgr2=0x7f723c14b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:41:39.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.277+0000 7f7242d14640 1 --2- 172.21.15.12:0/491805076 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f723c0bcb00 0x7f723c14b650 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f72240097a0 tx=0x7f722402a180 comp rx=0 tx=0).stop 2024-05-15T15:41:39.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.277+0000 7f7242d14640 1 -- 172.21.15.12:0/491805076 shutdown_connections 2024-05-15T15:41:39.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.277+0000 7f7242d14640 1 --2- 172.21.15.12:0/491805076 >> v2:172.21.15.84:3300/0 conn(0x7f723c14bb90 0x7f723c155a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:41:39.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.277+0000 7f7242d14640 1 --2- 172.21.15.12:0/491805076 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f723c0bcb00 0x7f723c14b650 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:41:39.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.277+0000 7f7242d14640 1 -- 172.21.15.12:0/491805076 >> 172.21.15.12:0/491805076 conn(0x7f723c0bd0f0 msgr2=0x7f723c0bd500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:41:39.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.277+0000 7f7242d14640 1 -- 172.21.15.12:0/491805076 shutdown_connections 2024-05-15T15:41:39.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.277+0000 7f7242d14640 1 -- 172.21.15.12:0/491805076 wait complete. 2024-05-15T15:41:39.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.278+0000 7f7242d14640 1 Processor -- start 2024-05-15T15:41:39.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.278+0000 7f7242d14640 1 -- start start 2024-05-15T15:41:39.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.279+0000 7f7242d14640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f723c0bcb00 0x7f723c1e59f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:41:39.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.279+0000 7f7242d14640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f723c145580 0x7f723c13ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:41:39.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.279+0000 7f7242d14640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f723c14bb90 0x7f723c13a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:41:39.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.279+0000 7f7242d14640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f723c14bfa0 con 0x7f723c0bcb00 2024-05-15T15:41:39.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.279+0000 7f7242d14640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f723c14f4b0 con 0x7f723c14bb90 2024-05-15T15:41:39.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.279+0000 7f7242d14640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f723c0c0240 con 0x7f723c145580 2024-05-15T15:41:39.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.280+0000 7f7240ab0640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f723c0bcb00 0x7f723c1e59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:41:39.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.280+0000 7f7240ab0640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f723c0bcb00 0x7f723c1e59f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45988/0 (socket says 172.21.15.12:45988) 2024-05-15T15:41:39.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.280+0000 7f7240ab0640 1 -- 172.21.15.12:0/279400929 learned_addr learned my addr 172.21.15.12:0/279400929 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:41:39.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.280+0000 7f72412b1640 1 --2- 172.21.15.12:0/279400929 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f723c14bb90 0x7f723c13a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:41:39.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.280+0000 7f723bfff640 1 --2- 172.21.15.12:0/279400929 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f723c145580 0x7f723c13ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:41:39.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.280+0000 7f7240ab0640 1 -- 172.21.15.12:0/279400929 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f723c145580 msgr2=0x7f723c13ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:41:39.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.280+0000 7f7240ab0640 1 --2- 172.21.15.12:0/279400929 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f723c145580 0x7f723c13ee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:41:39.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.280+0000 7f7240ab0640 1 -- 172.21.15.12:0/279400929 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f723c14bb90 msgr2=0x7f723c13a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:41:39.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.280+0000 7f7240ab0640 1 --2- 172.21.15.12:0/279400929 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f723c14bb90 0x7f723c13a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:41:39.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.280+0000 7f7240ab0640 1 -- 172.21.15.12:0/279400929 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f723c13f3d0 con 0x7f723c0bcb00 2024-05-15T15:41:39.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.280+0000 7f7240ab0640 1 --2- 172.21.15.12:0/279400929 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f723c0bcb00 0x7f723c1e59f0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f722c00c730 tx=0x7f722c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:41:39.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.280+0000 7f72397fa640 1 -- 172.21.15.12:0/279400929 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f722c005ab0 con 0x7f723c0bcb00 2024-05-15T15:41:39.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.280+0000 7f72397fa640 1 -- 172.21.15.12:0/279400929 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f722c001d30 con 0x7f723c0bcb00 2024-05-15T15:41:39.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.280+0000 7f7242d14640 1 -- 172.21.15.12:0/279400929 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f723c13e3a0 con 0x7f723c0bcb00 2024-05-15T15:41:39.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.280+0000 7f72397fa640 1 -- 172.21.15.12:0/279400929 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f722c005e50 con 0x7f723c0bcb00 2024-05-15T15:41:39.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.280+0000 7f7242d14640 1 -- 172.21.15.12:0/279400929 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f723c13cb50 con 0x7f723c0bcb00 2024-05-15T15:41:39.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.281+0000 7f7242d14640 1 -- 172.21.15.12:0/279400929 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f723c069b50 con 0x7f723c0bcb00 2024-05-15T15:41:39.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.282+0000 7f72397fa640 1 -- 172.21.15.12:0/279400929 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f722c007070 con 0x7f723c0bcb00 2024-05-15T15:41:39.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.282+0000 7f72397fa640 1 --2- 172.21.15.12:0/279400929 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f721c0764a0 0x7f721c0789b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:41:39.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.283+0000 7f72397fa640 1 -- 172.21.15.12:0/279400929 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 5825+0+0 (secure 0 0 0) 0x7f722c0972b0 con 0x7f723c0bcb00 2024-05-15T15:41:39.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.283+0000 7f723bfff640 1 --2- 172.21.15.12:0/279400929 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f721c0764a0 0x7f721c0789b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:41:39.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.283+0000 7f723bfff640 1 --2- 172.21.15.12:0/279400929 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f721c0764a0 0x7f721c0789b0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7224034000 tx=0x7f722402e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:41:39.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.287+0000 7f72397fa640 1 -- 172.21.15.12:0/279400929 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f723c0bb700 con 0x7f723c0bcb00 2024-05-15T15:41:39.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.515+0000 7f7242d14640 1 -- 172.21.15.12:0/279400929 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f723c050940 con 0x7f723c0bcb00 2024-05-15T15:41:39.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.516+0000 7f72397fa640 1 -- 172.21.15.12:0/279400929 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+4350 (secure 0 0 0) 0x7f722c060a60 con 0x7f723c0bcb00 2024-05-15T15:41:39.519 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-05-15T15:41:39.519 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4577,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/1749847216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1749847216},{"type":"v1","addr":"172.21.15.84:6835","nonce":1749847216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4580,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/3678098513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6833","nonce":3678098513},{"type":"v1","addr":"172.21.15.12:6835","nonce":3678098513}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-15T15:40:31.243097+0000","modified":"2024-05-15T15:40:34.253461+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4759},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4759":{"gid":4759,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.12:6834/32438370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":32438370},{"type":"v1","addr":"172.21.15.12:6834","nonce":32438370}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4759,"qdb_cluster":[4759]},"id":2}]} 2024-05-15T15:41:39.521 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 16 2024-05-15T15:41:39.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.518+0000 7f7242d14640 1 -- 172.21.15.12:0/279400929 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f721c0764a0 msgr2=0x7f721c0789b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:41:39.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.518+0000 7f7242d14640 1 --2- 172.21.15.12:0/279400929 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f721c0764a0 0x7f721c0789b0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7224034000 tx=0x7f722402e000 comp rx=0 tx=0).stop 2024-05-15T15:41:39.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.518+0000 7f7242d14640 1 -- 172.21.15.12:0/279400929 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f723c0bcb00 msgr2=0x7f723c1e59f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:41:39.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.518+0000 7f7242d14640 1 --2- 172.21.15.12:0/279400929 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f723c0bcb00 0x7f723c1e59f0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f722c00c730 tx=0x7f722c00cbf0 comp rx=0 tx=0).stop 2024-05-15T15:41:39.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.518+0000 7f7242d14640 1 -- 172.21.15.12:0/279400929 shutdown_connections 2024-05-15T15:41:39.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.518+0000 7f7242d14640 1 --2- 172.21.15.12:0/279400929 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f723c14bb90 0x7f723c13a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:41:39.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.518+0000 7f7242d14640 1 --2- 172.21.15.12:0/279400929 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f723c145580 0x7f723c13ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:41:39.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.518+0000 7f7242d14640 1 --2- 172.21.15.12:0/279400929 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f721c0764a0 0x7f721c0789b0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:41:39.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.518+0000 7f7242d14640 1 --2- 172.21.15.12:0/279400929 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f723c0bcb00 0x7f723c1e59f0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:41:39.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.518+0000 7f7242d14640 1 -- 172.21.15.12:0/279400929 >> 172.21.15.12:0/279400929 conn(0x7f723c0bd0f0 msgr2=0x7f723c073400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:41:39.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.518+0000 7f7242d14640 1 -- 172.21.15.12:0/279400929 shutdown_connections 2024-05-15T15:41:39.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.518+0000 7f7242d14640 1 -- 172.21.15.12:0/279400929 wait complete. 2024-05-15T15:41:39.533 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-15T15:41:39.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.642+0000 7fce16bb7640 1 Processor -- start 2024-05-15T15:41:39.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.642+0000 7fce16bb7640 1 -- start start 2024-05-15T15:41:39.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.643+0000 7fce16bb7640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fce1014e530 0x7fce100ba320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:41:39.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.643+0000 7fce16bb7640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fce100bd440 0x7fce100bd850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:41:39.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.643+0000 7fce16bb7640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fce100b8d70 0x7fce100b9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:41:39.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.643+0000 7fce16bb7640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fce100b88e0 con 0x7fce100b8d70 2024-05-15T15:41:39.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.643+0000 7fce16bb7640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7fce100ba860 con 0x7fce1014e530 2024-05-15T15:41:39.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.643+0000 7fce16bb7640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fce100bdd90 con 0x7fce100bd440 2024-05-15T15:41:39.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.643+0000 7fce15154640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fce100b8d70 0x7fce100b9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:41:39.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.643+0000 7fce15154640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fce100b8d70 0x7fce100b9180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46002/0 (socket says 172.21.15.12:46002) 2024-05-15T15:41:39.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.643+0000 7fce15154640 1 -- 172.21.15.12:0/3971626893 learned_addr learned my addr 172.21.15.12:0/3971626893 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:41:39.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.643+0000 7fce14953640 1 --2- 172.21.15.12:0/3971626893 >> v2:172.21.15.84:3300/0 conn(0x7fce1014e530 0x7fce100ba320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:41:39.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.643+0000 7fce07fff640 1 --2- 172.21.15.12:0/3971626893 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fce100bd440 0x7fce100bd850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:41:39.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.643+0000 7fce14953640 1 -- 172.21.15.12:0/3971626893 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fce100bd440 msgr2=0x7fce100bd850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:41:39.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.643+0000 7fce14953640 1 --2- 172.21.15.12:0/3971626893 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fce100bd440 0x7fce100bd850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:41:39.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.643+0000 7fce14953640 1 -- 172.21.15.12:0/3971626893 >> v2:172.21.15.12:3300/0 conn(0x7fce100b8d70 msgr2=0x7fce100b9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:41:39.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.643+0000 7fce14953640 1 --2- 172.21.15.12:0/3971626893 >> v2:172.21.15.12:3300/0 conn(0x7fce100b8d70 0x7fce100b9180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:41:39.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.643+0000 7fce14953640 1 -- 172.21.15.12:0/3971626893 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce1014ece0 con 0x7fce1014e530 2024-05-15T15:41:39.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.643+0000 7fce15154640 1 --2- 172.21.15.12:0/3971626893 >> v2:172.21.15.12:3300/0 conn(0x7fce100b8d70 0x7fce100b9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-15T15:41:39.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.644+0000 7fce14953640 1 --2- 172.21.15.12:0/3971626893 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fce1014e530 0x7fce100ba320 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fce1008d0d0 tx=0x7fce0c02a130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7743f8fa420fea7e server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:41:39.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.644+0000 7fce077fe640 1 -- 172.21.15.12:0/3971626893 <== mon.1 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce0c037070 con 0x7fce1014e530 2024-05-15T15:41:39.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.644+0000 7fce077fe640 1 -- 172.21.15.12:0/3971626893 <== mon.1 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce0c02ae40 con 0x7fce1014e530 2024-05-15T15:41:39.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.644+0000 7fce077fe640 1 -- 172.21.15.12:0/3971626893 <== mon.1 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce0c032660 con 0x7fce1014e530 2024-05-15T15:41:39.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.645+0000 7fce16bb7640 1 -- 172.21.15.12:0/3971626893 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fce1014e530 msgr2=0x7fce100ba320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:41:39.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.645+0000 7fce16bb7640 1 --2- 172.21.15.12:0/3971626893 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fce1014e530 0x7fce100ba320 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fce1008d0d0 tx=0x7fce0c02a130 comp rx=0 tx=0).stop 2024-05-15T15:41:39.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.645+0000 7fce16bb7640 1 -- 172.21.15.12:0/3971626893 shutdown_connections 2024-05-15T15:41:39.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.645+0000 7fce16bb7640 1 --2- 172.21.15.12:0/3971626893 >> v2:172.21.15.12:3300/0 conn(0x7fce100b8d70 0x7fce100b9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:41:39.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.645+0000 7fce16bb7640 1 --2- 172.21.15.12:0/3971626893 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fce100bd440 0x7fce100bd850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:41:39.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.645+0000 7fce16bb7640 1 --2- 172.21.15.12:0/3971626893 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fce1014e530 0x7fce100ba320 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:41:39.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.645+0000 7fce16bb7640 1 -- 172.21.15.12:0/3971626893 >> 172.21.15.12:0/3971626893 conn(0x7fce100c0570 msgr2=0x7fce100c0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:41:39.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.645+0000 7fce16bb7640 1 -- 172.21.15.12:0/3971626893 shutdown_connections 2024-05-15T15:41:39.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.645+0000 7fce16bb7640 1 -- 172.21.15.12:0/3971626893 wait complete. 2024-05-15T15:41:39.652 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.647+0000 7fce16bb7640 1 Processor -- start 2024-05-15T15:41:39.652 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.647+0000 7fce16bb7640 1 -- start start 2024-05-15T15:41:39.652 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.648+0000 7fce16bb7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce100b8d70 0x7fce1014d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:41:39.652 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.648+0000 7fce16bb7640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fce100bd440 0x7fce101e8320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:41:39.652 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.648+0000 7fce16bb7640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fce1014e530 0x7fce101e6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:41:39.652 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.648+0000 7fce16bb7640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fce100bbb70 con 0x7fce100b8d70 2024-05-15T15:41:39.652 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.648+0000 7fce16bb7640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fce1014f2a0 con 0x7fce100bd440 2024-05-15T15:41:39.652 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.648+0000 7fce16bb7640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fce100b96c0 con 0x7fce1014e530 2024-05-15T15:41:39.652 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.648+0000 7fce14953640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce100b8d70 0x7fce1014d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:41:39.652 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.648+0000 7fce14953640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce100b8d70 0x7fce1014d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46016/0 (socket says 172.21.15.12:46016) 2024-05-15T15:41:39.652 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.648+0000 7fce14953640 1 -- 172.21.15.12:0/1743896766 learned_addr learned my addr 172.21.15.12:0/1743896766 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:41:39.652 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.648+0000 7fce07fff640 1 --2- 172.21.15.12:0/1743896766 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fce100bd440 0x7fce101e8320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:41:39.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.648+0000 7fce15154640 1 --2- 172.21.15.12:0/1743896766 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fce1014e530 0x7fce101e6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:41:39.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.648+0000 7fce14953640 1 -- 172.21.15.12:0/1743896766 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fce1014e530 msgr2=0x7fce101e6ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:41:39.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.648+0000 7fce14953640 1 --2- 172.21.15.12:0/1743896766 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fce1014e530 0x7fce101e6ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:41:39.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.648+0000 7fce14953640 1 -- 172.21.15.12:0/1743896766 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fce100bd440 msgr2=0x7fce101e8320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:41:39.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.648+0000 7fce14953640 1 --2- 172.21.15.12:0/1743896766 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fce100bd440 0x7fce101e8320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:41:39.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.648+0000 7fce14953640 1 -- 172.21.15.12:0/1743896766 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce1014df20 con 0x7fce100b8d70 2024-05-15T15:41:39.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.649+0000 7fce14953640 1 --2- 172.21.15.12:0/1743896766 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce100b8d70 0x7fce1014d9e0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fce0c0098b0 tx=0x7fce0c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:41:39.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.649+0000 7fce057fa640 1 -- 172.21.15.12:0/1743896766 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce0c037040 con 0x7fce100b8d70 2024-05-15T15:41:39.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.649+0000 7fce057fa640 1 -- 172.21.15.12:0/1743896766 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce0c042070 con 0x7fce100b8d70 2024-05-15T15:41:39.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.649+0000 7fce16bb7640 1 -- 172.21.15.12:0/1743896766 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce101e58f0 con 0x7fce100b8d70 2024-05-15T15:41:39.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.649+0000 7fce057fa640 1 -- 172.21.15.12:0/1743896766 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce0c005de0 con 0x7fce100b8d70 2024-05-15T15:41:39.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.649+0000 7fce16bb7640 1 -- 172.21.15.12:0/1743896766 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce10140e40 con 0x7fce100b8d70 2024-05-15T15:41:39.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.650+0000 7fce16bb7640 1 -- 172.21.15.12:0/1743896766 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce101e5ac0 con 0x7fce100b8d70 2024-05-15T15:41:39.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.651+0000 7fce057fa640 1 -- 172.21.15.12:0/1743896766 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fce0c03a070 con 0x7fce100b8d70 2024-05-15T15:41:39.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.651+0000 7fce057fa640 1 --2- 172.21.15.12:0/1743896766 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fcdfc076300 0x7fcdfc078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:41:39.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.651+0000 7fce057fa640 1 -- 172.21.15.12:0/1743896766 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 5825+0+0 (secure 0 0 0) 0x7fce0c0b7820 con 0x7fce100b8d70 2024-05-15T15:41:39.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.651+0000 7fce07fff640 1 --2- 172.21.15.12:0/1743896766 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fcdfc076300 0x7fcdfc078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:41:39.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.652+0000 7fce07fff640 1 --2- 172.21.15.12:0/1743896766 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fcdfc076300 0x7fcdfc078810 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fce10148c40 tx=0x7fce00008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:41:39.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.656+0000 7fce057fa640 1 -- 172.21.15.12:0/1743896766 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fce0c081060 con 0x7fce100b8d70 2024-05-15T15:41:39.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.889+0000 7fce16bb7640 1 -- 172.21.15.12:0/1743896766 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fce10050940 con 0x7fce100b8d70 2024-05-15T15:41:39.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.889+0000 7fce057fa640 1 -- 172.21.15.12:0/1743896766 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+4350 (secure 0 0 0) 0x7fce0c080960 con 0x7fce100b8d70 2024-05-15T15:41:39.892 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-05-15T15:41:39.892 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4577,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/1749847216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1749847216},{"type":"v1","addr":"172.21.15.84:6835","nonce":1749847216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4580,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/3678098513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6833","nonce":3678098513},{"type":"v1","addr":"172.21.15.12:6835","nonce":3678098513}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-15T15:40:31.243097+0000","modified":"2024-05-15T15:40:34.253461+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4759},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4759":{"gid":4759,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.12:6834/32438370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":32438370},{"type":"v1","addr":"172.21.15.12:6834","nonce":32438370}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4759,"qdb_cluster":[4759]},"id":2}]} 2024-05-15T15:41:39.892 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 16 2024-05-15T15:41:39.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.892+0000 7fce16bb7640 1 -- 172.21.15.12:0/1743896766 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fcdfc076300 msgr2=0x7fcdfc078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:41:39.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.892+0000 7fce16bb7640 1 --2- 172.21.15.12:0/1743896766 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fcdfc076300 0x7fcdfc078810 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fce10148c40 tx=0x7fce00008040 comp rx=0 tx=0).stop 2024-05-15T15:41:39.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.892+0000 7fce16bb7640 1 -- 172.21.15.12:0/1743896766 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce100b8d70 msgr2=0x7fce1014d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:41:39.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.892+0000 7fce16bb7640 1 --2- 172.21.15.12:0/1743896766 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce100b8d70 0x7fce1014d9e0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fce0c0098b0 tx=0x7fce0c0046c0 comp rx=0 tx=0).stop 2024-05-15T15:41:39.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.892+0000 7fce16bb7640 1 -- 172.21.15.12:0/1743896766 shutdown_connections 2024-05-15T15:41:39.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.892+0000 7fce16bb7640 1 --2- 172.21.15.12:0/1743896766 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fce1014e530 0x7fce101e6ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:41:39.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.892+0000 7fce16bb7640 1 --2- 172.21.15.12:0/1743896766 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fce100bd440 0x7fce101e8320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:41:39.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.892+0000 7fce16bb7640 1 --2- 172.21.15.12:0/1743896766 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fcdfc076300 0x7fcdfc078810 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:41:39.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.892+0000 7fce16bb7640 1 --2- 172.21.15.12:0/1743896766 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce100b8d70 0x7fce1014d9e0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:41:39.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.892+0000 7fce16bb7640 1 -- 172.21.15.12:0/1743896766 >> 172.21.15.12:0/1743896766 conn(0x7fce100c0570 msgr2=0x7fce100bdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:41:39.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.892+0000 7fce16bb7640 1 -- 172.21.15.12:0/1743896766 shutdown_connections 2024-05-15T15:41:39.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:39.892+0000 7fce16bb7640 1 -- 172.21.15.12:0/1743896766 wait complete. 2024-05-15T15:41:39.905 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-15T15:41:40.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.015+0000 7f9ca90a8640 1 Processor -- start 2024-05-15T15:41:40.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.015+0000 7f9ca90a8640 1 -- start start 2024-05-15T15:41:40.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.017+0000 7f9ca90a8640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f9ca40bc1c0 0x7f9ca40a0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:41:40.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.017+0000 7f9ca90a8640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f9ca4146380 0x7f9ca4070a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:41:40.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.017+0000 7f9ca90a8640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ca414c120 con 0x7f9ca414c8e0 2024-05-15T15:41:40.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.017+0000 7f9ca90a8640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f9ca414c450 con 0x7f9ca4146380 2024-05-15T15:41:40.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.017+0000 7f9ca90a8640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f9ca4071e40 con 0x7f9ca40bc1c0 2024-05-15T15:41:40.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.017+0000 7f9ca259c640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f9ca4146380 0x7f9ca4070a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:41:40.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.017+0000 7f9ca259c640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f9ca4146380 0x7f9ca4070a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46018/0 (socket says 172.21.15.12:46018) 2024-05-15T15:41:40.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.017+0000 7f9ca259c640 1 -- 172.21.15.12:0/2997253042 learned_addr learned my addr 172.21.15.12:0/2997253042 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:41:40.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.017+0000 7f9ca359e640 1 --1- 172.21.15.12:0/2997253042 >> v1:172.21.15.12:6789/0 conn(0x7f9ca414c8e0 0x7f9ca414f6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:49692/0 (socket says 172.21.15.12:49692) 2024-05-15T15:41:40.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.017+0000 7f9ca2d9d640 1 --2- 172.21.15.12:0/2997253042 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f9ca40bc1c0 0x7f9ca40a0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:41:40.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.017+0000 7f9ca259c640 1 -- 172.21.15.12:0/2997253042 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f9ca40bc1c0 msgr2=0x7f9ca40a0ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:41:40.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.017+0000 7f9ca259c640 1 --2- 172.21.15.12:0/2997253042 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f9ca40bc1c0 0x7f9ca40a0ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:41:40.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.017+0000 7f9ca259c640 1 -- 172.21.15.12:0/2997253042 >> v1:172.21.15.12:6789/0 conn(0x7f9ca414c8e0 legacy=0x7f9ca414f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:41:40.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.017+0000 7f9ca1d9b640 1 -- 172.21.15.12:0/2997253042 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3231585369 0 0) 0x7f9ca414c120 con 0x7f9ca414c8e0 2024-05-15T15:41:40.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.017+0000 7f9ca259c640 1 -- 172.21.15.12:0/2997253042 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ca40713d0 con 0x7f9ca4146380 2024-05-15T15:41:40.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.017+0000 7f9ca2d9d640 1 --2- 172.21.15.12:0/2997253042 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f9ca40bc1c0 0x7f9ca40a0ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-15T15:41:40.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.018+0000 7f9ca259c640 1 --2- 172.21.15.12:0/2997253042 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9ca4146380 0x7f9ca4070a40 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f9c8c009870 tx=0x7f9c8c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cc7bfcd08e5c49e server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:41:40.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.018+0000 7f9ca1d9b640 1 -- 172.21.15.12:0/2997253042 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c8c037070 con 0x7f9ca4146380 2024-05-15T15:41:40.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.018+0000 7f9ca1d9b640 1 -- 172.21.15.12:0/2997253042 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c8c032440 con 0x7f9ca4146380 2024-05-15T15:41:40.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.018+0000 7f9ca1d9b640 1 -- 172.21.15.12:0/2997253042 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c8c032810 con 0x7f9ca4146380 2024-05-15T15:41:40.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.019+0000 7f9ca90a8640 1 -- 172.21.15.12:0/2997253042 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9ca4146380 msgr2=0x7f9ca4070a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:41:40.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.019+0000 7f9ca90a8640 1 --2- 172.21.15.12:0/2997253042 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9ca4146380 0x7f9ca4070a40 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f9c8c009870 tx=0x7f9c8c02a270 comp rx=0 tx=0).stop 2024-05-15T15:41:40.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.019+0000 7f9ca90a8640 1 -- 172.21.15.12:0/2997253042 shutdown_connections 2024-05-15T15:41:40.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.019+0000 7f9ca90a8640 1 --2- 172.21.15.12:0/2997253042 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9ca4146380 0x7f9ca4070a40 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:41:40.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.019+0000 7f9ca90a8640 1 --2- 172.21.15.12:0/2997253042 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f9ca40bc1c0 0x7f9ca40a0ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:41:40.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.019+0000 7f9ca90a8640 1 -- 172.21.15.12:0/2997253042 >> 172.21.15.12:0/2997253042 conn(0x7f9ca40c17c0 msgr2=0x7f9ca40c1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:41:40.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.019+0000 7f9ca90a8640 1 -- 172.21.15.12:0/2997253042 shutdown_connections 2024-05-15T15:41:40.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.019+0000 7f9ca90a8640 1 -- 172.21.15.12:0/2997253042 wait complete. 2024-05-15T15:41:40.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.021+0000 7f9ca90a8640 1 Processor -- start 2024-05-15T15:41:40.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.021+0000 7f9ca90a8640 1 -- start start 2024-05-15T15:41:40.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.022+0000 7f9ca90a8640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9ca40bc1c0 0x7f9ca4147e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:41:40.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.022+0000 7f9ca90a8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9ca4146380 0x7f9ca414b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:41:40.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.022+0000 7f9ca90a8640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f9ca414c8e0 0x7f9ca41e23e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:41:40.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.022+0000 7f9ca90a8640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f9ca40bd5f0 con 0x7f9ca4146380 2024-05-15T15:41:40.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.022+0000 7f9ca90a8640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f9ca4146790 con 0x7f9ca40bc1c0 2024-05-15T15:41:40.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.022+0000 7f9ca90a8640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f9ca40bd770 con 0x7f9ca414c8e0 2024-05-15T15:41:40.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.022+0000 7f9ca259c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9ca4146380 0x7f9ca414b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:41:40.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.022+0000 7f9ca259c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9ca4146380 0x7f9ca414b620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46026/0 (socket says 172.21.15.12:46026) 2024-05-15T15:41:40.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.022+0000 7f9ca259c640 1 -- 172.21.15.12:0/3029601862 learned_addr learned my addr 172.21.15.12:0/3029601862 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:41:40.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.022+0000 7f9ca2d9d640 1 --2- 172.21.15.12:0/3029601862 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9ca40bc1c0 0x7f9ca4147e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:41:40.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.022+0000 7f9ca359e640 1 --2- 172.21.15.12:0/3029601862 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f9ca414c8e0 0x7f9ca41e23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:41:40.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.022+0000 7f9ca259c640 1 -- 172.21.15.12:0/3029601862 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f9ca414c8e0 msgr2=0x7f9ca41e23e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:41:40.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.022+0000 7f9ca259c640 1 --2- 172.21.15.12:0/3029601862 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f9ca414c8e0 0x7f9ca41e23e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:41:40.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.022+0000 7f9ca259c640 1 -- 172.21.15.12:0/3029601862 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9ca40bc1c0 msgr2=0x7f9ca4147e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:41:40.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.022+0000 7f9ca259c640 1 --2- 172.21.15.12:0/3029601862 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9ca40bc1c0 0x7f9ca4147e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:41:40.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.022+0000 7f9ca259c640 1 -- 172.21.15.12:0/3029601862 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ca414bb60 con 0x7f9ca4146380 2024-05-15T15:41:40.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.022+0000 7f9ca259c640 1 --2- 172.21.15.12:0/3029601862 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9ca4146380 0x7f9ca414b620 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f9c8c009870 tx=0x7f9c8c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:41:40.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.022+0000 7f9c9b7fe640 1 -- 172.21.15.12:0/3029601862 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c8c041020 con 0x7f9ca4146380 2024-05-15T15:41:40.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.023+0000 7f9c9b7fe640 1 -- 172.21.15.12:0/3029601862 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c8c0306c0 con 0x7f9ca4146380 2024-05-15T15:41:40.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.023+0000 7f9ca90a8640 1 -- 172.21.15.12:0/3029601862 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ca41e2920 con 0x7f9ca4146380 2024-05-15T15:41:40.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.023+0000 7f9c9b7fe640 1 -- 172.21.15.12:0/3029601862 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c8c037040 con 0x7f9ca4146380 2024-05-15T15:41:40.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.023+0000 7f9ca90a8640 1 -- 172.21.15.12:0/3029601862 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ca4146cf0 con 0x7f9ca4146380 2024-05-15T15:41:40.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.024+0000 7f9ca90a8640 1 -- 172.21.15.12:0/3029601862 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ca4050940 con 0x7f9ca4146380 2024-05-15T15:41:40.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.024+0000 7f9c9b7fe640 1 -- 172.21.15.12:0/3029601862 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f9c8c044020 con 0x7f9ca4146380 2024-05-15T15:41:40.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.025+0000 7f9c9b7fe640 1 --2- 172.21.15.12:0/3029601862 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f9c840762d0 0x7f9c840787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:41:40.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.025+0000 7f9c9b7fe640 1 -- 172.21.15.12:0/3029601862 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 5825+0+0 (secure 0 0 0) 0x7f9c8c0b7f10 con 0x7f9ca4146380 2024-05-15T15:41:40.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.025+0000 7f9ca2d9d640 1 --2- 172.21.15.12:0/3029601862 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f9c840762d0 0x7f9c840787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:41:40.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.026+0000 7f9ca2d9d640 1 --2- 172.21.15.12:0/3029601862 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f9c840762d0 0x7f9c840787e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f9c9c0096d0 tx=0x7f9c9c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:41:40.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.030+0000 7f9c9b7fe640 1 -- 172.21.15.12:0/3029601862 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f9c8c04b030 con 0x7f9ca4146380 2024-05-15T15:41:40.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.221+0000 7f9ca90a8640 1 -- 172.21.15.12:0/3029601862 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9ca4143b40 con 0x7f9ca4146380 2024-05-15T15:41:40.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.222+0000 7f9c9b7fe640 1 -- 172.21.15.12:0/3029601862 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) ==== 74+0+16821 (secure 0 0 0) 0x7f9c8c0817f0 con 0x7f9ca4146380 2024-05-15T15:41:40.224 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-05-15T15:41:40.225 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":38,"fsid":"3b7fc4b2-b85c-49b5-a5de-38444eeed40d","created":"2024-05-15T15:39:28.392476+0000","modified":"2024-05-15T15:41:36.207122+0000","last_up_change":"2024-05-15T15:39:39.363983+0000","last_in_change":"2024-05-15T15:39:30.591216+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-15T15:39:40.715999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-05-15T15:40:29.381895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-05-15T15:40:30.183897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0d06a12a-866a-418e-9776-704d74354579","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":3943681952},{"type":"v1","addr":"172.21.15.12:6809","nonce":3943681952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":3943681952},{"type":"v1","addr":"172.21.15.12:6812","nonce":3943681952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":3943681952},{"type":"v1","addr":"172.21.15.12:6821","nonce":3943681952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":3943681952},{"type":"v1","addr":"172.21.15.12:6816","nonce":3943681952}]},"public_addr":"172.21.15.12:6809/3943681952","cluster_addr":"172.21.15.12:6812/3943681952","heartbeat_back_addr":"172.21.15.12:6821/3943681952","heartbeat_front_addr":"172.21.15.12:6816/3943681952","state":["exists","up"]},{"osd":1,"uuid":"09d0fa19-9ef8-4f35-bf99-6e86658c6f10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6811","nonce":1763752148},{"type":"v1","addr":"172.21.15.12:6813","nonce":1763752148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":1763752148},{"type":"v1","addr":"172.21.15.12:6817","nonce":1763752148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":1763752148},{"type":"v1","addr":"172.21.15.12:6827","nonce":1763752148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6819","nonce":1763752148},{"type":"v1","addr":"172.21.15.12:6822","nonce":1763752148}]},"public_addr":"172.21.15.12:6813/1763752148","cluster_addr":"172.21.15.12:6817/1763752148","heartbeat_back_addr":"172.21.15.12:6827/1763752148","heartbeat_front_addr":"172.21.15.12:6822/1763752148","state":["exists","up"]},{"osd":2,"uuid":"b204c6ad-f431-40a5-ba27-9844294f0ece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":2173702802},{"type":"v1","addr":"172.21.15.12:6823","nonce":2173702802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":2173702802},{"type":"v1","addr":"172.21.15.12:6826","nonce":2173702802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":2173702802},{"type":"v1","addr":"172.21.15.12:6831","nonce":2173702802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":2173702802},{"type":"v1","addr":"172.21.15.12:6829","nonce":2173702802}]},"public_addr":"172.21.15.12:6823/2173702802","cluster_addr":"172.21.15.12:6826/2173702802","heartbeat_back_addr":"172.21.15.12:6831/2173702802","heartbeat_front_addr":"172.21.15.12:6829/2173702802","state":["exists","up"]},{"osd":3,"uuid":"660a9ccb-2ee5-42d8-8481-0835047a8260","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":3956443113},{"type":"v1","addr":"172.21.15.12:6801","nonce":3956443113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":3956443113},{"type":"v1","addr":"172.21.15.12:6803","nonce":3956443113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":3956443113},{"type":"v1","addr":"172.21.15.12:6807","nonce":3956443113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":3956443113},{"type":"v1","addr":"172.21.15.12:6805","nonce":3956443113}]},"public_addr":"172.21.15.12:6801/3956443113","cluster_addr":"172.21.15.12:6803/3956443113","heartbeat_back_addr":"172.21.15.12:6807/3956443113","heartbeat_front_addr":"172.21.15.12:6805/3956443113","state":["exists","up"]},{"osd":4,"uuid":"9eef1461-a961-457c-9a78-43b5098a46a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":1021092792},{"type":"v1","addr":"172.21.15.84:6809","nonce":1021092792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":1021092792},{"type":"v1","addr":"172.21.15.84:6811","nonce":1021092792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":1021092792},{"type":"v1","addr":"172.21.15.84:6815","nonce":1021092792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":1021092792},{"type":"v1","addr":"172.21.15.84:6813","nonce":1021092792}]},"public_addr":"172.21.15.84:6809/1021092792","cluster_addr":"172.21.15.84:6811/1021092792","heartbeat_back_addr":"172.21.15.84:6815/1021092792","heartbeat_front_addr":"172.21.15.84:6813/1021092792","state":["exists","up"]},{"osd":5,"uuid":"5f924e2f-6c71-4741-a727-d3710c438431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":3173527851},{"type":"v1","addr":"172.21.15.84:6801","nonce":3173527851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":3173527851},{"type":"v1","addr":"172.21.15.84:6803","nonce":3173527851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":3173527851},{"type":"v1","addr":"172.21.15.84:6807","nonce":3173527851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":3173527851},{"type":"v1","addr":"172.21.15.84:6805","nonce":3173527851}]},"public_addr":"172.21.15.84:6801/3173527851","cluster_addr":"172.21.15.84:6803/3173527851","heartbeat_back_addr":"172.21.15.84:6807/3173527851","heartbeat_front_addr":"172.21.15.84:6805/3173527851","state":["exists","up"]},{"osd":6,"uuid":"efae9975-8c16-4ad3-892f-71f3c59718d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3029180670},{"type":"v1","addr":"172.21.15.84:6817","nonce":3029180670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3029180670},{"type":"v1","addr":"172.21.15.84:6819","nonce":3029180670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3029180670},{"type":"v1","addr":"172.21.15.84:6823","nonce":3029180670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3029180670},{"type":"v1","addr":"172.21.15.84:6821","nonce":3029180670}]},"public_addr":"172.21.15.84:6817/3029180670","cluster_addr":"172.21.15.84:6819/3029180670","heartbeat_back_addr":"172.21.15.84:6823/3029180670","heartbeat_front_addr":"172.21.15.84:6821/3029180670","state":["exists","up"]},{"osd":7,"uuid":"6426efba-ee4d-4e44-83d1-c76c75aec30c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3067620602},{"type":"v1","addr":"172.21.15.84:6825","nonce":3067620602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3067620602},{"type":"v1","addr":"172.21.15.84:6827","nonce":3067620602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":3067620602},{"type":"v1","addr":"172.21.15.84:6831","nonce":3067620602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":3067620602},{"type":"v1","addr":"172.21.15.84:6829","nonce":3067620602}]},"public_addr":"172.21.15.84:6825/3067620602","cluster_addr":"172.21.15.84:6827/3067620602","heartbeat_back_addr":"172.21.15.84:6831/3067620602","heartbeat_front_addr":"172.21.15.84:6829/3067620602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.809514+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.845364+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.762733+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.688597+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.699228+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.747865+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.712415+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.820683+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"5.0","mappings":[{"from":4,"to":5}]},{"pgid":"5.8","mappings":[{"from":4,"to":5}]},{"pgid":"5.13","mappings":[{"from":4,"to":5}]},{"pgid":"5.27","mappings":[{"from":4,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-15T15:41:40.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.224+0000 7f9ca90a8640 1 -- 172.21.15.12:0/3029601862 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f9c840762d0 msgr2=0x7f9c840787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:41:40.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.224+0000 7f9ca90a8640 1 --2- 172.21.15.12:0/3029601862 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f9c840762d0 0x7f9c840787e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f9c9c0096d0 tx=0x7f9c9c008040 comp rx=0 tx=0).stop 2024-05-15T15:41:40.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.224+0000 7f9ca90a8640 1 -- 172.21.15.12:0/3029601862 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9ca4146380 msgr2=0x7f9ca414b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:41:40.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.224+0000 7f9ca90a8640 1 --2- 172.21.15.12:0/3029601862 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9ca4146380 0x7f9ca414b620 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f9c8c009870 tx=0x7f9c8c0046c0 comp rx=0 tx=0).stop 2024-05-15T15:41:40.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.224+0000 7f9ca90a8640 1 -- 172.21.15.12:0/3029601862 shutdown_connections 2024-05-15T15:41:40.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.224+0000 7f9ca90a8640 1 --2- 172.21.15.12:0/3029601862 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f9ca414c8e0 0x7f9ca41e23e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:41:40.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.224+0000 7f9ca90a8640 1 --2- 172.21.15.12:0/3029601862 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f9c840762d0 0x7f9c840787e0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:41:40.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.224+0000 7f9ca90a8640 1 --2- 172.21.15.12:0/3029601862 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9ca4146380 0x7f9ca414b620 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:41:40.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.224+0000 7f9ca90a8640 1 --2- 172.21.15.12:0/3029601862 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9ca40bc1c0 0x7f9ca4147e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:41:40.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.224+0000 7f9ca90a8640 1 -- 172.21.15.12:0/3029601862 >> 172.21.15.12:0/3029601862 conn(0x7f9ca40c17c0 msgr2=0x7f9ca40c1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:41:40.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.224+0000 7f9ca90a8640 1 -- 172.21.15.12:0/3029601862 shutdown_connections 2024-05-15T15:41:40.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.225+0000 7f9ca90a8640 1 -- 172.21.15.12:0/3029601862 wait complete. 2024-05-15T15:41:40.238 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-15T15:41:40.239 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-15T15:41:40.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.347+0000 7f1978372640 1 Processor -- start 2024-05-15T15:41:40.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.347+0000 7f1978372640 1 -- start start 2024-05-15T15:41:40.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.349+0000 7f1978372640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f19700a0ba0 0x7f1970146380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:41:40.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.349+0000 7f1978372640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1970071150 con 0x7f19700bc1c0 2024-05-15T15:41:40.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.349+0000 7f1978372640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f197014c120 con 0x7f197014c8e0 2024-05-15T15:41:40.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.349+0000 7f1978372640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f197014c450 con 0x7f19700a0ba0 2024-05-15T15:41:40.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.349+0000 7f197610e640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f19700bc1c0 0x7f1970070a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:49698/0 (socket says 172.21.15.12:49698) 2024-05-15T15:41:40.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.349+0000 7f197610e640 1 -- 172.21.15.12:0/3561014589 learned_addr learned my addr 172.21.15.12:0/3561014589 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-05-15T15:41:40.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.349+0000 7f197590d640 1 --2- 172.21.15.12:0/3561014589 >> v2:172.21.15.84:3300/0 conn(0x7f19700a0ba0 0x7f1970146380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:41:40.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.349+0000 7f197510c640 1 -- 172.21.15.12:0/3561014589 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2021546252 0 0) 0x7f1968001110 con 0x7f19700bc1c0 2024-05-15T15:41:40.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.349+0000 7f197510c640 1 -- 172.21.15.12:0/3561014589 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1958003520 con 0x7f19700bc1c0 2024-05-15T15:41:40.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.349+0000 7f197510c640 1 -- 172.21.15.12:0/3561014589 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2683375466 0 0) 0x7f1958003520 con 0x7f19700bc1c0 2024-05-15T15:41:40.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.349+0000 7f197510c640 1 -- 172.21.15.12:0/3561014589 >> v2:172.21.15.84:3300/0 conn(0x7f19700a0ba0 msgr2=0x7f1970146380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:41:40.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.349+0000 7f197510c640 1 --2- 172.21.15.12:0/3561014589 >> v2:172.21.15.84:3300/0 conn(0x7f19700a0ba0 0x7f1970146380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:41:40.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.349+0000 7f197510c640 1 -- 172.21.15.12:0/3561014589 >> v1:172.21.15.84:6789/0 conn(0x7f197014c8e0 legacy=0x7f1970156a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:41:40.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.349+0000 7f197510c640 1 -- 172.21.15.12:0/3561014589 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1970071e40 con 0x7f19700bc1c0 2024-05-15T15:41:40.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.349+0000 7f197510c640 1 -- 172.21.15.12:0/3561014589 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 38171736 0 0) 0x7f19680018c0 con 0x7f19700bc1c0 2024-05-15T15:41:40.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.349+0000 7f197510c640 1 -- 172.21.15.12:0/3561014589 >> v1:172.21.15.12:6789/0 conn(0x7f19700bc1c0 legacy=0x7f1970070a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:41:40.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.349+0000 7f197510c640 1 --2- 172.21.15.12:0/3561014589 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1958003a50 0x7f1958003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:41:40.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.349+0000 7f197510c640 1 --2- 172.21.15.12:0/3561014589 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1958004800 0x7f1958004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:41:40.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.349+0000 7f197510c640 1 --2- 172.21.15.12:0/3561014589 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1958005250 0x7f195800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:41:40.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.350+0000 7f197510c640 1 -- 172.21.15.12:0/3561014589 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f197014c450 con 0x7f1958004800 2024-05-15T15:41:40.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.350+0000 7f197510c640 1 -- 172.21.15.12:0/3561014589 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f195800c1e0 con 0x7f1958005250 2024-05-15T15:41:40.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.350+0000 7f197510c640 1 -- 172.21.15.12:0/3561014589 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f195800c3e0 con 0x7f1958003a50 2024-05-15T15:41:40.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.350+0000 7f197590d640 1 --2- 172.21.15.12:0/3561014589 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1958004800 0x7f1958004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:41:40.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.350+0000 7f197610e640 1 --2- 172.21.15.12:0/3561014589 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1958003a50 0x7f1958003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:41:40.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.350+0000 7f197690f640 1 --2- 172.21.15.12:0/3561014589 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1958005250 0x7f195800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:41:40.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.350+0000 7f197590d640 1 -- 172.21.15.12:0/3561014589 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1958003a50 msgr2=0x7f1958003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:41:40.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.350+0000 7f197590d640 1 --2- 172.21.15.12:0/3561014589 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1958003a50 0x7f1958003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:41:40.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.350+0000 7f197590d640 1 -- 172.21.15.12:0/3561014589 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1958005250 msgr2=0x7f195800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:41:40.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.350+0000 7f197590d640 1 --2- 172.21.15.12:0/3561014589 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1958005250 0x7f195800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:41:40.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.350+0000 7f197690f640 1 -- 172.21.15.12:0/3561014589 reap_dead start 2024-05-15T15:41:40.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.350+0000 7f197590d640 1 -- 172.21.15.12:0/3561014589 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1958003520 con 0x7f1958004800 2024-05-15T15:41:40.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.350+0000 7f197610e640 1 --2- 172.21.15.12:0/3561014589 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1958003a50 0x7f1958003ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-15T15:41:40.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.351+0000 7f197590d640 1 --2- 172.21.15.12:0/3561014589 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1958004800 0x7f1958004c10 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f1964009ac0 tx=0x7f1958005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81bb7023ea92e560 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:41:40.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.351+0000 7f197510c640 1 -- 172.21.15.12:0/3561014589 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1964036070 con 0x7f1958004800 2024-05-15T15:41:40.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.351+0000 7f197510c640 1 -- 172.21.15.12:0/3561014589 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1964031400 con 0x7f1958004800 2024-05-15T15:41:40.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.351+0000 7f197510c640 1 -- 172.21.15.12:0/3561014589 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1964009690 con 0x7f1958004800 2024-05-15T15:41:40.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.351+0000 7f1978372640 1 -- 172.21.15.12:0/3561014589 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1958004800 msgr2=0x7f1958004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:41:40.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.351+0000 7f1978372640 1 --2- 172.21.15.12:0/3561014589 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1958004800 0x7f1958004c10 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f1964009ac0 tx=0x7f1958005830 comp rx=0 tx=0).stop 2024-05-15T15:41:40.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.352+0000 7f1978372640 1 -- 172.21.15.12:0/3561014589 shutdown_connections 2024-05-15T15:41:40.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.352+0000 7f1978372640 1 --2- 172.21.15.12:0/3561014589 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1958004800 0x7f1958004c10 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:41:40.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.352+0000 7f1978372640 1 -- 172.21.15.12:0/3561014589 >> 172.21.15.12:0/3561014589 conn(0x7f19700c17c0 msgr2=0x7f19700c1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:41:40.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.352+0000 7f1978372640 1 -- 172.21.15.12:0/3561014589 shutdown_connections 2024-05-15T15:41:40.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.352+0000 7f1978372640 1 -- 172.21.15.12:0/3561014589 wait complete. 2024-05-15T15:41:40.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.353+0000 7f1978372640 1 Processor -- start 2024-05-15T15:41:40.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.353+0000 7f1978372640 1 -- start start 2024-05-15T15:41:40.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.354+0000 7f1978372640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1958004800 0x7f19700a1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:41:40.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.354+0000 7f1978372640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f19700a2f80 0x7f197014f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:41:40.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.354+0000 7f1978372640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f197014f8a0 0x7f19701e55f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:41:40.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.354+0000 7f1978372640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f19700a0fb0 con 0x7f197014f8a0 2024-05-15T15:41:40.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.354+0000 7f1978372640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f19700716b0 con 0x7f1958004800 2024-05-15T15:41:40.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.354+0000 7f1978372640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f19700bd5f0 con 0x7f19700a2f80 2024-05-15T15:41:40.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.354+0000 7f197690f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f197014f8a0 0x7f19701e55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:41:40.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.354+0000 7f197690f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f197014f8a0 0x7f19701e55f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46034/0 (socket says 172.21.15.12:46034) 2024-05-15T15:41:40.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.354+0000 7f197690f640 1 -- 172.21.15.12:0/3282383645 learned_addr learned my addr 172.21.15.12:0/3282383645 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:41:40.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.354+0000 7f197610e640 1 --2- 172.21.15.12:0/3282383645 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1958004800 0x7f19700a1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:41:40.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.354+0000 7f197590d640 1 --2- 172.21.15.12:0/3282383645 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f19700a2f80 0x7f197014f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:41:40.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.355+0000 7f197690f640 1 -- 172.21.15.12:0/3282383645 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f19700a2f80 msgr2=0x7f197014f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:41:40.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.355+0000 7f197690f640 1 --2- 172.21.15.12:0/3282383645 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f19700a2f80 0x7f197014f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:41:40.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.355+0000 7f197690f640 1 -- 172.21.15.12:0/3282383645 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1958004800 msgr2=0x7f19700a1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:41:40.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.355+0000 7f197690f640 1 --2- 172.21.15.12:0/3282383645 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1958004800 0x7f19700a1ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:41:40.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.355+0000 7f197690f640 1 -- 172.21.15.12:0/3282383645 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19700a2410 con 0x7f197014f8a0 2024-05-15T15:41:40.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.355+0000 7f197690f640 1 --2- 172.21.15.12:0/3282383645 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f197014f8a0 0x7f19701e55f0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f19700c2690 tx=0x7f196000fd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:41:40.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.355+0000 7f196effd640 1 -- 172.21.15.12:0/3282383645 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1960019070 con 0x7f197014f8a0 2024-05-15T15:41:40.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.355+0000 7f196effd640 1 -- 172.21.15.12:0/3282383645 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1960006e20 con 0x7f197014f8a0 2024-05-15T15:41:40.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.355+0000 7f1978372640 1 -- 172.21.15.12:0/3282383645 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19701e2170 con 0x7f197014f8a0 2024-05-15T15:41:40.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.355+0000 7f196effd640 1 -- 172.21.15.12:0/3282383645 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1960003b90 con 0x7f197014f8a0 2024-05-15T15:41:40.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.355+0000 7f1978372640 1 -- 172.21.15.12:0/3282383645 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19701e2730 con 0x7f197014f8a0 2024-05-15T15:41:40.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.356+0000 7f1978372640 1 -- 172.21.15.12:0/3282383645 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19701502e0 con 0x7f197014f8a0 2024-05-15T15:41:40.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.357+0000 7f196effd640 1 -- 172.21.15.12:0/3282383645 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f196001c070 con 0x7f197014f8a0 2024-05-15T15:41:40.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.357+0000 7f196effd640 1 --2- 172.21.15.12:0/3282383645 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f195c0762d0 0x7f195c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:41:40.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.357+0000 7f196effd640 1 -- 172.21.15.12:0/3282383645 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 5825+0+0 (secure 0 0 0) 0x7f1960096840 con 0x7f197014f8a0 2024-05-15T15:41:40.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.357+0000 7f197610e640 1 --2- 172.21.15.12:0/3282383645 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f195c0762d0 0x7f195c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:41:40.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.358+0000 7f197610e640 1 --2- 172.21.15.12:0/3282383645 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f195c0762d0 0x7f195c0787e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f197006b070 tx=0x7f19680012d0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:41:40.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.362+0000 7f196effd640 1 -- 172.21.15.12:0/3282383645 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f196005fa40 con 0x7f197014f8a0 2024-05-15T15:41:40.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.589+0000 7f1978372640 1 -- 172.21.15.12:0/3282383645 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1970050940 con 0x7f197014f8a0 2024-05-15T15:41:40.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.590+0000 7f196effd640 1 -- 172.21.15.12:0/3282383645 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+4350 (secure 0 0 0) 0x7f1960063d40 con 0x7f197014f8a0 2024-05-15T15:41:40.592 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-05-15T15:41:40.592 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4577,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/1749847216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1749847216},{"type":"v1","addr":"172.21.15.84:6835","nonce":1749847216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4580,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/3678098513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6833","nonce":3678098513},{"type":"v1","addr":"172.21.15.12:6835","nonce":3678098513}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-15T15:40:31.243097+0000","modified":"2024-05-15T15:40:34.253461+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4759},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4759":{"gid":4759,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.12:6834/32438370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":32438370},{"type":"v1","addr":"172.21.15.12:6834","nonce":32438370}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4759,"qdb_cluster":[4759]},"id":2}]} 2024-05-15T15:41:40.592 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 16 2024-05-15T15:41:40.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.591+0000 7f1978372640 1 -- 172.21.15.12:0/3282383645 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f195c0762d0 msgr2=0x7f195c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:41:40.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.591+0000 7f1978372640 1 --2- 172.21.15.12:0/3282383645 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f195c0762d0 0x7f195c0787e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f197006b070 tx=0x7f19680012d0 comp rx=0 tx=0).stop 2024-05-15T15:41:40.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.591+0000 7f1978372640 1 -- 172.21.15.12:0/3282383645 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f197014f8a0 msgr2=0x7f19701e55f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:41:40.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.591+0000 7f1978372640 1 --2- 172.21.15.12:0/3282383645 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f197014f8a0 0x7f19701e55f0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f19700c2690 tx=0x7f196000fd40 comp rx=0 tx=0).stop 2024-05-15T15:41:40.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.592+0000 7f1978372640 1 -- 172.21.15.12:0/3282383645 shutdown_connections 2024-05-15T15:41:40.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.592+0000 7f1978372640 1 --2- 172.21.15.12:0/3282383645 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f195c0762d0 0x7f195c0787e0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:41:40.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.592+0000 7f1978372640 1 --2- 172.21.15.12:0/3282383645 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f197014f8a0 0x7f19701e55f0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:41:40.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.592+0000 7f1978372640 1 --2- 172.21.15.12:0/3282383645 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f19700a2f80 0x7f197014f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:41:40.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.592+0000 7f1978372640 1 --2- 172.21.15.12:0/3282383645 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1958004800 0x7f19700a1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:41:40.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.592+0000 7f1978372640 1 -- 172.21.15.12:0/3282383645 >> 172.21.15.12:0/3282383645 conn(0x7f19700c17c0 msgr2=0x7f197013ff10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:41:40.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.592+0000 7f1978372640 1 -- 172.21.15.12:0/3282383645 shutdown_connections 2024-05-15T15:41:40.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.592+0000 7f1978372640 1 -- 172.21.15.12:0/3282383645 wait complete. 2024-05-15T15:41:40.605 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-15T15:41:40.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.714+0000 7fdebdb4d640 1 Processor -- start 2024-05-15T15:41:40.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.714+0000 7fdebdb4d640 1 -- start start 2024-05-15T15:41:40.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.715+0000 7fdebdb4d640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fdeb80bd440 0x7fdeb80bd850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:41:40.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.715+0000 7fdebdb4d640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fdeb80b8d70 0x7fdeb80b9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:41:40.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.715+0000 7fdebdb4d640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdeb80bdd90 con 0x7fdeb814e530 2024-05-15T15:41:40.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.715+0000 7fdebdb4d640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fdeb80b88e0 con 0x7fdeb80b8d70 2024-05-15T15:41:40.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.715+0000 7fdebdb4d640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7fdeb814ece0 con 0x7fdeb80bd440 2024-05-15T15:41:40.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.715+0000 7fdeb7fff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fdeb80b8d70 0x7fdeb80b9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:41:40.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.715+0000 7fdeb7fff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fdeb80b8d70 0x7fdeb80b9180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46040/0 (socket says 172.21.15.12:46040) 2024-05-15T15:41:40.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.715+0000 7fdeb7fff640 1 -- 172.21.15.12:0/960984019 learned_addr learned my addr 172.21.15.12:0/960984019 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:41:40.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.715+0000 7fdeb6ffd640 1 --2- 172.21.15.12:0/960984019 >> v2:172.21.15.84:3300/0 conn(0x7fdeb80bd440 0x7fdeb80bd850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:41:40.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.715+0000 7fdeb7fff640 1 -- 172.21.15.12:0/960984019 >> v2:172.21.15.84:3300/0 conn(0x7fdeb80bd440 msgr2=0x7fdeb80bd850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:41:40.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.715+0000 7fdeb7fff640 1 --2- 172.21.15.12:0/960984019 >> v2:172.21.15.84:3300/0 conn(0x7fdeb80bd440 0x7fdeb80bd850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:41:40.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.715+0000 7fdeb7fff640 1 -- 172.21.15.12:0/960984019 >> v1:172.21.15.84:6789/0 conn(0x7fdeb814e530 legacy=0x7fdeb80ba320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:41:40.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.715+0000 7fdeb7fff640 1 -- 172.21.15.12:0/960984019 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdeb814efc0 con 0x7fdeb80b8d70 2024-05-15T15:41:40.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.716+0000 7fdeb7fff640 1 --2- 172.21.15.12:0/960984019 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdeb80b8d70 0x7fdeb80b9180 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fdeb80a96a0 tx=0x7fdeb002a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33fde86f7556f75c server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:41:40.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.716+0000 7fdeb67fc640 1 -- 172.21.15.12:0/960984019 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeb0036070 con 0x7fdeb80b8d70 2024-05-15T15:41:40.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.716+0000 7fdeb67fc640 1 -- 172.21.15.12:0/960984019 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdeb0031600 con 0x7fdeb80b8d70 2024-05-15T15:41:40.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.716+0000 7fdeb67fc640 1 -- 172.21.15.12:0/960984019 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeb00319d0 con 0x7fdeb80b8d70 2024-05-15T15:41:40.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.717+0000 7fdebdb4d640 1 -- 172.21.15.12:0/960984019 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdeb80b8d70 msgr2=0x7fdeb80b9180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:41:40.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.717+0000 7fdebdb4d640 1 --2- 172.21.15.12:0/960984019 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdeb80b8d70 0x7fdeb80b9180 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fdeb80a96a0 tx=0x7fdeb002a730 comp rx=0 tx=0).stop 2024-05-15T15:41:40.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.717+0000 7fdebdb4d640 1 -- 172.21.15.12:0/960984019 shutdown_connections 2024-05-15T15:41:40.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.717+0000 7fdebdb4d640 1 --2- 172.21.15.12:0/960984019 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdeb80b8d70 0x7fdeb80b9180 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:41:40.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.717+0000 7fdebdb4d640 1 --2- 172.21.15.12:0/960984019 >> v2:172.21.15.84:3300/0 conn(0x7fdeb80bd440 0x7fdeb80bd850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:41:40.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.717+0000 7fdebdb4d640 1 -- 172.21.15.12:0/960984019 >> 172.21.15.12:0/960984019 conn(0x7fdeb80c0570 msgr2=0x7fdeb80c0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:41:40.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.717+0000 7fdebdb4d640 1 -- 172.21.15.12:0/960984019 shutdown_connections 2024-05-15T15:41:40.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.717+0000 7fdebdb4d640 1 -- 172.21.15.12:0/960984019 wait complete. 2024-05-15T15:41:40.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.719+0000 7fdebdb4d640 1 Processor -- start 2024-05-15T15:41:40.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.719+0000 7fdebdb4d640 1 -- start start 2024-05-15T15:41:40.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.720+0000 7fdebdb4d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdeb80b8d70 0x7fdeb8149e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:41:40.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.720+0000 7fdebdb4d640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fdeb80bd440 0x7fdeb814af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:41:40.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.720+0000 7fdebdb4d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdeb814e530 0x7fdeb8141700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:41:40.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.720+0000 7fdebdb4d640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fdeb80b96c0 con 0x7fdeb80b8d70 2024-05-15T15:41:40.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.720+0000 7fdebdb4d640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fdeb80bbb70 con 0x7fdeb814e530 2024-05-15T15:41:40.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.720+0000 7fdebdb4d640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fdeb814e940 con 0x7fdeb80bd440 2024-05-15T15:41:40.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.720+0000 7fdeb77fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdeb80b8d70 0x7fdeb8149e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:41:40.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.720+0000 7fdeb77fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdeb80b8d70 0x7fdeb8149e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46052/0 (socket says 172.21.15.12:46052) 2024-05-15T15:41:40.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.720+0000 7fdeb77fe640 1 -- 172.21.15.12:0/2124106984 learned_addr learned my addr 172.21.15.12:0/2124106984 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:41:40.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.720+0000 7fdeb7fff640 1 --2- 172.21.15.12:0/2124106984 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdeb814e530 0x7fdeb8141700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:41:40.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.720+0000 7fdeb6ffd640 1 --2- 172.21.15.12:0/2124106984 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fdeb80bd440 0x7fdeb814af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:41:40.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.720+0000 7fdeb77fe640 1 -- 172.21.15.12:0/2124106984 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fdeb80bd440 msgr2=0x7fdeb814af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:41:40.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.720+0000 7fdeb77fe640 1 --2- 172.21.15.12:0/2124106984 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fdeb80bd440 0x7fdeb814af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:41:40.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.720+0000 7fdeb77fe640 1 -- 172.21.15.12:0/2124106984 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdeb814e530 msgr2=0x7fdeb8141700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:41:40.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.720+0000 7fdeb77fe640 1 --2- 172.21.15.12:0/2124106984 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdeb814e530 0x7fdeb8141700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:41:40.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.720+0000 7fdeb77fe640 1 -- 172.21.15.12:0/2124106984 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdeb814a380 con 0x7fdeb80b8d70 2024-05-15T15:41:40.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.720+0000 7fdeb77fe640 1 --2- 172.21.15.12:0/2124106984 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdeb80b8d70 0x7fdeb8149e40 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fdea800c390 tx=0x7fdea800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:41:40.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.721+0000 7fde9ffff640 1 -- 172.21.15.12:0/2124106984 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdea8017070 con 0x7fdeb80b8d70 2024-05-15T15:41:40.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.721+0000 7fde9ffff640 1 -- 172.21.15.12:0/2124106984 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdea80052d0 con 0x7fdeb80b8d70 2024-05-15T15:41:40.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.721+0000 7fdebdb4d640 1 -- 172.21.15.12:0/2124106984 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdeb81e7c80 con 0x7fdeb80b8d70 2024-05-15T15:41:40.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.721+0000 7fde9ffff640 1 -- 172.21.15.12:0/2124106984 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdea8003640 con 0x7fdeb80b8d70 2024-05-15T15:41:40.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.721+0000 7fdebdb4d640 1 -- 172.21.15.12:0/2124106984 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdeb81e8240 con 0x7fdeb80b8d70 2024-05-15T15:41:40.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.722+0000 7fdebdb4d640 1 -- 172.21.15.12:0/2124106984 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdeb8050940 con 0x7fdeb80b8d70 2024-05-15T15:41:40.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.723+0000 7fde9ffff640 1 -- 172.21.15.12:0/2124106984 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fdea801a070 con 0x7fdeb80b8d70 2024-05-15T15:41:40.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.723+0000 7fde9ffff640 1 --2- 172.21.15.12:0/2124106984 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fdea40762d0 0x7fdea40787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:41:40.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.723+0000 7fde9ffff640 1 -- 172.21.15.12:0/2124106984 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 5825+0+0 (secure 0 0 0) 0x7fdea80968f0 con 0x7fdeb80b8d70 2024-05-15T15:41:40.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.723+0000 7fdeb6ffd640 1 --2- 172.21.15.12:0/2124106984 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fdea40762d0 0x7fdea40787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:41:40.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.724+0000 7fdeb6ffd640 1 --2- 172.21.15.12:0/2124106984 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fdea40762d0 0x7fdea40787e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fdeb80a8f40 tx=0x7fdeac009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:41:40.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.728+0000 7fde9ffff640 1 -- 172.21.15.12:0/2124106984 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fdea805fb80 con 0x7fdeb80b8d70 2024-05-15T15:41:40.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.959+0000 7fdebdb4d640 1 -- 172.21.15.12:0/2124106984 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdeb80c2300 con 0x7fdeb80b8d70 2024-05-15T15:41:40.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.959+0000 7fde9ffff640 1 -- 172.21.15.12:0/2124106984 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+4350 (secure 0 0 0) 0x7fdea80681c0 con 0x7fdeb80b8d70 2024-05-15T15:41:40.962 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-05-15T15:41:40.962 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4577,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/1749847216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1749847216},{"type":"v1","addr":"172.21.15.84:6835","nonce":1749847216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4580,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/3678098513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6833","nonce":3678098513},{"type":"v1","addr":"172.21.15.12:6835","nonce":3678098513}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-15T15:40:31.243097+0000","modified":"2024-05-15T15:40:34.253461+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4759},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4759":{"gid":4759,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.12:6834/32438370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":32438370},{"type":"v1","addr":"172.21.15.12:6834","nonce":32438370}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4759,"qdb_cluster":[4759]},"id":2}]} 2024-05-15T15:41:40.962 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 16 2024-05-15T15:41:40.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.962+0000 7fdebdb4d640 1 -- 172.21.15.12:0/2124106984 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fdea40762d0 msgr2=0x7fdea40787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:41:40.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.962+0000 7fdebdb4d640 1 --2- 172.21.15.12:0/2124106984 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fdea40762d0 0x7fdea40787e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fdeb80a8f40 tx=0x7fdeac009190 comp rx=0 tx=0).stop 2024-05-15T15:41:40.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.962+0000 7fdebdb4d640 1 -- 172.21.15.12:0/2124106984 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdeb80b8d70 msgr2=0x7fdeb8149e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:41:40.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.962+0000 7fdebdb4d640 1 --2- 172.21.15.12:0/2124106984 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdeb80b8d70 0x7fdeb8149e40 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fdea800c390 tx=0x7fdea800c850 comp rx=0 tx=0).stop 2024-05-15T15:41:40.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.962+0000 7fdebdb4d640 1 -- 172.21.15.12:0/2124106984 shutdown_connections 2024-05-15T15:41:40.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.962+0000 7fdebdb4d640 1 --2- 172.21.15.12:0/2124106984 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdeb814e530 0x7fdeb8141700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:41:40.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.962+0000 7fdebdb4d640 1 --2- 172.21.15.12:0/2124106984 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fdeb80bd440 0x7fdeb814af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:41:40.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.962+0000 7fdebdb4d640 1 --2- 172.21.15.12:0/2124106984 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fdea40762d0 0x7fdea40787e0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:41:40.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.962+0000 7fdebdb4d640 1 --2- 172.21.15.12:0/2124106984 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdeb80b8d70 0x7fdeb8149e40 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:41:40.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.962+0000 7fdebdb4d640 1 -- 172.21.15.12:0/2124106984 >> 172.21.15.12:0/2124106984 conn(0x7fdeb80c0570 msgr2=0x7fdeb80bdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:41:40.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.962+0000 7fdebdb4d640 1 -- 172.21.15.12:0/2124106984 shutdown_connections 2024-05-15T15:41:40.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:40.962+0000 7fdebdb4d640 1 -- 172.21.15.12:0/2124106984 wait complete. 2024-05-15T15:41:40.975 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-15T15:41:41.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.084+0000 7fc44de22640 1 Processor -- start 2024-05-15T15:41:41.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.084+0000 7fc44de22640 1 -- start start 2024-05-15T15:41:41.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.085+0000 7fc44de22640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fc4480b4500 0x7fc44806cb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:41:41.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.085+0000 7fc44de22640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc448163250 0x7fc448165670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:41:41.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.085+0000 7fc44de22640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4480a0db0 con 0x7fc4480b5bf0 2024-05-15T15:41:41.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.085+0000 7fc44de22640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fc4480a1090 con 0x7fc4480b4500 2024-05-15T15:41:41.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.085+0000 7fc44de22640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fc4480749a0 con 0x7fc448163250 2024-05-15T15:41:41.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.085+0000 7fc446ffd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fc4480b4500 0x7fc44806cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:41:41.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.085+0000 7fc4477fe640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fc4480b5bf0 0x7fc4480bb840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:49712/0 (socket says 172.21.15.12:49712) 2024-05-15T15:41:41.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.085+0000 7fc4477fe640 1 -- 172.21.15.12:0/3904369953 learned_addr learned my addr 172.21.15.12:0/3904369953 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-05-15T15:41:41.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.085+0000 7fc447fff640 1 --2- 172.21.15.12:0/3904369953 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc448163250 0x7fc448165670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:41:41.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.085+0000 7fc4467fc640 1 -- 172.21.15.12:0/3904369953 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2886230306 0 0) 0x7fc4480a0db0 con 0x7fc4480b5bf0 2024-05-15T15:41:41.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.101+0000 7fc4467fc640 1 -- 172.21.15.12:0/3904369953 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc430003420 con 0x7fc4480b5bf0 2024-05-15T15:41:41.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.101+0000 7fc446ffd640 1 -- 172.21.15.12:0/3904369953 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc448163250 msgr2=0x7fc448165670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:41:41.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.101+0000 7fc446ffd640 1 --2- 172.21.15.12:0/3904369953 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc448163250 0x7fc448165670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:41:41.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.101+0000 7fc446ffd640 1 -- 172.21.15.12:0/3904369953 >> v1:172.21.15.12:6789/0 conn(0x7fc4480b5bf0 legacy=0x7fc4480bb840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:41:41.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.101+0000 7fc4467fc640 1 -- 172.21.15.12:0/3904369953 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 306403739 0 0) 0x7fc430003420 con 0x7fc4480b5bf0 2024-05-15T15:41:41.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.101+0000 7fc446ffd640 1 -- 172.21.15.12:0/3904369953 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4480b57d0 con 0x7fc4480b4500 2024-05-15T15:41:41.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.102+0000 7fc446ffd640 1 --2- 172.21.15.12:0/3904369953 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc4480b4500 0x7fc44806cb00 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fc43c008820 tx=0x7fc43c008180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6856aef684c2fbb server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:41:41.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.102+0000 7fc4467fc640 1 -- 172.21.15.12:0/3904369953 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4380016f0 con 0x7fc4480b4500 2024-05-15T15:41:41.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.102+0000 7fc4467fc640 1 -- 172.21.15.12:0/3904369953 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc43c00ae50 con 0x7fc4480b4500 2024-05-15T15:41:41.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.102+0000 7fc4467fc640 1 -- 172.21.15.12:0/3904369953 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc43c02add0 con 0x7fc4480b4500 2024-05-15T15:41:41.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.103+0000 7fc44de22640 1 -- 172.21.15.12:0/3904369953 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc4480b4500 msgr2=0x7fc44806cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:41:41.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.103+0000 7fc44de22640 1 --2- 172.21.15.12:0/3904369953 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc4480b4500 0x7fc44806cb00 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fc43c008820 tx=0x7fc43c008180 comp rx=0 tx=0).stop 2024-05-15T15:41:41.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.103+0000 7fc44de22640 1 -- 172.21.15.12:0/3904369953 shutdown_connections 2024-05-15T15:41:41.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.103+0000 7fc44de22640 1 --2- 172.21.15.12:0/3904369953 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc448163250 0x7fc448165670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:41:41.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.103+0000 7fc44de22640 1 --2- 172.21.15.12:0/3904369953 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc4480b4500 0x7fc44806cb00 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:41:41.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.103+0000 7fc44de22640 1 -- 172.21.15.12:0/3904369953 >> 172.21.15.12:0/3904369953 conn(0x7fc4480a16b0 msgr2=0x7fc4480a1ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:41:41.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.103+0000 7fc44de22640 1 -- 172.21.15.12:0/3904369953 shutdown_connections 2024-05-15T15:41:41.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.103+0000 7fc44de22640 1 -- 172.21.15.12:0/3904369953 wait complete. 2024-05-15T15:41:41.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.104+0000 7fc44de22640 1 Processor -- start 2024-05-15T15:41:41.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.105+0000 7fc44de22640 1 -- start start 2024-05-15T15:41:41.109 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.106+0000 7fc44de22640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc4480b4500 0x7fc4480bc1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:41:41.109 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.106+0000 7fc44de22640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4480b5bf0 0x7fc4480b6930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:41:41.109 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.106+0000 7fc44de22640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc448163250 0x7fc448087f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:41:41.109 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.106+0000 7fc44de22640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fc44806d040 con 0x7fc4480b4500 2024-05-15T15:41:41.109 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.106+0000 7fc44de22640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fc4480bb4b0 con 0x7fc4480b5bf0 2024-05-15T15:41:41.109 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.106+0000 7fc44de22640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fc44806d1c0 con 0x7fc448163250 2024-05-15T15:41:41.109 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.106+0000 7fc4477fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc4480b4500 0x7fc4480bc1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:41:41.109 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.106+0000 7fc4477fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc4480b4500 0x7fc4480bc1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46072/0 (socket says 172.21.15.12:46072) 2024-05-15T15:41:41.109 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.106+0000 7fc4477fe640 1 -- 172.21.15.12:0/510903275 learned_addr learned my addr 172.21.15.12:0/510903275 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:41:41.110 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.106+0000 7fc447fff640 1 --2- 172.21.15.12:0/510903275 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc448163250 0x7fc448087f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:41:41.110 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.106+0000 7fc446ffd640 1 --2- 172.21.15.12:0/510903275 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4480b5bf0 0x7fc4480b6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:41:41.110 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.106+0000 7fc4477fe640 1 -- 172.21.15.12:0/510903275 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc448163250 msgr2=0x7fc448087f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:41:41.110 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.106+0000 7fc4477fe640 1 --2- 172.21.15.12:0/510903275 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc448163250 0x7fc448087f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:41:41.110 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.106+0000 7fc4477fe640 1 -- 172.21.15.12:0/510903275 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4480b5bf0 msgr2=0x7fc4480b6930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:41:41.110 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.106+0000 7fc4477fe640 1 --2- 172.21.15.12:0/510903275 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4480b5bf0 0x7fc4480b6930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:41:41.110 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.106+0000 7fc4477fe640 1 -- 172.21.15.12:0/510903275 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4480bc700 con 0x7fc4480b4500 2024-05-15T15:41:41.110 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.106+0000 7fc4477fe640 1 --2- 172.21.15.12:0/510903275 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc4480b4500 0x7fc4480bc1c0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fc43800c490 tx=0x7fc43800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:41:41.110 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.106+0000 7fc42ffff640 1 -- 172.21.15.12:0/510903275 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc438005ce0 con 0x7fc4480b4500 2024-05-15T15:41:41.110 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.106+0000 7fc42ffff640 1 -- 172.21.15.12:0/510903275 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc438007070 con 0x7fc4480b4500 2024-05-15T15:41:41.110 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.106+0000 7fc44de22640 1 -- 172.21.15.12:0/510903275 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc44815b7d0 con 0x7fc4480b4500 2024-05-15T15:41:41.110 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.107+0000 7fc42ffff640 1 -- 172.21.15.12:0/510903275 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc438007460 con 0x7fc4480b4500 2024-05-15T15:41:41.110 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.107+0000 7fc44de22640 1 -- 172.21.15.12:0/510903275 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4481f1110 con 0x7fc4480b4500 2024-05-15T15:41:41.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.107+0000 7fc44de22640 1 -- 172.21.15.12:0/510903275 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc448050940 con 0x7fc4480b4500 2024-05-15T15:41:41.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.108+0000 7fc42ffff640 1 -- 172.21.15.12:0/510903275 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc438007600 con 0x7fc4480b4500 2024-05-15T15:41:41.112 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.109+0000 7fc42ffff640 1 --2- 172.21.15.12:0/510903275 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fc4340762d0 0x7fc4340787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:41:41.112 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.109+0000 7fc42ffff640 1 -- 172.21.15.12:0/510903275 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 5825+0+0 (secure 0 0 0) 0x7fc4380971c0 con 0x7fc4480b4500 2024-05-15T15:41:41.112 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.109+0000 7fc446ffd640 1 --2- 172.21.15.12:0/510903275 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fc4340762d0 0x7fc4340787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:41:41.112 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.109+0000 7fc446ffd640 1 --2- 172.21.15.12:0/510903275 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fc4340762d0 0x7fc4340787e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc43c033000 tx=0x7fc43c02e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:41:41.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.114+0000 7fc42ffff640 1 -- 172.21.15.12:0/510903275 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fc44815b7d0 con 0x7fc4480b4500 2024-05-15T15:41:41.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.307+0000 7fc44de22640 1 -- 172.21.15.12:0/510903275 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc4480ba100 con 0x7fc4480b4500 2024-05-15T15:41:41.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.308+0000 7fc42ffff640 1 -- 172.21.15.12:0/510903275 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) ==== 74+0+16821 (secure 0 0 0) 0x7fc438060450 con 0x7fc4480b4500 2024-05-15T15:41:41.310 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-05-15T15:41:41.310 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":38,"fsid":"3b7fc4b2-b85c-49b5-a5de-38444eeed40d","created":"2024-05-15T15:39:28.392476+0000","modified":"2024-05-15T15:41:36.207122+0000","last_up_change":"2024-05-15T15:39:39.363983+0000","last_in_change":"2024-05-15T15:39:30.591216+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-15T15:39:40.715999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-05-15T15:40:29.381895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-05-15T15:40:30.183897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0d06a12a-866a-418e-9776-704d74354579","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":3943681952},{"type":"v1","addr":"172.21.15.12:6809","nonce":3943681952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":3943681952},{"type":"v1","addr":"172.21.15.12:6812","nonce":3943681952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":3943681952},{"type":"v1","addr":"172.21.15.12:6821","nonce":3943681952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":3943681952},{"type":"v1","addr":"172.21.15.12:6816","nonce":3943681952}]},"public_addr":"172.21.15.12:6809/3943681952","cluster_addr":"172.21.15.12:6812/3943681952","heartbeat_back_addr":"172.21.15.12:6821/3943681952","heartbeat_front_addr":"172.21.15.12:6816/3943681952","state":["exists","up"]},{"osd":1,"uuid":"09d0fa19-9ef8-4f35-bf99-6e86658c6f10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6811","nonce":1763752148},{"type":"v1","addr":"172.21.15.12:6813","nonce":1763752148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":1763752148},{"type":"v1","addr":"172.21.15.12:6817","nonce":1763752148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":1763752148},{"type":"v1","addr":"172.21.15.12:6827","nonce":1763752148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6819","nonce":1763752148},{"type":"v1","addr":"172.21.15.12:6822","nonce":1763752148}]},"public_addr":"172.21.15.12:6813/1763752148","cluster_addr":"172.21.15.12:6817/1763752148","heartbeat_back_addr":"172.21.15.12:6827/1763752148","heartbeat_front_addr":"172.21.15.12:6822/1763752148","state":["exists","up"]},{"osd":2,"uuid":"b204c6ad-f431-40a5-ba27-9844294f0ece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":2173702802},{"type":"v1","addr":"172.21.15.12:6823","nonce":2173702802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":2173702802},{"type":"v1","addr":"172.21.15.12:6826","nonce":2173702802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":2173702802},{"type":"v1","addr":"172.21.15.12:6831","nonce":2173702802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":2173702802},{"type":"v1","addr":"172.21.15.12:6829","nonce":2173702802}]},"public_addr":"172.21.15.12:6823/2173702802","cluster_addr":"172.21.15.12:6826/2173702802","heartbeat_back_addr":"172.21.15.12:6831/2173702802","heartbeat_front_addr":"172.21.15.12:6829/2173702802","state":["exists","up"]},{"osd":3,"uuid":"660a9ccb-2ee5-42d8-8481-0835047a8260","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":3956443113},{"type":"v1","addr":"172.21.15.12:6801","nonce":3956443113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":3956443113},{"type":"v1","addr":"172.21.15.12:6803","nonce":3956443113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":3956443113},{"type":"v1","addr":"172.21.15.12:6807","nonce":3956443113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":3956443113},{"type":"v1","addr":"172.21.15.12:6805","nonce":3956443113}]},"public_addr":"172.21.15.12:6801/3956443113","cluster_addr":"172.21.15.12:6803/3956443113","heartbeat_back_addr":"172.21.15.12:6807/3956443113","heartbeat_front_addr":"172.21.15.12:6805/3956443113","state":["exists","up"]},{"osd":4,"uuid":"9eef1461-a961-457c-9a78-43b5098a46a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":1021092792},{"type":"v1","addr":"172.21.15.84:6809","nonce":1021092792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":1021092792},{"type":"v1","addr":"172.21.15.84:6811","nonce":1021092792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":1021092792},{"type":"v1","addr":"172.21.15.84:6815","nonce":1021092792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":1021092792},{"type":"v1","addr":"172.21.15.84:6813","nonce":1021092792}]},"public_addr":"172.21.15.84:6809/1021092792","cluster_addr":"172.21.15.84:6811/1021092792","heartbeat_back_addr":"172.21.15.84:6815/1021092792","heartbeat_front_addr":"172.21.15.84:6813/1021092792","state":["exists","up"]},{"osd":5,"uuid":"5f924e2f-6c71-4741-a727-d3710c438431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":3173527851},{"type":"v1","addr":"172.21.15.84:6801","nonce":3173527851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":3173527851},{"type":"v1","addr":"172.21.15.84:6803","nonce":3173527851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":3173527851},{"type":"v1","addr":"172.21.15.84:6807","nonce":3173527851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":3173527851},{"type":"v1","addr":"172.21.15.84:6805","nonce":3173527851}]},"public_addr":"172.21.15.84:6801/3173527851","cluster_addr":"172.21.15.84:6803/3173527851","heartbeat_back_addr":"172.21.15.84:6807/3173527851","heartbeat_front_addr":"172.21.15.84:6805/3173527851","state":["exists","up"]},{"osd":6,"uuid":"efae9975-8c16-4ad3-892f-71f3c59718d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3029180670},{"type":"v1","addr":"172.21.15.84:6817","nonce":3029180670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3029180670},{"type":"v1","addr":"172.21.15.84:6819","nonce":3029180670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3029180670},{"type":"v1","addr":"172.21.15.84:6823","nonce":3029180670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3029180670},{"type":"v1","addr":"172.21.15.84:6821","nonce":3029180670}]},"public_addr":"172.21.15.84:6817/3029180670","cluster_addr":"172.21.15.84:6819/3029180670","heartbeat_back_addr":"172.21.15.84:6823/3029180670","heartbeat_front_addr":"172.21.15.84:6821/3029180670","state":["exists","up"]},{"osd":7,"uuid":"6426efba-ee4d-4e44-83d1-c76c75aec30c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3067620602},{"type":"v1","addr":"172.21.15.84:6825","nonce":3067620602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3067620602},{"type":"v1","addr":"172.21.15.84:6827","nonce":3067620602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":3067620602},{"type":"v1","addr":"172.21.15.84:6831","nonce":3067620602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":3067620602},{"type":"v1","addr":"172.21.15.84:6829","nonce":3067620602}]},"public_addr":"172.21.15.84:6825/3067620602","cluster_addr":"172.21.15.84:6827/3067620602","heartbeat_back_addr":"172.21.15.84:6831/3067620602","heartbeat_front_addr":"172.21.15.84:6829/3067620602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.809514+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.845364+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.762733+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.688597+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.699228+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.747865+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.712415+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.820683+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"5.0","mappings":[{"from":4,"to":5}]},{"pgid":"5.8","mappings":[{"from":4,"to":5}]},{"pgid":"5.13","mappings":[{"from":4,"to":5}]},{"pgid":"5.27","mappings":[{"from":4,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-15T15:41:41.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.310+0000 7fc44de22640 1 -- 172.21.15.12:0/510903275 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fc4340762d0 msgr2=0x7fc4340787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:41:41.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.310+0000 7fc44de22640 1 --2- 172.21.15.12:0/510903275 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fc4340762d0 0x7fc4340787e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc43c033000 tx=0x7fc43c02e000 comp rx=0 tx=0).stop 2024-05-15T15:41:41.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.310+0000 7fc44de22640 1 -- 172.21.15.12:0/510903275 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc4480b4500 msgr2=0x7fc4480bc1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:41:41.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.310+0000 7fc44de22640 1 --2- 172.21.15.12:0/510903275 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc4480b4500 0x7fc4480bc1c0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fc43800c490 tx=0x7fc43800c950 comp rx=0 tx=0).stop 2024-05-15T15:41:41.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.310+0000 7fc44de22640 1 -- 172.21.15.12:0/510903275 shutdown_connections 2024-05-15T15:41:41.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.310+0000 7fc44de22640 1 --2- 172.21.15.12:0/510903275 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc448163250 0x7fc448087f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:41:41.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.310+0000 7fc44de22640 1 --2- 172.21.15.12:0/510903275 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4480b5bf0 0x7fc4480b6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:41:41.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.310+0000 7fc44de22640 1 --2- 172.21.15.12:0/510903275 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fc4340762d0 0x7fc4340787e0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:41:41.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.310+0000 7fc44de22640 1 --2- 172.21.15.12:0/510903275 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc4480b4500 0x7fc4480bc1c0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:41:41.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.310+0000 7fc44de22640 1 -- 172.21.15.12:0/510903275 >> 172.21.15.12:0/510903275 conn(0x7fc4480a16b0 msgr2=0x7fc448074080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:41:41.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.311+0000 7fc44de22640 1 -- 172.21.15.12:0/510903275 shutdown_connections 2024-05-15T15:41:41.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.311+0000 7fc44de22640 1 -- 172.21.15.12:0/510903275 wait complete. 2024-05-15T15:41:41.324 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-15T15:41:41.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.434+0000 7f36ff822640 1 Processor -- start 2024-05-15T15:41:41.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.434+0000 7f36ff822640 1 -- start start 2024-05-15T15:41:41.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.435+0000 7f36ff822640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f36f814e360 0x7f36f81522d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:41:41.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.435+0000 7f36ff822640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f36f80bf9b0 0x7f36f80bfdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:41:41.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.435+0000 7f36ff822640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36f80c1390 con 0x7f36f8148770 2024-05-15T15:41:41.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.435+0000 7f36ff822640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f36f8151e40 con 0x7f36f814e360 2024-05-15T15:41:41.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.435+0000 7f36ff822640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f36f80c0620 con 0x7f36f80bf9b0 2024-05-15T15:41:41.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.435+0000 7f36fddbf640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f36f80bf9b0 0x7f36f80bfdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:41:41.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.435+0000 7f36fd5be640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f36f814e360 0x7f36f81522d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:41:41.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.435+0000 7f36fddbf640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f36f80bf9b0 0x7f36f80bfdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3301/0 says I am v2:172.21.15.12:59078/0 (socket says 172.21.15.12:59078) 2024-05-15T15:41:41.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.435+0000 7f36fddbf640 1 -- 172.21.15.12:0/1570957765 learned_addr learned my addr 172.21.15.12:0/1570957765 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:41:41.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.436+0000 7f36fd5be640 1 -- 172.21.15.12:0/1570957765 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f36f80bf9b0 msgr2=0x7f36f80bfdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:41:41.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.436+0000 7f36fd5be640 1 --2- 172.21.15.12:0/1570957765 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f36f80bf9b0 0x7f36f80bfdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:41:41.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.436+0000 7f36fd5be640 1 -- 172.21.15.12:0/1570957765 >> v1:172.21.15.84:6789/0 conn(0x7f36f8148770 legacy=0x7f36f80c0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:41:41.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.436+0000 7f36fd5be640 1 -- 172.21.15.12:0/1570957765 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36f8151ad0 con 0x7f36f814e360 2024-05-15T15:41:41.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.436+0000 7f36fddbf640 1 --2- 172.21.15.12:0/1570957765 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f36f80bf9b0 0x7f36f80bfdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-15T15:41:41.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.436+0000 7f36fd5be640 1 --2- 172.21.15.12:0/1570957765 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f36f814e360 0x7f36f81522d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f36f40097a0 tx=0x7f36f402a210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a201394874ad1a2d server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:41:41.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.437+0000 7f36effff640 1 -- 172.21.15.12:0/1570957765 <== mon.1 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36f4037070 con 0x7f36f814e360 2024-05-15T15:41:41.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.437+0000 7f36effff640 1 -- 172.21.15.12:0/1570957765 <== mon.1 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36f4032440 con 0x7f36f814e360 2024-05-15T15:41:41.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.437+0000 7f36effff640 1 -- 172.21.15.12:0/1570957765 <== mon.1 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36f4032810 con 0x7f36f814e360 2024-05-15T15:41:41.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.437+0000 7f36ff822640 1 -- 172.21.15.12:0/1570957765 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f36f814e360 msgr2=0x7f36f81522d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:41:41.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.437+0000 7f36ff822640 1 --2- 172.21.15.12:0/1570957765 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f36f814e360 0x7f36f81522d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f36f40097a0 tx=0x7f36f402a210 comp rx=0 tx=0).stop 2024-05-15T15:41:41.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.437+0000 7f36ff822640 1 -- 172.21.15.12:0/1570957765 shutdown_connections 2024-05-15T15:41:41.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.437+0000 7f36ff822640 1 --2- 172.21.15.12:0/1570957765 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f36f80bf9b0 0x7f36f80bfdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:41:41.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.437+0000 7f36ff822640 1 --2- 172.21.15.12:0/1570957765 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f36f814e360 0x7f36f81522d0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:41:41.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.437+0000 7f36ff822640 1 -- 172.21.15.12:0/1570957765 >> 172.21.15.12:0/1570957765 conn(0x7f36f80c17c0 msgr2=0x7f36f80c1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:41:41.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.437+0000 7f36ff822640 1 -- 172.21.15.12:0/1570957765 shutdown_connections 2024-05-15T15:41:41.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.437+0000 7f36ff822640 1 -- 172.21.15.12:0/1570957765 wait complete. 2024-05-15T15:41:41.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.439+0000 7f36ff822640 1 Processor -- start 2024-05-15T15:41:41.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.439+0000 7f36ff822640 1 -- start start 2024-05-15T15:41:41.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.440+0000 7f36ff822640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f36f80bf9b0 0x7f36f8072020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:41:41.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.440+0000 7f36ff822640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f36f8148770 0x7f36f813d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:41:41.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.440+0000 7f36ff822640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f36f814e360 0x7f36f813de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:41:41.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.440+0000 7f36ff822640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f36f8158cc0 con 0x7f36f80bf9b0 2024-05-15T15:41:41.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.440+0000 7f36ff822640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f36f80c0300 con 0x7f36f814e360 2024-05-15T15:41:41.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.440+0000 7f36ff822640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f36f8158e40 con 0x7f36f8148770 2024-05-15T15:41:41.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.440+0000 7f36fd5be640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f36f80bf9b0 0x7f36f8072020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:41:41.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.440+0000 7f36fd5be640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f36f80bf9b0 0x7f36f8072020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46080/0 (socket says 172.21.15.12:46080) 2024-05-15T15:41:41.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.440+0000 7f36fd5be640 1 -- 172.21.15.12:0/1762815813 learned_addr learned my addr 172.21.15.12:0/1762815813 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:41:41.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.440+0000 7f36fddbf640 1 --2- 172.21.15.12:0/1762815813 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f36f814e360 0x7f36f813de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:41:41.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.440+0000 7f36fcdbd640 1 --2- 172.21.15.12:0/1762815813 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f36f8148770 0x7f36f813d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:41:41.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.440+0000 7f36fd5be640 1 -- 172.21.15.12:0/1762815813 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f36f8148770 msgr2=0x7f36f813d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:41:41.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.440+0000 7f36fd5be640 1 --2- 172.21.15.12:0/1762815813 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f36f8148770 0x7f36f813d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:41:41.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.440+0000 7f36fd5be640 1 -- 172.21.15.12:0/1762815813 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f36f814e360 msgr2=0x7f36f813de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:41:41.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.440+0000 7f36fd5be640 1 --2- 172.21.15.12:0/1762815813 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f36f814e360 0x7f36f813de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:41:41.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.440+0000 7f36fd5be640 1 -- 172.21.15.12:0/1762815813 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36f8150b90 con 0x7f36f80bf9b0 2024-05-15T15:41:41.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.440+0000 7f36fddbf640 1 --2- 172.21.15.12:0/1762815813 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f36f814e360 0x7f36f813de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-15T15:41:41.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.441+0000 7f36fd5be640 1 --2- 172.21.15.12:0/1762815813 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f36f80bf9b0 0x7f36f8072020 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f36f4035040 tx=0x7f36f40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:41:41.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.441+0000 7f36edffb640 1 -- 172.21.15.12:0/1762815813 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36f4037040 con 0x7f36f80bf9b0 2024-05-15T15:41:41.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.441+0000 7f36edffb640 1 -- 172.21.15.12:0/1762815813 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36f4030500 con 0x7f36f80bf9b0 2024-05-15T15:41:41.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.441+0000 7f36ff822640 1 -- 172.21.15.12:0/1762815813 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36f8150d90 con 0x7f36f80bf9b0 2024-05-15T15:41:41.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.441+0000 7f36edffb640 1 -- 172.21.15.12:0/1762815813 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36f4030910 con 0x7f36f80bf9b0 2024-05-15T15:41:41.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.441+0000 7f36ff822640 1 -- 172.21.15.12:0/1762815813 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36f81e7e90 con 0x7f36f80bf9b0 2024-05-15T15:41:41.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.442+0000 7f36ff822640 1 -- 172.21.15.12:0/1762815813 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36f80c1130 con 0x7f36f80bf9b0 2024-05-15T15:41:41.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.443+0000 7f36edffb640 1 -- 172.21.15.12:0/1762815813 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f36f4044020 con 0x7f36f80bf9b0 2024-05-15T15:41:41.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.443+0000 7f36edffb640 1 --2- 172.21.15.12:0/1762815813 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f36dc0762d0 0x7f36dc0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:41:41.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.444+0000 7f36edffb640 1 -- 172.21.15.12:0/1762815813 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 5825+0+0 (secure 0 0 0) 0x7f36f40b7790 con 0x7f36f80bf9b0 2024-05-15T15:41:41.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.444+0000 7f36fcdbd640 1 --2- 172.21.15.12:0/1762815813 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f36dc0762d0 0x7f36dc0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:41:41.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.444+0000 7f36fcdbd640 1 --2- 172.21.15.12:0/1762815813 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f36dc0762d0 0x7f36dc0787e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f36f814c770 tx=0x7f36e8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:41:41.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.448+0000 7f36edffb640 1 -- 172.21.15.12:0/1762815813 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f36f80c1130 con 0x7f36f80bf9b0 2024-05-15T15:41:41.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.676+0000 7f36ff822640 1 -- 172.21.15.12:0/1762815813 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f36f814c1b0 con 0x7f36f80bf9b0 2024-05-15T15:41:41.679 INFO:tasks.ceph.mon.a.smithi012.stderr:2024-05-15T15:41:41.677+0000 7faf78af7640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-15T15:41:41.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.679+0000 7f36edffb640 1 -- 172.21.15.12:0/1762815813 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v17) ==== 161+0+0 (secure 0 0 0) 0x7f36f8150b90 con 0x7f36f80bf9b0 2024-05-15T15:41:41.680 INFO:teuthology.orchestra.run.smithi012.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-15T15:41:41.683 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.681+0000 7f36ff822640 1 -- 172.21.15.12:0/1762815813 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f36dc0762d0 msgr2=0x7f36dc0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:41:41.683 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.681+0000 7f36ff822640 1 --2- 172.21.15.12:0/1762815813 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f36dc0762d0 0x7f36dc0787e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f36f814c770 tx=0x7f36e8009040 comp rx=0 tx=0).stop 2024-05-15T15:41:41.683 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.681+0000 7f36ff822640 1 -- 172.21.15.12:0/1762815813 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f36f80bf9b0 msgr2=0x7f36f8072020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:41:41.683 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.681+0000 7f36ff822640 1 --2- 172.21.15.12:0/1762815813 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f36f80bf9b0 0x7f36f8072020 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f36f4035040 tx=0x7f36f40046c0 comp rx=0 tx=0).stop 2024-05-15T15:41:41.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.681+0000 7f36ff822640 1 -- 172.21.15.12:0/1762815813 shutdown_connections 2024-05-15T15:41:41.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.681+0000 7f36ff822640 1 --2- 172.21.15.12:0/1762815813 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f36f814e360 0x7f36f813de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:41:41.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.681+0000 7f36ff822640 1 --2- 172.21.15.12:0/1762815813 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f36f8148770 0x7f36f813d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:41:41.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.681+0000 7f36ff822640 1 --2- 172.21.15.12:0/1762815813 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f36dc0762d0 0x7f36dc0787e0 secure :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f36f814c770 tx=0x7f36e8009040 comp rx=0 tx=0).stop 2024-05-15T15:41:41.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.681+0000 7f36ff822640 1 --2- 172.21.15.12:0/1762815813 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f36f80bf9b0 0x7f36f8072020 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:41:41.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.681+0000 7f36ff822640 1 -- 172.21.15.12:0/1762815813 >> 172.21.15.12:0/1762815813 conn(0x7f36f80c17c0 msgr2=0x7f36f80c0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:41:41.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.682+0000 7f36ff822640 1 -- 172.21.15.12:0/1762815813 shutdown_connections 2024-05-15T15:41:41.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.682+0000 7f36ff822640 1 -- 172.21.15.12:0/1762815813 wait complete. 2024-05-15T15:41:41.695 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-05-15T15:41:41.749 INFO:tasks.ceph.mds.c.smithi012.stdout:starting mds.c at 2024-05-15T15:41:41.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.812+0000 7f0915815640 1 Processor -- start 2024-05-15T15:41:41.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.812+0000 7f0915815640 1 -- start start 2024-05-15T15:41:41.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.813+0000 7f0915815640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0910151fc0 0x7f09100bd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:41:41.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.813+0000 7f0915815640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f091006da30 0x7f09100be940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:41:41.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.813+0000 7f0915815640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f091006de40 0x7f09100bee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:41:41.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.813+0000 7f0915815640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f09100bdc10 con 0x7f091006da30 2024-05-15T15:41:41.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.813+0000 7f0915815640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f09100c36f0 con 0x7f0910151fc0 2024-05-15T15:41:41.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.813+0000 7f0915815640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f0910152530 con 0x7f091006de40 2024-05-15T15:41:41.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.813+0000 7f090e7fc640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f091006da30 0x7f09100be940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:41:41.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.813+0000 7f090e7fc640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f091006da30 0x7f09100be940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46110/0 (socket says 172.21.15.12:46110) 2024-05-15T15:41:41.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.813+0000 7f090e7fc640 1 -- 172.21.15.12:0/3186553967 learned_addr learned my addr 172.21.15.12:0/3186553967 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:41:41.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.813+0000 7f090effd640 1 --2- 172.21.15.12:0/3186553967 >> v2:172.21.15.84:3300/0 conn(0x7f0910151fc0 0x7f09100bd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:41:41.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.813+0000 7f090f7fe640 1 --2- 172.21.15.12:0/3186553967 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f091006de40 0x7f09100bee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:41:41.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.814+0000 7f090e7fc640 1 -- 172.21.15.12:0/3186553967 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f091006de40 msgr2=0x7f09100bee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:41:41.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.814+0000 7f090e7fc640 1 --2- 172.21.15.12:0/3186553967 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f091006de40 0x7f09100bee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:41:41.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.814+0000 7f090e7fc640 1 -- 172.21.15.12:0/3186553967 >> v2:172.21.15.84:3300/0 conn(0x7f0910151fc0 msgr2=0x7f09100bd6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:41:41.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.814+0000 7f090e7fc640 1 --2- 172.21.15.12:0/3186553967 >> v2:172.21.15.84:3300/0 conn(0x7f0910151fc0 0x7f09100bd6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:41:41.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.814+0000 7f090e7fc640 1 -- 172.21.15.12:0/3186553967 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0910152810 con 0x7f091006da30 2024-05-15T15:41:41.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.814+0000 7f090e7fc640 1 --2- 172.21.15.12:0/3186553967 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f091006da30 0x7f09100be940 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f09100c38d0 tx=0x7f090402a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=caad35613865716c server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:41:41.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.815+0000 7f090dffb640 1 -- 172.21.15.12:0/3186553967 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0904037070 con 0x7f091006da30 2024-05-15T15:41:41.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.815+0000 7f090dffb640 1 -- 172.21.15.12:0/3186553967 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0904032440 con 0x7f091006da30 2024-05-15T15:41:41.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.815+0000 7f090dffb640 1 -- 172.21.15.12:0/3186553967 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0904032810 con 0x7f091006da30 2024-05-15T15:41:41.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.815+0000 7f0915815640 1 -- 172.21.15.12:0/3186553967 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f091006da30 msgr2=0x7f09100be940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:41:41.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.815+0000 7f0915815640 1 --2- 172.21.15.12:0/3186553967 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f091006da30 0x7f09100be940 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f09100c38d0 tx=0x7f090402a1c0 comp rx=0 tx=0).stop 2024-05-15T15:41:41.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.815+0000 7f0915815640 1 -- 172.21.15.12:0/3186553967 shutdown_connections 2024-05-15T15:41:41.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.815+0000 7f0915815640 1 --2- 172.21.15.12:0/3186553967 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f091006de40 0x7f09100bee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:41:41.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.815+0000 7f0915815640 1 --2- 172.21.15.12:0/3186553967 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f091006da30 0x7f09100be940 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:41:41.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.815+0000 7f0915815640 1 --2- 172.21.15.12:0/3186553967 >> v2:172.21.15.84:3300/0 conn(0x7f0910151fc0 0x7f09100bd6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:41:41.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.815+0000 7f0915815640 1 -- 172.21.15.12:0/3186553967 >> 172.21.15.12:0/3186553967 conn(0x7f09100c3d20 msgr2=0x7f09100c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:41:41.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.815+0000 7f0915815640 1 -- 172.21.15.12:0/3186553967 shutdown_connections 2024-05-15T15:41:41.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.815+0000 7f0915815640 1 -- 172.21.15.12:0/3186553967 wait complete. 2024-05-15T15:41:41.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.817+0000 7f0915815640 1 Processor -- start 2024-05-15T15:41:41.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.817+0000 7f0915815640 1 -- start start 2024-05-15T15:41:41.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.818+0000 7f0915815640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f091006da30 0x7f09100b9d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:41:41.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.818+0000 7f0915815640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f091006de40 0x7f09100bc040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:41:41.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.818+0000 7f0915815640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f0910151fc0 0x7f091014b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:41:41.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.818+0000 7f0915815640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f09100a3050 con 0x7f091006de40 2024-05-15T15:41:41.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.818+0000 7f0915815640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f09100a2ed0 con 0x7f091006da30 2024-05-15T15:41:41.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.818+0000 7f0915815640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f091014e570 con 0x7f0910151fc0 2024-05-15T15:41:41.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.818+0000 7f090e7fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f091006de40 0x7f09100bc040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:41:41.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.818+0000 7f090e7fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f091006de40 0x7f09100bc040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46126/0 (socket says 172.21.15.12:46126) 2024-05-15T15:41:41.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.818+0000 7f090e7fc640 1 -- 172.21.15.12:0/3420547279 learned_addr learned my addr 172.21.15.12:0/3420547279 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:41:41.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.818+0000 7f090effd640 1 --2- 172.21.15.12:0/3420547279 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f091006da30 0x7f09100b9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:41:41.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.818+0000 7f090f7fe640 1 --2- 172.21.15.12:0/3420547279 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f0910151fc0 0x7f091014b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:41:41.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.819+0000 7f090e7fc640 1 -- 172.21.15.12:0/3420547279 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f0910151fc0 msgr2=0x7f091014b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:41:41.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.819+0000 7f090e7fc640 1 --2- 172.21.15.12:0/3420547279 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f0910151fc0 0x7f091014b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:41:41.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.819+0000 7f090e7fc640 1 -- 172.21.15.12:0/3420547279 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f091006da30 msgr2=0x7f09100b9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:41:41.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.819+0000 7f090e7fc640 1 --2- 172.21.15.12:0/3420547279 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f091006da30 0x7f09100b9d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:41:41.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.819+0000 7f090e7fc640 1 -- 172.21.15.12:0/3420547279 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09100ba280 con 0x7f091006de40 2024-05-15T15:41:41.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.819+0000 7f090f7fe640 1 --2- 172.21.15.12:0/3420547279 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f0910151fc0 0x7f091014b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-15T15:41:41.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.819+0000 7f090e7fc640 1 --2- 172.21.15.12:0/3420547279 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f091006de40 0x7f09100bc040 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f0904000c00 tx=0x7f09040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:41:41.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.819+0000 7f08f7fff640 1 -- 172.21.15.12:0/3420547279 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0904041020 con 0x7f091006de40 2024-05-15T15:41:41.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.819+0000 7f08f7fff640 1 -- 172.21.15.12:0/3420547279 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f090403d620 con 0x7f091006de40 2024-05-15T15:41:41.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.819+0000 7f0915815640 1 -- 172.21.15.12:0/3420547279 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09100bc580 con 0x7f091006de40 2024-05-15T15:41:41.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.819+0000 7f08f7fff640 1 -- 172.21.15.12:0/3420547279 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0904037040 con 0x7f091006de40 2024-05-15T15:41:41.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.819+0000 7f0915815640 1 -- 172.21.15.12:0/3420547279 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09100b7d90 con 0x7f091006de40 2024-05-15T15:41:41.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.820+0000 7f0915815640 1 -- 172.21.15.12:0/3420547279 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0910050940 con 0x7f091006de40 2024-05-15T15:41:41.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.821+0000 7f08f7fff640 1 -- 172.21.15.12:0/3420547279 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0904044020 con 0x7f091006de40 2024-05-15T15:41:41.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.821+0000 7f08f7fff640 1 --2- 172.21.15.12:0/3420547279 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f08fc0762d0 0x7f08fc0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:41:41.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.821+0000 7f08f7fff640 1 -- 172.21.15.12:0/3420547279 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 5911+0+0 (secure 0 0 0) 0x7f09040b7e30 con 0x7f091006de40 2024-05-15T15:41:41.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.822+0000 7f090effd640 1 --2- 172.21.15.12:0/3420547279 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f08fc0762d0 0x7f08fc0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:41:41.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.822+0000 7f090effd640 1 --2- 172.21.15.12:0/3420547279 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f08fc0762d0 0x7f08fc0787e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0900009aa0 tx=0x7f0900009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:41:41.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:41.826+0000 7f08f7fff640 1 -- 172.21.15.12:0/3420547279 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f090404b030 con 0x7f091006de40 2024-05-15T15:41:42.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:42.058+0000 7f0915815640 1 -- 172.21.15.12:0/3420547279 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f091006eb40 con 0x7f091006de40 2024-05-15T15:41:42.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:42.680+0000 7f08f7fff640 1 -- 172.21.15.12:0/3420547279 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v18) ==== 104+0+0 (secure 0 0 0) 0x7f0904081590 con 0x7f091006de40 2024-05-15T15:41:42.686 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:42.683+0000 7f0915815640 1 -- 172.21.15.12:0/3420547279 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f08fc0762d0 msgr2=0x7f08fc0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:41:42.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:42.683+0000 7f0915815640 1 --2- 172.21.15.12:0/3420547279 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f08fc0762d0 0x7f08fc0787e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0900009aa0 tx=0x7f0900009190 comp rx=0 tx=0).stop 2024-05-15T15:41:42.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:42.683+0000 7f0915815640 1 -- 172.21.15.12:0/3420547279 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f091006de40 msgr2=0x7f09100bc040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:41:42.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:42.683+0000 7f0915815640 1 --2- 172.21.15.12:0/3420547279 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f091006de40 0x7f09100bc040 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f0904000c00 tx=0x7f09040046c0 comp rx=0 tx=0).stop 2024-05-15T15:41:42.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:42.684+0000 7f0915815640 1 -- 172.21.15.12:0/3420547279 shutdown_connections 2024-05-15T15:41:42.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:42.684+0000 7f0915815640 1 --2- 172.21.15.12:0/3420547279 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f0910151fc0 0x7f091014b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:41:42.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:42.684+0000 7f0915815640 1 --2- 172.21.15.12:0/3420547279 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f08fc0762d0 0x7f08fc0787e0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:41:42.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:42.684+0000 7f0915815640 1 --2- 172.21.15.12:0/3420547279 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f091006de40 0x7f09100bc040 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:41:42.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:42.684+0000 7f0915815640 1 --2- 172.21.15.12:0/3420547279 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f091006da30 0x7f09100b9d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:41:42.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:42.684+0000 7f0915815640 1 -- 172.21.15.12:0/3420547279 >> 172.21.15.12:0/3420547279 conn(0x7f09100c3d20 msgr2=0x7f09100a3db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:41:42.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:42.684+0000 7f0915815640 1 -- 172.21.15.12:0/3420547279 shutdown_connections 2024-05-15T15:41:42.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:42.684+0000 7f0915815640 1 -- 172.21.15.12:0/3420547279 wait complete. 2024-05-15T15:41:42.702 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-15T15:41:42.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:42.823+0000 7f15a6630640 1 Processor -- start 2024-05-15T15:41:42.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:42.823+0000 7f15a6630640 1 -- start start 2024-05-15T15:41:42.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:42.824+0000 7f15a6630640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f15a0151fc0 0x7f15a00bd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:41:42.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:42.824+0000 7f15a6630640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15a00c36f0 con 0x7f15a006da30 2024-05-15T15:41:42.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:42.824+0000 7f15a6630640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15a0152530 con 0x7f15a00bf050 2024-05-15T15:41:42.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:42.824+0000 7f15a6630640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f15a00bdc10 con 0x7f15a0151fc0 2024-05-15T15:41:42.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:42.825+0000 7f159ffff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f15a0151fc0 0x7f15a00bd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:41:42.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:42.825+0000 7f159f7fe640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f15a006da30 0x7f15a00be940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:49738/0 (socket says 172.21.15.12:49738) 2024-05-15T15:41:42.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:42.825+0000 7f159ffff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f15a0151fc0 0x7f15a00bd6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46128/0 (socket says 172.21.15.12:46128) 2024-05-15T15:41:42.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:42.825+0000 7f159f7fe640 1 -- 172.21.15.12:0/3863642611 learned_addr learned my addr 172.21.15.12:0/3863642611 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-05-15T15:41:42.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:42.825+0000 7f159ffff640 1 -- 172.21.15.12:0/3863642611 >> v1:172.21.15.84:6789/0 conn(0x7f15a00bf050 legacy=0x7f15a0158e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:41:42.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:42.825+0000 7f159ffff640 1 -- 172.21.15.12:0/3863642611 >> v1:172.21.15.12:6789/0 conn(0x7f15a006da30 legacy=0x7f15a00be940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:41:42.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:42.825+0000 7f159effd640 1 -- 172.21.15.12:0/3863642611 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1408061560 0 0) 0x7f15a00c36f0 con 0x7f15a006da30 2024-05-15T15:41:42.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:42.825+0000 7f159ffff640 1 -- 172.21.15.12:0/3863642611 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15a0152810 con 0x7f15a0151fc0 2024-05-15T15:41:42.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:42.826+0000 7f159ffff640 1 --2- 172.21.15.12:0/3863642611 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f15a0151fc0 0x7f15a00bd6d0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f15940097a0 tx=0x7f159402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4614804dbf960d62 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:41:42.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:42.826+0000 7f159effd640 1 -- 172.21.15.12:0/3863642611 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1594037070 con 0x7f15a0151fc0 2024-05-15T15:41:42.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:42.826+0000 7f159effd640 1 -- 172.21.15.12:0/3863642611 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1594032440 con 0x7f15a0151fc0 2024-05-15T15:41:42.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:42.826+0000 7f159effd640 1 -- 172.21.15.12:0/3863642611 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1594032810 con 0x7f15a0151fc0 2024-05-15T15:41:42.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:42.826+0000 7f15a6630640 1 -- 172.21.15.12:0/3863642611 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f15a0151fc0 msgr2=0x7f15a00bd6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:41:42.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:42.826+0000 7f15a6630640 1 --2- 172.21.15.12:0/3863642611 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f15a0151fc0 0x7f15a00bd6d0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f15940097a0 tx=0x7f159402a180 comp rx=0 tx=0).stop 2024-05-15T15:41:42.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:42.827+0000 7f15a6630640 1 -- 172.21.15.12:0/3863642611 shutdown_connections 2024-05-15T15:41:42.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:42.827+0000 7f15a6630640 1 --2- 172.21.15.12:0/3863642611 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f15a0151fc0 0x7f15a00bd6d0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:41:42.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:42.827+0000 7f15a6630640 1 -- 172.21.15.12:0/3863642611 >> 172.21.15.12:0/3863642611 conn(0x7f15a00c3d20 msgr2=0x7f15a00c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:41:42.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:42.827+0000 7f15a6630640 1 -- 172.21.15.12:0/3863642611 shutdown_connections 2024-05-15T15:41:42.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:42.827+0000 7f15a6630640 1 -- 172.21.15.12:0/3863642611 wait complete. 2024-05-15T15:41:42.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:42.828+0000 7f15a6630640 1 Processor -- start 2024-05-15T15:41:42.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:42.828+0000 7f15a6630640 1 -- start start 2024-05-15T15:41:42.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:42.829+0000 7f15a6630640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f15a006da30 0x7f15a014d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:41:42.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:42.829+0000 7f15a6630640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f15a00bf050 0x7f15a014c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:41:42.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:42.829+0000 7f15a6630640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f15a0151fc0 0x7f15a0148c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:41:42.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:42.829+0000 7f15a6630640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f15a00a3050 con 0x7f15a00bf050 2024-05-15T15:41:42.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:42.829+0000 7f15a6630640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f15a00a2ed0 con 0x7f15a006da30 2024-05-15T15:41:42.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:42.829+0000 7f15a6630640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f15a006de40 con 0x7f15a0151fc0 2024-05-15T15:41:42.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:42.829+0000 7f159f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f15a00bf050 0x7f15a014c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:41:42.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:42.829+0000 7f159f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f15a00bf050 0x7f15a014c390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46132/0 (socket says 172.21.15.12:46132) 2024-05-15T15:41:42.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:42.829+0000 7f159f7fe640 1 -- 172.21.15.12:0/1951403662 learned_addr learned my addr 172.21.15.12:0/1951403662 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:41:42.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:42.830+0000 7f159ffff640 1 --2- 172.21.15.12:0/1951403662 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f15a006da30 0x7f15a014d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:41:42.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:42.830+0000 7f15a4bcd640 1 --2- 172.21.15.12:0/1951403662 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f15a0151fc0 0x7f15a0148c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:41:42.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:42.830+0000 7f159f7fe640 1 -- 172.21.15.12:0/1951403662 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f15a0151fc0 msgr2=0x7f15a0148c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:41:42.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:42.830+0000 7f159f7fe640 1 --2- 172.21.15.12:0/1951403662 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f15a0151fc0 0x7f15a0148c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:41:42.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:42.830+0000 7f159f7fe640 1 -- 172.21.15.12:0/1951403662 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f15a006da30 msgr2=0x7f15a014d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:41:42.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:42.830+0000 7f159f7fe640 1 --2- 172.21.15.12:0/1951403662 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f15a006da30 0x7f15a014d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:41:42.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:42.830+0000 7f159f7fe640 1 -- 172.21.15.12:0/1951403662 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15a01d94a0 con 0x7f15a00bf050 2024-05-15T15:41:42.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:42.830+0000 7f15a4bcd640 1 --2- 172.21.15.12:0/1951403662 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f15a0151fc0 0x7f15a0148c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-15T15:41:42.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:42.830+0000 7f159f7fe640 1 --2- 172.21.15.12:0/1951403662 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f15a00bf050 0x7f15a014c390 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f159000c390 tx=0x7f159000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:41:42.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:42.830+0000 7f159cff9640 1 -- 172.21.15.12:0/1951403662 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1590017070 con 0x7f15a00bf050 2024-05-15T15:41:42.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:42.830+0000 7f159cff9640 1 -- 172.21.15.12:0/1951403662 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1590005ce0 con 0x7f15a00bf050 2024-05-15T15:41:42.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:42.830+0000 7f15a6630640 1 -- 172.21.15.12:0/1951403662 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15a014da00 con 0x7f15a00bf050 2024-05-15T15:41:42.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:42.830+0000 7f159cff9640 1 -- 172.21.15.12:0/1951403662 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15900072f0 con 0x7f15a00bf050 2024-05-15T15:41:42.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:42.830+0000 7f15a6630640 1 -- 172.21.15.12:0/1951403662 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15a014cba0 con 0x7f15a00bf050 2024-05-15T15:41:42.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:42.831+0000 7f15a6630640 1 -- 172.21.15.12:0/1951403662 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15a0050940 con 0x7f15a00bf050 2024-05-15T15:41:42.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:42.832+0000 7f159cff9640 1 -- 172.21.15.12:0/1951403662 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f159001a070 con 0x7f15a00bf050 2024-05-15T15:41:42.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:42.832+0000 7f159cff9640 1 --2- 172.21.15.12:0/1951403662 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f158c0762d0 0x7f158c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:41:42.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:42.832+0000 7f159cff9640 1 -- 172.21.15.12:0/1951403662 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 5911+0+0 (secure 0 0 0) 0x7f1590096a10 con 0x7f15a00bf050 2024-05-15T15:41:42.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:42.833+0000 7f159ffff640 1 --2- 172.21.15.12:0/1951403662 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f158c0762d0 0x7f158c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:41:42.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:42.833+0000 7f159ffff640 1 --2- 172.21.15.12:0/1951403662 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f158c0762d0 0x7f158c0787e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f1594034000 tx=0x7f159402e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:41:42.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:42.837+0000 7f159cff9640 1 -- 172.21.15.12:0/1951403662 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f1590001080 con 0x7f15a00bf050 2024-05-15T15:41:43.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:43.034+0000 7f15a6630640 1 -- 172.21.15.12:0/1951403662 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f15a006eb40 con 0x7f15a00bf050 2024-05-15T15:41:43.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:43.685+0000 7f159cff9640 1 -- 172.21.15.12:0/1951403662 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v40) ==== 181+0+0 (secure 0 0 0) 0x7f159005fbc0 con 0x7f15a00bf050 2024-05-15T15:41:43.688 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_metadata' removed 2024-05-15T15:41:43.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:43.693+0000 7f15a6630640 1 -- 172.21.15.12:0/1951403662 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f158c0762d0 msgr2=0x7f158c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:41:43.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:43.693+0000 7f15a6630640 1 --2- 172.21.15.12:0/1951403662 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f158c0762d0 0x7f158c0787e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f1594034000 tx=0x7f159402e000 comp rx=0 tx=0).stop 2024-05-15T15:41:43.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:43.693+0000 7f15a6630640 1 -- 172.21.15.12:0/1951403662 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f15a00bf050 msgr2=0x7f15a014c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:41:43.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:43.693+0000 7f15a6630640 1 --2- 172.21.15.12:0/1951403662 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f15a00bf050 0x7f15a014c390 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f159000c390 tx=0x7f159000c850 comp rx=0 tx=0).stop 2024-05-15T15:41:43.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:43.693+0000 7f15a6630640 1 -- 172.21.15.12:0/1951403662 shutdown_connections 2024-05-15T15:41:43.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:43.693+0000 7f15a6630640 1 --2- 172.21.15.12:0/1951403662 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f15a0151fc0 0x7f15a0148c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:41:43.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:43.693+0000 7f15a6630640 1 --2- 172.21.15.12:0/1951403662 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f158c0762d0 0x7f158c0787e0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:41:43.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:43.693+0000 7f15a6630640 1 --2- 172.21.15.12:0/1951403662 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f15a00bf050 0x7f15a014c390 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:41:43.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:43.693+0000 7f15a6630640 1 --2- 172.21.15.12:0/1951403662 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f15a006da30 0x7f15a014d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:41:43.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:43.694+0000 7f15a6630640 1 -- 172.21.15.12:0/1951403662 >> 172.21.15.12:0/1951403662 conn(0x7f15a00c3d20 msgr2=0x7f15a00c09d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:41:43.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:43.694+0000 7f15a6630640 1 -- 172.21.15.12:0/1951403662 shutdown_connections 2024-05-15T15:41:43.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:43.695+0000 7f15a6630640 1 -- 172.21.15.12:0/1951403662 wait complete. 2024-05-15T15:41:43.711 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-15T15:41:43.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:43.830+0000 7f47837ea640 1 Processor -- start 2024-05-15T15:41:43.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:43.830+0000 7f47837ea640 1 -- start start 2024-05-15T15:41:43.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:43.831+0000 7f47837ea640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f477c0bf9b0 0x7f477c0bfdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:41:43.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:43.831+0000 7f47837ea640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f477c0c1390 con 0x7f477c148770 2024-05-15T15:41:43.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:43.831+0000 7f47837ea640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f477c0c0620 con 0x7f477c14e360 2024-05-15T15:41:43.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:43.831+0000 7f47837ea640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f477c151e40 con 0x7f477c0bf9b0 2024-05-15T15:41:43.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:43.832+0000 7f4781d87640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f477c0bf9b0 0x7f477c0bfdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:41:43.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:43.832+0000 7f4780d85640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f477c148770 0x7f477c0c0c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:49740/0 (socket says 172.21.15.12:49740) 2024-05-15T15:41:43.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:43.832+0000 7f4780d85640 1 -- 172.21.15.12:0/3307834230 learned_addr learned my addr 172.21.15.12:0/3307834230 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-05-15T15:41:43.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:43.832+0000 7f4781d87640 1 -- 172.21.15.12:0/3307834230 >> v1:172.21.15.84:6789/0 conn(0x7f477c14e360 legacy=0x7f477c1522d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:41:43.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:43.832+0000 7f4781d87640 1 -- 172.21.15.12:0/3307834230 >> v1:172.21.15.12:6789/0 conn(0x7f477c148770 legacy=0x7f477c0c0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:41:43.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:43.832+0000 7f4773fff640 1 -- 172.21.15.12:0/3307834230 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2308863409 0 0) 0x7f476c001110 con 0x7f477c148770 2024-05-15T15:41:43.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:43.832+0000 7f4781d87640 1 -- 172.21.15.12:0/3307834230 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f477c151ad0 con 0x7f477c0bf9b0 2024-05-15T15:41:43.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:43.833+0000 7f4781d87640 1 --2- 172.21.15.12:0/3307834230 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f477c0bf9b0 0x7f477c0bfdc0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f4778009dc0 tx=0x7f477802a7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=975640f2e22d8605 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:41:43.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:43.833+0000 7f4773fff640 1 -- 172.21.15.12:0/3307834230 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4778037070 con 0x7f477c0bf9b0 2024-05-15T15:41:43.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:43.833+0000 7f4773fff640 1 -- 172.21.15.12:0/3307834230 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4778007740 con 0x7f477c0bf9b0 2024-05-15T15:41:43.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:43.833+0000 7f4773fff640 1 -- 172.21.15.12:0/3307834230 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4778007b10 con 0x7f477c0bf9b0 2024-05-15T15:41:43.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:43.833+0000 7f47837ea640 1 -- 172.21.15.12:0/3307834230 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f477c0bf9b0 msgr2=0x7f477c0bfdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:41:43.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:43.833+0000 7f47837ea640 1 --2- 172.21.15.12:0/3307834230 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f477c0bf9b0 0x7f477c0bfdc0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f4778009dc0 tx=0x7f477802a7c0 comp rx=0 tx=0).stop 2024-05-15T15:41:43.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:43.834+0000 7f47837ea640 1 -- 172.21.15.12:0/3307834230 shutdown_connections 2024-05-15T15:41:43.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:43.834+0000 7f47837ea640 1 --2- 172.21.15.12:0/3307834230 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f477c0bf9b0 0x7f477c0bfdc0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:41:43.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:43.834+0000 7f47837ea640 1 -- 172.21.15.12:0/3307834230 >> 172.21.15.12:0/3307834230 conn(0x7f477c0c17c0 msgr2=0x7f477c0c1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:41:43.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:43.834+0000 7f47837ea640 1 -- 172.21.15.12:0/3307834230 shutdown_connections 2024-05-15T15:41:43.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:43.834+0000 7f47837ea640 1 -- 172.21.15.12:0/3307834230 wait complete. 2024-05-15T15:41:43.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:43.835+0000 7f47837ea640 1 Processor -- start 2024-05-15T15:41:43.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:43.835+0000 7f47837ea640 1 -- start start 2024-05-15T15:41:43.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:43.836+0000 7f47837ea640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f477c0bf9b0 0x7f477c1e79f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:41:43.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:43.836+0000 7f47837ea640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f477c148770 0x7f477c06f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:41:43.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:43.836+0000 7f47837ea640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f477c14e360 0x7f477c13ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:41:43.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:43.836+0000 7f47837ea640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f477c159e50 con 0x7f477c148770 2024-05-15T15:41:43.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:43.836+0000 7f47837ea640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f477c159cd0 con 0x7f477c0bf9b0 2024-05-15T15:41:43.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:43.836+0000 7f47837ea640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f477c159fd0 con 0x7f477c14e360 2024-05-15T15:41:43.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:43.836+0000 7f4780d85640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f477c148770 0x7f477c06f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:41:43.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:43.836+0000 7f4780d85640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f477c148770 0x7f477c06f0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46150/0 (socket says 172.21.15.12:46150) 2024-05-15T15:41:43.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:43.836+0000 7f4780d85640 1 -- 172.21.15.12:0/2371870699 learned_addr learned my addr 172.21.15.12:0/2371870699 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:41:43.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:43.837+0000 7f4781d87640 1 --2- 172.21.15.12:0/2371870699 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f477c14e360 0x7f477c13ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:41:43.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:43.837+0000 7f4781586640 1 --2- 172.21.15.12:0/2371870699 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f477c0bf9b0 0x7f477c1e79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:41:43.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:43.837+0000 7f4780d85640 1 -- 172.21.15.12:0/2371870699 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f477c14e360 msgr2=0x7f477c13ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:41:43.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:43.837+0000 7f4780d85640 1 --2- 172.21.15.12:0/2371870699 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f477c14e360 0x7f477c13ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:41:43.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:43.837+0000 7f4780d85640 1 -- 172.21.15.12:0/2371870699 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f477c0bf9b0 msgr2=0x7f477c1e79f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:41:43.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:43.837+0000 7f4780d85640 1 --2- 172.21.15.12:0/2371870699 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f477c0bf9b0 0x7f477c1e79f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:41:43.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:43.837+0000 7f4780d85640 1 -- 172.21.15.12:0/2371870699 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f477c06f630 con 0x7f477c148770 2024-05-15T15:41:43.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:43.837+0000 7f4781d87640 1 --2- 172.21.15.12:0/2371870699 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f477c14e360 0x7f477c13ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-15T15:41:43.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:43.837+0000 7f4780d85640 1 --2- 172.21.15.12:0/2371870699 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f477c148770 0x7f477c06f0f0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f476c00c3a0 tx=0x7f476c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:41:43.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:43.837+0000 7f4771ffb640 1 -- 172.21.15.12:0/2371870699 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f476c0074e0 con 0x7f477c148770 2024-05-15T15:41:43.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:43.837+0000 7f4771ffb640 1 -- 172.21.15.12:0/2371870699 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f476c0047e0 con 0x7f477c148770 2024-05-15T15:41:43.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:43.837+0000 7f47837ea640 1 -- 172.21.15.12:0/2371870699 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f477c0b6990 con 0x7f477c148770 2024-05-15T15:41:43.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:43.837+0000 7f4771ffb640 1 -- 172.21.15.12:0/2371870699 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f476c004c50 con 0x7f477c148770 2024-05-15T15:41:43.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:43.837+0000 7f47837ea640 1 -- 172.21.15.12:0/2371870699 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f477c150240 con 0x7f477c148770 2024-05-15T15:41:43.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:43.838+0000 7f47837ea640 1 -- 172.21.15.12:0/2371870699 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f477c159ab0 con 0x7f477c148770 2024-05-15T15:41:43.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:43.839+0000 7f4771ffb640 1 -- 172.21.15.12:0/2371870699 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f476c011070 con 0x7f477c148770 2024-05-15T15:41:43.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:43.839+0000 7f4771ffb640 1 --2- 172.21.15.12:0/2371870699 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f4760076300 0x7f4760078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:41:43.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:43.839+0000 7f4771ffb640 1 -- 172.21.15.12:0/2371870699 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 5473+0+0 (secure 0 0 0) 0x7f476c097120 con 0x7f477c148770 2024-05-15T15:41:43.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:43.839+0000 7f4781586640 1 --2- 172.21.15.12:0/2371870699 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f4760076300 0x7f4760078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:41:43.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:43.840+0000 7f4781586640 1 --2- 172.21.15.12:0/2371870699 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f4760076300 0x7f4760078810 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f4774000f60 tx=0x7f4774009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:41:43.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:43.844+0000 7f4771ffb640 1 -- 172.21.15.12:0/2371870699 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f477c0c1390 con 0x7f477c148770 2024-05-15T15:41:44.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:44.041+0000 7f47837ea640 1 -- 172.21.15.12:0/2371870699 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f477c050940 con 0x7f477c148770 2024-05-15T15:41:44.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:44.689+0000 7f4771ffb640 1 -- 172.21.15.12:0/2371870699 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v41) ==== 169+0+0 (secure 0 0 0) 0x7f476c060ac0 con 0x7f477c148770 2024-05-15T15:41:44.692 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_data' removed 2024-05-15T15:41:44.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:44.692+0000 7f47837ea640 1 -- 172.21.15.12:0/2371870699 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f4760076300 msgr2=0x7f4760078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:41:44.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:44.692+0000 7f47837ea640 1 --2- 172.21.15.12:0/2371870699 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f4760076300 0x7f4760078810 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f4774000f60 tx=0x7f4774009040 comp rx=0 tx=0).stop 2024-05-15T15:41:44.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:44.692+0000 7f47837ea640 1 -- 172.21.15.12:0/2371870699 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f477c148770 msgr2=0x7f477c06f0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:41:44.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:44.692+0000 7f47837ea640 1 --2- 172.21.15.12:0/2371870699 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f477c148770 0x7f477c06f0f0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f476c00c3a0 tx=0x7f476c00c860 comp rx=0 tx=0).stop 2024-05-15T15:41:44.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:44.692+0000 7f47837ea640 1 -- 172.21.15.12:0/2371870699 shutdown_connections 2024-05-15T15:41:44.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:44.692+0000 7f47837ea640 1 --2- 172.21.15.12:0/2371870699 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f477c14e360 0x7f477c13ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:41:44.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:44.692+0000 7f47837ea640 1 --2- 172.21.15.12:0/2371870699 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f4760076300 0x7f4760078810 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:41:44.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:44.692+0000 7f47837ea640 1 --2- 172.21.15.12:0/2371870699 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f477c148770 0x7f477c06f0f0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:41:44.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:44.692+0000 7f47837ea640 1 --2- 172.21.15.12:0/2371870699 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f477c0bf9b0 0x7f477c1e79f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:41:44.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:44.692+0000 7f47837ea640 1 -- 172.21.15.12:0/2371870699 >> 172.21.15.12:0/2371870699 conn(0x7f477c0c17c0 msgr2=0x7f477c0a4970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:41:44.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:44.692+0000 7f47837ea640 1 -- 172.21.15.12:0/2371870699 shutdown_connections 2024-05-15T15:41:44.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:44.692+0000 7f47837ea640 1 -- 172.21.15.12:0/2371870699 wait complete. 2024-05-15T15:41:44.717 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-05-15T15:41:44.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:44.861+0000 7fea6a896640 1 Processor -- start 2024-05-15T15:41:44.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:44.861+0000 7fea6a896640 1 -- start start 2024-05-15T15:41:44.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:44.862+0000 7fea6a896640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fea640bd6d0 0x7fea640be940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:41:44.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:44.862+0000 7fea6a896640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fea640bee80 0x7fea64158e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:41:44.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:44.862+0000 7fea6a896640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea6406e140 con 0x7fea64151fc0 2024-05-15T15:41:44.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:44.862+0000 7fea6a896640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fea640c36f0 con 0x7fea640bd6d0 2024-05-15T15:41:44.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:44.862+0000 7fea6a896640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fea64152530 con 0x7fea640bee80 2024-05-15T15:41:44.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:44.862+0000 7fea637fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fea640bd6d0 0x7fea640be940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:41:44.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:44.862+0000 7fea63fff640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fea64151fc0 0x7fea6406da30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:49746/0 (socket says 172.21.15.12:49746) 2024-05-15T15:41:44.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:44.862+0000 7fea63fff640 1 -- 172.21.15.12:0/1073274946 learned_addr learned my addr 172.21.15.12:0/1073274946 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-05-15T15:41:44.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:44.863+0000 7fea637fe640 1 -- 172.21.15.12:0/1073274946 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fea640bee80 msgr2=0x7fea64158e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:41:44.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:44.863+0000 7fea68e33640 1 --2- 172.21.15.12:0/1073274946 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fea640bee80 0x7fea64158e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:41:44.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:44.863+0000 7fea62ffd640 1 -- 172.21.15.12:0/1073274946 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2006670697 0 0) 0x7fea54001110 con 0x7fea64151fc0 2024-05-15T15:41:44.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:44.863+0000 7fea637fe640 1 --2- 172.21.15.12:0/1073274946 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fea640bee80 0x7fea64158e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:41:44.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:44.863+0000 7fea637fe640 1 -- 172.21.15.12:0/1073274946 >> v1:172.21.15.12:6789/0 conn(0x7fea64151fc0 legacy=0x7fea6406da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:41:44.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:44.863+0000 7fea637fe640 1 -- 172.21.15.12:0/1073274946 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea64152810 con 0x7fea640bd6d0 2024-05-15T15:41:44.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:44.863+0000 7fea637fe640 1 --2- 172.21.15.12:0/1073274946 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea640bd6d0 0x7fea640be940 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fea580097a0 tx=0x7fea5802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8aee8ca73af07753 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:41:44.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:44.864+0000 7fea62ffd640 1 -- 172.21.15.12:0/1073274946 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea58037070 con 0x7fea640bd6d0 2024-05-15T15:41:44.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:44.864+0000 7fea62ffd640 1 -- 172.21.15.12:0/1073274946 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea58032440 con 0x7fea640bd6d0 2024-05-15T15:41:44.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:44.864+0000 7fea62ffd640 1 -- 172.21.15.12:0/1073274946 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea58032810 con 0x7fea640bd6d0 2024-05-15T15:41:44.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:44.864+0000 7fea6a896640 1 -- 172.21.15.12:0/1073274946 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea640bd6d0 msgr2=0x7fea640be940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:41:44.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:44.864+0000 7fea6a896640 1 --2- 172.21.15.12:0/1073274946 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea640bd6d0 0x7fea640be940 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fea580097a0 tx=0x7fea5802a180 comp rx=0 tx=0).stop 2024-05-15T15:41:44.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:44.864+0000 7fea6a896640 1 -- 172.21.15.12:0/1073274946 shutdown_connections 2024-05-15T15:41:44.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:44.864+0000 7fea6a896640 1 --2- 172.21.15.12:0/1073274946 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fea640bee80 0x7fea64158e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:41:44.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:44.864+0000 7fea6a896640 1 --2- 172.21.15.12:0/1073274946 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea640bd6d0 0x7fea640be940 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:41:44.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:44.864+0000 7fea6a896640 1 -- 172.21.15.12:0/1073274946 >> 172.21.15.12:0/1073274946 conn(0x7fea640c3d20 msgr2=0x7fea640c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:41:44.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:44.864+0000 7fea6a896640 1 -- 172.21.15.12:0/1073274946 shutdown_connections 2024-05-15T15:41:44.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:44.864+0000 7fea6a896640 1 -- 172.21.15.12:0/1073274946 wait complete. 2024-05-15T15:41:44.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:44.866+0000 7fea6a896640 1 Processor -- start 2024-05-15T15:41:44.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:44.866+0000 7fea6a896640 1 -- start start 2024-05-15T15:41:44.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:44.867+0000 7fea6a896640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea640bd6d0 0x7fea641e40d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:41:44.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:44.867+0000 7fea6a896640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fea640bee80 0x7fea6414b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:41:44.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:44.867+0000 7fea6a896640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea64151fc0 0x7fea640b5e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:41:44.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:44.867+0000 7fea6a896640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fea640bdae0 con 0x7fea640bd6d0 2024-05-15T15:41:44.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:44.867+0000 7fea6a896640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fea640c0070 con 0x7fea64151fc0 2024-05-15T15:41:44.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:44.867+0000 7fea6a896640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fea640a2ed0 con 0x7fea640bee80 2024-05-15T15:41:44.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:44.867+0000 7fea63fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea640bd6d0 0x7fea641e40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:41:44.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:44.867+0000 7fea63fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea640bd6d0 0x7fea641e40d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46162/0 (socket says 172.21.15.12:46162) 2024-05-15T15:41:44.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:44.867+0000 7fea63fff640 1 -- 172.21.15.12:0/2382355920 learned_addr learned my addr 172.21.15.12:0/2382355920 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:41:44.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:44.868+0000 7fea637fe640 1 --2- 172.21.15.12:0/2382355920 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fea640bee80 0x7fea6414b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:41:44.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:44.868+0000 7fea68e33640 1 --2- 172.21.15.12:0/2382355920 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea64151fc0 0x7fea640b5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:41:44.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:44.868+0000 7fea63fff640 1 -- 172.21.15.12:0/2382355920 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fea640bee80 msgr2=0x7fea6414b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:41:44.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:44.868+0000 7fea63fff640 1 --2- 172.21.15.12:0/2382355920 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fea640bee80 0x7fea6414b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:41:44.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:44.868+0000 7fea63fff640 1 -- 172.21.15.12:0/2382355920 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea64151fc0 msgr2=0x7fea640b5e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:41:44.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:44.868+0000 7fea63fff640 1 --2- 172.21.15.12:0/2382355920 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea64151fc0 0x7fea640b5e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:41:44.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:44.868+0000 7fea63fff640 1 -- 172.21.15.12:0/2382355920 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea641e7b00 con 0x7fea640bd6d0 2024-05-15T15:41:44.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:44.868+0000 7fea63fff640 1 --2- 172.21.15.12:0/2382355920 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea640bd6d0 0x7fea641e40d0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fea5400c410 tx=0x7fea5400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:41:44.873 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:44.868+0000 7fea60ff9640 1 -- 172.21.15.12:0/2382355920 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea540074e0 con 0x7fea640bd6d0 2024-05-15T15:41:44.873 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:44.868+0000 7fea60ff9640 1 -- 172.21.15.12:0/2382355920 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea540047e0 con 0x7fea640bd6d0 2024-05-15T15:41:44.873 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:44.868+0000 7fea6a896640 1 -- 172.21.15.12:0/2382355920 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea6414b930 con 0x7fea640bd6d0 2024-05-15T15:41:44.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:44.868+0000 7fea60ff9640 1 -- 172.21.15.12:0/2382355920 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea54004bd0 con 0x7fea640bd6d0 2024-05-15T15:41:44.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:44.868+0000 7fea6a896640 1 -- 172.21.15.12:0/2382355920 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea641515d0 con 0x7fea640bd6d0 2024-05-15T15:41:44.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:44.869+0000 7fea6a896640 1 -- 172.21.15.12:0/2382355920 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea640b73b0 con 0x7fea640bd6d0 2024-05-15T15:41:44.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:44.870+0000 7fea60ff9640 1 -- 172.21.15.12:0/2382355920 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fea54011070 con 0x7fea640bd6d0 2024-05-15T15:41:44.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:44.870+0000 7fea60ff9640 1 --2- 172.21.15.12:0/2382355920 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fea50076300 0x7fea50078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:41:44.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:44.871+0000 7fea60ff9640 1 -- 172.21.15.12:0/2382355920 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4943+0+0 (secure 0 0 0) 0x7fea54096d60 con 0x7fea640bd6d0 2024-05-15T15:41:44.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:44.871+0000 7fea637fe640 1 --2- 172.21.15.12:0/2382355920 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fea50076300 0x7fea50078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:41:44.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:44.871+0000 7fea637fe640 1 --2- 172.21.15.12:0/2382355920 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fea50076300 0x7fea50078810 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fea58034000 tx=0x7fea5802e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:41:44.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:44.875+0000 7fea60ff9640 1 -- 172.21.15.12:0/2382355920 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fea641e7b00 con 0x7fea640bd6d0 2024-05-15T15:41:45.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:45.065+0000 7fea6a896640 1 -- 172.21.15.12:0/2382355920 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7fea64050940 con 0x7fea640bd6d0 2024-05-15T15:41:45.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:45.068+0000 7fea60ff9640 1 -- 172.21.15.12:0/2382355920 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) ==== 104+0+0 (secure 0 0 0) 0x7fea6406e140 con 0x7fea640bd6d0 2024-05-15T15:41:45.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:45.070+0000 7fea6a896640 1 -- 172.21.15.12:0/2382355920 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fea50076300 msgr2=0x7fea50078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:41:45.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:45.070+0000 7fea6a896640 1 --2- 172.21.15.12:0/2382355920 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fea50076300 0x7fea50078810 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fea58034000 tx=0x7fea5802e000 comp rx=0 tx=0).stop 2024-05-15T15:41:45.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:45.070+0000 7fea6a896640 1 -- 172.21.15.12:0/2382355920 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea640bd6d0 msgr2=0x7fea641e40d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:41:45.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:45.070+0000 7fea6a896640 1 --2- 172.21.15.12:0/2382355920 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea640bd6d0 0x7fea641e40d0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fea5400c410 tx=0x7fea5400c8d0 comp rx=0 tx=0).stop 2024-05-15T15:41:45.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:45.070+0000 7fea6a896640 1 -- 172.21.15.12:0/2382355920 shutdown_connections 2024-05-15T15:41:45.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:45.070+0000 7fea6a896640 1 --2- 172.21.15.12:0/2382355920 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea64151fc0 0x7fea640b5e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:41:45.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:45.070+0000 7fea6a896640 1 --2- 172.21.15.12:0/2382355920 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fea640bee80 0x7fea6414b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:41:45.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:45.070+0000 7fea6a896640 1 --2- 172.21.15.12:0/2382355920 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fea50076300 0x7fea50078810 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:41:45.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:45.070+0000 7fea6a896640 1 --2- 172.21.15.12:0/2382355920 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea640bd6d0 0x7fea641e40d0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:41:45.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:45.070+0000 7fea6a896640 1 -- 172.21.15.12:0/2382355920 >> 172.21.15.12:0/2382355920 conn(0x7fea640c3d20 msgr2=0x7fea640a4820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:41:45.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:45.070+0000 7fea6a896640 1 -- 172.21.15.12:0/2382355920 shutdown_connections 2024-05-15T15:41:45.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:45.070+0000 7fea6a896640 1 -- 172.21.15.12:0/2382355920 wait complete. 2024-05-15T15:41:45.083 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_fscrypt.TestFSCrypt.test_fscrypt_basic_mount' 2024-05-15T15:41:45.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:45.216+0000 7fc87ca3b640 1 Processor -- start 2024-05-15T15:41:45.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:45.216+0000 7fc87ca3b640 1 -- start start 2024-05-15T15:41:45.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:45.218+0000 7fc87ca3b640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc878070a20 0x7fc878146510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:41:45.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:45.218+0000 7fc87ca3b640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fc8780721a0 0x7fc8780725b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:41:45.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:45.219+0000 7fc87ca3b640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc878071020 con 0x7fc8780bdc50 2024-05-15T15:41:45.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:45.219+0000 7fc87ca3b640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fc878146a50 con 0x7fc8780721a0 2024-05-15T15:41:45.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:45.219+0000 7fc87ca3b640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7fc87814ff00 con 0x7fc878070a20 2024-05-15T15:41:45.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:45.219+0000 7fc87659c640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fc8780bdc50 0x7fc87814f7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:49752/0 (socket says 172.21.15.12:49752) 2024-05-15T15:41:45.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:45.219+0000 7fc87659c640 1 -- 172.21.15.12:0/1957786197 learned_addr learned my addr 172.21.15.12:0/1957786197 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-05-15T15:41:45.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:45.219+0000 7fc876d9d640 1 --2- 172.21.15.12:0/1957786197 >> v2:172.21.15.12:3300/0 conn(0x7fc8780721a0 0x7fc8780725b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:41:45.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:45.219+0000 7fc875d9b640 1 --2- 172.21.15.12:0/1957786197 >> v2:172.21.15.84:3300/0 conn(0x7fc878070a20 0x7fc878146510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:41:45.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:45.219+0000 7fc87559a640 1 -- 172.21.15.12:0/1957786197 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3600905856 0 0) 0x7fc86c001110 con 0x7fc8780bdc50 2024-05-15T15:41:45.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:45.219+0000 7fc87559a640 1 -- 172.21.15.12:0/1957786197 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc860003520 con 0x7fc8780bdc50 2024-05-15T15:41:45.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:45.219+0000 7fc876d9d640 1 -- 172.21.15.12:0/1957786197 >> v2:172.21.15.84:3300/0 conn(0x7fc878070a20 msgr2=0x7fc878146510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T15:41:45.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:45.219+0000 7fc876d9d640 1 --2- 172.21.15.12:0/1957786197 >> v2:172.21.15.84:3300/0 conn(0x7fc878070a20 0x7fc878146510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:41:45.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:45.219+0000 7fc876d9d640 1 -- 172.21.15.12:0/1957786197 >> v1:172.21.15.12:6789/0 conn(0x7fc8780bdc50 legacy=0x7fc87814f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:41:45.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:45.219+0000 7fc876d9d640 1 -- 172.21.15.12:0/1957786197 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8780bc740 con 0x7fc8780721a0 2024-05-15T15:41:45.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:45.220+0000 7fc876d9d640 1 --2- 172.21.15.12:0/1957786197 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc8780721a0 0x7fc8780725b0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fc878074160 tx=0x7fc87002a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3897c64e068bb9c server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:41:45.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:45.221+0000 7fc87559a640 1 -- 172.21.15.12:0/1957786197 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc870007740 con 0x7fc8780721a0 2024-05-15T15:41:45.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:45.221+0000 7fc87559a640 1 -- 172.21.15.12:0/1957786197 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8700078e0 con 0x7fc8780721a0 2024-05-15T15:41:45.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:45.221+0000 7fc87559a640 1 -- 172.21.15.12:0/1957786197 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc870007cb0 con 0x7fc8780721a0 2024-05-15T15:41:45.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:45.222+0000 7fc87ca3b640 1 -- 172.21.15.12:0/1957786197 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc8780721a0 msgr2=0x7fc8780725b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:41:45.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:45.222+0000 7fc87ca3b640 1 --2- 172.21.15.12:0/1957786197 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc8780721a0 0x7fc8780725b0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fc878074160 tx=0x7fc87002a710 comp rx=0 tx=0).stop 2024-05-15T15:41:45.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:45.223+0000 7fc87ca3b640 1 -- 172.21.15.12:0/1957786197 shutdown_connections 2024-05-15T15:41:45.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:45.223+0000 7fc87ca3b640 1 --2- 172.21.15.12:0/1957786197 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc8780721a0 0x7fc8780725b0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:41:45.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:45.223+0000 7fc87ca3b640 1 --2- 172.21.15.12:0/1957786197 >> v2:172.21.15.84:3300/0 conn(0x7fc878070a20 0x7fc878146510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:41:45.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:45.223+0000 7fc87ca3b640 1 -- 172.21.15.12:0/1957786197 >> 172.21.15.12:0/1957786197 conn(0x7fc87806c6e0 msgr2=0x7fc87806caf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:41:45.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:45.224+0000 7fc87ca3b640 1 -- 172.21.15.12:0/1957786197 shutdown_connections 2024-05-15T15:41:45.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:45.224+0000 7fc87ca3b640 1 -- 172.21.15.12:0/1957786197 wait complete. 2024-05-15T15:41:45.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:45.227+0000 7fc87ca3b640 1 Processor -- start 2024-05-15T15:41:45.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:45.227+0000 7fc87ca3b640 1 -- start start 2024-05-15T15:41:45.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:45.228+0000 7fc87ca3b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc878070a20 0x7fc878149680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:41:45.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:45.228+0000 7fc87ca3b640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc8780721a0 0x7fc878142bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:41:45.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:45.228+0000 7fc87ca3b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc8780bdc50 0x7fc8781e2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:41:45.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:45.228+0000 7fc87ca3b640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fc8780bd220 con 0x7fc8780bdc50 2024-05-15T15:41:45.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:45.228+0000 7fc87ca3b640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fc8780bd5f0 con 0x7fc878070a20 2024-05-15T15:41:45.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:45.228+0000 7fc87ca3b640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fc878156b80 con 0x7fc8780721a0 2024-05-15T15:41:45.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:45.229+0000 7fc876d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc8780bdc50 0x7fc8781e2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:41:45.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:45.229+0000 7fc876d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc8780bdc50 0x7fc8781e2410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46174/0 (socket says 172.21.15.12:46174) 2024-05-15T15:41:45.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:45.229+0000 7fc876d9d640 1 -- 172.21.15.12:0/3997573562 learned_addr learned my addr 172.21.15.12:0/3997573562 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T15:41:45.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:45.229+0000 7fc87659c640 1 --2- 172.21.15.12:0/3997573562 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc878070a20 0x7fc878149680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:41:45.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:45.229+0000 7fc876d9d640 1 -- 172.21.15.12:0/3997573562 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc8780721a0 msgr2=0x7fc878142bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:41:45.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:45.229+0000 7fc876d9d640 1 --2- 172.21.15.12:0/3997573562 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc8780721a0 0x7fc878142bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:41:45.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:45.229+0000 7fc876d9d640 1 -- 172.21.15.12:0/3997573562 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc878070a20 msgr2=0x7fc878149680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:41:45.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:45.229+0000 7fc876d9d640 1 --2- 172.21.15.12:0/3997573562 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc878070a20 0x7fc878149680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:41:45.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:45.229+0000 7fc876d9d640 1 -- 172.21.15.12:0/3997573562 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc878143130 con 0x7fc8780bdc50 2024-05-15T15:41:45.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:45.229+0000 7fc876d9d640 1 --2- 172.21.15.12:0/3997573562 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc8780bdc50 0x7fc8781e2410 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fc87002ad00 tx=0x7fc870004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:41:45.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:45.230+0000 7fc866ffd640 1 -- 172.21.15.12:0/3997573562 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc87003f070 con 0x7fc8780bdc50 2024-05-15T15:41:45.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:45.230+0000 7fc866ffd640 1 -- 172.21.15.12:0/3997573562 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc870031bc0 con 0x7fc8780bdc50 2024-05-15T15:41:45.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:45.230+0000 7fc866ffd640 1 -- 172.21.15.12:0/3997573562 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc870009450 con 0x7fc8780bdc50 2024-05-15T15:41:45.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:45.230+0000 7fc87ca3b640 1 -- 172.21.15.12:0/3997573562 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8781e2950 con 0x7fc8780bdc50 2024-05-15T15:41:45.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:45.231+0000 7fc87ca3b640 1 -- 172.21.15.12:0/3997573562 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8781e5ce0 con 0x7fc8780bdc50 2024-05-15T15:41:45.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:45.233+0000 7fc866ffd640 1 -- 172.21.15.12:0/3997573562 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc870044460 con 0x7fc8780bdc50 2024-05-15T15:41:45.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:45.234+0000 7fc866ffd640 1 --2- 172.21.15.12:0/3997573562 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fc8580763b0 0x7fc8580788c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T15:41:45.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:45.234+0000 7fc866ffd640 1 -- 172.21.15.12:0/3997573562 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4943+0+0 (secure 0 0 0) 0x7fc8700b88e0 con 0x7fc8780bdc50 2024-05-15T15:41:45.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:45.235+0000 7fc87ca3b640 1 -- 172.21.15.12:0/3997573562 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8781e66e0 con 0x7fc8780bdc50 2024-05-15T15:41:45.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:45.238+0000 7fc87659c640 1 --2- 172.21.15.12:0/3997573562 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fc8580763b0 0x7fc8580788c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T15:41:45.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:45.242+0000 7fc87659c640 1 --2- 172.21.15.12:0/3997573562 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fc8580763b0 0x7fc8580788c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc86c005880 tx=0x7fc86c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T15:41:45.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:45.245+0000 7fc866ffd640 1 -- 172.21.15.12:0/3997573562 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fc8700825b0 con 0x7fc8780bdc50 2024-05-15T15:41:45.601 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:45.599+0000 7fc87ca3b640 1 -- 172.21.15.12:0/3997573562 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_fscrypt.TestFSCrypt.test_fscrypt_basic_mount"]} v 0) -- 0x7fc878150720 con 0x7fc8780bdc50 2024-05-15T15:41:45.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:45.693+0000 7fc866ffd640 1 -- 172.21.15.12:0/3997573562 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_fscrypt.TestFSCrypt.test_fscrypt_basic_mount"]}]=0 v107) ==== 141+0+0 (secure 0 0 0) 0x7fc870081eb0 con 0x7fc8780bdc50 2024-05-15T15:41:45.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:45.696+0000 7fc87ca3b640 1 -- 172.21.15.12:0/3997573562 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fc8580763b0 msgr2=0x7fc8580788c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:41:45.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:45.696+0000 7fc87ca3b640 1 --2- 172.21.15.12:0/3997573562 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fc8580763b0 0x7fc8580788c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc86c005880 tx=0x7fc86c009040 comp rx=0 tx=0).stop 2024-05-15T15:41:45.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:45.696+0000 7fc87ca3b640 1 -- 172.21.15.12:0/3997573562 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc8780bdc50 msgr2=0x7fc8781e2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T15:41:45.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:45.696+0000 7fc87ca3b640 1 --2- 172.21.15.12:0/3997573562 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc8780bdc50 0x7fc8781e2410 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fc87002ad00 tx=0x7fc870004a40 comp rx=0 tx=0).stop 2024-05-15T15:41:45.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:45.696+0000 7fc87ca3b640 1 -- 172.21.15.12:0/3997573562 shutdown_connections 2024-05-15T15:41:45.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:45.696+0000 7fc87ca3b640 1 --2- 172.21.15.12:0/3997573562 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fc8580763b0 0x7fc8580788c0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:41:45.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:45.696+0000 7fc87ca3b640 1 --2- 172.21.15.12:0/3997573562 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc8780bdc50 0x7fc8781e2410 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:41:45.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:45.696+0000 7fc87ca3b640 1 --2- 172.21.15.12:0/3997573562 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc8780721a0 0x7fc878142bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:41:45.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:45.696+0000 7fc87ca3b640 1 --2- 172.21.15.12:0/3997573562 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc878070a20 0x7fc878149680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T15:41:45.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:45.696+0000 7fc87ca3b640 1 -- 172.21.15.12:0/3997573562 >> 172.21.15.12:0/3997573562 conn(0x7fc87806c6e0 msgr2=0x7fc8780c0120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T15:41:45.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:45.696+0000 7fc87ca3b640 1 -- 172.21.15.12:0/3997573562 shutdown_connections 2024-05-15T15:41:45.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T15:41:45.696+0000 7fc87ca3b640 1 -- 172.21.15.12:0/3997573562 wait complete. 2024-05-15T15:41:45.710 INFO:tasks.cephfs_test_runner:That fscrypt can be setup and ingest files. ... ERROR 2024-05-15T15:41:45.711 INFO:tasks.cephfs_test_runner: 2024-05-15T15:41:45.711 INFO:tasks.cephfs_test_runner:====================================================================== 2024-05-15T15:41:45.711 INFO:tasks.cephfs_test_runner:ERROR: test_fscrypt_basic_mount (tasks.cephfs.test_fscrypt.TestFSCrypt) 2024-05-15T15:41:45.711 INFO:tasks.cephfs_test_runner:That fscrypt can be setup and ingest files. 2024-05-15T15:41:45.711 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-05-15T15:41:45.711 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-05-15T15:41:45.711 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_b8bd437e67ddf964c5c673086ea1e4c237db86fa/qa/tasks/cephfs/test_fscrypt.py", line 41, in test_fscrypt_basic_mount 2024-05-15T15:41:45.712 INFO:tasks.cephfs_test_runner: self.mount_a.run_shell_payload(f"cp -av /usr/bin {self.path}") 2024-05-15T15:41:45.712 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_b8bd437e67ddf964c5c673086ea1e4c237db86fa/qa/tasks/cephfs/mount.py", line 795, in run_shell_payload 2024-05-15T15:41:45.712 INFO:tasks.cephfs_test_runner: p.wait() 2024-05-15T15:41:45.712 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_08ca1187b5d019c0ae6c90488c6c9faaace42185/teuthology/orchestra/run.py", line 161, in wait 2024-05-15T15:41:45.712 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-05-15T15:41:45.712 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_08ca1187b5d019c0ae6c90488c6c9faaace42185/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-05-15T15:41:45.712 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-05-15T15:41:45.712 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi104 with status 1: "(cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'cp -av /usr/bin dir/')" 2024-05-15T15:41:45.712 INFO:tasks.cephfs_test_runner: 2024-05-15T15:41:45.712 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-05-15T15:41:45.712 INFO:tasks.cephfs_test_runner:Ran 1 test in 90.677s 2024-05-15T15:41:45.712 INFO:tasks.cephfs_test_runner: 2024-05-15T15:41:45.712 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2024-05-15T15:41:45.712 INFO:tasks.cephfs_test_runner: 2024-05-15T15:41:45.712 INFO:tasks.cephfs_test_runner:====================================================================== 2024-05-15T15:41:45.713 INFO:tasks.cephfs_test_runner:ERROR: test_fscrypt_basic_mount (tasks.cephfs.test_fscrypt.TestFSCrypt) 2024-05-15T15:41:45.713 INFO:tasks.cephfs_test_runner:That fscrypt can be setup and ingest files. 2024-05-15T15:41:45.713 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-05-15T15:41:45.713 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-05-15T15:41:45.713 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_b8bd437e67ddf964c5c673086ea1e4c237db86fa/qa/tasks/cephfs/test_fscrypt.py", line 41, in test_fscrypt_basic_mount 2024-05-15T15:41:45.713 INFO:tasks.cephfs_test_runner: self.mount_a.run_shell_payload(f"cp -av /usr/bin {self.path}") 2024-05-15T15:41:45.713 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_b8bd437e67ddf964c5c673086ea1e4c237db86fa/qa/tasks/cephfs/mount.py", line 795, in run_shell_payload 2024-05-15T15:41:45.713 INFO:tasks.cephfs_test_runner: p.wait() 2024-05-15T15:41:45.713 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_08ca1187b5d019c0ae6c90488c6c9faaace42185/teuthology/orchestra/run.py", line 161, in wait 2024-05-15T15:41:45.713 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-05-15T15:41:45.713 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_08ca1187b5d019c0ae6c90488c6c9faaace42185/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-05-15T15:41:45.713 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-05-15T15:41:45.713 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi104 with status 1: "(cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'cp -av /usr/bin dir/')" 2024-05-15T15:41:45.713 INFO:tasks.cephfs_test_runner: 2024-05-15T15:41:45.714 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_08ca1187b5d019c0ae6c90488c6c9faaace42185/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_batrick_ceph_b8bd437e67ddf964c5c673086ea1e4c237db86fa/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_fscrypt_basic_mount (tasks.cephfs.test_fscrypt.TestFSCrypt) 2024-05-15T15:41:46.903 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=5d045ddea2704f3b9bb7751ed049579e Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_08ca1187b5d019c0ae6c90488c6c9faaace42185/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_batrick_ceph_b8bd437e67ddf964c5c673086ea1e4c237db86fa/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_fscrypt_basic_mount (tasks.cephfs.test_fscrypt.TestFSCrypt) 2024-05-15T15:41:46.905 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-05-15T15:41:46.914 DEBUG:teuthology.run_tasks:Unwinding manager full_sequential_finally 2024-05-15T15:41:46.932 INFO:teuthology.task.full_sequential_finally:In full_sequential_finally, running task sleep... 2024-05-15T15:41:46.935 INFO:teuthology.task.sleep:Sleeping for 3600 seconds 2024-05-15T15:41:53.079 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:41:53.083 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:41:53.085 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:42:23.200 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:42:23.204 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:42:23.207 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:42:53.338 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:42:53.343 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:42:53.346 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:43:23.482 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:43:23.487 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:43:23.490 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:43:53.628 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:43:53.632 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:43:53.635 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:44:23.809 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:44:23.814 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:44:23.816 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:44:53.954 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:44:53.959 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:44:53.962 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:45:24.093 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:45:24.098 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:45:24.101 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:45:54.240 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:45:54.244 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:45:54.247 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:46:24.381 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:46:24.386 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:46:24.388 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:46:54.508 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:46:54.513 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:46:54.515 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:47:24.676 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:47:24.680 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:47:24.682 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:47:54.808 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:47:54.813 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:47:54.815 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:48:24.944 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:48:24.948 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:48:24.950 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:48:55.088 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:48:55.093 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:48:55.095 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:49:25.226 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:49:25.229 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:49:25.232 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:49:55.372 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:49:55.376 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:49:55.379 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:50:25.521 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:50:25.525 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:50:25.527 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:50:55.648 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:50:55.653 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:50:55.656 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:51:25.785 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:51:25.790 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:51:25.792 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:51:55.930 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:51:55.934 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:51:55.938 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:52:26.068 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:52:26.073 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:52:26.076 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:52:56.194 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:52:56.199 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:52:56.201 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:53:26.348 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:53:26.353 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:53:26.356 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:53:56.475 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:53:56.479 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:53:56.482 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:54:26.613 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:54:26.617 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:54:26.624 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:54:56.747 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:54:56.751 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:54:56.754 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:55:26.875 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:55:26.880 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:55:26.883 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:55:57.022 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:55:57.026 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:55:57.029 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:56:27.170 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:56:27.175 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:56:27.178 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:56:57.473 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:56:57.478 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:56:57.480 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:57:27.596 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:57:27.601 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:57:27.604 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:57:57.732 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:57:57.736 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:57:57.739 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:58:27.880 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:58:27.926 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:58:27.929 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:58:58.057 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:58:58.061 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:58:58.064 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:59:28.199 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:59:28.203 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:59:28.206 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:59:58.536 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:59:58.540 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:59:58.542 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:00:28.665 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:00:28.669 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:00:28.672 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:00:58.784 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:00:58.788 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:00:58.791 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:01:28.912 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:01:28.916 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:01:28.919 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:01:59.038 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:01:59.043 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:01:59.046 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:02:29.186 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:02:29.189 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:02:29.195 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:02:59.338 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:02:59.342 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:02:59.345 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:03:29.635 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:03:29.639 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:03:29.642 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:03:59.766 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:03:59.770 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:03:59.773 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:04:29.903 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:04:29.908 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:04:29.911 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:05:00.067 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:05:00.070 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:05:00.073 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:05:30.199 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:05:30.203 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:05:30.206 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:06:00.358 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:06:00.362 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:06:00.364 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:06:30.488 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:06:30.493 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:06:30.496 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:07:00.616 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:07:00.620 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:07:00.622 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:07:30.750 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:07:30.755 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:07:30.758 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:08:00.929 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:08:00.933 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:08:00.935 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:08:31.050 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:08:31.054 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:08:31.057 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:09:01.268 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:09:01.273 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:09:01.275 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:09:31.406 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:09:31.410 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:09:31.413 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:10:01.558 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:10:01.563 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:10:01.565 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:10:31.762 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:10:31.766 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:10:31.769 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:11:01.887 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:11:01.891 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:11:01.894 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:11:32.024 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:11:32.054 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:11:32.062 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:12:02.194 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:12:02.198 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:12:02.201 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:12:32.372 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:12:32.377 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:12:32.381 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:13:02.524 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:13:02.529 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:13:02.531 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:13:32.691 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:13:32.695 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:13:32.698 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:14:02.852 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:14:02.857 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:14:02.859 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:14:33.070 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:14:33.074 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:14:33.077 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:15:03.212 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:15:03.217 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:15:03.219 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:15:33.385 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:15:33.390 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:15:33.392 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:16:03.544 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:16:03.548 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:16:03.551 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:16:33.716 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:16:33.721 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:16:33.723 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:17:03.883 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:17:03.886 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:17:03.889 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:17:34.008 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:17:34.012 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:17:34.015 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:18:04.136 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:18:04.140 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:18:04.143 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:18:34.255 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:18:34.259 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:18:34.262 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:19:04.390 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:19:04.394 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:19:04.397 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:19:34.544 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:19:34.548 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:19:34.551 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:20:04.680 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:20:04.684 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:20:04.686 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:20:34.816 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:20:34.820 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:20:34.822 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:21:04.946 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:21:04.949 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:21:04.952 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:21:35.073 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:21:35.078 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:21:35.081 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:22:05.201 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:22:05.205 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:22:05.208 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:22:35.471 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:22:35.475 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:22:35.477 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:23:05.606 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:23:05.610 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:23:05.614 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:23:35.733 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:23:35.737 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:23:35.739 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:24:05.881 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:24:05.885 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:24:05.888 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:24:36.014 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:24:36.018 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:24:36.020 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:25:06.150 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:25:06.154 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:25:06.156 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:25:36.286 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:25:36.290 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:25:36.293 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:26:06.423 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:26:06.427 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:26:06.429 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:26:36.594 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:26:36.598 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:26:36.601 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:27:06.766 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:27:06.769 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:27:06.772 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:27:36.896 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:27:36.900 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:27:36.902 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:28:07.156 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:28:07.159 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:28:07.162 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:28:37.360 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:28:37.364 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:28:37.367 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:29:07.546 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:29:07.549 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:29:07.552 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:29:37.731 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:29:37.735 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:29:37.737 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:30:07.925 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:30:07.928 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:30:07.931 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:30:38.137 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:30:38.141 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:30:38.143 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:31:08.272 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:31:08.276 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:31:08.278 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:31:38.474 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:31:38.478 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:31:38.481 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:32:08.684 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:32:08.689 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:32:08.691 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:32:38.862 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:32:38.866 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:32:38.869 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:33:09.065 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:33:09.068 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:33:09.071 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:33:39.266 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:33:39.270 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:33:39.273 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:34:09.493 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:34:09.497 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:34:09.500 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:34:39.705 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:34:39.709 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:34:39.712 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:35:09.914 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:35:09.918 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:35:09.921 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:35:40.126 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:35:40.129 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:35:40.132 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:36:10.311 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:36:10.316 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:36:10.319 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:36:40.512 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:36:40.516 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:36:40.519 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:37:10.715 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:37:10.720 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:37:10.723 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:37:40.934 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:37:40.938 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:37:40.941 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:38:11.171 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:38:11.175 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:38:11.178 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:38:41.389 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:38:41.393 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:38:41.396 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:39:11.592 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:39:11.596 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:39:11.599 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:39:41.795 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:39:41.798 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:39:41.801 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:40:11.979 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:40:11.983 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:40:11.986 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:40:42.190 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:40:42.194 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:40:42.197 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:41:12.384 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:41:12.388 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:41:12.390 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:41:42.603 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:41:42.606 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:41:42.609 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:41:46.935 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-05-15T16:41:46.946 INFO:tasks.kclient:Unmounting kernel clients... 2024-05-15T16:41:46.946 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-05-15T16:41:46.946 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-15T16:41:47.004 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052731,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498000k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248996k,nr_inodes=812249,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498000k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2024-05-15T16:41:47.004 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-15T16:41:47.005 DEBUG:teuthology.orchestra.run.smithi104:> ip netns list 2024-05-15T16:41:47.056 INFO:teuthology.orchestra.run.smithi104.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-15T16:41:47.057 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-15T16:41:47.057 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-15T16:41:47.139 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-15T16:41:47.139 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip link delete ceph-brx 2024-05-15T16:41:47.251 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-05-15T16:41:47.259 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-15T16:41:47.259 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-15T16:41:47.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.384+0000 7ff4c7a96640 1 Processor -- start 2024-05-15T16:41:47.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.384+0000 7ff4c7a96640 1 -- start start 2024-05-15T16:41:47.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.386+0000 7ff4c7a96640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff4c01464a0 0x7ff4c014fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:47.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.386+0000 7ff4c7a96640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4c006de00 con 0x7ff4c014fff0 2024-05-15T16:41:47.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.386+0000 7ff4c7a96640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4c0073410 con 0x7ff4c00bbc80 2024-05-15T16:41:47.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.386+0000 7ff4c7a96640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7ff4c00731c0 con 0x7ff4c01464a0 2024-05-15T16:41:47.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.386+0000 7ff4c5031640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff4c01464a0 0x7ff4c014fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:47.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.386+0000 7ff4c6033640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7ff4c014fff0 0x7ff4c0156af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:53928/0 (socket says 172.21.15.12:53928) 2024-05-15T16:41:47.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.386+0000 7ff4c6033640 1 -- 172.21.15.12:0/2871051199 learned_addr learned my addr 172.21.15.12:0/2871051199 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-05-15T16:41:47.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.386+0000 7ff4c5031640 1 -- 172.21.15.12:0/2871051199 >> v1:172.21.15.84:6789/0 conn(0x7ff4c00bbc80 legacy=0x7ff4c006d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:47.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.386+0000 7ff4c5031640 1 -- 172.21.15.12:0/2871051199 >> v1:172.21.15.12:6789/0 conn(0x7ff4c014fff0 legacy=0x7ff4c0156af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:47.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.386+0000 7ff4c5031640 1 -- 172.21.15.12:0/2871051199 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4c00736f0 con 0x7ff4c01464a0 2024-05-15T16:41:47.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.387+0000 7ff4c5031640 1 --2- 172.21.15.12:0/2871051199 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4c01464a0 0x7ff4c014fab0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7ff4b40097a0 tx=0x7ff4b402a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5507777b664f625 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T16:41:47.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.387+0000 7ff4c4830640 1 -- 172.21.15.12:0/2871051199 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4b4037070 con 0x7ff4c01464a0 2024-05-15T16:41:47.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.387+0000 7ff4c4830640 1 -- 172.21.15.12:0/2871051199 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4b4032640 con 0x7ff4c01464a0 2024-05-15T16:41:47.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.387+0000 7ff4c4830640 1 -- 172.21.15.12:0/2871051199 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4b4032a10 con 0x7ff4c01464a0 2024-05-15T16:41:47.394 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.388+0000 7ff4c7a96640 1 -- 172.21.15.12:0/2871051199 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4c01464a0 msgr2=0x7ff4c014fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:47.394 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.388+0000 7ff4c7a96640 1 --2- 172.21.15.12:0/2871051199 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4c01464a0 0x7ff4c014fab0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7ff4b40097a0 tx=0x7ff4b402a2c0 comp rx=0 tx=0).stop 2024-05-15T16:41:47.394 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.388+0000 7ff4c7a96640 1 -- 172.21.15.12:0/2871051199 shutdown_connections 2024-05-15T16:41:47.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.388+0000 7ff4c7a96640 1 --2- 172.21.15.12:0/2871051199 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4c01464a0 0x7ff4c014fab0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:47.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.388+0000 7ff4c7a96640 1 -- 172.21.15.12:0/2871051199 >> 172.21.15.12:0/2871051199 conn(0x7ff4c006f2c0 msgr2=0x7ff4c006f6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T16:41:47.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.388+0000 7ff4c7a96640 1 -- 172.21.15.12:0/2871051199 shutdown_connections 2024-05-15T16:41:47.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.388+0000 7ff4c7a96640 1 -- 172.21.15.12:0/2871051199 wait complete. 2024-05-15T16:41:47.402 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.389+0000 7ff4c7a96640 1 Processor -- start 2024-05-15T16:41:47.402 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.390+0000 7ff4c7a96640 1 -- start start 2024-05-15T16:41:47.402 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.390+0000 7ff4c7a96640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff4c00bbc80 0x7ff4c01d7c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:47.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.391+0000 7ff4c7a96640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff4c01464a0 0x7ff4c01d6960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:47.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.391+0000 7ff4c7a96640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4c014fff0 0x7ff4c01d6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:47.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.391+0000 7ff4c7a96640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7ff4c0150400 con 0x7ff4c014fff0 2024-05-15T16:41:47.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.391+0000 7ff4c7a96640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ff4c01468b0 con 0x7ff4c01464a0 2024-05-15T16:41:47.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.391+0000 7ff4c7a96640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7ff4c00bc6c0 con 0x7ff4c00bbc80 2024-05-15T16:41:47.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.391+0000 7ff4c6033640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4c014fff0 0x7ff4c01d6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:47.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.391+0000 7ff4c6033640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4c014fff0 0x7ff4c01d6ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45830/0 (socket says 172.21.15.12:45830) 2024-05-15T16:41:47.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.391+0000 7ff4c6033640 1 -- 172.21.15.12:0/2082187702 learned_addr learned my addr 172.21.15.12:0/2082187702 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T16:41:47.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.391+0000 7ff4c5031640 1 --2- 172.21.15.12:0/2082187702 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff4c01464a0 0x7ff4c01d6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:47.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.391+0000 7ff4c5832640 1 --2- 172.21.15.12:0/2082187702 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff4c00bbc80 0x7ff4c01d7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:47.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.391+0000 7ff4c6033640 1 -- 172.21.15.12:0/2082187702 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff4c00bbc80 msgr2=0x7ff4c01d7c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:47.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.391+0000 7ff4c6033640 1 --2- 172.21.15.12:0/2082187702 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff4c00bbc80 0x7ff4c01d7c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:47.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.391+0000 7ff4c6033640 1 -- 172.21.15.12:0/2082187702 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff4c01464a0 msgr2=0x7ff4c01d6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:47.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.391+0000 7ff4c6033640 1 --2- 172.21.15.12:0/2082187702 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff4c01464a0 0x7ff4c01d6960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:47.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.391+0000 7ff4c6033640 1 -- 172.21.15.12:0/2082187702 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4c01d81c0 con 0x7ff4c014fff0 2024-05-15T16:41:47.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.391+0000 7ff4c5031640 1 --2- 172.21.15.12:0/2082187702 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff4c01464a0 0x7ff4c01d6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-15T16:41:47.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.391+0000 7ff4c6033640 1 --2- 172.21.15.12:0/2082187702 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4c014fff0 0x7ff4c01d6ea0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7ff4b000cab0 tx=0x7ff4b000cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T16:41:47.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.391+0000 7ff4be7fc640 1 -- 172.21.15.12:0/2082187702 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4b0017070 con 0x7ff4c014fff0 2024-05-15T16:41:47.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.391+0000 7ff4be7fc640 1 -- 172.21.15.12:0/2082187702 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4b000ac30 con 0x7ff4c014fff0 2024-05-15T16:41:47.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.391+0000 7ff4c7a96640 1 -- 172.21.15.12:0/2082187702 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4c00ba160 con 0x7ff4c014fff0 2024-05-15T16:41:47.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.391+0000 7ff4be7fc640 1 -- 172.21.15.12:0/2082187702 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4b0012400 con 0x7ff4c014fff0 2024-05-15T16:41:47.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.392+0000 7ff4c7a96640 1 -- 172.21.15.12:0/2082187702 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4c00b9960 con 0x7ff4c014fff0 2024-05-15T16:41:47.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.392+0000 7ff4c7a96640 1 -- 172.21.15.12:0/2082187702 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4c00b94a0 con 0x7ff4c014fff0 2024-05-15T16:41:47.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.393+0000 7ff4be7fc640 1 -- 172.21.15.12:0/2082187702 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff4b001a070 con 0x7ff4c014fff0 2024-05-15T16:41:47.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.394+0000 7ff4be7fc640 1 --2- 172.21.15.12:0/2082187702 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7ff4ac076300 0x7ff4ac078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:47.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.394+0000 7ff4be7fc640 1 -- 172.21.15.12:0/2082187702 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4943+0+0 (secure 0 0 0) 0x7ff4b0096e70 con 0x7ff4c014fff0 2024-05-15T16:41:47.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.394+0000 7ff4c5832640 1 --2- 172.21.15.12:0/2082187702 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7ff4ac076300 0x7ff4ac078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:47.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.395+0000 7ff4c5832640 1 --2- 172.21.15.12:0/2082187702 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7ff4ac076300 0x7ff4ac078810 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff4b8001640 tx=0x7ff4b8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T16:41:47.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.399+0000 7ff4be7fc640 1 -- 172.21.15.12:0/2082187702 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7ff4c00b94a0 con 0x7ff4c014fff0 2024-05-15T16:41:47.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.589+0000 7ff4c7a96640 1 -- 172.21.15.12:0/2082187702 --> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff4c00747c0 con 0x7ff4ac076300 2024-05-15T16:41:47.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.590+0000 7ff4be7fc640 1 -- 172.21.15.12:0/2082187702 <== mgr.4106 v2:172.21.15.84:6832/4173299311 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13361 (secure 0 0 0) 0x7ff4c00747c0 con 0x7ff4ac076300 2024-05-15T16:41:47.591 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-05-15T16:41:47.592 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-05-15T16:41:47.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.592+0000 7ff4c7a96640 1 -- 172.21.15.12:0/2082187702 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7ff4ac076300 msgr2=0x7ff4ac078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:47.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.592+0000 7ff4c7a96640 1 --2- 172.21.15.12:0/2082187702 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7ff4ac076300 0x7ff4ac078810 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff4b8001640 tx=0x7ff4b8009040 comp rx=0 tx=0).stop 2024-05-15T16:41:47.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.592+0000 7ff4c7a96640 1 -- 172.21.15.12:0/2082187702 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4c014fff0 msgr2=0x7ff4c01d6ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:47.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.592+0000 7ff4c7a96640 1 --2- 172.21.15.12:0/2082187702 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4c014fff0 0x7ff4c01d6ea0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7ff4b000cab0 tx=0x7ff4b000cf70 comp rx=0 tx=0).stop 2024-05-15T16:41:47.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.592+0000 7ff4c7a96640 1 -- 172.21.15.12:0/2082187702 shutdown_connections 2024-05-15T16:41:47.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.592+0000 7ff4c7a96640 1 --2- 172.21.15.12:0/2082187702 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7ff4ac076300 0x7ff4ac078810 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:47.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.592+0000 7ff4c7a96640 1 --2- 172.21.15.12:0/2082187702 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4c014fff0 0x7ff4c01d6ea0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:47.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.592+0000 7ff4c7a96640 1 --2- 172.21.15.12:0/2082187702 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff4c01464a0 0x7ff4c01d6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:47.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.592+0000 7ff4c7a96640 1 --2- 172.21.15.12:0/2082187702 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff4c00bbc80 0x7ff4c01d7c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:47.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.592+0000 7ff4c7a96640 1 -- 172.21.15.12:0/2082187702 >> 172.21.15.12:0/2082187702 conn(0x7ff4c006f2c0 msgr2=0x7ff4c0145540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T16:41:47.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.593+0000 7ff4c7a96640 1 -- 172.21.15.12:0/2082187702 shutdown_connections 2024-05-15T16:41:47.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.593+0000 7ff4c7a96640 1 -- 172.21.15.12:0/2082187702 wait complete. 2024-05-15T16:41:47.604 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":1899,"stamp":"2024-05-15T16:41:47.552954+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":997904,"kb_used_data":4840,"kb_used_omap":12,"kb_used_meta":992947,"kb_avail":753976816,"statfs":{"total":773094113280,"available":772072259584,"internally_reserved":0,"allocated":4956160,"data_stored":2685216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":1016778291},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002970"},"pg_stats":[{"pgid":"1.0","version":"18'72","reported_seq":175,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-15T16:37:54.798671+0000","last_change":"2024-05-15T15:39:42.584601+0000","last_active":"2024-05-15T16:37:54.798671+0000","last_peered":"2024-05-15T16:37:54.798671+0000","last_clean":"2024-05-15T16:37:54.798671+0000","last_became_active":"2024-05-15T15:39:42.584129+0000","last_became_peered":"2024-05-15T15:39:42.584129+0000","last_unstale":"2024-05-15T16:37:54.798671+0000","last_undegraded":"2024-05-15T16:37:54.798671+0000","last_fullsized":"2024-05-15T16:37:54.798671+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:41.378107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:41.378107+0000","last_clean_scrub_stamp":"2024-05-15T15:39:41.378107+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:23:25.285669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510188,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":99608,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94272232,"statfs":{"total":96636764160,"available":96534765568,"internally_reserved":0,"allocated":471040,"data_stored":188060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":101513675},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424510188,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":117660,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":117182,"kb_avail":94254180,"statfs":{"total":96636764160,"available":96516280320,"internally_reserved":0,"allocated":471040,"data_stored":188060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":119994822},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424510189,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":68256,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":94303584,"statfs":{"total":96636764160,"available":96566870016,"internally_reserved":0,"allocated":1064960,"data_stored":778428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68811205},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424510188,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":125976,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":125502,"kb_avail":94245864,"statfs":{"total":96636764160,"available":96507764736,"internally_reserved":0,"allocated":471040,"data_stored":188060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":128514503},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510188,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":148188,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":147710,"kb_avail":94223652,"statfs":{"total":96636764160,"available":96485019648,"internally_reserved":0,"allocated":471040,"data_stored":188060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":151255493},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510189,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":144604,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":143550,"kb_avail":94227236,"statfs":{"total":96636764160,"available":96488689664,"internally_reserved":0,"allocated":1064960,"data_stored":778428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":146995654},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510188,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":103768,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":103294,"kb_avail":94268072,"statfs":{"total":96636764160,"available":96530505728,"internally_reserved":0,"allocated":471040,"data_stored":188060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":105773510},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575597,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":189844,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":189374,"kb_avail":94181996,"statfs":{"total":96636764160,"available":96442363904,"internally_reserved":0,"allocated":471040,"data_stored":188060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":193919429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-15T16:41:47.605 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-15T16:41:47.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.715+0000 7fa8105be640 1 Processor -- start 2024-05-15T16:41:47.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.715+0000 7fa8105be640 1 -- start start 2024-05-15T16:41:47.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.716+0000 7fa8105be640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa808151fc0 0x7fa8080bd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:47.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.716+0000 7fa8105be640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa80806da30 0x7fa8080be940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:47.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.716+0000 7fa8105be640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8080c36f0 con 0x7fa80806de40 2024-05-15T16:41:47.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.716+0000 7fa8105be640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7fa8080bdc10 con 0x7fa808151fc0 2024-05-15T16:41:47.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.716+0000 7fa8105be640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fa808152530 con 0x7fa80806da30 2024-05-15T16:41:47.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.716+0000 7fa80eb5b640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fa80806de40 0x7fa80814e570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:53930/0 (socket says 172.21.15.12:53930) 2024-05-15T16:41:47.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.717+0000 7fa80eb5b640 1 -- 172.21.15.12:0/3729210965 learned_addr learned my addr 172.21.15.12:0/3729210965 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-05-15T16:41:47.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.717+0000 7fa80e35a640 1 --2- 172.21.15.12:0/3729210965 >> v2:172.21.15.84:3300/0 conn(0x7fa808151fc0 0x7fa8080bd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:47.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.717+0000 7fa80db59640 1 --2- 172.21.15.12:0/3729210965 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa80806da30 0x7fa8080be940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:47.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.717+0000 7fa80d358640 1 -- 172.21.15.12:0/3729210965 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1787134079 0 0) 0x7fa8080c36f0 con 0x7fa80806de40 2024-05-15T16:41:47.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.717+0000 7fa80d358640 1 -- 172.21.15.12:0/3729210965 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa7f4003520 con 0x7fa80806de40 2024-05-15T16:41:47.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.717+0000 7fa80e35a640 1 -- 172.21.15.12:0/3729210965 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa80806da30 msgr2=0x7fa8080be940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T16:41:47.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.717+0000 7fa80e35a640 1 --2- 172.21.15.12:0/3729210965 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa80806da30 0x7fa8080be940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:47.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.717+0000 7fa80e35a640 1 -- 172.21.15.12:0/3729210965 >> v1:172.21.15.12:6789/0 conn(0x7fa80806de40 legacy=0x7fa80814e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:47.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.717+0000 7fa80e35a640 1 -- 172.21.15.12:0/3729210965 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa808152810 con 0x7fa808151fc0 2024-05-15T16:41:47.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.717+0000 7fa80db59640 1 --2- 172.21.15.12:0/3729210965 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa80806da30 0x7fa8080be940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-15T16:41:47.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.718+0000 7fa80e35a640 1 --2- 172.21.15.12:0/3729210965 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa808151fc0 0x7fa8080bd6d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fa8040097a0 tx=0x7fa80402a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=891d73e8b4d5d2e5 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T16:41:47.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.718+0000 7fa80d358640 1 -- 172.21.15.12:0/3729210965 <== mon.1 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa804037070 con 0x7fa808151fc0 2024-05-15T16:41:47.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.718+0000 7fa80d358640 1 -- 172.21.15.12:0/3729210965 <== mon.1 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa804032440 con 0x7fa808151fc0 2024-05-15T16:41:47.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.718+0000 7fa80d358640 1 -- 172.21.15.12:0/3729210965 <== mon.1 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa804032810 con 0x7fa808151fc0 2024-05-15T16:41:47.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.719+0000 7fa8105be640 1 -- 172.21.15.12:0/3729210965 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa808151fc0 msgr2=0x7fa8080bd6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:47.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.719+0000 7fa8105be640 1 --2- 172.21.15.12:0/3729210965 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa808151fc0 0x7fa8080bd6d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fa8040097a0 tx=0x7fa80402a180 comp rx=0 tx=0).stop 2024-05-15T16:41:47.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.719+0000 7fa8105be640 1 -- 172.21.15.12:0/3729210965 shutdown_connections 2024-05-15T16:41:47.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.719+0000 7fa8105be640 1 --2- 172.21.15.12:0/3729210965 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa80806da30 0x7fa8080be940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:47.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.719+0000 7fa8105be640 1 --2- 172.21.15.12:0/3729210965 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa808151fc0 0x7fa8080bd6d0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:47.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.719+0000 7fa8105be640 1 -- 172.21.15.12:0/3729210965 >> 172.21.15.12:0/3729210965 conn(0x7fa8080c3d20 msgr2=0x7fa8080c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T16:41:47.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.719+0000 7fa8105be640 1 -- 172.21.15.12:0/3729210965 shutdown_connections 2024-05-15T16:41:47.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.719+0000 7fa8105be640 1 -- 172.21.15.12:0/3729210965 wait complete. 2024-05-15T16:41:47.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.720+0000 7fa8105be640 1 Processor -- start 2024-05-15T16:41:47.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.720+0000 7fa8105be640 1 -- start start 2024-05-15T16:41:47.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.721+0000 7fa8105be640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa80806da30 0x7fa8080b97e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:47.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.721+0000 7fa8105be640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa80806de40 0x7fa8081e4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:47.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.721+0000 7fa8105be640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa808151fc0 0x7fa80814ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:47.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.721+0000 7fa8105be640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa8080a3050 con 0x7fa808151fc0 2024-05-15T16:41:47.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.721+0000 7fa8105be640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa8080a2ed0 con 0x7fa80806de40 2024-05-15T16:41:47.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.721+0000 7fa8105be640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fa8080bee80 con 0x7fa80806da30 2024-05-15T16:41:47.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.722+0000 7fa80eb5b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa808151fc0 0x7fa80814ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:47.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.722+0000 7fa80eb5b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa808151fc0 0x7fa80814ae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45844/0 (socket says 172.21.15.12:45844) 2024-05-15T16:41:47.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.722+0000 7fa80eb5b640 1 -- 172.21.15.12:0/3119946979 learned_addr learned my addr 172.21.15.12:0/3119946979 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T16:41:47.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.722+0000 7fa80e35a640 1 --2- 172.21.15.12:0/3119946979 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa80806da30 0x7fa8080b97e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:47.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.722+0000 7fa80db59640 1 --2- 172.21.15.12:0/3119946979 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa80806de40 0x7fa8081e4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:47.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.722+0000 7fa80eb5b640 1 -- 172.21.15.12:0/3119946979 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa80806da30 msgr2=0x7fa8080b97e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:47.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.722+0000 7fa80eb5b640 1 --2- 172.21.15.12:0/3119946979 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa80806da30 0x7fa8080b97e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:47.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.722+0000 7fa80eb5b640 1 -- 172.21.15.12:0/3119946979 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa80806de40 msgr2=0x7fa8081e4a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:47.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.722+0000 7fa80eb5b640 1 --2- 172.21.15.12:0/3119946979 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa80806de40 0x7fa8081e4a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:47.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.722+0000 7fa80eb5b640 1 -- 172.21.15.12:0/3119946979 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8080b9d20 con 0x7fa808151fc0 2024-05-15T16:41:47.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.722+0000 7fa80eb5b640 1 --2- 172.21.15.12:0/3119946979 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa808151fc0 0x7fa80814ae10 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fa80000caa0 tx=0x7fa80000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T16:41:47.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.722+0000 7fa7feffd640 1 -- 172.21.15.12:0/3119946979 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa80000aba0 con 0x7fa808151fc0 2024-05-15T16:41:47.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.722+0000 7fa7feffd640 1 -- 172.21.15.12:0/3119946979 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa80000ad40 con 0x7fa808151fc0 2024-05-15T16:41:47.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.722+0000 7fa8105be640 1 -- 172.21.15.12:0/3119946979 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8081e4f70 con 0x7fa808151fc0 2024-05-15T16:41:47.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.722+0000 7fa7feffd640 1 -- 172.21.15.12:0/3119946979 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa800012620 con 0x7fa808151fc0 2024-05-15T16:41:47.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.722+0000 7fa8105be640 1 -- 172.21.15.12:0/3119946979 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa80814f1e0 con 0x7fa808151fc0 2024-05-15T16:41:47.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.723+0000 7fa8105be640 1 -- 172.21.15.12:0/3119946979 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa808050940 con 0x7fa808151fc0 2024-05-15T16:41:47.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.724+0000 7fa7feffd640 1 -- 172.21.15.12:0/3119946979 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa8000127c0 con 0x7fa808151fc0 2024-05-15T16:41:47.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.724+0000 7fa7feffd640 1 --2- 172.21.15.12:0/3119946979 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fa7ec0762d0 0x7fa7ec0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:47.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.725+0000 7fa7feffd640 1 -- 172.21.15.12:0/3119946979 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4943+0+0 (secure 0 0 0) 0x7fa800097860 con 0x7fa808151fc0 2024-05-15T16:41:47.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.725+0000 7fa80e35a640 1 --2- 172.21.15.12:0/3119946979 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fa7ec0762d0 0x7fa7ec0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:47.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.725+0000 7fa80e35a640 1 --2- 172.21.15.12:0/3119946979 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fa7ec0762d0 0x7fa7ec0787e0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fa804034000 tx=0x7fa80402e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T16:41:47.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.729+0000 7fa7feffd640 1 -- 172.21.15.12:0/3119946979 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fa800060d40 con 0x7fa808151fc0 2024-05-15T16:41:47.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.916+0000 7fa8105be640 1 -- 172.21.15.12:0/3119946979 --> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa80814ed50 con 0x7fa7ec0762d0 2024-05-15T16:41:47.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.917+0000 7fa7feffd640 1 -- 172.21.15.12:0/3119946979 <== mgr.4106 v2:172.21.15.84:6832/4173299311 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13361 (secure 0 0 0) 0x7fa80814ed50 con 0x7fa7ec0762d0 2024-05-15T16:41:47.918 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-05-15T16:41:47.918 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-05-15T16:41:47.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.919+0000 7fa8105be640 1 -- 172.21.15.12:0/3119946979 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fa7ec0762d0 msgr2=0x7fa7ec0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:47.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.919+0000 7fa8105be640 1 --2- 172.21.15.12:0/3119946979 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fa7ec0762d0 0x7fa7ec0787e0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fa804034000 tx=0x7fa80402e000 comp rx=0 tx=0).stop 2024-05-15T16:41:47.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.919+0000 7fa8105be640 1 -- 172.21.15.12:0/3119946979 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa808151fc0 msgr2=0x7fa80814ae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:47.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.919+0000 7fa8105be640 1 --2- 172.21.15.12:0/3119946979 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa808151fc0 0x7fa80814ae10 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fa80000caa0 tx=0x7fa80000cf60 comp rx=0 tx=0).stop 2024-05-15T16:41:47.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.919+0000 7fa8105be640 1 -- 172.21.15.12:0/3119946979 shutdown_connections 2024-05-15T16:41:47.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.919+0000 7fa8105be640 1 --2- 172.21.15.12:0/3119946979 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fa7ec0762d0 0x7fa7ec0787e0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:47.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.919+0000 7fa8105be640 1 --2- 172.21.15.12:0/3119946979 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa808151fc0 0x7fa80814ae10 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:47.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.919+0000 7fa8105be640 1 --2- 172.21.15.12:0/3119946979 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa80806de40 0x7fa8081e4a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:47.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.919+0000 7fa8105be640 1 --2- 172.21.15.12:0/3119946979 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa80806da30 0x7fa8080b97e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:47.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.919+0000 7fa8105be640 1 -- 172.21.15.12:0/3119946979 >> 172.21.15.12:0/3119946979 conn(0x7fa8080c3d20 msgr2=0x7fa8080c0aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T16:41:47.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.919+0000 7fa8105be640 1 -- 172.21.15.12:0/3119946979 shutdown_connections 2024-05-15T16:41:47.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:47.919+0000 7fa8105be640 1 -- 172.21.15.12:0/3119946979 wait complete. 2024-05-15T16:41:47.931 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":1899,"stamp":"2024-05-15T16:41:47.552954+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":997904,"kb_used_data":4840,"kb_used_omap":12,"kb_used_meta":992947,"kb_avail":753976816,"statfs":{"total":773094113280,"available":772072259584,"internally_reserved":0,"allocated":4956160,"data_stored":2685216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":1016778291},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002970"},"pg_stats":[{"pgid":"1.0","version":"18'72","reported_seq":175,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-15T16:37:54.798671+0000","last_change":"2024-05-15T15:39:42.584601+0000","last_active":"2024-05-15T16:37:54.798671+0000","last_peered":"2024-05-15T16:37:54.798671+0000","last_clean":"2024-05-15T16:37:54.798671+0000","last_became_active":"2024-05-15T15:39:42.584129+0000","last_became_peered":"2024-05-15T15:39:42.584129+0000","last_unstale":"2024-05-15T16:37:54.798671+0000","last_undegraded":"2024-05-15T16:37:54.798671+0000","last_fullsized":"2024-05-15T16:37:54.798671+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:41.378107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:41.378107+0000","last_clean_scrub_stamp":"2024-05-15T15:39:41.378107+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:23:25.285669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510188,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":99608,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94272232,"statfs":{"total":96636764160,"available":96534765568,"internally_reserved":0,"allocated":471040,"data_stored":188060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":101513675},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424510188,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":117660,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":117182,"kb_avail":94254180,"statfs":{"total":96636764160,"available":96516280320,"internally_reserved":0,"allocated":471040,"data_stored":188060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":119994822},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424510189,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":68256,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":94303584,"statfs":{"total":96636764160,"available":96566870016,"internally_reserved":0,"allocated":1064960,"data_stored":778428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68811205},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424510188,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":125976,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":125502,"kb_avail":94245864,"statfs":{"total":96636764160,"available":96507764736,"internally_reserved":0,"allocated":471040,"data_stored":188060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":128514503},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510188,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":148188,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":147710,"kb_avail":94223652,"statfs":{"total":96636764160,"available":96485019648,"internally_reserved":0,"allocated":471040,"data_stored":188060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":151255493},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510189,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":144604,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":143550,"kb_avail":94227236,"statfs":{"total":96636764160,"available":96488689664,"internally_reserved":0,"allocated":1064960,"data_stored":778428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":146995654},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510188,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":103768,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":103294,"kb_avail":94268072,"statfs":{"total":96636764160,"available":96530505728,"internally_reserved":0,"allocated":471040,"data_stored":188060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":105773510},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575597,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":189844,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":189374,"kb_avail":94181996,"statfs":{"total":96636764160,"available":96442363904,"internally_reserved":0,"allocated":471040,"data_stored":188060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":193919429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-15T16:41:47.931 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-15T16:41:47.932 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-15T16:41:48.048 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.042+0000 7f99e8fea640 1 Processor -- start 2024-05-15T16:41:48.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.042+0000 7f99e8fea640 1 -- start start 2024-05-15T16:41:48.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.043+0000 7f99e8fea640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f99e414e360 0x7f99e41522d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:48.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.043+0000 7f99e8fea640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f99e4148770 0x7f99e40c0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:48.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.043+0000 7f99e8fea640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f99e40bf9b0 0x7f99e40bfdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:48.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.043+0000 7f99e8fea640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f99e4151e40 con 0x7f99e4148770 2024-05-15T16:41:48.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.043+0000 7f99e8fea640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f99e40c0620 con 0x7f99e40bf9b0 2024-05-15T16:41:48.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.043+0000 7f99e8fea640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f99e4151ad0 con 0x7f99e414e360 2024-05-15T16:41:48.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.043+0000 7f99e1d9b640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f99e4148770 0x7f99e40c0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:48.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.043+0000 7f99e1d9b640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f99e4148770 0x7f99e40c0c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45850/0 (socket says 172.21.15.12:45850) 2024-05-15T16:41:48.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.043+0000 7f99e1d9b640 1 -- 172.21.15.12:0/999876857 learned_addr learned my addr 172.21.15.12:0/999876857 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T16:41:48.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.044+0000 7f99e2d9d640 1 --2- 172.21.15.12:0/999876857 >> v2:172.21.15.84:3300/0 conn(0x7f99e40bf9b0 0x7f99e40bfdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:48.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.044+0000 7f99e259c640 1 --2- 172.21.15.12:0/999876857 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f99e414e360 0x7f99e41522d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:48.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.044+0000 7f99e1d9b640 1 -- 172.21.15.12:0/999876857 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f99e414e360 msgr2=0x7f99e41522d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T16:41:48.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.044+0000 7f99e1d9b640 1 --2- 172.21.15.12:0/999876857 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f99e414e360 0x7f99e41522d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:48.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.044+0000 7f99e1d9b640 1 -- 172.21.15.12:0/999876857 >> v2:172.21.15.84:3300/0 conn(0x7f99e40bf9b0 msgr2=0x7f99e40bfdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T16:41:48.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.044+0000 7f99e1d9b640 1 --2- 172.21.15.12:0/999876857 >> v2:172.21.15.84:3300/0 conn(0x7f99e40bf9b0 0x7f99e40bfdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:48.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.044+0000 7f99e1d9b640 1 -- 172.21.15.12:0/999876857 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99e4152810 con 0x7f99e4148770 2024-05-15T16:41:48.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.044+0000 7f99e1d9b640 1 --2- 172.21.15.12:0/999876857 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f99e4148770 0x7f99e40c0c80 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f99d8009870 tx=0x7f99d802a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a715335aa56ae03c server_cookie=0 in_seq=0 out_seq=0 2024-05-15T16:41:48.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.045+0000 7f99e159a640 1 -- 172.21.15.12:0/999876857 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99d8037070 con 0x7f99e4148770 2024-05-15T16:41:48.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.045+0000 7f99e159a640 1 -- 172.21.15.12:0/999876857 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99d8032440 con 0x7f99e4148770 2024-05-15T16:41:48.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.045+0000 7f99e159a640 1 -- 172.21.15.12:0/999876857 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99d8032810 con 0x7f99e4148770 2024-05-15T16:41:48.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.045+0000 7f99e8fea640 1 -- 172.21.15.12:0/999876857 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f99e4148770 msgr2=0x7f99e40c0c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:48.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.045+0000 7f99e8fea640 1 --2- 172.21.15.12:0/999876857 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f99e4148770 0x7f99e40c0c80 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f99d8009870 tx=0x7f99d802a2a0 comp rx=0 tx=0).stop 2024-05-15T16:41:48.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.045+0000 7f99e8fea640 1 -- 172.21.15.12:0/999876857 shutdown_connections 2024-05-15T16:41:48.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.045+0000 7f99e8fea640 1 --2- 172.21.15.12:0/999876857 >> v2:172.21.15.84:3300/0 conn(0x7f99e40bf9b0 0x7f99e40bfdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:48.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.045+0000 7f99e8fea640 1 --2- 172.21.15.12:0/999876857 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f99e4148770 0x7f99e40c0c80 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:48.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.045+0000 7f99e8fea640 1 --2- 172.21.15.12:0/999876857 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f99e414e360 0x7f99e41522d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:48.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.045+0000 7f99e8fea640 1 -- 172.21.15.12:0/999876857 >> 172.21.15.12:0/999876857 conn(0x7f99e40c17c0 msgr2=0x7f99e40c1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T16:41:48.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.045+0000 7f99e8fea640 1 -- 172.21.15.12:0/999876857 shutdown_connections 2024-05-15T16:41:48.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.045+0000 7f99e8fea640 1 -- 172.21.15.12:0/999876857 wait complete. 2024-05-15T16:41:48.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.047+0000 7f99e8fea640 1 Processor -- start 2024-05-15T16:41:48.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.047+0000 7f99e8fea640 1 -- start start 2024-05-15T16:41:48.055 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.048+0000 7f99e8fea640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f99e40bf9b0 0x7f99e414f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:48.055 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.048+0000 7f99e8fea640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f99e4148770 0x7f99e41e42f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:48.055 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.048+0000 7f99e8fea640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99e414e360 0x7f99e414ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:48.055 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.048+0000 7f99e8fea640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f99e40c1340 con 0x7f99e4148770 2024-05-15T16:41:48.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.048+0000 7f99e8fea640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f99e40c11c0 con 0x7f99e414e360 2024-05-15T16:41:48.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.048+0000 7f99e8fea640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f99e409fd50 con 0x7f99e40bf9b0 2024-05-15T16:41:48.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.048+0000 7f99e1d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f99e4148770 0x7f99e41e42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:48.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.048+0000 7f99e1d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f99e4148770 0x7f99e41e42f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45856/0 (socket says 172.21.15.12:45856) 2024-05-15T16:41:48.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.048+0000 7f99e1d9b640 1 -- 172.21.15.12:0/1416585774 learned_addr learned my addr 172.21.15.12:0/1416585774 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T16:41:48.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.048+0000 7f99e2d9d640 1 --2- 172.21.15.12:0/1416585774 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99e414e360 0x7f99e414ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:48.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.048+0000 7f99e259c640 1 --2- 172.21.15.12:0/1416585774 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f99e40bf9b0 0x7f99e414f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:48.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.049+0000 7f99e1d9b640 1 -- 172.21.15.12:0/1416585774 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f99e40bf9b0 msgr2=0x7f99e414f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:48.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.049+0000 7f99e1d9b640 1 --2- 172.21.15.12:0/1416585774 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f99e40bf9b0 0x7f99e414f660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:48.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.049+0000 7f99e1d9b640 1 -- 172.21.15.12:0/1416585774 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99e414e360 msgr2=0x7f99e414ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:48.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.049+0000 7f99e1d9b640 1 --2- 172.21.15.12:0/1416585774 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99e414e360 0x7f99e414ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:48.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.049+0000 7f99e1d9b640 1 -- 172.21.15.12:0/1416585774 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99e41e4830 con 0x7f99e4148770 2024-05-15T16:41:48.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.049+0000 7f99e1d9b640 1 --2- 172.21.15.12:0/1416585774 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f99e4148770 0x7f99e41e42f0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f99d802a2e0 tx=0x7f99d80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T16:41:48.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.049+0000 7f99d2ffd640 1 -- 172.21.15.12:0/1416585774 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99d8041020 con 0x7f99e4148770 2024-05-15T16:41:48.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.049+0000 7f99d2ffd640 1 -- 172.21.15.12:0/1416585774 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99d80306c0 con 0x7f99e4148770 2024-05-15T16:41:48.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.049+0000 7f99e8fea640 1 -- 172.21.15.12:0/1416585774 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99e40a6bb0 con 0x7f99e4148770 2024-05-15T16:41:48.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.049+0000 7f99d2ffd640 1 -- 172.21.15.12:0/1416585774 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99d8037040 con 0x7f99e4148770 2024-05-15T16:41:48.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.049+0000 7f99e8fea640 1 -- 172.21.15.12:0/1416585774 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99e4151430 con 0x7f99e4148770 2024-05-15T16:41:48.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.050+0000 7f99e8fea640 1 -- 172.21.15.12:0/1416585774 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99e4050940 con 0x7f99e4148770 2024-05-15T16:41:48.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.051+0000 7f99d2ffd640 1 -- 172.21.15.12:0/1416585774 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f99d8044020 con 0x7f99e4148770 2024-05-15T16:41:48.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.051+0000 7f99d2ffd640 1 --2- 172.21.15.12:0/1416585774 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f99c40762d0 0x7f99c40787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:48.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.051+0000 7f99d2ffd640 1 -- 172.21.15.12:0/1416585774 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4943+0+0 (secure 0 0 0) 0x7f99d80b7af0 con 0x7f99e4148770 2024-05-15T16:41:48.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.052+0000 7f99e259c640 1 --2- 172.21.15.12:0/1416585774 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f99c40762d0 0x7f99c40787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:48.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.052+0000 7f99e259c640 1 --2- 172.21.15.12:0/1416585774 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f99c40762d0 0x7f99c40787e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f99dc00b7c0 tx=0x7f99dc008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T16:41:48.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.056+0000 7f99d2ffd640 1 -- 172.21.15.12:0/1416585774 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f99d804b030 con 0x7f99e4148770 2024-05-15T16:41:48.246 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.245+0000 7f99e8fea640 1 -- 172.21.15.12:0/1416585774 --> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f99e40bf790 con 0x7f99c40762d0 2024-05-15T16:41:48.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.246+0000 7f99d2ffd640 1 -- 172.21.15.12:0/1416585774 <== mgr.4106 v2:172.21.15.84:6832/4173299311 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13361 (secure 0 0 0) 0x7f99e40bf790 con 0x7f99c40762d0 2024-05-15T16:41:48.247 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-05-15T16:41:48.247 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-05-15T16:41:48.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.248+0000 7f99e8fea640 1 -- 172.21.15.12:0/1416585774 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f99c40762d0 msgr2=0x7f99c40787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:48.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.248+0000 7f99e8fea640 1 --2- 172.21.15.12:0/1416585774 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f99c40762d0 0x7f99c40787e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f99dc00b7c0 tx=0x7f99dc008040 comp rx=0 tx=0).stop 2024-05-15T16:41:48.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.248+0000 7f99e8fea640 1 -- 172.21.15.12:0/1416585774 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f99e4148770 msgr2=0x7f99e41e42f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:48.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.248+0000 7f99e8fea640 1 --2- 172.21.15.12:0/1416585774 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f99e4148770 0x7f99e41e42f0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f99d802a2e0 tx=0x7f99d80046c0 comp rx=0 tx=0).stop 2024-05-15T16:41:48.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.248+0000 7f99e8fea640 1 -- 172.21.15.12:0/1416585774 shutdown_connections 2024-05-15T16:41:48.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.248+0000 7f99e8fea640 1 --2- 172.21.15.12:0/1416585774 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99e414e360 0x7f99e414ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:48.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.248+0000 7f99e8fea640 1 --2- 172.21.15.12:0/1416585774 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f99c40762d0 0x7f99c40787e0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:48.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.248+0000 7f99e8fea640 1 --2- 172.21.15.12:0/1416585774 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f99e4148770 0x7f99e41e42f0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:48.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.248+0000 7f99e8fea640 1 --2- 172.21.15.12:0/1416585774 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f99e40bf9b0 0x7f99e414f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:48.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.248+0000 7f99e8fea640 1 -- 172.21.15.12:0/1416585774 >> 172.21.15.12:0/1416585774 conn(0x7f99e40c17c0 msgr2=0x7f99e41d7750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T16:41:48.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.248+0000 7f99e8fea640 1 -- 172.21.15.12:0/1416585774 shutdown_connections 2024-05-15T16:41:48.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.248+0000 7f99e8fea640 1 -- 172.21.15.12:0/1416585774 wait complete. 2024-05-15T16:41:48.260 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":1899,"stamp":"2024-05-15T16:41:47.552954+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":997904,"kb_used_data":4840,"kb_used_omap":12,"kb_used_meta":992947,"kb_avail":753976816,"statfs":{"total":773094113280,"available":772072259584,"internally_reserved":0,"allocated":4956160,"data_stored":2685216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":1016778291},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002970"},"pg_stats":[{"pgid":"1.0","version":"18'72","reported_seq":175,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-15T16:37:54.798671+0000","last_change":"2024-05-15T15:39:42.584601+0000","last_active":"2024-05-15T16:37:54.798671+0000","last_peered":"2024-05-15T16:37:54.798671+0000","last_clean":"2024-05-15T16:37:54.798671+0000","last_became_active":"2024-05-15T15:39:42.584129+0000","last_became_peered":"2024-05-15T15:39:42.584129+0000","last_unstale":"2024-05-15T16:37:54.798671+0000","last_undegraded":"2024-05-15T16:37:54.798671+0000","last_fullsized":"2024-05-15T16:37:54.798671+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:41.378107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:41.378107+0000","last_clean_scrub_stamp":"2024-05-15T15:39:41.378107+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:23:25.285669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510188,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":99608,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94272232,"statfs":{"total":96636764160,"available":96534765568,"internally_reserved":0,"allocated":471040,"data_stored":188060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":101513675},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424510188,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":117660,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":117182,"kb_avail":94254180,"statfs":{"total":96636764160,"available":96516280320,"internally_reserved":0,"allocated":471040,"data_stored":188060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":119994822},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424510189,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":68256,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":94303584,"statfs":{"total":96636764160,"available":96566870016,"internally_reserved":0,"allocated":1064960,"data_stored":778428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68811205},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424510188,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":125976,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":125502,"kb_avail":94245864,"statfs":{"total":96636764160,"available":96507764736,"internally_reserved":0,"allocated":471040,"data_stored":188060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":128514503},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510188,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":148188,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":147710,"kb_avail":94223652,"statfs":{"total":96636764160,"available":96485019648,"internally_reserved":0,"allocated":471040,"data_stored":188060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":151255493},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510189,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":144604,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":143550,"kb_avail":94227236,"statfs":{"total":96636764160,"available":96488689664,"internally_reserved":0,"allocated":1064960,"data_stored":778428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":146995654},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510188,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":103768,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":103294,"kb_avail":94268072,"statfs":{"total":96636764160,"available":96530505728,"internally_reserved":0,"allocated":471040,"data_stored":188060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":105773510},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575597,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":189844,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":189374,"kb_avail":94181996,"statfs":{"total":96636764160,"available":96442363904,"internally_reserved":0,"allocated":471040,"data_stored":188060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":193919429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-15T16:41:48.261 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-15T16:41:48.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.371+0000 7fb5c22f9640 1 Processor -- start 2024-05-15T16:41:48.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.371+0000 7fb5c22f9640 1 -- start start 2024-05-15T16:41:48.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.372+0000 7fb5c22f9640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb5bc151fc0 0x7fb5bc0bd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:48.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.372+0000 7fb5c22f9640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb5bc06da30 0x7fb5bc0be940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:48.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.372+0000 7fb5c22f9640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5bc0c36f0 con 0x7fb5bc06de40 2024-05-15T16:41:48.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.372+0000 7fb5c22f9640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fb5bc0bdc10 con 0x7fb5bc151fc0 2024-05-15T16:41:48.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.372+0000 7fb5c22f9640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fb5bc152530 con 0x7fb5bc06da30 2024-05-15T16:41:48.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.372+0000 7fb5bbfff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb5bc151fc0 0x7fb5bc0bd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:48.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.372+0000 7fb5c0896640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fb5bc06de40 0x7fb5bc14e570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:53938/0 (socket says 172.21.15.12:53938) 2024-05-15T16:41:48.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.372+0000 7fb5c0896640 1 -- 172.21.15.12:0/3907112992 learned_addr learned my addr 172.21.15.12:0/3907112992 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-05-15T16:41:48.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.372+0000 7fb5bb7fe640 1 --2- 172.21.15.12:0/3907112992 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb5bc06da30 0x7fb5bc0be940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:48.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.373+0000 7fb5bbfff640 1 -- 172.21.15.12:0/3907112992 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb5bc06da30 msgr2=0x7fb5bc0be940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T16:41:48.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.373+0000 7fb5bbfff640 1 --2- 172.21.15.12:0/3907112992 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb5bc06da30 0x7fb5bc0be940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:48.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.373+0000 7fb5bbfff640 1 -- 172.21.15.12:0/3907112992 >> v1:172.21.15.12:6789/0 conn(0x7fb5bc06de40 legacy=0x7fb5bc14e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:48.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.373+0000 7fb5bbfff640 1 -- 172.21.15.12:0/3907112992 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5bc152810 con 0x7fb5bc151fc0 2024-05-15T16:41:48.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.373+0000 7fb5baffd640 1 -- 172.21.15.12:0/3907112992 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 90030128 0 0) 0x7fb5bc0c36f0 con 0x7fb5bc06de40 2024-05-15T16:41:48.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.373+0000 7fb5bbfff640 1 --2- 172.21.15.12:0/3907112992 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb5bc151fc0 0x7fb5bc0bd6d0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fb5b00097a0 tx=0x7fb5b002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f08479c2d09dc437 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T16:41:48.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.373+0000 7fb5baffd640 1 -- 172.21.15.12:0/3907112992 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5b0037070 con 0x7fb5bc151fc0 2024-05-15T16:41:48.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.374+0000 7fb5baffd640 1 -- 172.21.15.12:0/3907112992 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5b0032440 con 0x7fb5bc151fc0 2024-05-15T16:41:48.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.374+0000 7fb5baffd640 1 -- 172.21.15.12:0/3907112992 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5b0032810 con 0x7fb5bc151fc0 2024-05-15T16:41:48.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.374+0000 7fb5c22f9640 1 -- 172.21.15.12:0/3907112992 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb5bc151fc0 msgr2=0x7fb5bc0bd6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:48.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.374+0000 7fb5c22f9640 1 --2- 172.21.15.12:0/3907112992 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb5bc151fc0 0x7fb5bc0bd6d0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fb5b00097a0 tx=0x7fb5b002a180 comp rx=0 tx=0).stop 2024-05-15T16:41:48.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.374+0000 7fb5c22f9640 1 -- 172.21.15.12:0/3907112992 shutdown_connections 2024-05-15T16:41:48.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.374+0000 7fb5c22f9640 1 --2- 172.21.15.12:0/3907112992 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb5bc06da30 0x7fb5bc0be940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:48.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.374+0000 7fb5c22f9640 1 --2- 172.21.15.12:0/3907112992 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb5bc151fc0 0x7fb5bc0bd6d0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:48.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.374+0000 7fb5c22f9640 1 -- 172.21.15.12:0/3907112992 >> 172.21.15.12:0/3907112992 conn(0x7fb5bc0c3d20 msgr2=0x7fb5bc0c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T16:41:48.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.374+0000 7fb5c22f9640 1 -- 172.21.15.12:0/3907112992 shutdown_connections 2024-05-15T16:41:48.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.374+0000 7fb5c22f9640 1 -- 172.21.15.12:0/3907112992 wait complete. 2024-05-15T16:41:48.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.376+0000 7fb5c22f9640 1 Processor -- start 2024-05-15T16:41:48.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.376+0000 7fb5c22f9640 1 -- start start 2024-05-15T16:41:48.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.377+0000 7fb5c22f9640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb5bc06da30 0x7fb5bc14de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:48.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.377+0000 7fb5c22f9640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb5bc06de40 0x7fb5bc14ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:48.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.377+0000 7fb5c22f9640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb5bc151fc0 0x7fb5bc14b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:48.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.377+0000 7fb5c22f9640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fb5bc0a3050 con 0x7fb5bc151fc0 2024-05-15T16:41:48.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.377+0000 7fb5c22f9640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fb5bc0a2ed0 con 0x7fb5bc06da30 2024-05-15T16:41:48.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.377+0000 7fb5c22f9640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fb5bc0bee80 con 0x7fb5bc06de40 2024-05-15T16:41:48.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.377+0000 7fb5c0896640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb5bc151fc0 0x7fb5bc14b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:48.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.377+0000 7fb5c0896640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb5bc151fc0 0x7fb5bc14b580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45882/0 (socket says 172.21.15.12:45882) 2024-05-15T16:41:48.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.377+0000 7fb5c0896640 1 -- 172.21.15.12:0/3948106710 learned_addr learned my addr 172.21.15.12:0/3948106710 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T16:41:48.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.377+0000 7fb5bbfff640 1 --2- 172.21.15.12:0/3948106710 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb5bc06da30 0x7fb5bc14de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:48.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.377+0000 7fb5bb7fe640 1 --2- 172.21.15.12:0/3948106710 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb5bc06de40 0x7fb5bc14ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:48.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.377+0000 7fb5c0896640 1 -- 172.21.15.12:0/3948106710 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb5bc06de40 msgr2=0x7fb5bc14ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:48.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.377+0000 7fb5c0896640 1 --2- 172.21.15.12:0/3948106710 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb5bc06de40 0x7fb5bc14ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:48.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.377+0000 7fb5c0896640 1 -- 172.21.15.12:0/3948106710 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb5bc06da30 msgr2=0x7fb5bc14de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:48.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.377+0000 7fb5c0896640 1 --2- 172.21.15.12:0/3948106710 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb5bc06da30 0x7fb5bc14de80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:48.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.377+0000 7fb5c0896640 1 -- 172.21.15.12:0/3948106710 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5bc14e3c0 con 0x7fb5bc151fc0 2024-05-15T16:41:48.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.378+0000 7fb5c0896640 1 --2- 172.21.15.12:0/3948106710 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb5bc151fc0 0x7fb5bc14b580 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fb5b400c6b0 tx=0x7fb5b400cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T16:41:48.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.378+0000 7fb5b8ff9640 1 -- 172.21.15.12:0/3948106710 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5b4018070 con 0x7fb5bc151fc0 2024-05-15T16:41:48.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.378+0000 7fb5b8ff9640 1 -- 172.21.15.12:0/3948106710 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5b4004da0 con 0x7fb5bc151fc0 2024-05-15T16:41:48.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.378+0000 7fb5c22f9640 1 -- 172.21.15.12:0/3948106710 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5bc14f280 con 0x7fb5bc151fc0 2024-05-15T16:41:48.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.378+0000 7fb5b8ff9640 1 -- 172.21.15.12:0/3948106710 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5b400a880 con 0x7fb5bc151fc0 2024-05-15T16:41:48.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.378+0000 7fb5c22f9640 1 -- 172.21.15.12:0/3948106710 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5bc150f30 con 0x7fb5bc151fc0 2024-05-15T16:41:48.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.379+0000 7fb5c22f9640 1 -- 172.21.15.12:0/3948106710 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5bc050940 con 0x7fb5bc151fc0 2024-05-15T16:41:48.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.380+0000 7fb5b8ff9640 1 -- 172.21.15.12:0/3948106710 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb5b401b070 con 0x7fb5bc151fc0 2024-05-15T16:41:48.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.380+0000 7fb5b8ff9640 1 --2- 172.21.15.12:0/3948106710 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fb5a8076300 0x7fb5a8078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:48.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.380+0000 7fb5b8ff9640 1 -- 172.21.15.12:0/3948106710 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4943+0+0 (secure 0 0 0) 0x7fb5b4096860 con 0x7fb5bc151fc0 2024-05-15T16:41:48.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.380+0000 7fb5bbfff640 1 --2- 172.21.15.12:0/3948106710 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fb5a8076300 0x7fb5a8078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:48.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.381+0000 7fb5bbfff640 1 --2- 172.21.15.12:0/3948106710 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fb5a8076300 0x7fb5a8078810 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fb5b0034000 tx=0x7fb5b002e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T16:41:48.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.385+0000 7fb5b8ff9640 1 -- 172.21.15.12:0/3948106710 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fb5b405fde0 con 0x7fb5bc151fc0 2024-05-15T16:41:48.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.576+0000 7fb5c22f9640 1 -- 172.21.15.12:0/3948106710 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb5bc06eb40 con 0x7fb5bc151fc0 2024-05-15T16:41:48.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.577+0000 7fb5b8ff9640 1 -- 172.21.15.12:0/3948106710 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) ==== 74+0+12980 (secure 0 0 0) 0x7fb5b40640e0 con 0x7fb5bc151fc0 2024-05-15T16:41:48.578 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-05-15T16:41:48.579 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":41,"fsid":"3b7fc4b2-b85c-49b5-a5de-38444eeed40d","created":"2024-05-15T15:39:28.392476+0000","modified":"2024-05-15T15:41:44.686615+0000","last_up_change":"2024-05-15T15:39:39.363983+0000","last_in_change":"2024-05-15T15:39:30.591216+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-15T15:39:40.715999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0d06a12a-866a-418e-9776-704d74354579","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":3943681952},{"type":"v1","addr":"172.21.15.12:6809","nonce":3943681952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":3943681952},{"type":"v1","addr":"172.21.15.12:6812","nonce":3943681952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":3943681952},{"type":"v1","addr":"172.21.15.12:6821","nonce":3943681952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":3943681952},{"type":"v1","addr":"172.21.15.12:6816","nonce":3943681952}]},"public_addr":"172.21.15.12:6809/3943681952","cluster_addr":"172.21.15.12:6812/3943681952","heartbeat_back_addr":"172.21.15.12:6821/3943681952","heartbeat_front_addr":"172.21.15.12:6816/3943681952","state":["exists","up"]},{"osd":1,"uuid":"09d0fa19-9ef8-4f35-bf99-6e86658c6f10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6811","nonce":1763752148},{"type":"v1","addr":"172.21.15.12:6813","nonce":1763752148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":1763752148},{"type":"v1","addr":"172.21.15.12:6817","nonce":1763752148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":1763752148},{"type":"v1","addr":"172.21.15.12:6827","nonce":1763752148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6819","nonce":1763752148},{"type":"v1","addr":"172.21.15.12:6822","nonce":1763752148}]},"public_addr":"172.21.15.12:6813/1763752148","cluster_addr":"172.21.15.12:6817/1763752148","heartbeat_back_addr":"172.21.15.12:6827/1763752148","heartbeat_front_addr":"172.21.15.12:6822/1763752148","state":["exists","up"]},{"osd":2,"uuid":"b204c6ad-f431-40a5-ba27-9844294f0ece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":2173702802},{"type":"v1","addr":"172.21.15.12:6823","nonce":2173702802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":2173702802},{"type":"v1","addr":"172.21.15.12:6826","nonce":2173702802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":2173702802},{"type":"v1","addr":"172.21.15.12:6831","nonce":2173702802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":2173702802},{"type":"v1","addr":"172.21.15.12:6829","nonce":2173702802}]},"public_addr":"172.21.15.12:6823/2173702802","cluster_addr":"172.21.15.12:6826/2173702802","heartbeat_back_addr":"172.21.15.12:6831/2173702802","heartbeat_front_addr":"172.21.15.12:6829/2173702802","state":["exists","up"]},{"osd":3,"uuid":"660a9ccb-2ee5-42d8-8481-0835047a8260","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":3956443113},{"type":"v1","addr":"172.21.15.12:6801","nonce":3956443113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":3956443113},{"type":"v1","addr":"172.21.15.12:6803","nonce":3956443113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":3956443113},{"type":"v1","addr":"172.21.15.12:6807","nonce":3956443113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":3956443113},{"type":"v1","addr":"172.21.15.12:6805","nonce":3956443113}]},"public_addr":"172.21.15.12:6801/3956443113","cluster_addr":"172.21.15.12:6803/3956443113","heartbeat_back_addr":"172.21.15.12:6807/3956443113","heartbeat_front_addr":"172.21.15.12:6805/3956443113","state":["exists","up"]},{"osd":4,"uuid":"9eef1461-a961-457c-9a78-43b5098a46a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":1021092792},{"type":"v1","addr":"172.21.15.84:6809","nonce":1021092792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":1021092792},{"type":"v1","addr":"172.21.15.84:6811","nonce":1021092792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":1021092792},{"type":"v1","addr":"172.21.15.84:6815","nonce":1021092792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":1021092792},{"type":"v1","addr":"172.21.15.84:6813","nonce":1021092792}]},"public_addr":"172.21.15.84:6809/1021092792","cluster_addr":"172.21.15.84:6811/1021092792","heartbeat_back_addr":"172.21.15.84:6815/1021092792","heartbeat_front_addr":"172.21.15.84:6813/1021092792","state":["exists","up"]},{"osd":5,"uuid":"5f924e2f-6c71-4741-a727-d3710c438431","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":3173527851},{"type":"v1","addr":"172.21.15.84:6801","nonce":3173527851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":3173527851},{"type":"v1","addr":"172.21.15.84:6803","nonce":3173527851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":3173527851},{"type":"v1","addr":"172.21.15.84:6807","nonce":3173527851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":3173527851},{"type":"v1","addr":"172.21.15.84:6805","nonce":3173527851}]},"public_addr":"172.21.15.84:6801/3173527851","cluster_addr":"172.21.15.84:6803/3173527851","heartbeat_back_addr":"172.21.15.84:6807/3173527851","heartbeat_front_addr":"172.21.15.84:6805/3173527851","state":["exists","up"]},{"osd":6,"uuid":"efae9975-8c16-4ad3-892f-71f3c59718d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3029180670},{"type":"v1","addr":"172.21.15.84:6817","nonce":3029180670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3029180670},{"type":"v1","addr":"172.21.15.84:6819","nonce":3029180670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3029180670},{"type":"v1","addr":"172.21.15.84:6823","nonce":3029180670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3029180670},{"type":"v1","addr":"172.21.15.84:6821","nonce":3029180670}]},"public_addr":"172.21.15.84:6817/3029180670","cluster_addr":"172.21.15.84:6819/3029180670","heartbeat_back_addr":"172.21.15.84:6823/3029180670","heartbeat_front_addr":"172.21.15.84:6821/3029180670","state":["exists","up"]},{"osd":7,"uuid":"6426efba-ee4d-4e44-83d1-c76c75aec30c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3067620602},{"type":"v1","addr":"172.21.15.84:6825","nonce":3067620602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3067620602},{"type":"v1","addr":"172.21.15.84:6827","nonce":3067620602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":3067620602},{"type":"v1","addr":"172.21.15.84:6831","nonce":3067620602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":3067620602},{"type":"v1","addr":"172.21.15.84:6829","nonce":3067620602}]},"public_addr":"172.21.15.84:6825/3067620602","cluster_addr":"172.21.15.84:6827/3067620602","heartbeat_back_addr":"172.21.15.84:6831/3067620602","heartbeat_front_addr":"172.21.15.84:6829/3067620602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.809514+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.845364+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.762733+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.688597+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.699228+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.747865+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.712415+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T15:39:35.820683+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:6834/32438370":"2024-05-16T15:41:41.678205+0000","172.21.15.12:6832/32438370":"2024-05-16T15:41:41.678205+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-15T16:41:48.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.579+0000 7fb5c22f9640 1 -- 172.21.15.12:0/3948106710 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fb5a8076300 msgr2=0x7fb5a8078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:48.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.579+0000 7fb5c22f9640 1 --2- 172.21.15.12:0/3948106710 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fb5a8076300 0x7fb5a8078810 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fb5b0034000 tx=0x7fb5b002e000 comp rx=0 tx=0).stop 2024-05-15T16:41:48.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.579+0000 7fb5c22f9640 1 -- 172.21.15.12:0/3948106710 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb5bc151fc0 msgr2=0x7fb5bc14b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:48.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.579+0000 7fb5c22f9640 1 --2- 172.21.15.12:0/3948106710 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb5bc151fc0 0x7fb5bc14b580 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fb5b400c6b0 tx=0x7fb5b400cb70 comp rx=0 tx=0).stop 2024-05-15T16:41:48.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.579+0000 7fb5c22f9640 1 -- 172.21.15.12:0/3948106710 shutdown_connections 2024-05-15T16:41:48.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.579+0000 7fb5c22f9640 1 --2- 172.21.15.12:0/3948106710 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fb5a8076300 0x7fb5a8078810 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:48.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.579+0000 7fb5c22f9640 1 --2- 172.21.15.12:0/3948106710 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb5bc151fc0 0x7fb5bc14b580 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:48.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.579+0000 7fb5c22f9640 1 --2- 172.21.15.12:0/3948106710 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb5bc06de40 0x7fb5bc14ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:48.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.579+0000 7fb5c22f9640 1 --2- 172.21.15.12:0/3948106710 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb5bc06da30 0x7fb5bc14de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:48.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.579+0000 7fb5c22f9640 1 -- 172.21.15.12:0/3948106710 >> 172.21.15.12:0/3948106710 conn(0x7fb5bc0c3d20 msgr2=0x7fb5bc0a4ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T16:41:48.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.579+0000 7fb5c22f9640 1 -- 172.21.15.12:0/3948106710 shutdown_connections 2024-05-15T16:41:48.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:48.579+0000 7fb5c22f9640 1 -- 172.21.15.12:0/3948106710 wait complete. 2024-05-15T16:41:49.593 INFO:tasks.ceph:Scrubbing osd.0 2024-05-15T16:41:49.593 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-05-15T16:41:49.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.722+0000 7fa82ea61640 1 Processor -- start 2024-05-15T16:41:49.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.723+0000 7fa82ea61640 1 -- start start 2024-05-15T16:41:49.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.724+0000 7fa82ea61640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa8281455e0 0x7fa8280bfd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:49.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.724+0000 7fa82ea61640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa8280bb970 0x7fa8280740e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:49.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.724+0000 7fa82ea61640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa82814ece0 0x7fa82814f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:49.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.724+0000 7fa82ea61640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fa8280c12a0 con 0x7fa8280bb970 2024-05-15T16:41:49.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.724+0000 7fa82ea61640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7fa8280c02d0 con 0x7fa82814ece0 2024-05-15T16:41:49.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.724+0000 7fa82ea61640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fa82814f630 con 0x7fa8281455e0 2024-05-15T16:41:49.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.724+0000 7fa8277fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa8280bb970 0x7fa8280740e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:49.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.724+0000 7fa8277fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa8280bb970 0x7fa8280740e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45894/0 (socket says 172.21.15.12:45894) 2024-05-15T16:41:49.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.724+0000 7fa8277fe640 1 -- 172.21.15.12:0/1590036876 learned_addr learned my addr 172.21.15.12:0/1590036876 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T16:41:49.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.724+0000 7fa82cffe640 1 --2- 172.21.15.12:0/1590036876 >> v2:172.21.15.84:3300/0 conn(0x7fa82814ece0 0x7fa82814f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:49.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.724+0000 7fa827fff640 1 --2- 172.21.15.12:0/1590036876 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa8281455e0 0x7fa8280bfd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:49.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.724+0000 7fa8277fe640 1 -- 172.21.15.12:0/1590036876 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa8281455e0 msgr2=0x7fa8280bfd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T16:41:49.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.724+0000 7fa8277fe640 1 --2- 172.21.15.12:0/1590036876 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa8281455e0 0x7fa8280bfd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:49.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.724+0000 7fa8277fe640 1 -- 172.21.15.12:0/1590036876 >> v2:172.21.15.84:3300/0 conn(0x7fa82814ece0 msgr2=0x7fa82814f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T16:41:49.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.724+0000 7fa8277fe640 1 --2- 172.21.15.12:0/1590036876 >> v2:172.21.15.84:3300/0 conn(0x7fa82814ece0 0x7fa82814f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:49.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.724+0000 7fa8277fe640 1 -- 172.21.15.12:0/1590036876 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8280bbee0 con 0x7fa8280bb970 2024-05-15T16:41:49.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.724+0000 7fa827fff640 1 --2- 172.21.15.12:0/1590036876 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa8281455e0 0x7fa8280bfd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-15T16:41:49.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.725+0000 7fa8277fe640 1 --2- 172.21.15.12:0/1590036876 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8280bb970 0x7fa8280740e0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fa8280a0180 tx=0x7fa81c02c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf97c04fa949aae8 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T16:41:49.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.725+0000 7fa826ffd640 1 -- 172.21.15.12:0/1590036876 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa81c036020 con 0x7fa8280bb970 2024-05-15T16:41:49.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.725+0000 7fa826ffd640 1 -- 172.21.15.12:0/1590036876 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa81c032820 con 0x7fa8280bb970 2024-05-15T16:41:49.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.725+0000 7fa826ffd640 1 -- 172.21.15.12:0/1590036876 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa81c032bf0 con 0x7fa8280bb970 2024-05-15T16:41:49.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.726+0000 7fa82ea61640 1 -- 172.21.15.12:0/1590036876 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8280bb970 msgr2=0x7fa8280740e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:49.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.726+0000 7fa82ea61640 1 --2- 172.21.15.12:0/1590036876 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8280bb970 0x7fa8280740e0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fa8280a0180 tx=0x7fa81c02c960 comp rx=0 tx=0).stop 2024-05-15T16:41:49.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.726+0000 7fa82ea61640 1 -- 172.21.15.12:0/1590036876 shutdown_connections 2024-05-15T16:41:49.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.726+0000 7fa82ea61640 1 --2- 172.21.15.12:0/1590036876 >> v2:172.21.15.84:3300/0 conn(0x7fa82814ece0 0x7fa82814f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:49.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.726+0000 7fa82ea61640 1 --2- 172.21.15.12:0/1590036876 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8280bb970 0x7fa8280740e0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:49.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.726+0000 7fa82ea61640 1 --2- 172.21.15.12:0/1590036876 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa8281455e0 0x7fa8280bfd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:49.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.726+0000 7fa82ea61640 1 -- 172.21.15.12:0/1590036876 >> 172.21.15.12:0/1590036876 conn(0x7fa8280c05f0 msgr2=0x7fa8280c0a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T16:41:49.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.726+0000 7fa82ea61640 1 -- 172.21.15.12:0/1590036876 shutdown_connections 2024-05-15T16:41:49.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.726+0000 7fa82ea61640 1 -- 172.21.15.12:0/1590036876 wait complete. 2024-05-15T16:41:49.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.728+0000 7fa82ea61640 1 Processor -- start 2024-05-15T16:41:49.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.728+0000 7fa82ea61640 1 -- start start 2024-05-15T16:41:49.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.729+0000 7fa82ea61640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8280bb970 0x7fa8281d68a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:49.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.729+0000 7fa82ea61640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8281455e0 0x7fa8281e34c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:49.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.729+0000 7fa82ea61640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa82814ece0 0x7fa828145e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:49.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.729+0000 7fa82ea61640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa8280bc4a0 con 0x7fa8280bb970 2024-05-15T16:41:49.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.729+0000 7fa82ea61640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa82814e7c0 con 0x7fa8281455e0 2024-05-15T16:41:49.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.729+0000 7fa82ea61640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fa828074620 con 0x7fa82814ece0 2024-05-15T16:41:49.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.729+0000 7fa827fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8280bb970 0x7fa8281d68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:49.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.729+0000 7fa827fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8280bb970 0x7fa8281d68a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45904/0 (socket says 172.21.15.12:45904) 2024-05-15T16:41:49.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.729+0000 7fa827fff640 1 -- 172.21.15.12:0/936111474 learned_addr learned my addr 172.21.15.12:0/936111474 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T16:41:49.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.729+0000 7fa8277fe640 1 --2- 172.21.15.12:0/936111474 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8281455e0 0x7fa8281e34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:49.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.729+0000 7fa82cffe640 1 --2- 172.21.15.12:0/936111474 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa82814ece0 0x7fa828145e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:49.735 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.729+0000 7fa827fff640 1 -- 172.21.15.12:0/936111474 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa82814ece0 msgr2=0x7fa828145e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:49.735 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.729+0000 7fa827fff640 1 --2- 172.21.15.12:0/936111474 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa82814ece0 0x7fa828145e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:49.735 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.729+0000 7fa827fff640 1 -- 172.21.15.12:0/936111474 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8281455e0 msgr2=0x7fa8281e34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:49.735 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.729+0000 7fa827fff640 1 --2- 172.21.15.12:0/936111474 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8281455e0 0x7fa8281e34c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:49.735 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.729+0000 7fa827fff640 1 -- 172.21.15.12:0/936111474 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8281d6de0 con 0x7fa8280bb970 2024-05-15T16:41:49.735 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.729+0000 7fa8277fe640 1 --2- 172.21.15.12:0/936111474 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8281455e0 0x7fa8281e34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-15T16:41:49.735 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.729+0000 7fa827fff640 1 --2- 172.21.15.12:0/936111474 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8280bb970 0x7fa8281d68a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fa81800d800 tx=0x7fa81800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T16:41:49.735 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.730+0000 7fa824ff9640 1 -- 172.21.15.12:0/936111474 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa818018030 con 0x7fa8280bb970 2024-05-15T16:41:49.736 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.730+0000 7fa824ff9640 1 -- 172.21.15.12:0/936111474 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa818009640 con 0x7fa8280bb970 2024-05-15T16:41:49.736 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.730+0000 7fa82ea61640 1 -- 172.21.15.12:0/936111474 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8281d5800 con 0x7fa8280bb970 2024-05-15T16:41:49.736 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.730+0000 7fa824ff9640 1 -- 172.21.15.12:0/936111474 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa818009810 con 0x7fa8280bb970 2024-05-15T16:41:49.736 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.730+0000 7fa82ea61640 1 -- 172.21.15.12:0/936111474 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8281463c0 con 0x7fa8280bb970 2024-05-15T16:41:49.736 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.731+0000 7fa82ea61640 1 -- 172.21.15.12:0/936111474 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa828050940 con 0x7fa8280bb970 2024-05-15T16:41:49.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.732+0000 7fa824ff9640 1 -- 172.21.15.12:0/936111474 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa81801b070 con 0x7fa8280bb970 2024-05-15T16:41:49.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.732+0000 7fa824ff9640 1 --2- 172.21.15.12:0/936111474 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fa8140762d0 0x7fa8140787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:49.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.732+0000 7fa824ff9640 1 -- 172.21.15.12:0/936111474 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4943+0+0 (secure 0 0 0) 0x7fa818097c10 con 0x7fa8280bb970 2024-05-15T16:41:49.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.732+0000 7fa8277fe640 1 --2- 172.21.15.12:0/936111474 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fa8140762d0 0x7fa8140787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:49.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.732+0000 7fa824ff9640 1 --2- 172.21.15.12:0/936111474 >> [v2:172.21.15.12:6808/3943681952,v1:172.21.15.12:6809/3943681952] conn(0x7fa81407c1e0 0x7fa81407e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:49.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.732+0000 7fa824ff9640 1 -- 172.21.15.12:0/936111474 --> [v2:172.21.15.12:6808/3943681952,v1:172.21.15.12:6809/3943681952] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa818001d30 con 0x7fa81407c1e0 2024-05-15T16:41:49.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.732+0000 7fa824ff9640 1 -- 172.21.15.12:0/936111474 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7fa8180980a0 con 0x7fa8280bb970 2024-05-15T16:41:49.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.732+0000 7fa82cffe640 1 --2- 172.21.15.12:0/936111474 >> [v2:172.21.15.12:6808/3943681952,v1:172.21.15.12:6809/3943681952] conn(0x7fa81407c1e0 0x7fa81407e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:49.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.733+0000 7fa82cffe640 1 --2- 172.21.15.12:0/936111474 >> [v2:172.21.15.12:6808/3943681952,v1:172.21.15.12:6809/3943681952] conn(0x7fa81407c1e0 0x7fa81407e630 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T16:41:49.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.733+0000 7fa8277fe640 1 --2- 172.21.15.12:0/936111474 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fa8140762d0 0x7fa8140787e0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fa81c037000 tx=0x7fa81c032000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T16:41:49.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.734+0000 7fa824ff9640 1 -- 172.21.15.12:0/936111474 <== osd.0 v2:172.21.15.12:6808/3943681952 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa818001d30 con 0x7fa81407c1e0 2024-05-15T16:41:49.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.747+0000 7fa82ea61640 1 -- 172.21.15.12:0/936111474 --> [v2:172.21.15.12:6808/3943681952,v1:172.21.15.12:6809/3943681952] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fa8280bf6b0 con 0x7fa81407c1e0 2024-05-15T16:41:49.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.747+0000 7fa824ff9640 1 -- 172.21.15.12:0/936111474 <== osd.0 v2:172.21.15.12:6808/3943681952 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fa8280bf6b0 con 0x7fa81407c1e0 2024-05-15T16:41:49.749 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-05-15T16:41:49.749 INFO:teuthology.orchestra.run.smithi012.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-15T16:41:49.749 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-05-15T16:41:49.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.747+0000 7fa82ea61640 1 -- 172.21.15.12:0/936111474 >> [v2:172.21.15.12:6808/3943681952,v1:172.21.15.12:6809/3943681952] conn(0x7fa81407c1e0 msgr2=0x7fa81407e630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:49.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.747+0000 7fa82ea61640 1 --2- 172.21.15.12:0/936111474 >> [v2:172.21.15.12:6808/3943681952,v1:172.21.15.12:6809/3943681952] conn(0x7fa81407c1e0 0x7fa81407e630 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:49.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.747+0000 7fa82ea61640 1 -- 172.21.15.12:0/936111474 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fa8140762d0 msgr2=0x7fa8140787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:49.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.747+0000 7fa82ea61640 1 --2- 172.21.15.12:0/936111474 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fa8140762d0 0x7fa8140787e0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fa81c037000 tx=0x7fa81c032000 comp rx=0 tx=0).stop 2024-05-15T16:41:49.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.747+0000 7fa82ea61640 1 -- 172.21.15.12:0/936111474 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8280bb970 msgr2=0x7fa8281d68a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:49.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.747+0000 7fa82ea61640 1 --2- 172.21.15.12:0/936111474 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8280bb970 0x7fa8281d68a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fa81800d800 tx=0x7fa81800dcc0 comp rx=0 tx=0).stop 2024-05-15T16:41:49.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.747+0000 7fa82cffe640 1 -- 172.21.15.12:0/936111474 reap_dead start 2024-05-15T16:41:49.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.748+0000 7fa82ea61640 1 -- 172.21.15.12:0/936111474 shutdown_connections 2024-05-15T16:41:49.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.748+0000 7fa82ea61640 1 -- 172.21.15.12:0/936111474 >> 172.21.15.12:0/936111474 conn(0x7fa8280c05f0 msgr2=0x7fa8280ba810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T16:41:49.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.748+0000 7fa82ea61640 1 -- 172.21.15.12:0/936111474 shutdown_connections 2024-05-15T16:41:49.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.748+0000 7fa82ea61640 1 -- 172.21.15.12:0/936111474 wait complete. 2024-05-15T16:41:49.759 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-05-15T16:41:49.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.870+0000 7f55d7535640 1 Processor -- start 2024-05-15T16:41:49.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.870+0000 7f55d7535640 1 -- start start 2024-05-15T16:41:49.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.871+0000 7f55d7535640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f55d00b8d70 0x7f55d00b9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:49.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.871+0000 7f55d7535640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55d014ece0 con 0x7f55d00bd440 2024-05-15T16:41:49.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.871+0000 7f55d7535640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55d014efc0 con 0x7f55d014e530 2024-05-15T16:41:49.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.871+0000 7f55d7535640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f55d00b88e0 con 0x7f55d00b8d70 2024-05-15T16:41:49.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.872+0000 7f55d4ad0640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f55d00bd440 0x7f55d00bd850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:53950/0 (socket says 172.21.15.12:53950) 2024-05-15T16:41:49.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.872+0000 7f55d4ad0640 1 -- 172.21.15.12:0/2260169722 learned_addr learned my addr 172.21.15.12:0/2260169722 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-05-15T16:41:49.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.872+0000 7f55d5ad2640 1 --2- 172.21.15.12:0/2260169722 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f55d00b8d70 0x7f55d00b9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:49.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.872+0000 7f55cffff640 1 -- 172.21.15.12:0/2260169722 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3877006027 0 0) 0x7f55d014ece0 con 0x7f55d00bd440 2024-05-15T16:41:49.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.872+0000 7f55cffff640 1 -- 172.21.15.12:0/2260169722 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f55b8003520 con 0x7f55d00bd440 2024-05-15T16:41:49.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.872+0000 7f55cffff640 1 -- 172.21.15.12:0/2260169722 <== mon.1 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3606092263 0 0) 0x7f55d014efc0 con 0x7f55d014e530 2024-05-15T16:41:49.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.872+0000 7f55cffff640 1 -- 172.21.15.12:0/2260169722 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f55d014ece0 con 0x7f55d014e530 2024-05-15T16:41:49.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.872+0000 7f55cffff640 1 -- 172.21.15.12:0/2260169722 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1683710478 0 0) 0x7f55b8003520 con 0x7f55d00bd440 2024-05-15T16:41:49.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.872+0000 7f55cffff640 1 -- 172.21.15.12:0/2260169722 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f55d00b8d70 msgr2=0x7f55d00b9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T16:41:49.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.872+0000 7f55cffff640 1 --2- 172.21.15.12:0/2260169722 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f55d00b8d70 0x7f55d00b9180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:49.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.872+0000 7f55cffff640 1 -- 172.21.15.12:0/2260169722 >> v1:172.21.15.84:6789/0 conn(0x7f55d014e530 legacy=0x7f55d00ba320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:49.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.872+0000 7f55cffff640 1 -- 172.21.15.12:0/2260169722 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55d014f2a0 con 0x7f55d00bd440 2024-05-15T16:41:49.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.872+0000 7f55cffff640 1 -- 172.21.15.12:0/2260169722 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 38171736 0 0) 0x7f55c40016f0 con 0x7f55d00bd440 2024-05-15T16:41:49.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.872+0000 7f55d5ad2640 1 --2- 172.21.15.12:0/2260169722 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f55d00b8d70 0x7f55d00b9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-15T16:41:49.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.872+0000 7f55cffff640 1 -- 172.21.15.12:0/2260169722 >> v1:172.21.15.12:6789/0 conn(0x7f55d00bd440 legacy=0x7f55d00bd850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:49.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.872+0000 7f55cffff640 1 --2- 172.21.15.12:0/2260169722 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55b8003c10 0x7f55b8004060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:49.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.872+0000 7f55cffff640 1 --2- 172.21.15.12:0/2260169722 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f55d00b8d70 0x7f55b8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:49.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.872+0000 7f55cffff640 1 --2- 172.21.15.12:0/2260169722 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55b8004d40 0x7f55b8005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:49.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.872+0000 7f55cffff640 1 -- 172.21.15.12:0/2260169722 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f55d00b88e0 con 0x7f55b8004d40 2024-05-15T16:41:49.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.872+0000 7f55cffff640 1 -- 172.21.15.12:0/2260169722 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f55b800bb70 con 0x7f55b8003c10 2024-05-15T16:41:49.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.872+0000 7f55cffff640 1 -- 172.21.15.12:0/2260169722 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f55b800bd70 con 0x7f55d00b8d70 2024-05-15T16:41:49.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.872+0000 7f55d5ad2640 1 --2- 172.21.15.12:0/2260169722 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55b8004d40 0x7f55b8005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:49.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.872+0000 7f55d4ad0640 1 --2- 172.21.15.12:0/2260169722 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f55d00b8d70 0x7f55b8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:49.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.872+0000 7f55d52d1640 1 --2- 172.21.15.12:0/2260169722 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55b8003c10 0x7f55b8004060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:49.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.873+0000 7f55d5ad2640 1 -- 172.21.15.12:0/2260169722 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f55d00b8d70 msgr2=0x7f55b8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T16:41:49.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.873+0000 7f55d5ad2640 1 --2- 172.21.15.12:0/2260169722 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f55d00b8d70 0x7f55b8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:49.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.873+0000 7f55d5ad2640 1 -- 172.21.15.12:0/2260169722 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55b8003c10 msgr2=0x7f55b8004060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T16:41:49.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.873+0000 7f55d5ad2640 1 --2- 172.21.15.12:0/2260169722 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55b8003c10 0x7f55b8004060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:49.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.873+0000 7f55d5ad2640 1 -- 172.21.15.12:0/2260169722 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55b8003520 con 0x7f55b8004d40 2024-05-15T16:41:49.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.873+0000 7f55d5ad2640 1 --2- 172.21.15.12:0/2260169722 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55b8004d40 0x7f55b8005210 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f55d008db20 tx=0x7f55b8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46cb7fe919488391 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T16:41:49.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.873+0000 7f55cffff640 1 -- 172.21.15.12:0/2260169722 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55c0033070 con 0x7f55b8004d40 2024-05-15T16:41:49.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.874+0000 7f55cffff640 1 -- 172.21.15.12:0/2260169722 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55c0003b90 con 0x7f55b8004d40 2024-05-15T16:41:49.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.874+0000 7f55cffff640 1 -- 172.21.15.12:0/2260169722 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55c0009de0 con 0x7f55b8004d40 2024-05-15T16:41:49.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.874+0000 7f55d7535640 1 -- 172.21.15.12:0/2260169722 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55b8004d40 msgr2=0x7f55b8005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:49.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.874+0000 7f55d7535640 1 --2- 172.21.15.12:0/2260169722 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55b8004d40 0x7f55b8005210 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f55d008db20 tx=0x7f55b8005830 comp rx=0 tx=0).stop 2024-05-15T16:41:49.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.874+0000 7f55d5ad2640 1 -- 172.21.15.12:0/2260169722 reap_dead start 2024-05-15T16:41:49.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.874+0000 7f55d7535640 1 -- 172.21.15.12:0/2260169722 shutdown_connections 2024-05-15T16:41:49.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.874+0000 7f55d7535640 1 -- 172.21.15.12:0/2260169722 >> 172.21.15.12:0/2260169722 conn(0x7f55d00c0570 msgr2=0x7f55d00c0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T16:41:49.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.874+0000 7f55d7535640 1 -- 172.21.15.12:0/2260169722 shutdown_connections 2024-05-15T16:41:49.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.874+0000 7f55d7535640 1 -- 172.21.15.12:0/2260169722 wait complete. 2024-05-15T16:41:49.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.876+0000 7f55d7535640 1 Processor -- start 2024-05-15T16:41:49.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.876+0000 7f55d7535640 1 -- start start 2024-05-15T16:41:49.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.877+0000 7f55d7535640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f55b8004d40 0x7f55d014b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:49.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.877+0000 7f55d7535640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55d01e4760 0x7f55d0141560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:49.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.877+0000 7f55d7535640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55d01e7ae0 0x7f55d01e7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:49.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.877+0000 7f55d7535640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f55d014eac0 con 0x7f55d01e7ae0 2024-05-15T16:41:49.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.877+0000 7f55d7535640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f55d014e940 con 0x7f55d01e4760 2024-05-15T16:41:49.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.877+0000 7f55d7535640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f55d00bb6d0 con 0x7f55b8004d40 2024-05-15T16:41:49.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.877+0000 7f55d5ad2640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55d01e7ae0 0x7f55d01e7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:49.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.877+0000 7f55d5ad2640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55d01e7ae0 0x7f55d01e7ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45924/0 (socket says 172.21.15.12:45924) 2024-05-15T16:41:49.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.877+0000 7f55d5ad2640 1 -- 172.21.15.12:0/3737593745 learned_addr learned my addr 172.21.15.12:0/3737593745 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T16:41:49.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.877+0000 7f55d4ad0640 1 --2- 172.21.15.12:0/3737593745 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55d01e4760 0x7f55d0141560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:49.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.877+0000 7f55d52d1640 1 --2- 172.21.15.12:0/3737593745 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f55b8004d40 0x7f55d014b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:49.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.877+0000 7f55d5ad2640 1 -- 172.21.15.12:0/3737593745 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f55b8004d40 msgr2=0x7f55d014b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:49.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.877+0000 7f55d5ad2640 1 --2- 172.21.15.12:0/3737593745 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f55b8004d40 0x7f55d014b5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:49.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.877+0000 7f55d5ad2640 1 -- 172.21.15.12:0/3737593745 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55d01e4760 msgr2=0x7f55d0141560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:49.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.877+0000 7f55d5ad2640 1 --2- 172.21.15.12:0/3737593745 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55d01e4760 0x7f55d0141560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:49.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.877+0000 7f55d5ad2640 1 -- 172.21.15.12:0/3737593745 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55d0140fb0 con 0x7f55d01e7ae0 2024-05-15T16:41:49.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.877+0000 7f55d4ad0640 1 --2- 172.21.15.12:0/3737593745 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55d01e4760 0x7f55d0141560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-15T16:41:49.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.877+0000 7f55d52d1640 1 --2- 172.21.15.12:0/3737593745 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f55b8004d40 0x7f55d014b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-15T16:41:49.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.878+0000 7f55d5ad2640 1 --2- 172.21.15.12:0/3737593745 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55d01e7ae0 0x7f55d01e7ef0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f55c002b010 tx=0x7f55c0009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T16:41:49.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.878+0000 7f55cdffb640 1 -- 172.21.15.12:0/3737593745 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55c0033040 con 0x7f55d01e7ae0 2024-05-15T16:41:49.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.878+0000 7f55cdffb640 1 -- 172.21.15.12:0/3737593745 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55c0009a50 con 0x7f55d01e7ae0 2024-05-15T16:41:49.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.878+0000 7f55cdffb640 1 -- 172.21.15.12:0/3737593745 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55c0042410 con 0x7f55d01e7ae0 2024-05-15T16:41:49.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.878+0000 7f55d7535640 1 -- 172.21.15.12:0/3737593745 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55d013fb80 con 0x7f55d01e7ae0 2024-05-15T16:41:49.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.878+0000 7f55d7535640 1 -- 172.21.15.12:0/3737593745 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55d0140140 con 0x7f55d01e7ae0 2024-05-15T16:41:49.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.879+0000 7f55d7535640 1 -- 172.21.15.12:0/3737593745 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55d0141340 con 0x7f55d01e7ae0 2024-05-15T16:41:49.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.880+0000 7f55cdffb640 1 -- 172.21.15.12:0/3737593745 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f55c0040030 con 0x7f55d01e7ae0 2024-05-15T16:41:49.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.880+0000 7f55cdffb640 1 --2- 172.21.15.12:0/3737593745 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f55bc076300 0x7f55bc078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:49.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.880+0000 7f55cdffb640 1 -- 172.21.15.12:0/3737593745 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4943+0+0 (secure 0 0 0) 0x7f55c00b7680 con 0x7f55d01e7ae0 2024-05-15T16:41:49.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.880+0000 7f55d52d1640 1 --2- 172.21.15.12:0/3737593745 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f55bc076300 0x7f55bc078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:49.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.881+0000 7f55d52d1640 1 --2- 172.21.15.12:0/3737593745 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f55bc076300 0x7f55bc078810 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f55c8007fd0 tx=0x7f55c8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T16:41:49.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:49.885+0000 7f55cdffb640 1 -- 172.21.15.12:0/3737593745 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f55c0047030 con 0x7f55d01e7ae0 2024-05-15T16:41:50.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.074+0000 7f55d7535640 1 -- 172.21.15.12:0/3737593745 --> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f55d00bcbe0 con 0x7f55bc076300 2024-05-15T16:41:50.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.075+0000 7f55cdffb640 1 -- 172.21.15.12:0/3737593745 <== mgr.4106 v2:172.21.15.84:6832/4173299311 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f55d00bcbe0 con 0x7f55bc076300 2024-05-15T16:41:50.076 INFO:teuthology.orchestra.run.smithi012.stderr:instructed osd(s) 0 to deep-scrub 2024-05-15T16:41:50.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.077+0000 7f55d7535640 1 -- 172.21.15.12:0/3737593745 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f55bc076300 msgr2=0x7f55bc078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:50.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.077+0000 7f55d7535640 1 --2- 172.21.15.12:0/3737593745 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f55bc076300 0x7f55bc078810 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f55c8007fd0 tx=0x7f55c8009040 comp rx=0 tx=0).stop 2024-05-15T16:41:50.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.077+0000 7f55d7535640 1 -- 172.21.15.12:0/3737593745 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55d01e7ae0 msgr2=0x7f55d01e7ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:50.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.077+0000 7f55d7535640 1 --2- 172.21.15.12:0/3737593745 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55d01e7ae0 0x7f55d01e7ef0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f55c002b010 tx=0x7f55c0009750 comp rx=0 tx=0).stop 2024-05-15T16:41:50.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.077+0000 7f55d7535640 1 -- 172.21.15.12:0/3737593745 shutdown_connections 2024-05-15T16:41:50.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.077+0000 7f55d7535640 1 --2- 172.21.15.12:0/3737593745 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f55bc076300 0x7f55bc078810 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:50.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.077+0000 7f55d7535640 1 --2- 172.21.15.12:0/3737593745 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55d01e7ae0 0x7f55d01e7ef0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:50.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.077+0000 7f55d7535640 1 --2- 172.21.15.12:0/3737593745 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55d01e4760 0x7f55d0141560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:50.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.077+0000 7f55d7535640 1 --2- 172.21.15.12:0/3737593745 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f55b8004d40 0x7f55d014b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:50.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.077+0000 7f55d7535640 1 -- 172.21.15.12:0/3737593745 >> 172.21.15.12:0/3737593745 conn(0x7f55d00c0570 msgr2=0x7f55d0073e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T16:41:50.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.077+0000 7f55d7535640 1 -- 172.21.15.12:0/3737593745 shutdown_connections 2024-05-15T16:41:50.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.077+0000 7f55d7535640 1 -- 172.21.15.12:0/3737593745 wait complete. 2024-05-15T16:41:50.089 INFO:tasks.ceph:Scrubbing osd.1 2024-05-15T16:41:50.089 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-05-15T16:41:50.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.204+0000 7f61e2386640 1 Processor -- start 2024-05-15T16:41:50.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.204+0000 7f61e2386640 1 -- start start 2024-05-15T16:41:50.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.205+0000 7f61e2386640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f61dc148910 0x7f61dc14e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:50.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.205+0000 7f61e2386640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f61dc14eba0 0x7f61dc158db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:50.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.205+0000 7f61e2386640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61dc0ba800 con 0x7f61dc0a9060 2024-05-15T16:41:50.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.205+0000 7f61e2386640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f61dc0b8a30 con 0x7f61dc148910 2024-05-15T16:41:50.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.205+0000 7f61e2386640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f61dc0b8d10 con 0x7f61dc14eba0 2024-05-15T16:41:50.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.205+0000 7f61db7fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f61dc148910 0x7f61dc14e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:50.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.205+0000 7f61dbfff640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f61dc0a9060 0x7f61dc0ba0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:53960/0 (socket says 172.21.15.12:53960) 2024-05-15T16:41:50.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.205+0000 7f61dbfff640 1 -- 172.21.15.12:0/3839209722 learned_addr learned my addr 172.21.15.12:0/3839209722 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-05-15T16:41:50.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.205+0000 7f61e0923640 1 --2- 172.21.15.12:0/3839209722 >> v2:172.21.15.84:3300/0 conn(0x7f61dc14eba0 0x7f61dc158db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:50.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.205+0000 7f61db7fe640 1 -- 172.21.15.12:0/3839209722 >> v2:172.21.15.84:3300/0 conn(0x7f61dc14eba0 msgr2=0x7f61dc158db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T16:41:50.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.205+0000 7f61db7fe640 1 --2- 172.21.15.12:0/3839209722 >> v2:172.21.15.84:3300/0 conn(0x7f61dc14eba0 0x7f61dc158db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:50.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.205+0000 7f61db7fe640 1 -- 172.21.15.12:0/3839209722 >> v1:172.21.15.12:6789/0 conn(0x7f61dc0a9060 legacy=0x7f61dc0ba0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:50.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.205+0000 7f61daffd640 1 -- 172.21.15.12:0/3839209722 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1548490119 0 0) 0x7f61cc001110 con 0x7f61dc0a9060 2024-05-15T16:41:50.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.205+0000 7f61db7fe640 1 -- 172.21.15.12:0/3839209722 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61dc0b8ff0 con 0x7f61dc148910 2024-05-15T16:41:50.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.206+0000 7f61db7fe640 1 --2- 172.21.15.12:0/3839209722 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f61dc148910 0x7f61dc14e660 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f61dc0a9470 tx=0x7f61d002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de3a2808ff4fa20a server_cookie=0 in_seq=0 out_seq=0 2024-05-15T16:41:50.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.206+0000 7f61daffd640 1 -- 172.21.15.12:0/3839209722 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61d0037070 con 0x7f61dc148910 2024-05-15T16:41:50.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.206+0000 7f61daffd640 1 -- 172.21.15.12:0/3839209722 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61d0032440 con 0x7f61dc148910 2024-05-15T16:41:50.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.206+0000 7f61daffd640 1 -- 172.21.15.12:0/3839209722 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61d0032810 con 0x7f61dc148910 2024-05-15T16:41:50.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.207+0000 7f61e2386640 1 -- 172.21.15.12:0/3839209722 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f61dc148910 msgr2=0x7f61dc14e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:50.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.207+0000 7f61e2386640 1 --2- 172.21.15.12:0/3839209722 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f61dc148910 0x7f61dc14e660 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f61dc0a9470 tx=0x7f61d002a230 comp rx=0 tx=0).stop 2024-05-15T16:41:50.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.207+0000 7f61e2386640 1 -- 172.21.15.12:0/3839209722 shutdown_connections 2024-05-15T16:41:50.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.207+0000 7f61e2386640 1 --2- 172.21.15.12:0/3839209722 >> v2:172.21.15.84:3300/0 conn(0x7f61dc14eba0 0x7f61dc158db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:50.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.207+0000 7f61e2386640 1 --2- 172.21.15.12:0/3839209722 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f61dc148910 0x7f61dc14e660 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:50.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.207+0000 7f61e2386640 1 -- 172.21.15.12:0/3839209722 >> 172.21.15.12:0/3839209722 conn(0x7f61dc0c07c0 msgr2=0x7f61dc0c0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T16:41:50.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.207+0000 7f61e2386640 1 -- 172.21.15.12:0/3839209722 shutdown_connections 2024-05-15T16:41:50.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.207+0000 7f61e2386640 1 -- 172.21.15.12:0/3839209722 wait complete. 2024-05-15T16:41:50.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.208+0000 7f61e2386640 1 Processor -- start 2024-05-15T16:41:50.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.209+0000 7f61e2386640 1 -- start start 2024-05-15T16:41:50.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.210+0000 7f61e2386640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61dc0a9060 0x7f61dc13e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:50.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.210+0000 7f61e2386640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f61dc148910 0x7f61dc1d91f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:50.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.210+0000 7f61e2386640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f61dc14eba0 0x7f61dc0c1a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:50.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.210+0000 7f61e2386640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f61dc08d400 con 0x7f61dc14eba0 2024-05-15T16:41:50.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.210+0000 7f61e2386640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f61dc14efb0 con 0x7f61dc0a9060 2024-05-15T16:41:50.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.210+0000 7f61e2386640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f61dc08d580 con 0x7f61dc148910 2024-05-15T16:41:50.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.210+0000 7f61e0923640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f61dc14eba0 0x7f61dc0c1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:50.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.210+0000 7f61e0923640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f61dc14eba0 0x7f61dc0c1a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45944/0 (socket says 172.21.15.12:45944) 2024-05-15T16:41:50.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.210+0000 7f61e0923640 1 -- 172.21.15.12:0/2098394047 learned_addr learned my addr 172.21.15.12:0/2098394047 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T16:41:50.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.210+0000 7f61dbfff640 1 --2- 172.21.15.12:0/2098394047 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61dc0a9060 0x7f61dc13e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:50.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.210+0000 7f61db7fe640 1 --2- 172.21.15.12:0/2098394047 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f61dc148910 0x7f61dc1d91f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:50.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.210+0000 7f61e0923640 1 -- 172.21.15.12:0/2098394047 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f61dc148910 msgr2=0x7f61dc1d91f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:50.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.210+0000 7f61e0923640 1 --2- 172.21.15.12:0/2098394047 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f61dc148910 0x7f61dc1d91f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:50.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.210+0000 7f61e0923640 1 -- 172.21.15.12:0/2098394047 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61dc0a9060 msgr2=0x7f61dc13e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:50.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.210+0000 7f61e0923640 1 --2- 172.21.15.12:0/2098394047 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61dc0a9060 0x7f61dc13e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:50.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.210+0000 7f61e0923640 1 -- 172.21.15.12:0/2098394047 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61dc1d9730 con 0x7f61dc14eba0 2024-05-15T16:41:50.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.210+0000 7f61e0923640 1 --2- 172.21.15.12:0/2098394047 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f61dc14eba0 0x7f61dc0c1a30 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f61d4009fd0 tx=0x7f61d400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T16:41:50.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.211+0000 7f61d8ff9640 1 -- 172.21.15.12:0/2098394047 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61d4014420 con 0x7f61dc14eba0 2024-05-15T16:41:50.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.211+0000 7f61d8ff9640 1 -- 172.21.15.12:0/2098394047 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61d4019070 con 0x7f61dc14eba0 2024-05-15T16:41:50.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.211+0000 7f61d8ff9640 1 -- 172.21.15.12:0/2098394047 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61d4014800 con 0x7f61dc14eba0 2024-05-15T16:41:50.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.211+0000 7f61e2386640 1 -- 172.21.15.12:0/2098394047 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61dc1438a0 con 0x7f61dc14eba0 2024-05-15T16:41:50.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.211+0000 7f61e2386640 1 -- 172.21.15.12:0/2098394047 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61dc1d9940 con 0x7f61dc14eba0 2024-05-15T16:41:50.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.212+0000 7f61e2386640 1 -- 172.21.15.12:0/2098394047 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f61dc13e7d0 con 0x7f61dc14eba0 2024-05-15T16:41:50.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.212+0000 7f61d8ff9640 1 -- 172.21.15.12:0/2098394047 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f61d40149a0 con 0x7f61dc14eba0 2024-05-15T16:41:50.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.213+0000 7f61d8ff9640 1 --2- 172.21.15.12:0/2098394047 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f61c8076300 0x7f61c8078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:50.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.213+0000 7f61d8ff9640 1 -- 172.21.15.12:0/2098394047 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4943+0+0 (secure 0 0 0) 0x7f61d4098390 con 0x7f61dc14eba0 2024-05-15T16:41:50.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.213+0000 7f61d8ff9640 1 --2- 172.21.15.12:0/2098394047 >> [v2:172.21.15.12:6811/1763752148,v1:172.21.15.12:6813/1763752148] conn(0x7f61c807c210 0x7f61c807e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:50.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.213+0000 7f61d8ff9640 1 -- 172.21.15.12:0/2098394047 --> [v2:172.21.15.12:6811/1763752148,v1:172.21.15.12:6813/1763752148] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f61c807ed30 con 0x7f61c807c210 2024-05-15T16:41:50.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.213+0000 7f61d8ff9640 1 -- 172.21.15.12:0/2098394047 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f61d4098820 con 0x7f61dc14eba0 2024-05-15T16:41:50.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.213+0000 7f61dbfff640 1 --2- 172.21.15.12:0/2098394047 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f61c8076300 0x7f61c8078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:50.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.213+0000 7f61db7fe640 1 --2- 172.21.15.12:0/2098394047 >> [v2:172.21.15.12:6811/1763752148,v1:172.21.15.12:6813/1763752148] conn(0x7f61c807c210 0x7f61c807e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:50.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.214+0000 7f61db7fe640 1 --2- 172.21.15.12:0/2098394047 >> [v2:172.21.15.12:6811/1763752148,v1:172.21.15.12:6813/1763752148] conn(0x7f61c807c210 0x7f61c807e660 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T16:41:50.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.214+0000 7f61dbfff640 1 --2- 172.21.15.12:0/2098394047 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f61c8076300 0x7f61c8078810 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f61cc007fd0 tx=0x7f61cc007de0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T16:41:50.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.214+0000 7f61d8ff9640 1 -- 172.21.15.12:0/2098394047 <== osd.1 v2:172.21.15.12:6811/1763752148 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f61c807ed30 con 0x7f61c807c210 2024-05-15T16:41:50.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.227+0000 7f61e2386640 1 -- 172.21.15.12:0/2098394047 --> [v2:172.21.15.12:6811/1763752148,v1:172.21.15.12:6813/1763752148] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f61dc1d9be0 con 0x7f61c807c210 2024-05-15T16:41:50.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.228+0000 7f61d8ff9640 1 -- 172.21.15.12:0/2098394047 <== osd.1 v2:172.21.15.12:6811/1763752148 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f61dc1d9be0 con 0x7f61c807c210 2024-05-15T16:41:50.229 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-05-15T16:41:50.229 INFO:teuthology.orchestra.run.smithi012.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-15T16:41:50.229 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-05-15T16:41:50.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.228+0000 7f61e2386640 1 -- 172.21.15.12:0/2098394047 >> [v2:172.21.15.12:6811/1763752148,v1:172.21.15.12:6813/1763752148] conn(0x7f61c807c210 msgr2=0x7f61c807e660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:50.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.228+0000 7f61e2386640 1 --2- 172.21.15.12:0/2098394047 >> [v2:172.21.15.12:6811/1763752148,v1:172.21.15.12:6813/1763752148] conn(0x7f61c807c210 0x7f61c807e660 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:50.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.228+0000 7f61e2386640 1 -- 172.21.15.12:0/2098394047 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f61c8076300 msgr2=0x7f61c8078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:50.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.228+0000 7f61e2386640 1 --2- 172.21.15.12:0/2098394047 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f61c8076300 0x7f61c8078810 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f61cc007fd0 tx=0x7f61cc007de0 comp rx=0 tx=0).stop 2024-05-15T16:41:50.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.228+0000 7f61e2386640 1 -- 172.21.15.12:0/2098394047 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f61dc14eba0 msgr2=0x7f61dc0c1a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:50.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.228+0000 7f61e2386640 1 --2- 172.21.15.12:0/2098394047 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f61dc14eba0 0x7f61dc0c1a30 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f61d4009fd0 tx=0x7f61d400e4b0 comp rx=0 tx=0).stop 2024-05-15T16:41:50.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.228+0000 7f61e0923640 1 -- 172.21.15.12:0/2098394047 reap_dead start 2024-05-15T16:41:50.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.228+0000 7f61e2386640 1 -- 172.21.15.12:0/2098394047 shutdown_connections 2024-05-15T16:41:50.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.228+0000 7f61e2386640 1 -- 172.21.15.12:0/2098394047 >> 172.21.15.12:0/2098394047 conn(0x7f61dc0c07c0 msgr2=0x7f61dc146bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T16:41:50.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.228+0000 7f61e2386640 1 -- 172.21.15.12:0/2098394047 shutdown_connections 2024-05-15T16:41:50.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.228+0000 7f61e2386640 1 -- 172.21.15.12:0/2098394047 wait complete. 2024-05-15T16:41:50.240 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-05-15T16:41:50.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.350+0000 7f0ae10d1640 1 Processor -- start 2024-05-15T16:41:50.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.350+0000 7f0ae10d1640 1 -- start start 2024-05-15T16:41:50.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.352+0000 7f0ae10d1640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0adc14e530 0x7f0adc0ba320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:50.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.352+0000 7f0ae10d1640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f0adc0bd440 0x7f0adc0bd850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:50.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.352+0000 7f0ae10d1640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0adc0ba860 con 0x7f0adc0b8d70 2024-05-15T16:41:50.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.352+0000 7f0ae10d1640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f0adc0b88e0 con 0x7f0adc14e530 2024-05-15T16:41:50.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.352+0000 7f0ae10d1640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f0adc14ece0 con 0x7f0adc0bd440 2024-05-15T16:41:50.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.352+0000 7f0adad9d640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0adc14e530 0x7f0adc0ba320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:50.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.352+0000 7f0adad9d640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0adc14e530 0x7f0adc0ba320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45954/0 (socket says 172.21.15.12:45954) 2024-05-15T16:41:50.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.352+0000 7f0adad9d640 1 -- 172.21.15.12:0/3262955589 learned_addr learned my addr 172.21.15.12:0/3262955589 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T16:41:50.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.352+0000 7f0ada59c640 1 --2- 172.21.15.12:0/3262955589 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f0adc0bd440 0x7f0adc0bd850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:50.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.352+0000 7f0adad9d640 1 -- 172.21.15.12:0/3262955589 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f0adc0bd440 msgr2=0x7f0adc0bd850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T16:41:50.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.352+0000 7f0adad9d640 1 --2- 172.21.15.12:0/3262955589 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f0adc0bd440 0x7f0adc0bd850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:50.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.352+0000 7f0adad9d640 1 -- 172.21.15.12:0/3262955589 >> v1:172.21.15.84:6789/0 conn(0x7f0adc0b8d70 legacy=0x7f0adc0b9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:50.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.352+0000 7f0adad9d640 1 -- 172.21.15.12:0/3262955589 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0adc0bdd90 con 0x7f0adc14e530 2024-05-15T16:41:50.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.352+0000 7f0ada59c640 1 --2- 172.21.15.12:0/3262955589 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f0adc0bd440 0x7f0adc0bd850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-15T16:41:50.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.353+0000 7f0adad9d640 1 --2- 172.21.15.12:0/3262955589 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0adc14e530 0x7f0adc0ba320 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f0ad4009850 tx=0x7f0ad402a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7bf5be8295ba671 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T16:41:50.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.353+0000 7f0ad9d9b640 1 -- 172.21.15.12:0/3262955589 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ad4004030 con 0x7f0adc14e530 2024-05-15T16:41:50.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.353+0000 7f0ad9d9b640 1 -- 172.21.15.12:0/3262955589 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ad40041d0 con 0x7f0adc14e530 2024-05-15T16:41:50.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.353+0000 7f0ad9d9b640 1 -- 172.21.15.12:0/3262955589 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ad4003610 con 0x7f0adc14e530 2024-05-15T16:41:50.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.354+0000 7f0ae10d1640 1 -- 172.21.15.12:0/3262955589 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0adc14e530 msgr2=0x7f0adc0ba320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:50.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.354+0000 7f0ae10d1640 1 --2- 172.21.15.12:0/3262955589 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0adc14e530 0x7f0adc0ba320 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f0ad4009850 tx=0x7f0ad402a250 comp rx=0 tx=0).stop 2024-05-15T16:41:50.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.354+0000 7f0ae10d1640 1 -- 172.21.15.12:0/3262955589 shutdown_connections 2024-05-15T16:41:50.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.354+0000 7f0ae10d1640 1 --2- 172.21.15.12:0/3262955589 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f0adc0bd440 0x7f0adc0bd850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:50.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.354+0000 7f0ae10d1640 1 --2- 172.21.15.12:0/3262955589 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0adc14e530 0x7f0adc0ba320 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:50.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.354+0000 7f0ae10d1640 1 -- 172.21.15.12:0/3262955589 >> 172.21.15.12:0/3262955589 conn(0x7f0adc0c0570 msgr2=0x7f0adc0c0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T16:41:50.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.354+0000 7f0ae10d1640 1 -- 172.21.15.12:0/3262955589 shutdown_connections 2024-05-15T16:41:50.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.354+0000 7f0ae10d1640 1 -- 172.21.15.12:0/3262955589 wait complete. 2024-05-15T16:41:50.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.355+0000 7f0ae10d1640 1 Processor -- start 2024-05-15T16:41:50.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.356+0000 7f0ae10d1640 1 -- start start 2024-05-15T16:41:50.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.357+0000 7f0ae10d1640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0adc0b8d70 0x7f0adc1403f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:50.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.357+0000 7f0ae10d1640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0adc0bd440 0x7f0adc1e74d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:50.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.357+0000 7f0ae10d1640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f0adc14e530 0x7f0adc13a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:50.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.357+0000 7f0ae10d1640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f0adc0bbb70 con 0x7f0adc0b8d70 2024-05-15T16:41:50.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.357+0000 7f0ae10d1640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f0adc14f2a0 con 0x7f0adc0bd440 2024-05-15T16:41:50.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.357+0000 7f0ae10d1640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f0adc14e940 con 0x7f0adc14e530 2024-05-15T16:41:50.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.357+0000 7f0adad9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0adc0b8d70 0x7f0adc1403f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:50.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.357+0000 7f0adad9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0adc0b8d70 0x7f0adc1403f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45966/0 (socket says 172.21.15.12:45966) 2024-05-15T16:41:50.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.357+0000 7f0adad9d640 1 -- 172.21.15.12:0/3485835775 learned_addr learned my addr 172.21.15.12:0/3485835775 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T16:41:50.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.357+0000 7f0ada59c640 1 --2- 172.21.15.12:0/3485835775 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0adc0bd440 0x7f0adc1e74d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:50.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.357+0000 7f0adb59e640 1 --2- 172.21.15.12:0/3485835775 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f0adc14e530 0x7f0adc13a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:50.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.357+0000 7f0adad9d640 1 -- 172.21.15.12:0/3485835775 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f0adc14e530 msgr2=0x7f0adc13a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:50.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.357+0000 7f0adad9d640 1 --2- 172.21.15.12:0/3485835775 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f0adc14e530 0x7f0adc13a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:50.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.357+0000 7f0adad9d640 1 -- 172.21.15.12:0/3485835775 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0adc0bd440 msgr2=0x7f0adc1e74d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:50.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.357+0000 7f0adad9d640 1 --2- 172.21.15.12:0/3485835775 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0adc0bd440 0x7f0adc1e74d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:50.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.357+0000 7f0adad9d640 1 -- 172.21.15.12:0/3485835775 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0adc140930 con 0x7f0adc0b8d70 2024-05-15T16:41:50.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.357+0000 7f0adad9d640 1 --2- 172.21.15.12:0/3485835775 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0adc0b8d70 0x7f0adc1403f0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f0ad4034040 tx=0x7f0ad40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T16:41:50.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.357+0000 7f0ac37fe640 1 -- 172.21.15.12:0/3485835775 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ad4041030 con 0x7f0adc0b8d70 2024-05-15T16:41:50.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.357+0000 7f0ac37fe640 1 -- 172.21.15.12:0/3485835775 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ad4003c50 con 0x7f0adc0b8d70 2024-05-15T16:41:50.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.357+0000 7f0ae10d1640 1 -- 172.21.15.12:0/3485835775 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0adc1e7a10 con 0x7f0adc0b8d70 2024-05-15T16:41:50.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.357+0000 7f0ac37fe640 1 -- 172.21.15.12:0/3485835775 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ad4004030 con 0x7f0adc0b8d70 2024-05-15T16:41:50.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.357+0000 7f0ae10d1640 1 -- 172.21.15.12:0/3485835775 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0adc1437f0 con 0x7f0adc0b8d70 2024-05-15T16:41:50.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.359+0000 7f0ae10d1640 1 -- 172.21.15.12:0/3485835775 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0adc050940 con 0x7f0adc0b8d70 2024-05-15T16:41:50.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.359+0000 7f0ac37fe640 1 -- 172.21.15.12:0/3485835775 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0ad4044070 con 0x7f0adc0b8d70 2024-05-15T16:41:50.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.360+0000 7f0ac37fe640 1 --2- 172.21.15.12:0/3485835775 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f0ac80762d0 0x7f0ac80787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:50.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.360+0000 7f0ac37fe640 1 -- 172.21.15.12:0/3485835775 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4943+0+0 (secure 0 0 0) 0x7f0ad40b7d40 con 0x7f0adc0b8d70 2024-05-15T16:41:50.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.360+0000 7f0ada59c640 1 --2- 172.21.15.12:0/3485835775 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f0ac80762d0 0x7f0ac80787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:50.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.360+0000 7f0ada59c640 1 --2- 172.21.15.12:0/3485835775 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f0ac80762d0 0x7f0ac80787e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f0adc13b9e0 tx=0x7f0ad0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T16:41:50.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.365+0000 7f0ac37fe640 1 -- 172.21.15.12:0/3485835775 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f0ad4081350 con 0x7f0adc0b8d70 2024-05-15T16:41:50.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.554+0000 7f0ae10d1640 1 -- 172.21.15.12:0/3485835775 --> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f0adc0008d0 con 0x7f0ac80762d0 2024-05-15T16:41:50.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.555+0000 7f0ac37fe640 1 -- 172.21.15.12:0/3485835775 <== mgr.4106 v2:172.21.15.84:6832/4173299311 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f0adc0008d0 con 0x7f0ac80762d0 2024-05-15T16:41:50.556 INFO:teuthology.orchestra.run.smithi012.stderr:instructed osd(s) 1 to deep-scrub 2024-05-15T16:41:50.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.557+0000 7f0ae10d1640 1 -- 172.21.15.12:0/3485835775 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f0ac80762d0 msgr2=0x7f0ac80787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:50.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.557+0000 7f0ae10d1640 1 --2- 172.21.15.12:0/3485835775 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f0ac80762d0 0x7f0ac80787e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f0adc13b9e0 tx=0x7f0ad0008040 comp rx=0 tx=0).stop 2024-05-15T16:41:50.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.557+0000 7f0ae10d1640 1 -- 172.21.15.12:0/3485835775 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0adc0b8d70 msgr2=0x7f0adc1403f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:50.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.557+0000 7f0ae10d1640 1 --2- 172.21.15.12:0/3485835775 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0adc0b8d70 0x7f0adc1403f0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f0ad4034040 tx=0x7f0ad40046c0 comp rx=0 tx=0).stop 2024-05-15T16:41:50.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.557+0000 7f0ae10d1640 1 -- 172.21.15.12:0/3485835775 shutdown_connections 2024-05-15T16:41:50.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.557+0000 7f0ae10d1640 1 --2- 172.21.15.12:0/3485835775 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f0adc14e530 0x7f0adc13a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:50.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.557+0000 7f0ae10d1640 1 --2- 172.21.15.12:0/3485835775 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0adc0bd440 0x7f0adc1e74d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:50.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.557+0000 7f0ae10d1640 1 --2- 172.21.15.12:0/3485835775 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f0ac80762d0 0x7f0ac80787e0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:50.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.557+0000 7f0ae10d1640 1 --2- 172.21.15.12:0/3485835775 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0adc0b8d70 0x7f0adc1403f0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:50.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.557+0000 7f0ae10d1640 1 -- 172.21.15.12:0/3485835775 >> 172.21.15.12:0/3485835775 conn(0x7f0adc0c0570 msgr2=0x7f0adc0bbf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T16:41:50.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.557+0000 7f0ae10d1640 1 -- 172.21.15.12:0/3485835775 shutdown_connections 2024-05-15T16:41:50.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.557+0000 7f0ae10d1640 1 -- 172.21.15.12:0/3485835775 wait complete. 2024-05-15T16:41:50.569 INFO:tasks.ceph:Scrubbing osd.2 2024-05-15T16:41:50.569 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-05-15T16:41:50.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.684+0000 7f63b5469640 1 Processor -- start 2024-05-15T16:41:50.686 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.684+0000 7f63b5469640 1 -- start start 2024-05-15T16:41:50.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.685+0000 7f63b5469640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f63b0151fc0 0x7f63b00bd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:50.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.685+0000 7f63b5469640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f63b006da30 0x7f63b00be940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:50.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.685+0000 7f63b5469640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f63b006de40 0x7f63b00bee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:50.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.685+0000 7f63b5469640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f63b00bdc10 con 0x7f63b006de40 2024-05-15T16:41:50.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.685+0000 7f63b5469640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f63b00c36f0 con 0x7f63b0151fc0 2024-05-15T16:41:50.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.685+0000 7f63b5469640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f63b0152530 con 0x7f63b006da30 2024-05-15T16:41:50.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.685+0000 7f63af7fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f63b006de40 0x7f63b00bee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:50.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.686+0000 7f63af7fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f63b006de40 0x7f63b00bee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45976/0 (socket says 172.21.15.12:45976) 2024-05-15T16:41:50.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.686+0000 7f63af7fe640 1 -- 172.21.15.12:0/2018501548 learned_addr learned my addr 172.21.15.12:0/2018501548 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T16:41:50.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.686+0000 7f63aeffd640 1 --2- 172.21.15.12:0/2018501548 >> v2:172.21.15.84:3300/0 conn(0x7f63b0151fc0 0x7f63b00bd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:50.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.686+0000 7f63ae7fc640 1 --2- 172.21.15.12:0/2018501548 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f63b006da30 0x7f63b00be940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:50.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.686+0000 7f63af7fe640 1 -- 172.21.15.12:0/2018501548 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f63b006da30 msgr2=0x7f63b00be940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T16:41:50.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.686+0000 7f63af7fe640 1 --2- 172.21.15.12:0/2018501548 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f63b006da30 0x7f63b00be940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:50.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.686+0000 7f63af7fe640 1 -- 172.21.15.12:0/2018501548 >> v2:172.21.15.84:3300/0 conn(0x7f63b0151fc0 msgr2=0x7f63b00bd6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T16:41:50.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.686+0000 7f63af7fe640 1 --2- 172.21.15.12:0/2018501548 >> v2:172.21.15.84:3300/0 conn(0x7f63b0151fc0 0x7f63b00bd6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:50.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.686+0000 7f63af7fe640 1 -- 172.21.15.12:0/2018501548 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63b0152810 con 0x7f63b006de40 2024-05-15T16:41:50.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.686+0000 7f63aeffd640 1 --2- 172.21.15.12:0/2018501548 >> v2:172.21.15.84:3300/0 conn(0x7f63b0151fc0 0x7f63b00bd6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-15T16:41:50.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.686+0000 7f63af7fe640 1 --2- 172.21.15.12:0/2018501548 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f63b006de40 0x7f63b00bee80 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f63b008d300 tx=0x7f63a002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c4c790db00f41db server_cookie=0 in_seq=0 out_seq=0 2024-05-15T16:41:50.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.687+0000 7f63adffb640 1 -- 172.21.15.12:0/2018501548 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63a0036070 con 0x7f63b006de40 2024-05-15T16:41:50.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.687+0000 7f63adffb640 1 -- 172.21.15.12:0/2018501548 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63a0031600 con 0x7f63b006de40 2024-05-15T16:41:50.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.687+0000 7f63adffb640 1 -- 172.21.15.12:0/2018501548 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63a00319d0 con 0x7f63b006de40 2024-05-15T16:41:50.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.687+0000 7f63b5469640 1 -- 172.21.15.12:0/2018501548 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f63b006de40 msgr2=0x7f63b00bee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:50.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.687+0000 7f63b5469640 1 --2- 172.21.15.12:0/2018501548 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f63b006de40 0x7f63b00bee80 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f63b008d300 tx=0x7f63a002a6a0 comp rx=0 tx=0).stop 2024-05-15T16:41:50.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.687+0000 7f63b5469640 1 -- 172.21.15.12:0/2018501548 shutdown_connections 2024-05-15T16:41:50.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.687+0000 7f63b5469640 1 --2- 172.21.15.12:0/2018501548 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f63b006de40 0x7f63b00bee80 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:50.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.687+0000 7f63b5469640 1 --2- 172.21.15.12:0/2018501548 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f63b006da30 0x7f63b00be940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:50.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.687+0000 7f63b5469640 1 --2- 172.21.15.12:0/2018501548 >> v2:172.21.15.84:3300/0 conn(0x7f63b0151fc0 0x7f63b00bd6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:50.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.687+0000 7f63b5469640 1 -- 172.21.15.12:0/2018501548 >> 172.21.15.12:0/2018501548 conn(0x7f63b00c3d20 msgr2=0x7f63b00c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T16:41:50.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.687+0000 7f63b5469640 1 -- 172.21.15.12:0/2018501548 shutdown_connections 2024-05-15T16:41:50.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.687+0000 7f63b5469640 1 -- 172.21.15.12:0/2018501548 wait complete. 2024-05-15T16:41:50.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.689+0000 7f63b5469640 1 Processor -- start 2024-05-15T16:41:50.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.689+0000 7f63b5469640 1 -- start start 2024-05-15T16:41:50.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.690+0000 7f63b5469640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f63b006da30 0x7f63b00b9dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:50.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.690+0000 7f63b5469640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63b006de40 0x7f63b014abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:50.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.690+0000 7f63b5469640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f63b0151fc0 0x7f63b014b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:50.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.690+0000 7f63b5469640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f63b00a3050 con 0x7f63b0151fc0 2024-05-15T16:41:50.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.690+0000 7f63b5469640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f63b00a2ed0 con 0x7f63b006de40 2024-05-15T16:41:50.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.690+0000 7f63b5469640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f63b014e570 con 0x7f63b006da30 2024-05-15T16:41:50.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.690+0000 7f63af7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f63b0151fc0 0x7f63b014b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:50.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.690+0000 7f63af7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f63b0151fc0 0x7f63b014b130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45980/0 (socket says 172.21.15.12:45980) 2024-05-15T16:41:50.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.690+0000 7f63af7fe640 1 -- 172.21.15.12:0/2389021265 learned_addr learned my addr 172.21.15.12:0/2389021265 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T16:41:50.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.690+0000 7f63ae7fc640 1 --2- 172.21.15.12:0/2389021265 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63b006de40 0x7f63b014abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:50.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.690+0000 7f63aeffd640 1 --2- 172.21.15.12:0/2389021265 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f63b006da30 0x7f63b00b9dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:50.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.691+0000 7f63af7fe640 1 -- 172.21.15.12:0/2389021265 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f63b006da30 msgr2=0x7f63b00b9dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:50.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.691+0000 7f63af7fe640 1 --2- 172.21.15.12:0/2389021265 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f63b006da30 0x7f63b00b9dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:50.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.691+0000 7f63af7fe640 1 -- 172.21.15.12:0/2389021265 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63b006de40 msgr2=0x7f63b014abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:50.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.691+0000 7f63af7fe640 1 --2- 172.21.15.12:0/2389021265 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63b006de40 0x7f63b014abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:50.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.691+0000 7f63af7fe640 1 -- 172.21.15.12:0/2389021265 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63b00ba310 con 0x7f63b0151fc0 2024-05-15T16:41:50.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.691+0000 7f63af7fe640 1 --2- 172.21.15.12:0/2389021265 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f63b0151fc0 0x7f63b014b130 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f63a0009f40 tx=0x7f63a0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T16:41:50.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.691+0000 7f63a77fe640 1 -- 172.21.15.12:0/2389021265 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63a0036050 con 0x7f63b0151fc0 2024-05-15T16:41:50.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.691+0000 7f63a77fe640 1 -- 172.21.15.12:0/2389021265 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63a0042070 con 0x7f63b0151fc0 2024-05-15T16:41:50.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.691+0000 7f63a77fe640 1 -- 172.21.15.12:0/2389021265 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63a0009510 con 0x7f63b0151fc0 2024-05-15T16:41:50.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.691+0000 7f63b5469640 1 -- 172.21.15.12:0/2389021265 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63b00bcd60 con 0x7f63b0151fc0 2024-05-15T16:41:50.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.691+0000 7f63b5469640 1 -- 172.21.15.12:0/2389021265 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63b00b96d0 con 0x7f63b0151fc0 2024-05-15T16:41:50.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.692+0000 7f63b5469640 1 -- 172.21.15.12:0/2389021265 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f63b00bef50 con 0x7f63b0151fc0 2024-05-15T16:41:50.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.693+0000 7f63a77fe640 1 -- 172.21.15.12:0/2389021265 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f63a0007bd0 con 0x7f63b0151fc0 2024-05-15T16:41:50.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.693+0000 7f63a77fe640 1 --2- 172.21.15.12:0/2389021265 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f63900762d0 0x7f63900787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:50.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.693+0000 7f63a77fe640 1 -- 172.21.15.12:0/2389021265 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4943+0+0 (secure 0 0 0) 0x7f63a00b8260 con 0x7f63b0151fc0 2024-05-15T16:41:50.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.693+0000 7f63a77fe640 1 --2- 172.21.15.12:0/2389021265 >> [v2:172.21.15.12:6820/2173702802,v1:172.21.15.12:6823/2173702802] conn(0x7f639007c1e0 0x7f639007e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:50.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.693+0000 7f63a77fe640 1 -- 172.21.15.12:0/2389021265 --> [v2:172.21.15.12:6820/2173702802,v1:172.21.15.12:6823/2173702802] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f63a003ee50 con 0x7f639007c1e0 2024-05-15T16:41:50.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.693+0000 7f63a77fe640 1 -- 172.21.15.12:0/2389021265 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f63a00bf050 con 0x7f63b0151fc0 2024-05-15T16:41:50.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.693+0000 7f63aeffd640 1 --2- 172.21.15.12:0/2389021265 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f63900762d0 0x7f63900787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:50.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.693+0000 7f63ae7fc640 1 --2- 172.21.15.12:0/2389021265 >> [v2:172.21.15.12:6820/2173702802,v1:172.21.15.12:6823/2173702802] conn(0x7f639007c1e0 0x7f639007e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:50.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.694+0000 7f63ae7fc640 1 --2- 172.21.15.12:0/2389021265 >> [v2:172.21.15.12:6820/2173702802,v1:172.21.15.12:6823/2173702802] conn(0x7f639007c1e0 0x7f639007e630 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T16:41:50.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.694+0000 7f63aeffd640 1 --2- 172.21.15.12:0/2389021265 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f63900762d0 0x7f63900787e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f63a8006fd0 tx=0x7f63a8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T16:41:50.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.694+0000 7f63a77fe640 1 -- 172.21.15.12:0/2389021265 <== osd.2 v2:172.21.15.12:6820/2173702802 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f63a003ee50 con 0x7f639007c1e0 2024-05-15T16:41:50.710 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.707+0000 7f63b5469640 1 -- 172.21.15.12:0/2389021265 --> [v2:172.21.15.12:6820/2173702802,v1:172.21.15.12:6823/2173702802] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f63b0050940 con 0x7f639007c1e0 2024-05-15T16:41:50.710 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.708+0000 7f63a77fe640 1 -- 172.21.15.12:0/2389021265 <== osd.2 v2:172.21.15.12:6820/2173702802 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f63b0050940 con 0x7f639007c1e0 2024-05-15T16:41:50.711 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-05-15T16:41:50.711 INFO:teuthology.orchestra.run.smithi012.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-15T16:41:50.711 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-05-15T16:41:50.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.708+0000 7f63b5469640 1 -- 172.21.15.12:0/2389021265 >> [v2:172.21.15.12:6820/2173702802,v1:172.21.15.12:6823/2173702802] conn(0x7f639007c1e0 msgr2=0x7f639007e630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:50.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.708+0000 7f63b5469640 1 --2- 172.21.15.12:0/2389021265 >> [v2:172.21.15.12:6820/2173702802,v1:172.21.15.12:6823/2173702802] conn(0x7f639007c1e0 0x7f639007e630 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:50.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.708+0000 7f63b5469640 1 -- 172.21.15.12:0/2389021265 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f63900762d0 msgr2=0x7f63900787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:50.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.708+0000 7f63b5469640 1 --2- 172.21.15.12:0/2389021265 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f63900762d0 0x7f63900787e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f63a8006fd0 tx=0x7f63a8008040 comp rx=0 tx=0).stop 2024-05-15T16:41:50.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.708+0000 7f63b5469640 1 -- 172.21.15.12:0/2389021265 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f63b0151fc0 msgr2=0x7f63b014b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:50.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.708+0000 7f63b5469640 1 --2- 172.21.15.12:0/2389021265 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f63b0151fc0 0x7f63b014b130 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f63a0009f40 tx=0x7f63a0004a40 comp rx=0 tx=0).stop 2024-05-15T16:41:50.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.708+0000 7f63af7fe640 1 -- 172.21.15.12:0/2389021265 reap_dead start 2024-05-15T16:41:50.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.708+0000 7f63b5469640 1 -- 172.21.15.12:0/2389021265 shutdown_connections 2024-05-15T16:41:50.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.708+0000 7f63b5469640 1 -- 172.21.15.12:0/2389021265 >> 172.21.15.12:0/2389021265 conn(0x7f63b00c3d20 msgr2=0x7f63b00be840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T16:41:50.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.708+0000 7f63b5469640 1 -- 172.21.15.12:0/2389021265 shutdown_connections 2024-05-15T16:41:50.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.708+0000 7f63b5469640 1 -- 172.21.15.12:0/2389021265 wait complete. 2024-05-15T16:41:50.720 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-05-15T16:41:50.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.832+0000 7f929cb9d640 1 Processor -- start 2024-05-15T16:41:50.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.832+0000 7f929cb9d640 1 -- start start 2024-05-15T16:41:50.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.833+0000 7f929cb9d640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f92980bd6d0 0x7f92980be940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:50.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.833+0000 7f929cb9d640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f92980bee80 0x7f9298158e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:50.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.833+0000 7f929cb9d640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f929806e140 con 0x7f9298151fc0 2024-05-15T16:41:50.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.833+0000 7f929cb9d640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f92980c36f0 con 0x7f92980bd6d0 2024-05-15T16:41:50.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.833+0000 7f929cb9d640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f9298152530 con 0x7f92980bee80 2024-05-15T16:41:50.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.833+0000 7f928ffff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f92980bd6d0 0x7f92980be940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:50.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.833+0000 7f928ffff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f92980bd6d0 0x7f92980be940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45996/0 (socket says 172.21.15.12:45996) 2024-05-15T16:41:50.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.833+0000 7f928ffff640 1 -- 172.21.15.12:0/3039959743 learned_addr learned my addr 172.21.15.12:0/3039959743 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T16:41:50.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.833+0000 7f9296d9d640 1 --2- 172.21.15.12:0/3039959743 >> v2:172.21.15.84:3300/0 conn(0x7f92980bee80 0x7f9298158e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:50.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.834+0000 7f928ffff640 1 -- 172.21.15.12:0/3039959743 >> v2:172.21.15.84:3300/0 conn(0x7f92980bee80 msgr2=0x7f9298158e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T16:41:50.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.834+0000 7f928ffff640 1 --2- 172.21.15.12:0/3039959743 >> v2:172.21.15.84:3300/0 conn(0x7f92980bee80 0x7f9298158e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:50.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.834+0000 7f928ffff640 1 -- 172.21.15.12:0/3039959743 >> v1:172.21.15.84:6789/0 conn(0x7f9298151fc0 legacy=0x7f929806da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T16:41:50.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.834+0000 7f928ffff640 1 -- 172.21.15.12:0/3039959743 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9298152810 con 0x7f92980bd6d0 2024-05-15T16:41:50.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.834+0000 7f928ffff640 1 --2- 172.21.15.12:0/3039959743 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92980bd6d0 0x7f92980be940 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f92980c3290 tx=0x7f928002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=103fbf5551566189 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T16:41:50.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.834+0000 7f9295d9b640 1 -- 172.21.15.12:0/3039959743 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9280037070 con 0x7f92980bd6d0 2024-05-15T16:41:50.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.834+0000 7f9295d9b640 1 -- 172.21.15.12:0/3039959743 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9280032440 con 0x7f92980bd6d0 2024-05-15T16:41:50.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.834+0000 7f9295d9b640 1 -- 172.21.15.12:0/3039959743 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f928002ae60 con 0x7f92980bd6d0 2024-05-15T16:41:50.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.835+0000 7f929cb9d640 1 -- 172.21.15.12:0/3039959743 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92980bd6d0 msgr2=0x7f92980be940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:50.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.835+0000 7f929cb9d640 1 --2- 172.21.15.12:0/3039959743 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92980bd6d0 0x7f92980be940 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f92980c3290 tx=0x7f928002a110 comp rx=0 tx=0).stop 2024-05-15T16:41:50.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.835+0000 7f929cb9d640 1 -- 172.21.15.12:0/3039959743 shutdown_connections 2024-05-15T16:41:50.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.835+0000 7f929cb9d640 1 --2- 172.21.15.12:0/3039959743 >> v2:172.21.15.84:3300/0 conn(0x7f92980bee80 0x7f9298158e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:50.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.835+0000 7f929cb9d640 1 --2- 172.21.15.12:0/3039959743 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92980bd6d0 0x7f92980be940 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:50.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.835+0000 7f929cb9d640 1 -- 172.21.15.12:0/3039959743 >> 172.21.15.12:0/3039959743 conn(0x7f92980c3d20 msgr2=0x7f92980c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T16:41:50.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.835+0000 7f929cb9d640 1 -- 172.21.15.12:0/3039959743 shutdown_connections 2024-05-15T16:41:50.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.835+0000 7f929cb9d640 1 -- 172.21.15.12:0/3039959743 wait complete. 2024-05-15T16:41:50.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.837+0000 7f929cb9d640 1 Processor -- start 2024-05-15T16:41:50.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.837+0000 7f929cb9d640 1 -- start start 2024-05-15T16:41:50.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.838+0000 7f929cb9d640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f92980bd6d0 0x7f929814b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:50.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.838+0000 7f929cb9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f92980bee80 0x7f92980b7c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:50.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.838+0000 7f929cb9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9298151fc0 0x7f92980b60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:50.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.838+0000 7f929cb9d640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f92980bdae0 con 0x7f9298151fc0 2024-05-15T16:41:50.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.838+0000 7f929cb9d640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f92980c0070 con 0x7f92980bee80 2024-05-15T16:41:50.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.838+0000 7f929cb9d640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f92980a2ed0 con 0x7f92980bd6d0 2024-05-15T16:41:50.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.838+0000 7f9296d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9298151fc0 0x7f92980b60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:50.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.838+0000 7f9296d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9298151fc0 0x7f92980b60c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45998/0 (socket says 172.21.15.12:45998) 2024-05-15T16:41:50.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.838+0000 7f9296d9d640 1 -- 172.21.15.12:0/1706488345 learned_addr learned my addr 172.21.15.12:0/1706488345 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T16:41:50.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.838+0000 7f928ffff640 1 --2- 172.21.15.12:0/1706488345 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f92980bee80 0x7f92980b7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:50.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.838+0000 7f929659c640 1 --2- 172.21.15.12:0/1706488345 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f92980bd6d0 0x7f929814b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:50.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.838+0000 7f9296d9d640 1 -- 172.21.15.12:0/1706488345 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f92980bd6d0 msgr2=0x7f929814b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:50.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.838+0000 7f9296d9d640 1 --2- 172.21.15.12:0/1706488345 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f92980bd6d0 0x7f929814b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:50.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.838+0000 7f9296d9d640 1 -- 172.21.15.12:0/1706488345 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f92980bee80 msgr2=0x7f92980b7c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:50.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.838+0000 7f9296d9d640 1 --2- 172.21.15.12:0/1706488345 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f92980bee80 0x7f92980b7c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:50.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.838+0000 7f9296d9d640 1 -- 172.21.15.12:0/1706488345 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92980b74d0 con 0x7f9298151fc0 2024-05-15T16:41:50.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.838+0000 7f9296d9d640 1 --2- 172.21.15.12:0/1706488345 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9298151fc0 0x7f92980b60c0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f9290007e60 tx=0x7f929000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T16:41:50.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.839+0000 7f928effd640 1 -- 172.21.15.12:0/1706488345 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9290014420 con 0x7f9298151fc0 2024-05-15T16:41:50.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.839+0000 7f928effd640 1 -- 172.21.15.12:0/1706488345 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9290019070 con 0x7f9298151fc0 2024-05-15T16:41:50.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.839+0000 7f929cb9d640 1 -- 172.21.15.12:0/1706488345 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f929814bab0 con 0x7f9298151fc0 2024-05-15T16:41:50.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.839+0000 7f928effd640 1 -- 172.21.15.12:0/1706488345 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9290014820 con 0x7f9298151fc0 2024-05-15T16:41:50.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.839+0000 7f929cb9d640 1 -- 172.21.15.12:0/1706488345 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92981e7e90 con 0x7f9298151fc0 2024-05-15T16:41:50.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.840+0000 7f929cb9d640 1 -- 172.21.15.12:0/1706488345 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92981e8060 con 0x7f9298151fc0 2024-05-15T16:41:50.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.840+0000 7f928effd640 1 -- 172.21.15.12:0/1706488345 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f92900149c0 con 0x7f9298151fc0 2024-05-15T16:41:50.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.841+0000 7f928effd640 1 --2- 172.21.15.12:0/1706488345 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f92780762d0 0x7f92780787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:50.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.841+0000 7f928effd640 1 -- 172.21.15.12:0/1706488345 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4943+0+0 (secure 0 0 0) 0x7f9290097a00 con 0x7f9298151fc0 2024-05-15T16:41:50.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.841+0000 7f929659c640 1 --2- 172.21.15.12:0/1706488345 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f92780762d0 0x7f92780787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:50.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.842+0000 7f929659c640 1 --2- 172.21.15.12:0/1706488345 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f92780762d0 0x7f92780787e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f9288006fd0 tx=0x7f9288009060 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T16:41:50.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:50.846+0000 7f928effd640 1 -- 172.21.15.12:0/1706488345 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f9290061010 con 0x7f9298151fc0 2024-05-15T16:41:51.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.035+0000 7f929cb9d640 1 -- 172.21.15.12:0/1706488345 --> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f92980ba580 con 0x7f92780762d0 2024-05-15T16:41:51.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.035+0000 7f928effd640 1 -- 172.21.15.12:0/1706488345 <== mgr.4106 v2:172.21.15.84:6832/4173299311 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f92980ba580 con 0x7f92780762d0 2024-05-15T16:41:51.036 INFO:teuthology.orchestra.run.smithi012.stderr:instructed osd(s) 2 to deep-scrub 2024-05-15T16:41:51.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.037+0000 7f929cb9d640 1 -- 172.21.15.12:0/1706488345 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f92780762d0 msgr2=0x7f92780787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:51.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.037+0000 7f929cb9d640 1 --2- 172.21.15.12:0/1706488345 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f92780762d0 0x7f92780787e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f9288006fd0 tx=0x7f9288009060 comp rx=0 tx=0).stop 2024-05-15T16:41:51.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.037+0000 7f929cb9d640 1 -- 172.21.15.12:0/1706488345 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9298151fc0 msgr2=0x7f92980b60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:51.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.037+0000 7f929cb9d640 1 --2- 172.21.15.12:0/1706488345 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9298151fc0 0x7f92980b60c0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f9290007e60 tx=0x7f929000e4b0 comp rx=0 tx=0).stop 2024-05-15T16:41:51.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.037+0000 7f929cb9d640 1 -- 172.21.15.12:0/1706488345 shutdown_connections 2024-05-15T16:41:51.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.037+0000 7f929cb9d640 1 --2- 172.21.15.12:0/1706488345 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f92780762d0 0x7f92780787e0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:51.040 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.037+0000 7f929cb9d640 1 --2- 172.21.15.12:0/1706488345 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9298151fc0 0x7f92980b60c0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:51.040 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.037+0000 7f929cb9d640 1 --2- 172.21.15.12:0/1706488345 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f92980bee80 0x7f92980b7c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:51.040 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.037+0000 7f929cb9d640 1 --2- 172.21.15.12:0/1706488345 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f92980bd6d0 0x7f929814b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:51.040 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.037+0000 7f929cb9d640 1 -- 172.21.15.12:0/1706488345 >> 172.21.15.12:0/1706488345 conn(0x7f92980c3d20 msgr2=0x7f92980c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T16:41:51.040 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.038+0000 7f929cb9d640 1 -- 172.21.15.12:0/1706488345 shutdown_connections 2024-05-15T16:41:51.040 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.038+0000 7f929cb9d640 1 -- 172.21.15.12:0/1706488345 wait complete. 2024-05-15T16:41:51.049 INFO:tasks.ceph:Scrubbing osd.3 2024-05-15T16:41:51.050 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-05-15T16:41:51.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.164+0000 7ff41ed2e640 1 Processor -- start 2024-05-15T16:41:51.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.164+0000 7ff41ed2e640 1 -- start start 2024-05-15T16:41:51.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.165+0000 7ff41ed2e640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff4180a9060 0x7ff418148910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:51.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.165+0000 7ff41ed2e640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff4180ba0f0 0x7ff41814e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:51.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.165+0000 7ff41ed2e640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff4180ba500 0x7ff41814eba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:51.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.165+0000 7ff41ed2e640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7ff4180b8a30 con 0x7ff4180ba0f0 2024-05-15T16:41:51.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.165+0000 7ff41ed2e640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7ff4180b8d10 con 0x7ff4180ba500 2024-05-15T16:41:51.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.165+0000 7ff41ed2e640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7ff4180b8ff0 con 0x7ff4180a9060 2024-05-15T16:41:51.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.165+0000 7ff417fff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff4180ba0f0 0x7ff41814e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:51.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.165+0000 7ff417fff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff4180ba0f0 0x7ff41814e660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46012/0 (socket says 172.21.15.12:46012) 2024-05-15T16:41:51.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.165+0000 7ff417fff640 1 -- 172.21.15.12:0/994897625 learned_addr learned my addr 172.21.15.12:0/994897625 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T16:41:51.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.165+0000 7ff41d2cb640 1 --2- 172.21.15.12:0/994897625 >> v2:172.21.15.84:3300/0 conn(0x7ff4180ba500 0x7ff41814eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:51.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.165+0000 7ff41caca640 1 --2- 172.21.15.12:0/994897625 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff4180a9060 0x7ff418148910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:51.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.165+0000 7ff417fff640 1 -- 172.21.15.12:0/994897625 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff4180a9060 msgr2=0x7ff418148910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T16:41:51.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.165+0000 7ff417fff640 1 --2- 172.21.15.12:0/994897625 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff4180a9060 0x7ff418148910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:51.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.165+0000 7ff417fff640 1 -- 172.21.15.12:0/994897625 >> v2:172.21.15.84:3300/0 conn(0x7ff4180ba500 msgr2=0x7ff41814eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T16:41:51.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.165+0000 7ff417fff640 1 --2- 172.21.15.12:0/994897625 >> v2:172.21.15.84:3300/0 conn(0x7ff4180ba500 0x7ff41814eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:51.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.165+0000 7ff417fff640 1 -- 172.21.15.12:0/994897625 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4180b92d0 con 0x7ff4180ba0f0 2024-05-15T16:41:51.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.165+0000 7ff41caca640 1 --2- 172.21.15.12:0/994897625 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff4180a9060 0x7ff418148910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-15T16:41:51.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.166+0000 7ff417fff640 1 --2- 172.21.15.12:0/994897625 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4180ba0f0 0x7ff41814e660 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7ff4180ba060 tx=0x7ff40402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=194e995f09344e12 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T16:41:51.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.166+0000 7ff4177fe640 1 -- 172.21.15.12:0/994897625 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff404037070 con 0x7ff4180ba0f0 2024-05-15T16:41:51.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.166+0000 7ff4177fe640 1 -- 172.21.15.12:0/994897625 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff404032440 con 0x7ff4180ba0f0 2024-05-15T16:41:51.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.166+0000 7ff4177fe640 1 -- 172.21.15.12:0/994897625 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff404032810 con 0x7ff4180ba0f0 2024-05-15T16:41:51.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.167+0000 7ff41ed2e640 1 -- 172.21.15.12:0/994897625 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4180ba0f0 msgr2=0x7ff41814e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:51.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.167+0000 7ff41ed2e640 1 --2- 172.21.15.12:0/994897625 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4180ba0f0 0x7ff41814e660 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7ff4180ba060 tx=0x7ff40402a270 comp rx=0 tx=0).stop 2024-05-15T16:41:51.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.167+0000 7ff41ed2e640 1 -- 172.21.15.12:0/994897625 shutdown_connections 2024-05-15T16:41:51.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.167+0000 7ff41ed2e640 1 --2- 172.21.15.12:0/994897625 >> v2:172.21.15.84:3300/0 conn(0x7ff4180ba500 0x7ff41814eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:51.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.167+0000 7ff41ed2e640 1 --2- 172.21.15.12:0/994897625 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4180ba0f0 0x7ff41814e660 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:51.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.167+0000 7ff41ed2e640 1 --2- 172.21.15.12:0/994897625 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff4180a9060 0x7ff418148910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:51.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.167+0000 7ff41ed2e640 1 -- 172.21.15.12:0/994897625 >> 172.21.15.12:0/994897625 conn(0x7ff4180c07c0 msgr2=0x7ff4180c0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T16:41:51.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.167+0000 7ff41ed2e640 1 -- 172.21.15.12:0/994897625 shutdown_connections 2024-05-15T16:41:51.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.167+0000 7ff41ed2e640 1 -- 172.21.15.12:0/994897625 wait complete. 2024-05-15T16:41:51.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.168+0000 7ff41ed2e640 1 Processor -- start 2024-05-15T16:41:51.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.169+0000 7ff41ed2e640 1 -- start start 2024-05-15T16:41:51.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.170+0000 7ff41ed2e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff4180a9060 0x7ff4181e4980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:51.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.170+0000 7ff41ed2e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4180ba0f0 0x7ff41814b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:51.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.170+0000 7ff41ed2e640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff4180ba500 0x7ff418143ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:51.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.170+0000 7ff41ed2e640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7ff41808dbb0 con 0x7ff4180ba0f0 2024-05-15T16:41:51.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.170+0000 7ff41ed2e640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ff41808da30 con 0x7ff4180a9060 2024-05-15T16:41:51.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.170+0000 7ff41ed2e640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7ff418151a30 con 0x7ff4180ba500 2024-05-15T16:41:51.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.170+0000 7ff417fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4180ba0f0 0x7ff41814b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:51.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.170+0000 7ff417fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4180ba0f0 0x7ff41814b580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46024/0 (socket says 172.21.15.12:46024) 2024-05-15T16:41:51.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.170+0000 7ff417fff640 1 -- 172.21.15.12:0/2052063252 learned_addr learned my addr 172.21.15.12:0/2052063252 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T16:41:51.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.170+0000 7ff41caca640 1 --2- 172.21.15.12:0/2052063252 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff4180a9060 0x7ff4181e4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:51.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.170+0000 7ff41d2cb640 1 --2- 172.21.15.12:0/2052063252 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff4180ba500 0x7ff418143ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:51.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.170+0000 7ff417fff640 1 -- 172.21.15.12:0/2052063252 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff4180ba500 msgr2=0x7ff418143ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:51.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.170+0000 7ff417fff640 1 --2- 172.21.15.12:0/2052063252 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff4180ba500 0x7ff418143ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:51.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.170+0000 7ff417fff640 1 -- 172.21.15.12:0/2052063252 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff4180a9060 msgr2=0x7ff4181e4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:51.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.170+0000 7ff417fff640 1 --2- 172.21.15.12:0/2052063252 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff4180a9060 0x7ff4181e4980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:51.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.170+0000 7ff417fff640 1 -- 172.21.15.12:0/2052063252 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4181e4ec0 con 0x7ff4180ba0f0 2024-05-15T16:41:51.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.170+0000 7ff417fff640 1 --2- 172.21.15.12:0/2052063252 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4180ba0f0 0x7ff41814b580 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7ff40402a2b0 tx=0x7ff4040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T16:41:51.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.171+0000 7ff4157fa640 1 -- 172.21.15.12:0/2052063252 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff404041020 con 0x7ff4180ba0f0 2024-05-15T16:41:51.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.171+0000 7ff4157fa640 1 -- 172.21.15.12:0/2052063252 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4040306c0 con 0x7ff4180ba0f0 2024-05-15T16:41:51.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.171+0000 7ff41ed2e640 1 -- 172.21.15.12:0/2052063252 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff41814bd90 con 0x7ff4180ba0f0 2024-05-15T16:41:51.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.171+0000 7ff4157fa640 1 -- 172.21.15.12:0/2052063252 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff404037040 con 0x7ff4180ba0f0 2024-05-15T16:41:51.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.171+0000 7ff41ed2e640 1 -- 172.21.15.12:0/2052063252 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff41814fb60 con 0x7ff4180ba0f0 2024-05-15T16:41:51.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.171+0000 7ff41ed2e640 1 -- 172.21.15.12:0/2052063252 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff4181e4550 con 0x7ff4180ba0f0 2024-05-15T16:41:51.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.172+0000 7ff4157fa640 1 -- 172.21.15.12:0/2052063252 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff404044020 con 0x7ff4180ba0f0 2024-05-15T16:41:51.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.173+0000 7ff4157fa640 1 --2- 172.21.15.12:0/2052063252 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7ff3fc0762d0 0x7ff3fc0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:51.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.173+0000 7ff4157fa640 1 -- 172.21.15.12:0/2052063252 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4943+0+0 (secure 0 0 0) 0x7ff4040b7db0 con 0x7ff4180ba0f0 2024-05-15T16:41:51.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.173+0000 7ff4157fa640 1 --2- 172.21.15.12:0/2052063252 >> [v2:172.21.15.12:6800/3956443113,v1:172.21.15.12:6801/3956443113] conn(0x7ff3fc07c1e0 0x7ff3fc07e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:51.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.173+0000 7ff4157fa640 1 -- 172.21.15.12:0/2052063252 --> [v2:172.21.15.12:6800/3956443113,v1:172.21.15.12:6801/3956443113] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff4040067f0 con 0x7ff3fc07c1e0 2024-05-15T16:41:51.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.173+0000 7ff4157fa640 1 -- 172.21.15.12:0/2052063252 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7ff4040b8240 con 0x7ff4180ba0f0 2024-05-15T16:41:51.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.173+0000 7ff41caca640 1 --2- 172.21.15.12:0/2052063252 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7ff3fc0762d0 0x7ff3fc0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:51.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.173+0000 7ff41d2cb640 1 --2- 172.21.15.12:0/2052063252 >> [v2:172.21.15.12:6800/3956443113,v1:172.21.15.12:6801/3956443113] conn(0x7ff3fc07c1e0 0x7ff3fc07e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:51.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.174+0000 7ff41d2cb640 1 --2- 172.21.15.12:0/2052063252 >> [v2:172.21.15.12:6800/3956443113,v1:172.21.15.12:6801/3956443113] conn(0x7ff3fc07c1e0 0x7ff3fc07e630 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T16:41:51.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.174+0000 7ff41caca640 1 --2- 172.21.15.12:0/2052063252 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7ff3fc0762d0 0x7ff3fc0787e0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ff40c006fd0 tx=0x7ff40c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T16:41:51.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.174+0000 7ff4157fa640 1 -- 172.21.15.12:0/2052063252 <== osd.3 v2:172.21.15.12:6800/3956443113 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff4040067f0 con 0x7ff3fc07c1e0 2024-05-15T16:41:51.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.187+0000 7ff41ed2e640 1 -- 172.21.15.12:0/2052063252 --> [v2:172.21.15.12:6800/3956443113,v1:172.21.15.12:6801/3956443113] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7ff41814f670 con 0x7ff3fc07c1e0 2024-05-15T16:41:51.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.188+0000 7ff4157fa640 1 -- 172.21.15.12:0/2052063252 <== osd.3 v2:172.21.15.12:6800/3956443113 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7ff41814f670 con 0x7ff3fc07c1e0 2024-05-15T16:41:51.189 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-05-15T16:41:51.189 INFO:teuthology.orchestra.run.smithi012.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-15T16:41:51.189 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-05-15T16:41:51.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.188+0000 7ff41ed2e640 1 -- 172.21.15.12:0/2052063252 >> [v2:172.21.15.12:6800/3956443113,v1:172.21.15.12:6801/3956443113] conn(0x7ff3fc07c1e0 msgr2=0x7ff3fc07e630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:51.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.188+0000 7ff41ed2e640 1 --2- 172.21.15.12:0/2052063252 >> [v2:172.21.15.12:6800/3956443113,v1:172.21.15.12:6801/3956443113] conn(0x7ff3fc07c1e0 0x7ff3fc07e630 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:51.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.188+0000 7ff41ed2e640 1 -- 172.21.15.12:0/2052063252 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7ff3fc0762d0 msgr2=0x7ff3fc0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:51.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.188+0000 7ff41ed2e640 1 --2- 172.21.15.12:0/2052063252 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7ff3fc0762d0 0x7ff3fc0787e0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ff40c006fd0 tx=0x7ff40c008040 comp rx=0 tx=0).stop 2024-05-15T16:41:51.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.188+0000 7ff41ed2e640 1 -- 172.21.15.12:0/2052063252 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4180ba0f0 msgr2=0x7ff41814b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:51.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.188+0000 7ff41ed2e640 1 --2- 172.21.15.12:0/2052063252 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4180ba0f0 0x7ff41814b580 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7ff40402a2b0 tx=0x7ff4040046c0 comp rx=0 tx=0).stop 2024-05-15T16:41:51.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.188+0000 7ff41d2cb640 1 -- 172.21.15.12:0/2052063252 reap_dead start 2024-05-15T16:41:51.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.188+0000 7ff41ed2e640 1 -- 172.21.15.12:0/2052063252 shutdown_connections 2024-05-15T16:41:51.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.188+0000 7ff41ed2e640 1 -- 172.21.15.12:0/2052063252 >> 172.21.15.12:0/2052063252 conn(0x7ff4180c07c0 msgr2=0x7ff4180be4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T16:41:51.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.188+0000 7ff41ed2e640 1 -- 172.21.15.12:0/2052063252 shutdown_connections 2024-05-15T16:41:51.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.188+0000 7ff41ed2e640 1 -- 172.21.15.12:0/2052063252 wait complete. 2024-05-15T16:41:51.200 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-05-15T16:41:51.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.313+0000 7fe89e372640 1 Processor -- start 2024-05-15T16:41:51.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.313+0000 7fe89e372640 1 -- start start 2024-05-15T16:41:51.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.314+0000 7fe89e372640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe89814cce0 0x7fe8980716a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:51.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.314+0000 7fe89e372640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe898071be0 0x7fe898156cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:51.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.314+0000 7fe89e372640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8980720d0 con 0x7fe8980be4f0 2024-05-15T16:41:51.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.314+0000 7fe89e372640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fe8980bfa60 con 0x7fe898071be0 2024-05-15T16:41:51.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.314+0000 7fe89e372640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fe898071310 con 0x7fe89814cce0 2024-05-15T16:41:51.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.314+0000 7fe89c90f640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe898071be0 0x7fe898156cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:51.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.314+0000 7fe897fff640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fe8980be4f0 0x7fe8980bfef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:53964/0 (socket says 172.21.15.12:53964) 2024-05-15T16:41:51.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.314+0000 7fe897fff640 1 -- 172.21.15.12:0/3264521989 learned_addr learned my addr 172.21.15.12:0/3264521989 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-05-15T16:41:51.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.314+0000 7fe8977fe640 1 --2- 172.21.15.12:0/3264521989 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe89814cce0 0x7fe8980716a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:51.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.314+0000 7fe89c90f640 1 -- 172.21.15.12:0/3264521989 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe89814cce0 msgr2=0x7fe8980716a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T16:41:51.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.314+0000 7fe89c90f640 1 --2- 172.21.15.12:0/3264521989 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe89814cce0 0x7fe8980716a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:51.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.314+0000 7fe89c90f640 1 -- 172.21.15.12:0/3264521989 >> v1:172.21.15.12:6789/0 conn(0x7fe8980be4f0 legacy=0x7fe8980bfef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:51.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.314+0000 7fe89c90f640 1 -- 172.21.15.12:0/3264521989 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8980bf6f0 con 0x7fe898071be0 2024-05-15T16:41:51.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.314+0000 7fe896ffd640 1 -- 172.21.15.12:0/3264521989 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 641283990 0 0) 0x7fe8980720d0 con 0x7fe8980be4f0 2024-05-15T16:41:51.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.314+0000 7fe8977fe640 1 --2- 172.21.15.12:0/3264521989 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe89814cce0 0x7fe8980716a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-15T16:41:51.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.315+0000 7fe89c90f640 1 --2- 172.21.15.12:0/3264521989 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe898071be0 0x7fe898156cb0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fe890009d90 tx=0x7fe89002a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e571f880251f127d server_cookie=0 in_seq=0 out_seq=0 2024-05-15T16:41:51.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.315+0000 7fe896ffd640 1 -- 172.21.15.12:0/3264521989 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe890031600 con 0x7fe898071be0 2024-05-15T16:41:51.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.315+0000 7fe896ffd640 1 -- 172.21.15.12:0/3264521989 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8900317a0 con 0x7fe898071be0 2024-05-15T16:41:51.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.315+0000 7fe896ffd640 1 -- 172.21.15.12:0/3264521989 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe890031b70 con 0x7fe898071be0 2024-05-15T16:41:51.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.316+0000 7fe89e372640 1 -- 172.21.15.12:0/3264521989 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe898071be0 msgr2=0x7fe898156cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:51.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.316+0000 7fe89e372640 1 --2- 172.21.15.12:0/3264521989 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe898071be0 0x7fe898156cb0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fe890009d90 tx=0x7fe89002a5d0 comp rx=0 tx=0).stop 2024-05-15T16:41:51.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.316+0000 7fe89e372640 1 -- 172.21.15.12:0/3264521989 shutdown_connections 2024-05-15T16:41:51.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.316+0000 7fe89e372640 1 --2- 172.21.15.12:0/3264521989 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe898071be0 0x7fe898156cb0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:51.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.316+0000 7fe89e372640 1 --2- 172.21.15.12:0/3264521989 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe89814cce0 0x7fe8980716a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:51.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.316+0000 7fe89e372640 1 -- 172.21.15.12:0/3264521989 >> 172.21.15.12:0/3264521989 conn(0x7fe8980c17c0 msgr2=0x7fe8980c1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T16:41:51.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.316+0000 7fe89e372640 1 -- 172.21.15.12:0/3264521989 shutdown_connections 2024-05-15T16:41:51.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.316+0000 7fe89e372640 1 -- 172.21.15.12:0/3264521989 wait complete. 2024-05-15T16:41:51.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.318+0000 7fe89e372640 1 Processor -- start 2024-05-15T16:41:51.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.318+0000 7fe89e372640 1 -- start start 2024-05-15T16:41:51.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.319+0000 7fe89e372640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe898071be0 0x7fe8981d38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:51.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.319+0000 7fe89e372640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8980be4f0 0x7fe8981e56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:51.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.319+0000 7fe89e372640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe89814cce0 0x7fe8981d42e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:51.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.319+0000 7fe89e372640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fe8980a6c90 con 0x7fe898071be0 2024-05-15T16:41:51.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.319+0000 7fe89e372640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fe8980723b0 con 0x7fe8980be4f0 2024-05-15T16:41:51.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.319+0000 7fe89e372640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fe8980bc1c0 con 0x7fe89814cce0 2024-05-15T16:41:51.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.319+0000 7fe897fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe898071be0 0x7fe8981d38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:51.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.319+0000 7fe897fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe898071be0 0x7fe8981d38b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46048/0 (socket says 172.21.15.12:46048) 2024-05-15T16:41:51.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.319+0000 7fe897fff640 1 -- 172.21.15.12:0/2767450212 learned_addr learned my addr 172.21.15.12:0/2767450212 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T16:41:51.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.319+0000 7fe8977fe640 1 --2- 172.21.15.12:0/2767450212 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8980be4f0 0x7fe8981e56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:51.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.319+0000 7fe89c90f640 1 --2- 172.21.15.12:0/2767450212 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe89814cce0 0x7fe8981d42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:51.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.319+0000 7fe897fff640 1 -- 172.21.15.12:0/2767450212 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe89814cce0 msgr2=0x7fe8981d42e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:51.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.319+0000 7fe897fff640 1 --2- 172.21.15.12:0/2767450212 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe89814cce0 0x7fe8981d42e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:51.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.319+0000 7fe897fff640 1 -- 172.21.15.12:0/2767450212 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8980be4f0 msgr2=0x7fe8981e56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:51.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.319+0000 7fe897fff640 1 --2- 172.21.15.12:0/2767450212 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8980be4f0 0x7fe8981e56a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:51.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.319+0000 7fe897fff640 1 -- 172.21.15.12:0/2767450212 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8981d5b20 con 0x7fe898071be0 2024-05-15T16:41:51.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.319+0000 7fe8977fe640 1 --2- 172.21.15.12:0/2767450212 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8980be4f0 0x7fe8981e56a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-15T16:41:51.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.319+0000 7fe897fff640 1 --2- 172.21.15.12:0/2767450212 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe898071be0 0x7fe8981d38b0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fe88800c3e0 tx=0x7fe88800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T16:41:51.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.320+0000 7fe894ff9640 1 -- 172.21.15.12:0/2767450212 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8880074e0 con 0x7fe898071be0 2024-05-15T16:41:51.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.320+0000 7fe894ff9640 1 -- 172.21.15.12:0/2767450212 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8880047e0 con 0x7fe898071be0 2024-05-15T16:41:51.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.320+0000 7fe894ff9640 1 -- 172.21.15.12:0/2767450212 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe888004bd0 con 0x7fe898071be0 2024-05-15T16:41:51.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.320+0000 7fe89e372640 1 -- 172.21.15.12:0/2767450212 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8981e5be0 con 0x7fe898071be0 2024-05-15T16:41:51.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.320+0000 7fe89e372640 1 -- 172.21.15.12:0/2767450212 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8980a35f0 con 0x7fe898071be0 2024-05-15T16:41:51.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.321+0000 7fe89e372640 1 -- 172.21.15.12:0/2767450212 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe898050940 con 0x7fe898071be0 2024-05-15T16:41:51.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.321+0000 7fe894ff9640 1 -- 172.21.15.12:0/2767450212 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe888011070 con 0x7fe898071be0 2024-05-15T16:41:51.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.322+0000 7fe894ff9640 1 --2- 172.21.15.12:0/2767450212 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fe8840762d0 0x7fe8840787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:51.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.322+0000 7fe894ff9640 1 -- 172.21.15.12:0/2767450212 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4943+0+0 (secure 0 0 0) 0x7fe888096dc0 con 0x7fe898071be0 2024-05-15T16:41:51.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.322+0000 7fe8977fe640 1 --2- 172.21.15.12:0/2767450212 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fe8840762d0 0x7fe8840787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:51.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.322+0000 7fe8977fe640 1 --2- 172.21.15.12:0/2767450212 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fe8840762d0 0x7fe8840787e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fe8981d2bc0 tx=0x7fe88c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T16:41:51.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.327+0000 7fe894ff9640 1 -- 172.21.15.12:0/2767450212 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fe888060ab0 con 0x7fe898071be0 2024-05-15T16:41:51.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.514+0000 7fe89e372640 1 -- 172.21.15.12:0/2767450212 --> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7fe8980c0e20 con 0x7fe8840762d0 2024-05-15T16:41:51.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.515+0000 7fe894ff9640 1 -- 172.21.15.12:0/2767450212 <== mgr.4106 v2:172.21.15.84:6832/4173299311 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fe8980c0e20 con 0x7fe8840762d0 2024-05-15T16:41:51.516 INFO:teuthology.orchestra.run.smithi012.stderr:instructed osd(s) 3 to deep-scrub 2024-05-15T16:41:51.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.517+0000 7fe89e372640 1 -- 172.21.15.12:0/2767450212 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fe8840762d0 msgr2=0x7fe8840787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:51.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.517+0000 7fe89e372640 1 --2- 172.21.15.12:0/2767450212 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fe8840762d0 0x7fe8840787e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fe8981d2bc0 tx=0x7fe88c008040 comp rx=0 tx=0).stop 2024-05-15T16:41:51.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.517+0000 7fe89e372640 1 -- 172.21.15.12:0/2767450212 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe898071be0 msgr2=0x7fe8981d38b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:51.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.517+0000 7fe89e372640 1 --2- 172.21.15.12:0/2767450212 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe898071be0 0x7fe8981d38b0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fe88800c3e0 tx=0x7fe88800c8a0 comp rx=0 tx=0).stop 2024-05-15T16:41:51.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.517+0000 7fe89e372640 1 -- 172.21.15.12:0/2767450212 shutdown_connections 2024-05-15T16:41:51.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.517+0000 7fe89e372640 1 --2- 172.21.15.12:0/2767450212 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe89814cce0 0x7fe8981d42e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:51.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.517+0000 7fe89e372640 1 --2- 172.21.15.12:0/2767450212 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8980be4f0 0x7fe8981e56a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:51.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.517+0000 7fe89e372640 1 --2- 172.21.15.12:0/2767450212 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fe8840762d0 0x7fe8840787e0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:51.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.517+0000 7fe89e372640 1 --2- 172.21.15.12:0/2767450212 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe898071be0 0x7fe8981d38b0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:51.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.517+0000 7fe89e372640 1 -- 172.21.15.12:0/2767450212 >> 172.21.15.12:0/2767450212 conn(0x7fe8980c17c0 msgr2=0x7fe8981d87e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T16:41:51.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.517+0000 7fe89e372640 1 -- 172.21.15.12:0/2767450212 shutdown_connections 2024-05-15T16:41:51.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.517+0000 7fe89e372640 1 -- 172.21.15.12:0/2767450212 wait complete. 2024-05-15T16:41:51.529 INFO:tasks.ceph:Scrubbing osd.4 2024-05-15T16:41:51.529 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-05-15T16:41:51.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.644+0000 7f1f6fa9f640 1 Processor -- start 2024-05-15T16:41:51.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.644+0000 7f1f6fa9f640 1 -- start start 2024-05-15T16:41:51.656 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.645+0000 7f1f6fa9f640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1f68148770 0x7f1f680c0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:51.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.645+0000 7f1f6fa9f640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f680c0620 con 0x7f1f680bf9b0 2024-05-15T16:41:51.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.645+0000 7f1f6fa9f640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f68151ad0 con 0x7f1f6814e360 2024-05-15T16:41:51.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.645+0000 7f1f6fa9f640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f1f68151e40 con 0x7f1f68148770 2024-05-15T16:41:51.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.645+0000 7f1f6e03c640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f1f680bf9b0 0x7f1f680bfdc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:53972/0 (socket says 172.21.15.12:53972) 2024-05-15T16:41:51.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.645+0000 7f1f6e03c640 1 -- 172.21.15.12:0/1298623190 learned_addr learned my addr 172.21.15.12:0/1298623190 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-05-15T16:41:51.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.646+0000 7f1f6d03a640 1 --2- 172.21.15.12:0/1298623190 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1f68148770 0x7f1f680c0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:51.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.646+0000 7f1f6c839640 1 -- 172.21.15.12:0/1298623190 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1988692878 0 0) 0x7f1f680c0620 con 0x7f1f680bf9b0 2024-05-15T16:41:51.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.646+0000 7f1f6c839640 1 -- 172.21.15.12:0/1298623190 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1f54003520 con 0x7f1f680bf9b0 2024-05-15T16:41:51.659 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.646+0000 7f1f6c839640 1 -- 172.21.15.12:0/1298623190 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1269981526 0 0) 0x7f1f54003520 con 0x7f1f680bf9b0 2024-05-15T16:41:51.659 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.646+0000 7f1f6c839640 1 -- 172.21.15.12:0/1298623190 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1f68148770 msgr2=0x7f1f680c0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T16:41:51.659 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.646+0000 7f1f6c839640 1 --2- 172.21.15.12:0/1298623190 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1f68148770 0x7f1f680c0c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:51.659 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.646+0000 7f1f6c839640 1 -- 172.21.15.12:0/1298623190 >> v1:172.21.15.84:6789/0 conn(0x7f1f6814e360 legacy=0x7f1f681522d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:51.659 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.646+0000 7f1f6c839640 1 -- 172.21.15.12:0/1298623190 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f680c11c0 con 0x7f1f680bf9b0 2024-05-15T16:41:51.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.646+0000 7f1f6c839640 1 -- 172.21.15.12:0/1298623190 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 38171736 0 0) 0x7f1f60001a90 con 0x7f1f680bf9b0 2024-05-15T16:41:51.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.646+0000 7f1f6c839640 1 -- 172.21.15.12:0/1298623190 >> v1:172.21.15.12:6789/0 conn(0x7f1f680bf9b0 legacy=0x7f1f680bfdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:51.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.646+0000 7f1f6c839640 1 --2- 172.21.15.12:0/1298623190 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1f54003a30 0x7f1f54003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:51.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.646+0000 7f1f6c839640 1 --2- 172.21.15.12:0/1298623190 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1f68148770 0x7f1f54004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:51.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.646+0000 7f1f6c839640 1 --2- 172.21.15.12:0/1298623190 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f54004d40 0x7f1f54005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:51.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.646+0000 7f1f6c839640 1 -- 172.21.15.12:0/1298623190 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f1f68151e40 con 0x7f1f54003a30 2024-05-15T16:41:51.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.646+0000 7f1f6c839640 1 -- 172.21.15.12:0/1298623190 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f1f5400bc00 con 0x7f1f54004d40 2024-05-15T16:41:51.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.646+0000 7f1f6c839640 1 -- 172.21.15.12:0/1298623190 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f1f5400be00 con 0x7f1f68148770 2024-05-15T16:41:51.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.646+0000 7f1f6d83b640 1 --2- 172.21.15.12:0/1298623190 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1f54003a30 0x7f1f54003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:51.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.646+0000 7f1f6e03c640 1 --2- 172.21.15.12:0/1298623190 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f54004d40 0x7f1f54005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:51.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.646+0000 7f1f6d03a640 1 --2- 172.21.15.12:0/1298623190 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1f68148770 0x7f1f54004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:51.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.646+0000 7f1f6d83b640 1 -- 172.21.15.12:0/1298623190 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1f68148770 msgr2=0x7f1f54004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T16:41:51.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.646+0000 7f1f6d83b640 1 --2- 172.21.15.12:0/1298623190 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1f68148770 0x7f1f54004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:51.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.646+0000 7f1f6d83b640 1 -- 172.21.15.12:0/1298623190 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f54004d40 msgr2=0x7f1f54005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T16:41:51.663 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.646+0000 7f1f6d83b640 1 --2- 172.21.15.12:0/1298623190 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f54004d40 0x7f1f54005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:51.663 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.646+0000 7f1f6d83b640 1 -- 172.21.15.12:0/1298623190 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f54003520 con 0x7f1f54003a30 2024-05-15T16:41:51.663 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.646+0000 7f1f6d03a640 1 --2- 172.21.15.12:0/1298623190 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1f68148770 0x7f1f54004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-15T16:41:51.663 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.647+0000 7f1f6d83b640 1 --2- 172.21.15.12:0/1298623190 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1f54003a30 0x7f1f54003ea0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f1f64001790 tx=0x7f1f54005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3e3ae4ce203fb5 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T16:41:51.663 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.647+0000 7f1f6c839640 1 -- 172.21.15.12:0/1298623190 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f640013b0 con 0x7f1f54003a30 2024-05-15T16:41:51.664 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.647+0000 7f1f6c839640 1 -- 172.21.15.12:0/1298623190 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f640052d0 con 0x7f1f54003a30 2024-05-15T16:41:51.664 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.647+0000 7f1f6c839640 1 -- 172.21.15.12:0/1298623190 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f6402aae0 con 0x7f1f54003a30 2024-05-15T16:41:51.664 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.648+0000 7f1f6fa9f640 1 -- 172.21.15.12:0/1298623190 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1f54003a30 msgr2=0x7f1f54003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:51.664 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.648+0000 7f1f6fa9f640 1 --2- 172.21.15.12:0/1298623190 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1f54003a30 0x7f1f54003ea0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f1f64001790 tx=0x7f1f54005830 comp rx=0 tx=0).stop 2024-05-15T16:41:51.665 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.648+0000 7f1f6e03c640 1 -- 172.21.15.12:0/1298623190 reap_dead start 2024-05-15T16:41:51.665 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.648+0000 7f1f6fa9f640 1 -- 172.21.15.12:0/1298623190 shutdown_connections 2024-05-15T16:41:51.665 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.648+0000 7f1f6fa9f640 1 -- 172.21.15.12:0/1298623190 >> 172.21.15.12:0/1298623190 conn(0x7f1f680c17c0 msgr2=0x7f1f680c1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T16:41:51.665 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.648+0000 7f1f6fa9f640 1 -- 172.21.15.12:0/1298623190 shutdown_connections 2024-05-15T16:41:51.665 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.648+0000 7f1f6fa9f640 1 -- 172.21.15.12:0/1298623190 wait complete. 2024-05-15T16:41:51.666 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.649+0000 7f1f6fa9f640 1 Processor -- start 2024-05-15T16:41:51.666 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.650+0000 7f1f6fa9f640 1 -- start start 2024-05-15T16:41:51.666 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.651+0000 7f1f6fa9f640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1f54003a30 0x7f1f68146a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:51.666 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.651+0000 7f1f6fa9f640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f680728f0 0x7f1f681e8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:51.667 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.651+0000 7f1f6fa9f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1f68143e50 0x7f1f68144260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:51.667 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.651+0000 7f1f6fa9f640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f1f68154ca0 con 0x7f1f68143e50 2024-05-15T16:41:51.667 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.651+0000 7f1f6fa9f640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f1f680c0ed0 con 0x7f1f680728f0 2024-05-15T16:41:51.667 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.651+0000 7f1f6fa9f640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f1f68154e20 con 0x7f1f54003a30 2024-05-15T16:41:51.667 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.651+0000 7f1f6e03c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1f68143e50 0x7f1f68144260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:51.667 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.651+0000 7f1f6e03c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1f68143e50 0x7f1f68144260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46074/0 (socket says 172.21.15.12:46074) 2024-05-15T16:41:51.668 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.651+0000 7f1f6e03c640 1 -- 172.21.15.12:0/765062363 learned_addr learned my addr 172.21.15.12:0/765062363 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T16:41:51.668 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.651+0000 7f1f6d03a640 1 --2- 172.21.15.12:0/765062363 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f680728f0 0x7f1f681e8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:51.668 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.651+0000 7f1f6d83b640 1 --2- 172.21.15.12:0/765062363 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1f54003a30 0x7f1f68146a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:51.668 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.651+0000 7f1f6e03c640 1 -- 172.21.15.12:0/765062363 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1f54003a30 msgr2=0x7f1f68146a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:51.669 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.651+0000 7f1f6e03c640 1 --2- 172.21.15.12:0/765062363 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1f54003a30 0x7f1f68146a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:51.669 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.651+0000 7f1f6e03c640 1 -- 172.21.15.12:0/765062363 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f680728f0 msgr2=0x7f1f681e8020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:51.669 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.651+0000 7f1f6e03c640 1 --2- 172.21.15.12:0/765062363 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f680728f0 0x7f1f681e8020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:51.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.651+0000 7f1f6e03c640 1 -- 172.21.15.12:0/765062363 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f681e8560 con 0x7f1f68143e50 2024-05-15T16:41:51.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.651+0000 7f1f6e03c640 1 --2- 172.21.15.12:0/765062363 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1f68143e50 0x7f1f68144260 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f1f680bf700 tx=0x7f1f60007a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T16:41:51.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.651+0000 7f1f5e7fc640 1 -- 172.21.15.12:0/765062363 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f6000ac40 con 0x7f1f68143e50 2024-05-15T16:41:51.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.651+0000 7f1f5e7fc640 1 -- 172.21.15.12:0/765062363 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f60019070 con 0x7f1f68143e50 2024-05-15T16:41:51.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.651+0000 7f1f6fa9f640 1 -- 172.21.15.12:0/765062363 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f68147460 con 0x7f1f68143e50 2024-05-15T16:41:51.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.651+0000 7f1f5e7fc640 1 -- 172.21.15.12:0/765062363 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f60013630 con 0x7f1f68143e50 2024-05-15T16:41:51.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.651+0000 7f1f6fa9f640 1 -- 172.21.15.12:0/765062363 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f681e8770 con 0x7f1f68143e50 2024-05-15T16:41:51.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.652+0000 7f1f6fa9f640 1 -- 172.21.15.12:0/765062363 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1f68050940 con 0x7f1f68143e50 2024-05-15T16:41:51.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.653+0000 7f1f5e7fc640 1 -- 172.21.15.12:0/765062363 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1f600137d0 con 0x7f1f68143e50 2024-05-15T16:41:51.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.653+0000 7f1f5e7fc640 1 --2- 172.21.15.12:0/765062363 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f1f4c076300 0x7f1f4c078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:51.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.653+0000 7f1f5e7fc640 1 -- 172.21.15.12:0/765062363 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4943+0+0 (secure 0 0 0) 0x7f1f60097910 con 0x7f1f68143e50 2024-05-15T16:41:51.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.654+0000 7f1f5e7fc640 1 --2- 172.21.15.12:0/765062363 >> [v2:172.21.15.84:6808/1021092792,v1:172.21.15.84:6809/1021092792] conn(0x7f1f4c07c210 0x7f1f4c07e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:51.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.654+0000 7f1f5e7fc640 1 -- 172.21.15.12:0/765062363 --> [v2:172.21.15.84:6808/1021092792,v1:172.21.15.84:6809/1021092792] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1f4c07ed30 con 0x7f1f4c07c210 2024-05-15T16:41:51.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.654+0000 7f1f5e7fc640 1 -- 172.21.15.12:0/765062363 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f1f6009c2a0 con 0x7f1f68143e50 2024-05-15T16:41:51.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.654+0000 7f1f6d83b640 1 --2- 172.21.15.12:0/765062363 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f1f4c076300 0x7f1f4c078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:51.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.654+0000 7f1f6d03a640 1 --2- 172.21.15.12:0/765062363 >> [v2:172.21.15.84:6808/1021092792,v1:172.21.15.84:6809/1021092792] conn(0x7f1f4c07c210 0x7f1f4c07e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:51.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.654+0000 7f1f6d83b640 1 --2- 172.21.15.12:0/765062363 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f1f4c076300 0x7f1f4c078810 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f1f64032000 tx=0x7f1f6402e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T16:41:51.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.654+0000 7f1f6d03a640 1 --2- 172.21.15.12:0/765062363 >> [v2:172.21.15.84:6808/1021092792,v1:172.21.15.84:6809/1021092792] conn(0x7f1f4c07c210 0x7f1f4c07e660 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T16:41:51.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.655+0000 7f1f5e7fc640 1 -- 172.21.15.12:0/765062363 <== osd.4 v2:172.21.15.84:6808/1021092792 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1f4c07ed30 con 0x7f1f4c07c210 2024-05-15T16:41:51.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.668+0000 7f1f6fa9f640 1 -- 172.21.15.12:0/765062363 --> [v2:172.21.15.84:6808/1021092792,v1:172.21.15.84:6809/1021092792] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f1f68154180 con 0x7f1f4c07c210 2024-05-15T16:41:51.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.669+0000 7f1f5e7fc640 1 -- 172.21.15.12:0/765062363 <== osd.4 v2:172.21.15.84:6808/1021092792 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f1f68154180 con 0x7f1f4c07c210 2024-05-15T16:41:51.676 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-05-15T16:41:51.677 INFO:teuthology.orchestra.run.smithi012.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-15T16:41:51.677 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-05-15T16:41:51.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.669+0000 7f1f6fa9f640 1 -- 172.21.15.12:0/765062363 >> [v2:172.21.15.84:6808/1021092792,v1:172.21.15.84:6809/1021092792] conn(0x7f1f4c07c210 msgr2=0x7f1f4c07e660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:51.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.669+0000 7f1f6fa9f640 1 --2- 172.21.15.12:0/765062363 >> [v2:172.21.15.84:6808/1021092792,v1:172.21.15.84:6809/1021092792] conn(0x7f1f4c07c210 0x7f1f4c07e660 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:51.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.669+0000 7f1f6fa9f640 1 -- 172.21.15.12:0/765062363 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f1f4c076300 msgr2=0x7f1f4c078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:51.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.669+0000 7f1f6fa9f640 1 --2- 172.21.15.12:0/765062363 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f1f4c076300 0x7f1f4c078810 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f1f64032000 tx=0x7f1f6402e000 comp rx=0 tx=0).stop 2024-05-15T16:41:51.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.669+0000 7f1f6fa9f640 1 -- 172.21.15.12:0/765062363 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1f68143e50 msgr2=0x7f1f68144260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:51.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.669+0000 7f1f6fa9f640 1 --2- 172.21.15.12:0/765062363 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1f68143e50 0x7f1f68144260 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f1f680bf700 tx=0x7f1f60007a90 comp rx=0 tx=0).stop 2024-05-15T16:41:51.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.670+0000 7f1f6e03c640 1 -- 172.21.15.12:0/765062363 reap_dead start 2024-05-15T16:41:51.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.670+0000 7f1f6fa9f640 1 -- 172.21.15.12:0/765062363 shutdown_connections 2024-05-15T16:41:51.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.670+0000 7f1f6fa9f640 1 -- 172.21.15.12:0/765062363 >> 172.21.15.12:0/765062363 conn(0x7f1f680c17c0 msgr2=0x7f1f6814c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T16:41:51.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.670+0000 7f1f6fa9f640 1 -- 172.21.15.12:0/765062363 shutdown_connections 2024-05-15T16:41:51.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.670+0000 7f1f6fa9f640 1 -- 172.21.15.12:0/765062363 wait complete. 2024-05-15T16:41:51.683 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-05-15T16:41:51.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.794+0000 7f5140da9640 1 Processor -- start 2024-05-15T16:41:51.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.794+0000 7f5140da9640 1 -- start start 2024-05-15T16:41:51.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.795+0000 7f5140da9640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f513c14e360 0x7f513c1522d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:51.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.795+0000 7f5140da9640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f513c148770 0x7f513c0c0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:51.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.795+0000 7f5140da9640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f513c0c0620 con 0x7f513c0bf9b0 2024-05-15T16:41:51.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.795+0000 7f5140da9640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f513c151e40 con 0x7f513c14e360 2024-05-15T16:41:51.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.795+0000 7f5140da9640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f513c151ad0 con 0x7f513c148770 2024-05-15T16:41:51.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.795+0000 7f513a59c640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f513c14e360 0x7f513c1522d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:51.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.795+0000 7f513a59c640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f513c14e360 0x7f513c1522d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46086/0 (socket says 172.21.15.12:46086) 2024-05-15T16:41:51.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.795+0000 7f513a59c640 1 -- 172.21.15.12:0/666663316 learned_addr learned my addr 172.21.15.12:0/666663316 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T16:41:51.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.796+0000 7f5139d9b640 1 --2- 172.21.15.12:0/666663316 >> v2:172.21.15.84:3300/0 conn(0x7f513c148770 0x7f513c0c0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:51.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.796+0000 7f513a59c640 1 -- 172.21.15.12:0/666663316 >> v2:172.21.15.84:3300/0 conn(0x7f513c148770 msgr2=0x7f513c0c0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T16:41:51.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.796+0000 7f513a59c640 1 --2- 172.21.15.12:0/666663316 >> v2:172.21.15.84:3300/0 conn(0x7f513c148770 0x7f513c0c0c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:51.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.796+0000 7f513a59c640 1 -- 172.21.15.12:0/666663316 >> v1:172.21.15.84:6789/0 conn(0x7f513c0bf9b0 legacy=0x7f513c0bfdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T16:41:51.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.796+0000 7f513a59c640 1 -- 172.21.15.12:0/666663316 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f513c152810 con 0x7f513c14e360 2024-05-15T16:41:51.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.796+0000 7f513a59c640 1 --2- 172.21.15.12:0/666663316 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f513c14e360 0x7f513c1522d0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f5134009870 tx=0x7f513402a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3fade92266c7621 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T16:41:51.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.797+0000 7f513959a640 1 -- 172.21.15.12:0/666663316 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5134037070 con 0x7f513c14e360 2024-05-15T16:41:51.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.797+0000 7f513959a640 1 -- 172.21.15.12:0/666663316 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5134032440 con 0x7f513c14e360 2024-05-15T16:41:51.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.797+0000 7f513959a640 1 -- 172.21.15.12:0/666663316 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5134032810 con 0x7f513c14e360 2024-05-15T16:41:51.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.797+0000 7f5140da9640 1 -- 172.21.15.12:0/666663316 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f513c14e360 msgr2=0x7f513c1522d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:51.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.797+0000 7f5140da9640 1 --2- 172.21.15.12:0/666663316 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f513c14e360 0x7f513c1522d0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f5134009870 tx=0x7f513402a2a0 comp rx=0 tx=0).stop 2024-05-15T16:41:51.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.797+0000 7f5140da9640 1 -- 172.21.15.12:0/666663316 shutdown_connections 2024-05-15T16:41:51.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.797+0000 7f5140da9640 1 --2- 172.21.15.12:0/666663316 >> v2:172.21.15.84:3300/0 conn(0x7f513c148770 0x7f513c0c0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:51.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.797+0000 7f5140da9640 1 --2- 172.21.15.12:0/666663316 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f513c14e360 0x7f513c1522d0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:51.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.797+0000 7f5140da9640 1 -- 172.21.15.12:0/666663316 >> 172.21.15.12:0/666663316 conn(0x7f513c0c17c0 msgr2=0x7f513c0c1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T16:41:51.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.797+0000 7f5140da9640 1 -- 172.21.15.12:0/666663316 shutdown_connections 2024-05-15T16:41:51.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.797+0000 7f5140da9640 1 -- 172.21.15.12:0/666663316 wait complete. 2024-05-15T16:41:51.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.799+0000 7f5140da9640 1 Processor -- start 2024-05-15T16:41:51.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.799+0000 7f5140da9640 1 -- start start 2024-05-15T16:41:51.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.800+0000 7f5140da9640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f513c0bf9b0 0x7f513c071010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:51.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.800+0000 7f5140da9640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f513c148770 0x7f513c150b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:51.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.800+0000 7f5140da9640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f513c14e360 0x7f513c1e47f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:51.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.800+0000 7f5140da9640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f513c158cc0 con 0x7f513c14e360 2024-05-15T16:41:51.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.800+0000 7f5140da9640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f513c0c13d0 con 0x7f513c148770 2024-05-15T16:41:51.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.800+0000 7f5140da9640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f513c158e40 con 0x7f513c0bf9b0 2024-05-15T16:41:51.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.800+0000 7f513ad9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f513c14e360 0x7f513c1e47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:51.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.800+0000 7f513ad9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f513c14e360 0x7f513c1e47f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46096/0 (socket says 172.21.15.12:46096) 2024-05-15T16:41:51.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.800+0000 7f513ad9d640 1 -- 172.21.15.12:0/1183380055 learned_addr learned my addr 172.21.15.12:0/1183380055 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T16:41:51.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.800+0000 7f5139d9b640 1 --2- 172.21.15.12:0/1183380055 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f513c148770 0x7f513c150b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:51.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.801+0000 7f513a59c640 1 --2- 172.21.15.12:0/1183380055 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f513c0bf9b0 0x7f513c071010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:51.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.801+0000 7f513ad9d640 1 -- 172.21.15.12:0/1183380055 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f513c0bf9b0 msgr2=0x7f513c071010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:51.805 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.801+0000 7f513ad9d640 1 --2- 172.21.15.12:0/1183380055 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f513c0bf9b0 0x7f513c071010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:51.805 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.801+0000 7f513ad9d640 1 -- 172.21.15.12:0/1183380055 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f513c148770 msgr2=0x7f513c150b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:51.805 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.801+0000 7f513ad9d640 1 --2- 172.21.15.12:0/1183380055 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f513c148770 0x7f513c150b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:51.805 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.801+0000 7f513ad9d640 1 -- 172.21.15.12:0/1183380055 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f513c1504f0 con 0x7f513c14e360 2024-05-15T16:41:51.805 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.801+0000 7f513ad9d640 1 --2- 172.21.15.12:0/1183380055 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f513c14e360 0x7f513c1e47f0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f512c00ba10 tx=0x7f512c00bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T16:41:51.805 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.801+0000 7f5132ffd640 1 -- 172.21.15.12:0/1183380055 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f512c019070 con 0x7f513c14e360 2024-05-15T16:41:51.805 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.801+0000 7f5132ffd640 1 -- 172.21.15.12:0/1183380055 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f512c00cb40 con 0x7f513c14e360 2024-05-15T16:41:51.805 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.801+0000 7f5140da9640 1 -- 172.21.15.12:0/1183380055 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f513c0b8340 con 0x7f513c14e360 2024-05-15T16:41:51.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.801+0000 7f5132ffd640 1 -- 172.21.15.12:0/1183380055 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f512c014440 con 0x7f513c14e360 2024-05-15T16:41:51.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.801+0000 7f5140da9640 1 -- 172.21.15.12:0/1183380055 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f513c072040 con 0x7f513c14e360 2024-05-15T16:41:51.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.802+0000 7f5140da9640 1 -- 172.21.15.12:0/1183380055 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f513c050940 con 0x7f513c14e360 2024-05-15T16:41:51.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.803+0000 7f5132ffd640 1 -- 172.21.15.12:0/1183380055 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f512c01c070 con 0x7f513c14e360 2024-05-15T16:41:51.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.803+0000 7f5132ffd640 1 --2- 172.21.15.12:0/1183380055 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f511c0762d0 0x7f511c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:51.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.803+0000 7f5132ffd640 1 -- 172.21.15.12:0/1183380055 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4943+0+0 (secure 0 0 0) 0x7f512c096f30 con 0x7f513c14e360 2024-05-15T16:41:51.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.804+0000 7f513a59c640 1 --2- 172.21.15.12:0/1183380055 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f511c0762d0 0x7f511c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:51.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.804+0000 7f513a59c640 1 --2- 172.21.15.12:0/1183380055 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f511c0762d0 0x7f511c0787e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f5134034000 tx=0x7f513402e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T16:41:51.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:51.808+0000 7f5132ffd640 1 -- 172.21.15.12:0/1183380055 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f512c060af0 con 0x7f513c14e360 2024-05-15T16:41:52.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.001+0000 7f5140da9640 1 -- 172.21.15.12:0/1183380055 --> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f513c0bf790 con 0x7f511c0762d0 2024-05-15T16:41:52.003 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.002+0000 7f5132ffd640 1 -- 172.21.15.12:0/1183380055 <== mgr.4106 v2:172.21.15.84:6832/4173299311 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f513c0bf790 con 0x7f511c0762d0 2024-05-15T16:41:52.003 INFO:teuthology.orchestra.run.smithi012.stderr:instructed osd(s) 4 to deep-scrub 2024-05-15T16:41:52.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.004+0000 7f5140da9640 1 -- 172.21.15.12:0/1183380055 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f511c0762d0 msgr2=0x7f511c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:52.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.004+0000 7f5140da9640 1 --2- 172.21.15.12:0/1183380055 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f511c0762d0 0x7f511c0787e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f5134034000 tx=0x7f513402e000 comp rx=0 tx=0).stop 2024-05-15T16:41:52.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.004+0000 7f5140da9640 1 -- 172.21.15.12:0/1183380055 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f513c14e360 msgr2=0x7f513c1e47f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:52.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.004+0000 7f5140da9640 1 --2- 172.21.15.12:0/1183380055 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f513c14e360 0x7f513c1e47f0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f512c00ba10 tx=0x7f512c00bed0 comp rx=0 tx=0).stop 2024-05-15T16:41:52.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.004+0000 7f5140da9640 1 -- 172.21.15.12:0/1183380055 shutdown_connections 2024-05-15T16:41:52.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.004+0000 7f5140da9640 1 --2- 172.21.15.12:0/1183380055 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f511c0762d0 0x7f511c0787e0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:52.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.004+0000 7f5140da9640 1 --2- 172.21.15.12:0/1183380055 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f513c14e360 0x7f513c1e47f0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:52.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.004+0000 7f5140da9640 1 --2- 172.21.15.12:0/1183380055 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f513c148770 0x7f513c150b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:52.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.004+0000 7f5140da9640 1 --2- 172.21.15.12:0/1183380055 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f513c0bf9b0 0x7f513c071010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:52.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.004+0000 7f5140da9640 1 -- 172.21.15.12:0/1183380055 >> 172.21.15.12:0/1183380055 conn(0x7f513c0c17c0 msgr2=0x7f513c0be6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T16:41:52.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.004+0000 7f5140da9640 1 -- 172.21.15.12:0/1183380055 shutdown_connections 2024-05-15T16:41:52.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.004+0000 7f5140da9640 1 -- 172.21.15.12:0/1183380055 wait complete. 2024-05-15T16:41:52.016 INFO:tasks.ceph:Scrubbing osd.5 2024-05-15T16:41:52.017 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-05-15T16:41:52.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.131+0000 7faf67f4d640 1 Processor -- start 2024-05-15T16:41:52.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.132+0000 7faf67f4d640 1 -- start start 2024-05-15T16:41:52.139 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.133+0000 7faf67f4d640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7faf600a0d50 0x7faf600c1600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:52.139 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.133+0000 7faf67f4d640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7faf600bfef0 0x7faf60156bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:52.139 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.133+0000 7faf67f4d640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf60071a50 con 0x7faf6014d020 2024-05-15T16:41:52.139 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.133+0000 7faf67f4d640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7faf600722f0 con 0x7faf600a0d50 2024-05-15T16:41:52.139 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.133+0000 7faf67f4d640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7faf60071d30 con 0x7faf600bfef0 2024-05-15T16:41:52.139 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.133+0000 7faf65ce9640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7faf600a0d50 0x7faf600c1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:52.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.133+0000 7faf654e8640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7faf6014d020 0x7faf600bf7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:53984/0 (socket says 172.21.15.12:53984) 2024-05-15T16:41:52.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.133+0000 7faf654e8640 1 -- 172.21.15.12:0/1816636826 learned_addr learned my addr 172.21.15.12:0/1816636826 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-05-15T16:41:52.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.133+0000 7faf664ea640 1 --2- 172.21.15.12:0/1816636826 >> v2:172.21.15.84:3300/0 conn(0x7faf600bfef0 0x7faf60156bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:52.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.133+0000 7faf65ce9640 1 -- 172.21.15.12:0/1816636826 >> v2:172.21.15.84:3300/0 conn(0x7faf600bfef0 msgr2=0x7faf60156bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T16:41:52.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.133+0000 7faf65ce9640 1 --2- 172.21.15.12:0/1816636826 >> v2:172.21.15.84:3300/0 conn(0x7faf600bfef0 0x7faf60156bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:52.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.133+0000 7faf65ce9640 1 -- 172.21.15.12:0/1816636826 >> v1:172.21.15.12:6789/0 conn(0x7faf6014d020 legacy=0x7faf600bf7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:52.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.133+0000 7faf64ce7640 1 -- 172.21.15.12:0/1816636826 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3783948789 0 0) 0x7faf60071a50 con 0x7faf6014d020 2024-05-15T16:41:52.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.133+0000 7faf65ce9640 1 -- 172.21.15.12:0/1816636826 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf60072010 con 0x7faf600a0d50 2024-05-15T16:41:52.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.134+0000 7faf65ce9640 1 --2- 172.21.15.12:0/1816636826 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf600a0d50 0x7faf600c1600 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7faf580097a0 tx=0x7faf5802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc0d2e3e1a7d2e3f server_cookie=0 in_seq=0 out_seq=0 2024-05-15T16:41:52.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.134+0000 7faf64ce7640 1 -- 172.21.15.12:0/1816636826 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf58037070 con 0x7faf600a0d50 2024-05-15T16:41:52.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.134+0000 7faf64ce7640 1 -- 172.21.15.12:0/1816636826 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf58032440 con 0x7faf600a0d50 2024-05-15T16:41:52.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.134+0000 7faf64ce7640 1 -- 172.21.15.12:0/1816636826 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf58032810 con 0x7faf600a0d50 2024-05-15T16:41:52.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.135+0000 7faf67f4d640 1 -- 172.21.15.12:0/1816636826 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf600a0d50 msgr2=0x7faf600c1600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:52.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.135+0000 7faf67f4d640 1 --2- 172.21.15.12:0/1816636826 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf600a0d50 0x7faf600c1600 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7faf580097a0 tx=0x7faf5802a1e0 comp rx=0 tx=0).stop 2024-05-15T16:41:52.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.135+0000 7faf67f4d640 1 -- 172.21.15.12:0/1816636826 shutdown_connections 2024-05-15T16:41:52.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.135+0000 7faf67f4d640 1 --2- 172.21.15.12:0/1816636826 >> v2:172.21.15.84:3300/0 conn(0x7faf600bfef0 0x7faf60156bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:52.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.135+0000 7faf67f4d640 1 --2- 172.21.15.12:0/1816636826 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf600a0d50 0x7faf600c1600 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:52.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.135+0000 7faf67f4d640 1 -- 172.21.15.12:0/1816636826 >> 172.21.15.12:0/1816636826 conn(0x7faf600be170 msgr2=0x7faf600be580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T16:41:52.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.135+0000 7faf67f4d640 1 -- 172.21.15.12:0/1816636826 shutdown_connections 2024-05-15T16:41:52.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.135+0000 7faf67f4d640 1 -- 172.21.15.12:0/1816636826 wait complete. 2024-05-15T16:41:52.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.136+0000 7faf67f4d640 1 Processor -- start 2024-05-15T16:41:52.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.137+0000 7faf67f4d640 1 -- start start 2024-05-15T16:41:52.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.138+0000 7faf67f4d640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7faf600a0d50 0x7faf601d9140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:52.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.138+0000 7faf67f4d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf600bfef0 0x7faf601d3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:52.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.138+0000 7faf67f4d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf6014d020 0x7faf601d2a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:52.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.138+0000 7faf67f4d640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7faf60070f40 con 0x7faf600bfef0 2024-05-15T16:41:52.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.138+0000 7faf67f4d640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7faf60070dc0 con 0x7faf6014d020 2024-05-15T16:41:52.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.138+0000 7faf67f4d640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7faf600c1b40 con 0x7faf600a0d50 2024-05-15T16:41:52.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.138+0000 7faf654e8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf600bfef0 0x7faf601d3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:52.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.138+0000 7faf654e8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf600bfef0 0x7faf601d3bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46116/0 (socket says 172.21.15.12:46116) 2024-05-15T16:41:52.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.138+0000 7faf654e8640 1 -- 172.21.15.12:0/2529140863 learned_addr learned my addr 172.21.15.12:0/2529140863 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T16:41:52.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.138+0000 7faf664ea640 1 --2- 172.21.15.12:0/2529140863 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf6014d020 0x7faf601d2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:52.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.138+0000 7faf65ce9640 1 --2- 172.21.15.12:0/2529140863 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7faf600a0d50 0x7faf601d9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:52.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.138+0000 7faf654e8640 1 -- 172.21.15.12:0/2529140863 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7faf600a0d50 msgr2=0x7faf601d9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:52.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.138+0000 7faf654e8640 1 --2- 172.21.15.12:0/2529140863 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7faf600a0d50 0x7faf601d9140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:52.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.138+0000 7faf654e8640 1 -- 172.21.15.12:0/2529140863 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf6014d020 msgr2=0x7faf601d2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:52.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.138+0000 7faf654e8640 1 --2- 172.21.15.12:0/2529140863 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf6014d020 0x7faf601d2a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:52.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.138+0000 7faf654e8640 1 -- 172.21.15.12:0/2529140863 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf601d9680 con 0x7faf600bfef0 2024-05-15T16:41:52.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.138+0000 7faf654e8640 1 --2- 172.21.15.12:0/2529140863 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf600bfef0 0x7faf601d3bf0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7faf5400c3f0 tx=0x7faf5400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T16:41:52.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.138+0000 7faf5e7fc640 1 -- 172.21.15.12:0/2529140863 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf540074e0 con 0x7faf600bfef0 2024-05-15T16:41:52.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.138+0000 7faf5e7fc640 1 -- 172.21.15.12:0/2529140863 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf540047e0 con 0x7faf600bfef0 2024-05-15T16:41:52.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.138+0000 7faf67f4d640 1 -- 172.21.15.12:0/2529140863 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf601d4130 con 0x7faf600bfef0 2024-05-15T16:41:52.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.138+0000 7faf5e7fc640 1 -- 172.21.15.12:0/2529140863 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf54004bd0 con 0x7faf600bfef0 2024-05-15T16:41:52.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.138+0000 7faf67f4d640 1 -- 172.21.15.12:0/2529140863 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf601d8940 con 0x7faf600bfef0 2024-05-15T16:41:52.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.139+0000 7faf67f4d640 1 -- 172.21.15.12:0/2529140863 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7faf6006d540 con 0x7faf600bfef0 2024-05-15T16:41:52.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.140+0000 7faf5e7fc640 1 -- 172.21.15.12:0/2529140863 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7faf54011070 con 0x7faf600bfef0 2024-05-15T16:41:52.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.141+0000 7faf5e7fc640 1 --2- 172.21.15.12:0/2529140863 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7faf4c0762d0 0x7faf4c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:52.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.141+0000 7faf5e7fc640 1 -- 172.21.15.12:0/2529140863 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4943+0+0 (secure 0 0 0) 0x7faf540976d0 con 0x7faf600bfef0 2024-05-15T16:41:52.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.141+0000 7faf5e7fc640 1 --2- 172.21.15.12:0/2529140863 >> [v2:172.21.15.84:6800/3173527851,v1:172.21.15.84:6801/3173527851] conn(0x7faf4c07c1e0 0x7faf4c07e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:52.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.141+0000 7faf5e7fc640 1 -- 172.21.15.12:0/2529140863 --> [v2:172.21.15.84:6800/3173527851,v1:172.21.15.84:6801/3173527851] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7faf54017e80 con 0x7faf4c07c1e0 2024-05-15T16:41:52.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.141+0000 7faf5e7fc640 1 -- 172.21.15.12:0/2529140863 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7faf54097a80 con 0x7faf600bfef0 2024-05-15T16:41:52.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.141+0000 7faf65ce9640 1 --2- 172.21.15.12:0/2529140863 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7faf4c0762d0 0x7faf4c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:52.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.141+0000 7faf664ea640 1 --2- 172.21.15.12:0/2529140863 >> [v2:172.21.15.84:6800/3173527851,v1:172.21.15.84:6801/3173527851] conn(0x7faf4c07c1e0 0x7faf4c07e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:52.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.141+0000 7faf65ce9640 1 --2- 172.21.15.12:0/2529140863 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7faf4c0762d0 0x7faf4c0787e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7faf58034000 tx=0x7faf5802e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T16:41:52.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.141+0000 7faf664ea640 1 --2- 172.21.15.12:0/2529140863 >> [v2:172.21.15.84:6800/3173527851,v1:172.21.15.84:6801/3173527851] conn(0x7faf4c07c1e0 0x7faf4c07e630 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T16:41:52.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.142+0000 7faf5e7fc640 1 -- 172.21.15.12:0/2529140863 <== osd.5 v2:172.21.15.84:6800/3173527851 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7faf54017e80 con 0x7faf4c07c1e0 2024-05-15T16:41:52.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.156+0000 7faf67f4d640 1 -- 172.21.15.12:0/2529140863 --> [v2:172.21.15.84:6800/3173527851,v1:172.21.15.84:6801/3173527851] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7faf600a6c00 con 0x7faf4c07c1e0 2024-05-15T16:41:52.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.156+0000 7faf5e7fc640 1 -- 172.21.15.12:0/2529140863 <== osd.5 v2:172.21.15.84:6800/3173527851 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7faf600a6c00 con 0x7faf4c07c1e0 2024-05-15T16:41:52.157 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-05-15T16:41:52.157 INFO:teuthology.orchestra.run.smithi012.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-15T16:41:52.157 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-05-15T16:41:52.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.156+0000 7faf67f4d640 1 -- 172.21.15.12:0/2529140863 >> [v2:172.21.15.84:6800/3173527851,v1:172.21.15.84:6801/3173527851] conn(0x7faf4c07c1e0 msgr2=0x7faf4c07e630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:52.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.156+0000 7faf67f4d640 1 --2- 172.21.15.12:0/2529140863 >> [v2:172.21.15.84:6800/3173527851,v1:172.21.15.84:6801/3173527851] conn(0x7faf4c07c1e0 0x7faf4c07e630 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:52.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.156+0000 7faf67f4d640 1 -- 172.21.15.12:0/2529140863 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7faf4c0762d0 msgr2=0x7faf4c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:52.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.156+0000 7faf67f4d640 1 --2- 172.21.15.12:0/2529140863 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7faf4c0762d0 0x7faf4c0787e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7faf58034000 tx=0x7faf5802e000 comp rx=0 tx=0).stop 2024-05-15T16:41:52.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.156+0000 7faf67f4d640 1 -- 172.21.15.12:0/2529140863 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf600bfef0 msgr2=0x7faf601d3bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:52.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.156+0000 7faf67f4d640 1 --2- 172.21.15.12:0/2529140863 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf600bfef0 0x7faf601d3bf0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7faf5400c3f0 tx=0x7faf5400c8b0 comp rx=0 tx=0).stop 2024-05-15T16:41:52.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.156+0000 7faf664ea640 1 -- 172.21.15.12:0/2529140863 reap_dead start 2024-05-15T16:41:52.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.156+0000 7faf67f4d640 1 -- 172.21.15.12:0/2529140863 shutdown_connections 2024-05-15T16:41:52.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.156+0000 7faf67f4d640 1 -- 172.21.15.12:0/2529140863 >> 172.21.15.12:0/2529140863 conn(0x7faf600be170 msgr2=0x7faf6006ce30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T16:41:52.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.156+0000 7faf67f4d640 1 -- 172.21.15.12:0/2529140863 shutdown_connections 2024-05-15T16:41:52.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.157+0000 7faf67f4d640 1 -- 172.21.15.12:0/2529140863 wait complete. 2024-05-15T16:41:52.168 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-05-15T16:41:52.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.279+0000 7f6382649640 1 Processor -- start 2024-05-15T16:41:52.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.279+0000 7f6382649640 1 -- start start 2024-05-15T16:41:52.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.280+0000 7f6382649640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f637c0bb940 0x7f637c1462b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:52.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.280+0000 7f6382649640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f637c14fa20 0x7f637c14fe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:52.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.280+0000 7f6382649640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f637c0a40b0 con 0x7f637c0a3bd0 2024-05-15T16:41:52.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.280+0000 7f6382649640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f637c0a49e0 con 0x7f637c14fa20 2024-05-15T16:41:52.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.280+0000 7f6382649640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f637c0a4390 con 0x7f637c0bb940 2024-05-15T16:41:52.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.280+0000 7f637bfff640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f637c0a3bd0 0x7f637c0bc8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:54000/0 (socket says 172.21.15.12:54000) 2024-05-15T16:41:52.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.280+0000 7f637bfff640 1 -- 172.21.15.12:0/4241507984 learned_addr learned my addr 172.21.15.12:0/4241507984 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-05-15T16:41:52.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.280+0000 7f6380be6640 1 --2- 172.21.15.12:0/4241507984 >> v2:172.21.15.12:3300/0 conn(0x7f637c14fa20 0x7f637c14fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:52.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.281+0000 7f637b7fe640 1 --2- 172.21.15.12:0/4241507984 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f637c0bb940 0x7f637c1462b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:52.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.281+0000 7f637affd640 1 -- 172.21.15.12:0/4241507984 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 709401869 0 0) 0x7f637c0a40b0 con 0x7f637c0a3bd0 2024-05-15T16:41:52.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.281+0000 7f637affd640 1 -- 172.21.15.12:0/4241507984 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6368003520 con 0x7f637c0a3bd0 2024-05-15T16:41:52.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.281+0000 7f6380be6640 1 -- 172.21.15.12:0/4241507984 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f637c0bb940 msgr2=0x7f637c1462b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T16:41:52.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.281+0000 7f6380be6640 1 --2- 172.21.15.12:0/4241507984 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f637c0bb940 0x7f637c1462b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:52.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.281+0000 7f6380be6640 1 -- 172.21.15.12:0/4241507984 >> v1:172.21.15.12:6789/0 conn(0x7f637c0a3bd0 legacy=0x7f637c0bc8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:52.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.281+0000 7f6380be6640 1 -- 172.21.15.12:0/4241507984 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f637c0a4670 con 0x7f637c14fa20 2024-05-15T16:41:52.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.282+0000 7f6380be6640 1 --2- 172.21.15.12:0/4241507984 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f637c14fa20 0x7f637c14fe30 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f6374009d90 tx=0x7f637402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=332dff10d4d225b6 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T16:41:52.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.282+0000 7f637affd640 1 -- 172.21.15.12:0/4241507984 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6374007740 con 0x7f637c14fa20 2024-05-15T16:41:52.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.282+0000 7f637affd640 1 -- 172.21.15.12:0/4241507984 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63740078e0 con 0x7f637c14fa20 2024-05-15T16:41:52.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.282+0000 7f637affd640 1 -- 172.21.15.12:0/4241507984 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6374007cb0 con 0x7f637c14fa20 2024-05-15T16:41:52.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.282+0000 7f6382649640 1 -- 172.21.15.12:0/4241507984 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f637c14fa20 msgr2=0x7f637c14fe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:52.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.282+0000 7f6382649640 1 --2- 172.21.15.12:0/4241507984 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f637c14fa20 0x7f637c14fe30 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f6374009d90 tx=0x7f637402a660 comp rx=0 tx=0).stop 2024-05-15T16:41:52.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.282+0000 7f6382649640 1 -- 172.21.15.12:0/4241507984 shutdown_connections 2024-05-15T16:41:52.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.282+0000 7f6382649640 1 --2- 172.21.15.12:0/4241507984 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f637c14fa20 0x7f637c14fe30 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:52.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.282+0000 7f6382649640 1 --2- 172.21.15.12:0/4241507984 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f637c0bb940 0x7f637c1462b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:52.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.282+0000 7f6382649640 1 -- 172.21.15.12:0/4241507984 >> 172.21.15.12:0/4241507984 conn(0x7f637c0a1ac0 msgr2=0x7f637c0bbfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T16:41:52.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.283+0000 7f6382649640 1 -- 172.21.15.12:0/4241507984 shutdown_connections 2024-05-15T16:41:52.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.283+0000 7f6382649640 1 -- 172.21.15.12:0/4241507984 wait complete. 2024-05-15T16:41:52.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.284+0000 7f6382649640 1 Processor -- start 2024-05-15T16:41:52.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.284+0000 7f6382649640 1 -- start start 2024-05-15T16:41:52.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.285+0000 7f6382649640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f637c0a3bd0 0x7f637c14e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:52.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.285+0000 7f6382649640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f637c0bb940 0x7f637c1412d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:52.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.285+0000 7f6382649640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f637c14fa20 0x7f637c141810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:52.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.285+0000 7f6382649640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f637c0a28b0 con 0x7f637c0bb940 2024-05-15T16:41:52.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.285+0000 7f6382649640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f637c0bbe10 con 0x7f637c0a3bd0 2024-05-15T16:41:52.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.285+0000 7f6382649640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f637c0a2a30 con 0x7f637c14fa20 2024-05-15T16:41:52.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.285+0000 7f637b7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f637c0bb940 0x7f637c1412d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:52.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.285+0000 7f637b7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f637c0bb940 0x7f637c1412d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46130/0 (socket says 172.21.15.12:46130) 2024-05-15T16:41:52.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.285+0000 7f637b7fe640 1 -- 172.21.15.12:0/3240651635 learned_addr learned my addr 172.21.15.12:0/3240651635 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T16:41:52.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.286+0000 7f637bfff640 1 --2- 172.21.15.12:0/3240651635 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f637c0a3bd0 0x7f637c14e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:52.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.286+0000 7f6380be6640 1 --2- 172.21.15.12:0/3240651635 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f637c14fa20 0x7f637c141810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:52.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.286+0000 7f637b7fe640 1 -- 172.21.15.12:0/3240651635 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f637c14fa20 msgr2=0x7f637c141810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:52.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.286+0000 7f637b7fe640 1 --2- 172.21.15.12:0/3240651635 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f637c14fa20 0x7f637c141810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:52.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.286+0000 7f637b7fe640 1 -- 172.21.15.12:0/3240651635 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f637c0a3bd0 msgr2=0x7f637c14e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:52.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.286+0000 7f637b7fe640 1 --2- 172.21.15.12:0/3240651635 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f637c0a3bd0 0x7f637c14e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:52.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.286+0000 7f637b7fe640 1 -- 172.21.15.12:0/3240651635 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f637c14e790 con 0x7f637c0bb940 2024-05-15T16:41:52.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.286+0000 7f6380be6640 1 --2- 172.21.15.12:0/3240651635 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f637c14fa20 0x7f637c141810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-15T16:41:52.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.286+0000 7f637b7fe640 1 --2- 172.21.15.12:0/3240651635 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f637c0bb940 0x7f637c1412d0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f636c00d600 tx=0x7f636c00dac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T16:41:52.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.286+0000 7f6378ff9640 1 -- 172.21.15.12:0/3240651635 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f636c004240 con 0x7f637c0bb940 2024-05-15T16:41:52.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.286+0000 7f6378ff9640 1 -- 172.21.15.12:0/3240651635 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f636c0043e0 con 0x7f637c0bb940 2024-05-15T16:41:52.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.286+0000 7f6382649640 1 -- 172.21.15.12:0/3240651635 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f637c14d920 con 0x7f637c0bb940 2024-05-15T16:41:52.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.286+0000 7f6378ff9640 1 -- 172.21.15.12:0/3240651635 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f636c003830 con 0x7f637c0bb940 2024-05-15T16:41:52.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.286+0000 7f6382649640 1 -- 172.21.15.12:0/3240651635 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f637c14f160 con 0x7f637c0bb940 2024-05-15T16:41:52.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.287+0000 7f6382649640 1 -- 172.21.15.12:0/3240651635 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f637c050940 con 0x7f637c0bb940 2024-05-15T16:41:52.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.288+0000 7f6378ff9640 1 -- 172.21.15.12:0/3240651635 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f636c0039d0 con 0x7f637c0bb940 2024-05-15T16:41:52.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.288+0000 7f6378ff9640 1 --2- 172.21.15.12:0/3240651635 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f635c0762d0 0x7f635c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:52.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.289+0000 7f6378ff9640 1 -- 172.21.15.12:0/3240651635 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4943+0+0 (secure 0 0 0) 0x7f636c097f00 con 0x7f637c0bb940 2024-05-15T16:41:52.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.289+0000 7f637bfff640 1 --2- 172.21.15.12:0/3240651635 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f635c0762d0 0x7f635c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:52.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.289+0000 7f637bfff640 1 --2- 172.21.15.12:0/3240651635 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f635c0762d0 0x7f635c0787e0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f6364005880 tx=0x7f6364006aa0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T16:41:52.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.292+0000 7f6378ff9640 1 -- 172.21.15.12:0/3240651635 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f636c061c40 con 0x7f637c0bb940 2024-05-15T16:41:52.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.481+0000 7f6382649640 1 -- 172.21.15.12:0/3240651635 --> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f637c1451e0 con 0x7f635c0762d0 2024-05-15T16:41:52.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.482+0000 7f6378ff9640 1 -- 172.21.15.12:0/3240651635 <== mgr.4106 v2:172.21.15.84:6832/4173299311 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f637c1451e0 con 0x7f635c0762d0 2024-05-15T16:41:52.483 INFO:teuthology.orchestra.run.smithi012.stderr:instructed osd(s) 5 to deep-scrub 2024-05-15T16:41:52.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.484+0000 7f6382649640 1 -- 172.21.15.12:0/3240651635 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f635c0762d0 msgr2=0x7f635c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:52.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.484+0000 7f6382649640 1 --2- 172.21.15.12:0/3240651635 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f635c0762d0 0x7f635c0787e0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f6364005880 tx=0x7f6364006aa0 comp rx=0 tx=0).stop 2024-05-15T16:41:52.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.484+0000 7f6382649640 1 -- 172.21.15.12:0/3240651635 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f637c0bb940 msgr2=0x7f637c1412d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:52.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.484+0000 7f6382649640 1 --2- 172.21.15.12:0/3240651635 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f637c0bb940 0x7f637c1412d0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f636c00d600 tx=0x7f636c00dac0 comp rx=0 tx=0).stop 2024-05-15T16:41:52.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.484+0000 7f6382649640 1 -- 172.21.15.12:0/3240651635 shutdown_connections 2024-05-15T16:41:52.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.484+0000 7f6382649640 1 --2- 172.21.15.12:0/3240651635 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f637c14fa20 0x7f637c141810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:52.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.484+0000 7f6382649640 1 --2- 172.21.15.12:0/3240651635 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f635c0762d0 0x7f635c0787e0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:52.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.484+0000 7f6382649640 1 --2- 172.21.15.12:0/3240651635 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f637c0bb940 0x7f637c1412d0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:52.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.484+0000 7f6382649640 1 --2- 172.21.15.12:0/3240651635 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f637c0a3bd0 0x7f637c14e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:52.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.484+0000 7f6382649640 1 -- 172.21.15.12:0/3240651635 >> 172.21.15.12:0/3240651635 conn(0x7f637c0a1ac0 msgr2=0x7f637c073e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T16:41:52.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.484+0000 7f6382649640 1 -- 172.21.15.12:0/3240651635 shutdown_connections 2024-05-15T16:41:52.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.484+0000 7f6382649640 1 -- 172.21.15.12:0/3240651635 wait complete. 2024-05-15T16:41:52.496 INFO:tasks.ceph:Scrubbing osd.6 2024-05-15T16:41:52.496 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-05-15T16:41:52.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.610+0000 7f1f5a9c7640 1 Processor -- start 2024-05-15T16:41:52.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.610+0000 7f1f5a9c7640 1 -- start start 2024-05-15T16:41:52.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.611+0000 7f1f5a9c7640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1f5414d0f0 0x7f1f54157cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:52.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.611+0000 7f1f5a9c7640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f540720d0 con 0x7f1f540be4f0 2024-05-15T16:41:52.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.611+0000 7f1f5a9c7640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f540bf6f0 con 0x7f1f5414cce0 2024-05-15T16:41:52.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.611+0000 7f1f5a9c7640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f1f540bfa60 con 0x7f1f5414d0f0 2024-05-15T16:41:52.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.611+0000 7f1f53fff640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f1f540be4f0 0x7f1f540bfef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:54006/0 (socket says 172.21.15.12:54006) 2024-05-15T16:41:52.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.611+0000 7f1f53fff640 1 -- 172.21.15.12:0/1542360380 learned_addr learned my addr 172.21.15.12:0/1542360380 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-05-15T16:41:52.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.612+0000 7f1f52ffd640 1 -- 172.21.15.12:0/1542360380 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 400043481 0 0) 0x7f1f540720d0 con 0x7f1f540be4f0 2024-05-15T16:41:52.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.612+0000 7f1f58f64640 1 --2- 172.21.15.12:0/1542360380 >> v2:172.21.15.84:3300/0 conn(0x7f1f5414d0f0 0x7f1f54157cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:52.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.612+0000 7f1f52ffd640 1 -- 172.21.15.12:0/1542360380 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1f40003520 con 0x7f1f540be4f0 2024-05-15T16:41:52.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.612+0000 7f1f52ffd640 1 -- 172.21.15.12:0/1542360380 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3929290863 0 0) 0x7f1f40003520 con 0x7f1f540be4f0 2024-05-15T16:41:52.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.612+0000 7f1f52ffd640 1 -- 172.21.15.12:0/1542360380 >> v2:172.21.15.84:3300/0 conn(0x7f1f5414d0f0 msgr2=0x7f1f54157cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T16:41:52.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.612+0000 7f1f52ffd640 1 --2- 172.21.15.12:0/1542360380 >> v2:172.21.15.84:3300/0 conn(0x7f1f5414d0f0 0x7f1f54157cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:52.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.612+0000 7f1f52ffd640 1 -- 172.21.15.12:0/1542360380 >> v1:172.21.15.84:6789/0 conn(0x7f1f5414cce0 legacy=0x7f1f540716a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:52.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.612+0000 7f1f52ffd640 1 -- 172.21.15.12:0/1542360380 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f540be900 con 0x7f1f540be4f0 2024-05-15T16:41:52.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.612+0000 7f1f52ffd640 1 -- 172.21.15.12:0/1542360380 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 38171736 0 0) 0x7f1f3c0016f0 con 0x7f1f540be4f0 2024-05-15T16:41:52.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.612+0000 7f1f52ffd640 1 -- 172.21.15.12:0/1542360380 >> v1:172.21.15.12:6789/0 conn(0x7f1f540be4f0 legacy=0x7f1f540bfef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:52.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.612+0000 7f1f52ffd640 1 --2- 172.21.15.12:0/1542360380 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1f40003a50 0x7f1f40003ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:52.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.612+0000 7f1f52ffd640 1 --2- 172.21.15.12:0/1542360380 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1f40004800 0x7f1f40004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:52.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.612+0000 7f1f52ffd640 1 --2- 172.21.15.12:0/1542360380 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f40005350 0x7f1f4000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:52.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.612+0000 7f1f52ffd640 1 -- 172.21.15.12:0/1542360380 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f1f540bfa60 con 0x7f1f40004800 2024-05-15T16:41:52.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.612+0000 7f1f52ffd640 1 -- 172.21.15.12:0/1542360380 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f1f4000c2a0 con 0x7f1f40005350 2024-05-15T16:41:52.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.612+0000 7f1f52ffd640 1 -- 172.21.15.12:0/1542360380 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f1f4000c4a0 con 0x7f1f40003a50 2024-05-15T16:41:52.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.612+0000 7f1f537fe640 1 --2- 172.21.15.12:0/1542360380 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1f40004800 0x7f1f40004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:52.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.612+0000 7f1f53fff640 1 --2- 172.21.15.12:0/1542360380 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1f40003a50 0x7f1f40003ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:52.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.612+0000 7f1f58f64640 1 --2- 172.21.15.12:0/1542360380 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f40005350 0x7f1f4000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:52.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.612+0000 7f1f537fe640 1 -- 172.21.15.12:0/1542360380 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1f40003a50 msgr2=0x7f1f40003ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T16:41:52.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.613+0000 7f1f537fe640 1 --2- 172.21.15.12:0/1542360380 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1f40003a50 0x7f1f40003ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:52.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.613+0000 7f1f537fe640 1 -- 172.21.15.12:0/1542360380 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f40005350 msgr2=0x7f1f4000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T16:41:52.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.613+0000 7f1f537fe640 1 --2- 172.21.15.12:0/1542360380 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f40005350 0x7f1f4000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:52.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.613+0000 7f1f537fe640 1 -- 172.21.15.12:0/1542360380 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f40003520 con 0x7f1f40004800 2024-05-15T16:41:52.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.613+0000 7f1f58f64640 1 -- 172.21.15.12:0/1542360380 reap_dead start 2024-05-15T16:41:52.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.613+0000 7f1f537fe640 1 --2- 172.21.15.12:0/1542360380 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1f40004800 0x7f1f40004c10 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f1f540741b0 tx=0x7f1f40005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2382952d1615cdbb server_cookie=0 in_seq=0 out_seq=0 2024-05-15T16:41:52.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.613+0000 7f1f52ffd640 1 -- 172.21.15.12:0/1542360380 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f440013b0 con 0x7f1f40004800 2024-05-15T16:41:52.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.613+0000 7f1f52ffd640 1 -- 172.21.15.12:0/1542360380 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f440052d0 con 0x7f1f40004800 2024-05-15T16:41:52.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.613+0000 7f1f52ffd640 1 -- 172.21.15.12:0/1542360380 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f4402aa20 con 0x7f1f40004800 2024-05-15T16:41:52.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.614+0000 7f1f5a9c7640 1 -- 172.21.15.12:0/1542360380 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1f40004800 msgr2=0x7f1f40004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:52.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.614+0000 7f1f5a9c7640 1 --2- 172.21.15.12:0/1542360380 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1f40004800 0x7f1f40004c10 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f1f540741b0 tx=0x7f1f40005830 comp rx=0 tx=0).stop 2024-05-15T16:41:52.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.614+0000 7f1f5a9c7640 1 -- 172.21.15.12:0/1542360380 shutdown_connections 2024-05-15T16:41:52.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.614+0000 7f1f5a9c7640 1 --2- 172.21.15.12:0/1542360380 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1f40004800 0x7f1f40004c10 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:52.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.614+0000 7f1f5a9c7640 1 -- 172.21.15.12:0/1542360380 >> 172.21.15.12:0/1542360380 conn(0x7f1f540c17c0 msgr2=0x7f1f540c1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T16:41:52.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.614+0000 7f1f5a9c7640 1 -- 172.21.15.12:0/1542360380 shutdown_connections 2024-05-15T16:41:52.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.614+0000 7f1f5a9c7640 1 -- 172.21.15.12:0/1542360380 wait complete. 2024-05-15T16:41:52.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.616+0000 7f1f5a9c7640 1 Processor -- start 2024-05-15T16:41:52.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.616+0000 7f1f5a9c7640 1 -- start start 2024-05-15T16:41:52.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.617+0000 7f1f5a9c7640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f40004800 0x7f1f541e5510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:52.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.617+0000 7f1f5a9c7640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1f5409d580 0x7f1f5414fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:52.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.617+0000 7f1f5a9c7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1f5409f7c0 0x7f1f5409fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:52.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.617+0000 7f1f5a9c7640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f1f540723b0 con 0x7f1f5409f7c0 2024-05-15T16:41:52.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.617+0000 7f1f5a9c7640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f1f54071310 con 0x7f1f40004800 2024-05-15T16:41:52.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.617+0000 7f1f5a9c7640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f1f540bc1c0 con 0x7f1f5409d580 2024-05-15T16:41:52.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.617+0000 7f1f58f64640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1f5409f7c0 0x7f1f5409fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:52.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.617+0000 7f1f58f64640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1f5409f7c0 0x7f1f5409fbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46146/0 (socket says 172.21.15.12:46146) 2024-05-15T16:41:52.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.617+0000 7f1f58f64640 1 -- 172.21.15.12:0/2775148828 learned_addr learned my addr 172.21.15.12:0/2775148828 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T16:41:52.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.617+0000 7f1f53fff640 1 --2- 172.21.15.12:0/2775148828 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f40004800 0x7f1f541e5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:52.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.617+0000 7f1f537fe640 1 --2- 172.21.15.12:0/2775148828 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1f5409d580 0x7f1f5414fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:52.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.617+0000 7f1f58f64640 1 -- 172.21.15.12:0/2775148828 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1f5409d580 msgr2=0x7f1f5414fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:52.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.617+0000 7f1f58f64640 1 --2- 172.21.15.12:0/2775148828 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1f5409d580 0x7f1f5414fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:52.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.617+0000 7f1f58f64640 1 -- 172.21.15.12:0/2775148828 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f40004800 msgr2=0x7f1f541e5510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:52.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.617+0000 7f1f58f64640 1 --2- 172.21.15.12:0/2775148828 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f40004800 0x7f1f541e5510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:52.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.617+0000 7f1f58f64640 1 -- 172.21.15.12:0/2775148828 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f541e5a50 con 0x7f1f5409f7c0 2024-05-15T16:41:52.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.617+0000 7f1f53fff640 1 --2- 172.21.15.12:0/2775148828 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f40004800 0x7f1f541e5510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-15T16:41:52.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.617+0000 7f1f537fe640 1 --2- 172.21.15.12:0/2775148828 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1f5409d580 0x7f1f5414fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-15T16:41:52.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.618+0000 7f1f58f64640 1 --2- 172.21.15.12:0/2775148828 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1f5409f7c0 0x7f1f5409fbd0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f1f540739d0 tx=0x7f1f4c00f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T16:41:52.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.618+0000 7f1f50ff9640 1 -- 172.21.15.12:0/2775148828 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f4c00fde0 con 0x7f1f5409f7c0 2024-05-15T16:41:52.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.618+0000 7f1f50ff9640 1 -- 172.21.15.12:0/2775148828 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f4c015430 con 0x7f1f5409f7c0 2024-05-15T16:41:52.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.618+0000 7f1f5a9c7640 1 -- 172.21.15.12:0/2775148828 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f5409baf0 con 0x7f1f5409f7c0 2024-05-15T16:41:52.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.618+0000 7f1f50ff9640 1 -- 172.21.15.12:0/2775148828 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f4c015820 con 0x7f1f5409f7c0 2024-05-15T16:41:52.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.618+0000 7f1f5a9c7640 1 -- 172.21.15.12:0/2775148828 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f5409cd20 con 0x7f1f5409f7c0 2024-05-15T16:41:52.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.619+0000 7f1f5a9c7640 1 -- 172.21.15.12:0/2775148828 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1f540bf020 con 0x7f1f5409f7c0 2024-05-15T16:41:52.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.620+0000 7f1f50ff9640 1 -- 172.21.15.12:0/2775148828 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1f4c0159c0 con 0x7f1f5409f7c0 2024-05-15T16:41:52.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.620+0000 7f1f50ff9640 1 --2- 172.21.15.12:0/2775148828 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f1f340762d0 0x7f1f340787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:52.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.620+0000 7f1f50ff9640 1 -- 172.21.15.12:0/2775148828 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4943+0+0 (secure 0 0 0) 0x7f1f4c098930 con 0x7f1f5409f7c0 2024-05-15T16:41:52.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.620+0000 7f1f53fff640 1 --2- 172.21.15.12:0/2775148828 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f1f340762d0 0x7f1f340787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:52.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.620+0000 7f1f50ff9640 1 --2- 172.21.15.12:0/2775148828 >> [v2:172.21.15.84:6816/3029180670,v1:172.21.15.84:6817/3029180670] conn(0x7f1f3407c1e0 0x7f1f3407e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:52.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.620+0000 7f1f50ff9640 1 -- 172.21.15.12:0/2775148828 --> [v2:172.21.15.84:6816/3029180670,v1:172.21.15.84:6817/3029180670] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1f4c024ec0 con 0x7f1f3407c1e0 2024-05-15T16:41:52.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.620+0000 7f1f50ff9640 1 -- 172.21.15.12:0/2775148828 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f1f4c098dc0 con 0x7f1f5409f7c0 2024-05-15T16:41:52.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.620+0000 7f1f537fe640 1 --2- 172.21.15.12:0/2775148828 >> [v2:172.21.15.84:6816/3029180670,v1:172.21.15.84:6817/3029180670] conn(0x7f1f3407c1e0 0x7f1f3407e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:52.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.621+0000 7f1f53fff640 1 --2- 172.21.15.12:0/2775148828 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f1f340762d0 0x7f1f340787e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c000fb0 tx=0x7f1f3c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T16:41:52.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.621+0000 7f1f537fe640 1 --2- 172.21.15.12:0/2775148828 >> [v2:172.21.15.84:6816/3029180670,v1:172.21.15.84:6817/3029180670] conn(0x7f1f3407c1e0 0x7f1f3407e630 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T16:41:52.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.622+0000 7f1f50ff9640 1 -- 172.21.15.12:0/2775148828 <== osd.6 v2:172.21.15.84:6816/3029180670 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1f4c024ec0 con 0x7f1f3407c1e0 2024-05-15T16:41:52.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.635+0000 7f1f5a9c7640 1 -- 172.21.15.12:0/2775148828 --> [v2:172.21.15.84:6816/3029180670,v1:172.21.15.84:6817/3029180670] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f1f5414f0e0 con 0x7f1f3407c1e0 2024-05-15T16:41:52.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.635+0000 7f1f50ff9640 1 -- 172.21.15.12:0/2775148828 <== osd.6 v2:172.21.15.84:6816/3029180670 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f1f5414f0e0 con 0x7f1f3407c1e0 2024-05-15T16:41:52.637 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-05-15T16:41:52.637 INFO:teuthology.orchestra.run.smithi012.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-15T16:41:52.637 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-05-15T16:41:52.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.636+0000 7f1f5a9c7640 1 -- 172.21.15.12:0/2775148828 >> [v2:172.21.15.84:6816/3029180670,v1:172.21.15.84:6817/3029180670] conn(0x7f1f3407c1e0 msgr2=0x7f1f3407e630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:52.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.636+0000 7f1f5a9c7640 1 --2- 172.21.15.12:0/2775148828 >> [v2:172.21.15.84:6816/3029180670,v1:172.21.15.84:6817/3029180670] conn(0x7f1f3407c1e0 0x7f1f3407e630 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:52.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.636+0000 7f1f5a9c7640 1 -- 172.21.15.12:0/2775148828 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f1f340762d0 msgr2=0x7f1f340787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:52.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.636+0000 7f1f5a9c7640 1 --2- 172.21.15.12:0/2775148828 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f1f340762d0 0x7f1f340787e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c000fb0 tx=0x7f1f3c009040 comp rx=0 tx=0).stop 2024-05-15T16:41:52.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.636+0000 7f1f5a9c7640 1 -- 172.21.15.12:0/2775148828 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1f5409f7c0 msgr2=0x7f1f5409fbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:52.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.636+0000 7f1f5a9c7640 1 --2- 172.21.15.12:0/2775148828 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1f5409f7c0 0x7f1f5409fbd0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f1f540739d0 tx=0x7f1f4c00f580 comp rx=0 tx=0).stop 2024-05-15T16:41:52.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.636+0000 7f1f58f64640 1 -- 172.21.15.12:0/2775148828 reap_dead start 2024-05-15T16:41:52.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.636+0000 7f1f5a9c7640 1 -- 172.21.15.12:0/2775148828 shutdown_connections 2024-05-15T16:41:52.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.636+0000 7f1f5a9c7640 1 -- 172.21.15.12:0/2775148828 >> 172.21.15.12:0/2775148828 conn(0x7f1f540c17c0 msgr2=0x7f1f540716a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T16:41:52.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.636+0000 7f1f5a9c7640 1 -- 172.21.15.12:0/2775148828 shutdown_connections 2024-05-15T16:41:52.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.636+0000 7f1f5a9c7640 1 -- 172.21.15.12:0/2775148828 wait complete. 2024-05-15T16:41:52.648 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-05-15T16:41:52.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.758+0000 7fb8d958d640 1 Processor -- start 2024-05-15T16:41:52.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.759+0000 7fb8d958d640 1 -- start start 2024-05-15T16:41:52.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.760+0000 7fb8d958d640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb8d40be2c0 0x7fb8d409fd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:52.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.760+0000 7fb8d958d640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb8d40bd7b0 0x7fb8d40bdbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:52.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.760+0000 7fb8d958d640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8d4151910 con 0x7fb8d40be6d0 2024-05-15T16:41:52.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.760+0000 7fb8d958d640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fb8d4152240 con 0x7fb8d40be2c0 2024-05-15T16:41:52.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.760+0000 7fb8d958d640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7fb8d4151bf0 con 0x7fb8d40bd7b0 2024-05-15T16:41:52.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.760+0000 7fb8d2ffd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb8d40be2c0 0x7fb8d409fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:52.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.760+0000 7fb8d2ffd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb8d40be2c0 0x7fb8d409fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46152/0 (socket says 172.21.15.12:46152) 2024-05-15T16:41:52.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.760+0000 7fb8d2ffd640 1 -- 172.21.15.12:0/542270843 learned_addr learned my addr 172.21.15.12:0/542270843 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T16:41:52.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.760+0000 7fb8d37fe640 1 --2- 172.21.15.12:0/542270843 >> v2:172.21.15.84:3300/0 conn(0x7fb8d40bd7b0 0x7fb8d40bdbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:52.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.760+0000 7fb8d2ffd640 1 -- 172.21.15.12:0/542270843 >> v2:172.21.15.84:3300/0 conn(0x7fb8d40bd7b0 msgr2=0x7fb8d40bdbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T16:41:52.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.760+0000 7fb8d2ffd640 1 --2- 172.21.15.12:0/542270843 >> v2:172.21.15.84:3300/0 conn(0x7fb8d40bd7b0 0x7fb8d40bdbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:52.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.760+0000 7fb8d2ffd640 1 -- 172.21.15.12:0/542270843 >> v1:172.21.15.84:6789/0 conn(0x7fb8d40be6d0 legacy=0x7fb8d40bfaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T16:41:52.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.760+0000 7fb8d2ffd640 1 -- 172.21.15.12:0/542270843 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8d4151ed0 con 0x7fb8d40be2c0 2024-05-15T16:41:52.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.760+0000 7fb8d37fe640 1 --2- 172.21.15.12:0/542270843 >> v2:172.21.15.84:3300/0 conn(0x7fb8d40bd7b0 0x7fb8d40bdbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-15T16:41:52.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.761+0000 7fb8d2ffd640 1 --2- 172.21.15.12:0/542270843 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb8d40be2c0 0x7fb8d409fd50 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fb8d40a0e40 tx=0x7fb8cc02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95d76bc58c6d9cd5 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T16:41:52.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.761+0000 7fb8d1ffb640 1 -- 172.21.15.12:0/542270843 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8cc037070 con 0x7fb8d40be2c0 2024-05-15T16:41:52.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.761+0000 7fb8d1ffb640 1 -- 172.21.15.12:0/542270843 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8cc032440 con 0x7fb8d40be2c0 2024-05-15T16:41:52.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.761+0000 7fb8d1ffb640 1 -- 172.21.15.12:0/542270843 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8cc032810 con 0x7fb8d40be2c0 2024-05-15T16:41:52.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.762+0000 7fb8d958d640 1 -- 172.21.15.12:0/542270843 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb8d40be2c0 msgr2=0x7fb8d409fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:52.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.762+0000 7fb8d958d640 1 --2- 172.21.15.12:0/542270843 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb8d40be2c0 0x7fb8d409fd50 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fb8d40a0e40 tx=0x7fb8cc02a1e0 comp rx=0 tx=0).stop 2024-05-15T16:41:52.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.762+0000 7fb8d958d640 1 -- 172.21.15.12:0/542270843 shutdown_connections 2024-05-15T16:41:52.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.762+0000 7fb8d958d640 1 --2- 172.21.15.12:0/542270843 >> v2:172.21.15.84:3300/0 conn(0x7fb8d40bd7b0 0x7fb8d40bdbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:52.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.762+0000 7fb8d958d640 1 --2- 172.21.15.12:0/542270843 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb8d40be2c0 0x7fb8d409fd50 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:52.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.762+0000 7fb8d958d640 1 -- 172.21.15.12:0/542270843 >> 172.21.15.12:0/542270843 conn(0x7fb8d40c17c0 msgr2=0x7fb8d40c1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T16:41:52.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.762+0000 7fb8d958d640 1 -- 172.21.15.12:0/542270843 shutdown_connections 2024-05-15T16:41:52.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.762+0000 7fb8d958d640 1 -- 172.21.15.12:0/542270843 wait complete. 2024-05-15T16:41:52.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.763+0000 7fb8d958d640 1 Processor -- start 2024-05-15T16:41:52.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.764+0000 7fb8d958d640 1 -- start start 2024-05-15T16:41:52.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.765+0000 7fb8d958d640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb8d40bd7b0 0x7fb8d4150d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:52.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.765+0000 7fb8d958d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb8d40be2c0 0x7fb8d413e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:52.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.765+0000 7fb8d958d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8d40be6d0 0x7fb8d413ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:52.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.765+0000 7fb8d958d640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fb8d40c0c80 con 0x7fb8d40be2c0 2024-05-15T16:41:52.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.765+0000 7fb8d958d640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fb8d41526d0 con 0x7fb8d40be6d0 2024-05-15T16:41:52.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.765+0000 7fb8d958d640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fb8d41e4c40 con 0x7fb8d40bd7b0 2024-05-15T16:41:52.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.765+0000 7fb8d27fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb8d40be2c0 0x7fb8d413e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:52.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.765+0000 7fb8d27fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb8d40be2c0 0x7fb8d413e8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46158/0 (socket says 172.21.15.12:46158) 2024-05-15T16:41:52.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.765+0000 7fb8d27fc640 1 -- 172.21.15.12:0/3142869744 learned_addr learned my addr 172.21.15.12:0/3142869744 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T16:41:52.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.765+0000 7fb8d2ffd640 1 --2- 172.21.15.12:0/3142869744 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb8d40bd7b0 0x7fb8d4150d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:52.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.765+0000 7fb8d37fe640 1 --2- 172.21.15.12:0/3142869744 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8d40be6d0 0x7fb8d413ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:52.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.765+0000 7fb8d27fc640 1 -- 172.21.15.12:0/3142869744 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb8d40bd7b0 msgr2=0x7fb8d4150d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:52.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.765+0000 7fb8d27fc640 1 --2- 172.21.15.12:0/3142869744 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb8d40bd7b0 0x7fb8d4150d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:52.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.765+0000 7fb8d27fc640 1 -- 172.21.15.12:0/3142869744 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8d40be6d0 msgr2=0x7fb8d413ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:52.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.765+0000 7fb8d27fc640 1 --2- 172.21.15.12:0/3142869744 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8d40be6d0 0x7fb8d413ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:52.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.765+0000 7fb8d27fc640 1 -- 172.21.15.12:0/3142869744 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8d41512a0 con 0x7fb8d40be2c0 2024-05-15T16:41:52.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.765+0000 7fb8d27fc640 1 --2- 172.21.15.12:0/3142869744 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb8d40be2c0 0x7fb8d413e8d0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fb8bc00b420 tx=0x7fb8bc00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T16:41:52.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.765+0000 7fb8cb7fe640 1 -- 172.21.15.12:0/3142869744 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8bc011830 con 0x7fb8d40be2c0 2024-05-15T16:41:52.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.765+0000 7fb8cb7fe640 1 -- 172.21.15.12:0/3142869744 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8bc016070 con 0x7fb8d40be2c0 2024-05-15T16:41:52.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.766+0000 7fb8d958d640 1 -- 172.21.15.12:0/3142869744 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8d40a4d10 con 0x7fb8d40be2c0 2024-05-15T16:41:52.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.766+0000 7fb8cb7fe640 1 -- 172.21.15.12:0/3142869744 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8bc011c10 con 0x7fb8d40be2c0 2024-05-15T16:41:52.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.766+0000 7fb8d958d640 1 -- 172.21.15.12:0/3142869744 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8d40a4fd0 con 0x7fb8d40be2c0 2024-05-15T16:41:52.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.767+0000 7fb8d958d640 1 -- 172.21.15.12:0/3142869744 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8d40691f0 con 0x7fb8d40be2c0 2024-05-15T16:41:52.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.767+0000 7fb8cb7fe640 1 -- 172.21.15.12:0/3142869744 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb8bc004020 con 0x7fb8d40be2c0 2024-05-15T16:41:52.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.768+0000 7fb8cb7fe640 1 --2- 172.21.15.12:0/3142869744 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fb8b4076300 0x7fb8b4078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:52.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.768+0000 7fb8cb7fe640 1 -- 172.21.15.12:0/3142869744 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4943+0+0 (secure 0 0 0) 0x7fb8bc097560 con 0x7fb8d40be2c0 2024-05-15T16:41:52.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.768+0000 7fb8d2ffd640 1 --2- 172.21.15.12:0/3142869744 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fb8b4076300 0x7fb8b4078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:52.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.769+0000 7fb8d2ffd640 1 --2- 172.21.15.12:0/3142869744 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fb8b4076300 0x7fb8b4078810 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc034000 tx=0x7fb8cc02e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T16:41:52.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.772+0000 7fb8cb7fe640 1 -- 172.21.15.12:0/3142869744 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fb8bc060c50 con 0x7fb8d40be2c0 2024-05-15T16:41:52.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.966+0000 7fb8d958d640 1 -- 172.21.15.12:0/3142869744 --> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7fb8d40a6780 con 0x7fb8b4076300 2024-05-15T16:41:52.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.967+0000 7fb8cb7fe640 1 -- 172.21.15.12:0/3142869744 <== mgr.4106 v2:172.21.15.84:6832/4173299311 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fb8d40a6780 con 0x7fb8b4076300 2024-05-15T16:41:52.968 INFO:teuthology.orchestra.run.smithi012.stderr:instructed osd(s) 6 to deep-scrub 2024-05-15T16:41:52.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.969+0000 7fb8d958d640 1 -- 172.21.15.12:0/3142869744 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fb8b4076300 msgr2=0x7fb8b4078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:52.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.969+0000 7fb8d958d640 1 --2- 172.21.15.12:0/3142869744 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fb8b4076300 0x7fb8b4078810 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc034000 tx=0x7fb8cc02e000 comp rx=0 tx=0).stop 2024-05-15T16:41:52.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.969+0000 7fb8d958d640 1 -- 172.21.15.12:0/3142869744 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb8d40be2c0 msgr2=0x7fb8d413e8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:52.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.969+0000 7fb8d958d640 1 --2- 172.21.15.12:0/3142869744 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb8d40be2c0 0x7fb8d413e8d0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fb8bc00b420 tx=0x7fb8bc00b8e0 comp rx=0 tx=0).stop 2024-05-15T16:41:52.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.969+0000 7fb8d958d640 1 -- 172.21.15.12:0/3142869744 shutdown_connections 2024-05-15T16:41:52.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.969+0000 7fb8d958d640 1 --2- 172.21.15.12:0/3142869744 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8d40be6d0 0x7fb8d413ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:52.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.969+0000 7fb8d958d640 1 --2- 172.21.15.12:0/3142869744 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fb8b4076300 0x7fb8b4078810 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:52.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.969+0000 7fb8d958d640 1 --2- 172.21.15.12:0/3142869744 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb8d40be2c0 0x7fb8d413e8d0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:52.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.969+0000 7fb8d958d640 1 --2- 172.21.15.12:0/3142869744 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb8d40bd7b0 0x7fb8d4150d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:52.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.969+0000 7fb8d958d640 1 -- 172.21.15.12:0/3142869744 >> 172.21.15.12:0/3142869744 conn(0x7fb8d40c17c0 msgr2=0x7fb8d406e0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T16:41:52.973 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.970+0000 7fb8d958d640 1 -- 172.21.15.12:0/3142869744 shutdown_connections 2024-05-15T16:41:52.973 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:52.970+0000 7fb8d958d640 1 -- 172.21.15.12:0/3142869744 wait complete. 2024-05-15T16:41:52.981 INFO:tasks.ceph:Scrubbing osd.7 2024-05-15T16:41:52.982 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-05-15T16:41:53.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.097+0000 7f6b0000c640 1 Processor -- start 2024-05-15T16:41:53.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.097+0000 7f6b0000c640 1 -- start start 2024-05-15T16:41:53.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.098+0000 7f6b0000c640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6af80a9060 0x7f6af8148910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:53.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.098+0000 7f6b0000c640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6af80ba0f0 0x7f6af814e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:53.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.098+0000 7f6b0000c640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6af80b8a30 con 0x7f6af80ba500 2024-05-15T16:41:53.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.098+0000 7f6b0000c640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f6af80b8d10 con 0x7f6af80ba0f0 2024-05-15T16:41:53.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.098+0000 7f6b0000c640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f6af80b8ff0 con 0x7f6af80a9060 2024-05-15T16:41:53.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.098+0000 7f6afd5a7640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6af80ba0f0 0x7f6af814e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:53.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.098+0000 7f6afd5a7640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6af80ba0f0 0x7f6af814e660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46166/0 (socket says 172.21.15.12:46166) 2024-05-15T16:41:53.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.098+0000 7f6afd5a7640 1 -- 172.21.15.12:0/1249932758 learned_addr learned my addr 172.21.15.12:0/1249932758 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T16:41:53.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.098+0000 7f6afdda8640 1 --2- 172.21.15.12:0/1249932758 >> v2:172.21.15.84:3300/0 conn(0x7f6af80a9060 0x7f6af8148910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:53.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.098+0000 7f6afd5a7640 1 -- 172.21.15.12:0/1249932758 >> v2:172.21.15.84:3300/0 conn(0x7f6af80a9060 msgr2=0x7f6af8148910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T16:41:53.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.098+0000 7f6afd5a7640 1 --2- 172.21.15.12:0/1249932758 >> v2:172.21.15.84:3300/0 conn(0x7f6af80a9060 0x7f6af8148910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:53.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.098+0000 7f6afd5a7640 1 -- 172.21.15.12:0/1249932758 >> v1:172.21.15.84:6789/0 conn(0x7f6af80ba500 legacy=0x7f6af8151a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T16:41:53.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.098+0000 7f6afd5a7640 1 -- 172.21.15.12:0/1249932758 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6af80b92d0 con 0x7f6af80ba0f0 2024-05-15T16:41:53.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.099+0000 7f6afd5a7640 1 --2- 172.21.15.12:0/1249932758 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6af80ba0f0 0x7f6af814e660 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f6af8074f10 tx=0x7f6ae802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1eef24fb5137d2f server_cookie=0 in_seq=0 out_seq=0 2024-05-15T16:41:53.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.099+0000 7f6afcda6640 1 -- 172.21.15.12:0/1249932758 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ae8037070 con 0x7f6af80ba0f0 2024-05-15T16:41:53.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.099+0000 7f6afcda6640 1 -- 172.21.15.12:0/1249932758 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ae8032440 con 0x7f6af80ba0f0 2024-05-15T16:41:53.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.099+0000 7f6afcda6640 1 -- 172.21.15.12:0/1249932758 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ae8032810 con 0x7f6af80ba0f0 2024-05-15T16:41:53.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.100+0000 7f6b0000c640 1 -- 172.21.15.12:0/1249932758 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6af80ba0f0 msgr2=0x7f6af814e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:53.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.100+0000 7f6b0000c640 1 --2- 172.21.15.12:0/1249932758 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6af80ba0f0 0x7f6af814e660 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f6af8074f10 tx=0x7f6ae802a270 comp rx=0 tx=0).stop 2024-05-15T16:41:53.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.100+0000 7f6b0000c640 1 -- 172.21.15.12:0/1249932758 shutdown_connections 2024-05-15T16:41:53.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.100+0000 7f6b0000c640 1 --2- 172.21.15.12:0/1249932758 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6af80ba0f0 0x7f6af814e660 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:53.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.100+0000 7f6b0000c640 1 --2- 172.21.15.12:0/1249932758 >> v2:172.21.15.84:3300/0 conn(0x7f6af80a9060 0x7f6af8148910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:53.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.100+0000 7f6b0000c640 1 -- 172.21.15.12:0/1249932758 >> 172.21.15.12:0/1249932758 conn(0x7f6af80c07c0 msgr2=0x7f6af80c0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T16:41:53.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.100+0000 7f6b0000c640 1 -- 172.21.15.12:0/1249932758 shutdown_connections 2024-05-15T16:41:53.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.100+0000 7f6b0000c640 1 -- 172.21.15.12:0/1249932758 wait complete. 2024-05-15T16:41:53.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.102+0000 7f6b0000c640 1 Processor -- start 2024-05-15T16:41:53.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.102+0000 7f6b0000c640 1 -- start start 2024-05-15T16:41:53.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.103+0000 7f6b0000c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6af80a9060 0x7f6af81d9560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:53.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.103+0000 7f6b0000c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6af80ba0f0 0x7f6af80c2750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:53.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.103+0000 7f6b0000c640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f6af80ba500 0x7f6af81416c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:53.109 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.103+0000 7f6b0000c640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f6af808dbb0 con 0x7f6af80a9060 2024-05-15T16:41:53.109 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.103+0000 7f6b0000c640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f6af808da30 con 0x7f6af80ba0f0 2024-05-15T16:41:53.109 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.103+0000 7f6b0000c640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f6af814eba0 con 0x7f6af80ba500 2024-05-15T16:41:53.109 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.103+0000 7f6afdda8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6af80a9060 0x7f6af81d9560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:53.110 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.103+0000 7f6afdda8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6af80a9060 0x7f6af81d9560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46180/0 (socket says 172.21.15.12:46180) 2024-05-15T16:41:53.110 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.103+0000 7f6afdda8640 1 -- 172.21.15.12:0/2087122464 learned_addr learned my addr 172.21.15.12:0/2087122464 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T16:41:53.110 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.103+0000 7f6afd5a7640 1 --2- 172.21.15.12:0/2087122464 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6af80ba0f0 0x7f6af80c2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:53.110 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.103+0000 7f6afe5a9640 1 --2- 172.21.15.12:0/2087122464 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f6af80ba500 0x7f6af81416c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:53.110 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.103+0000 7f6afdda8640 1 -- 172.21.15.12:0/2087122464 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f6af80ba500 msgr2=0x7f6af81416c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:53.110 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.103+0000 7f6afdda8640 1 --2- 172.21.15.12:0/2087122464 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f6af80ba500 0x7f6af81416c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:53.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.103+0000 7f6afdda8640 1 -- 172.21.15.12:0/2087122464 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6af80ba0f0 msgr2=0x7f6af80c2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:53.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.103+0000 7f6afdda8640 1 --2- 172.21.15.12:0/2087122464 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6af80ba0f0 0x7f6af80c2750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:53.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.103+0000 7f6afdda8640 1 -- 172.21.15.12:0/2087122464 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6af81d9aa0 con 0x7f6af80a9060 2024-05-15T16:41:53.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.103+0000 7f6afd5a7640 1 --2- 172.21.15.12:0/2087122464 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6af80ba0f0 0x7f6af80c2750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-15T16:41:53.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.103+0000 7f6afdda8640 1 --2- 172.21.15.12:0/2087122464 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6af80a9060 0x7f6af81d9560 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f6af400c7f0 tx=0x7f6af400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T16:41:53.112 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.103+0000 7f6aee7fc640 1 -- 172.21.15.12:0/2087122464 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6af4015070 con 0x7f6af80a9060 2024-05-15T16:41:53.112 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.103+0000 7f6aee7fc640 1 -- 172.21.15.12:0/2087122464 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6af4004220 con 0x7f6af80a9060 2024-05-15T16:41:53.112 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.103+0000 7f6aee7fc640 1 -- 172.21.15.12:0/2087122464 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6af4007620 con 0x7f6af80a9060 2024-05-15T16:41:53.112 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.103+0000 7f6b0000c640 1 -- 172.21.15.12:0/2087122464 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6af814c690 con 0x7f6af80a9060 2024-05-15T16:41:53.112 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.103+0000 7f6b0000c640 1 -- 172.21.15.12:0/2087122464 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6af8146930 con 0x7f6af80a9060 2024-05-15T16:41:53.112 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.104+0000 7f6b0000c640 1 -- 172.21.15.12:0/2087122464 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6af80ba9e0 con 0x7f6af80a9060 2024-05-15T16:41:53.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.105+0000 7f6aee7fc640 1 -- 172.21.15.12:0/2087122464 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f6af40079d0 con 0x7f6af80a9060 2024-05-15T16:41:53.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.105+0000 7f6aee7fc640 1 --2- 172.21.15.12:0/2087122464 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f6adc0762d0 0x7f6adc0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:53.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.106+0000 7f6aee7fc640 1 -- 172.21.15.12:0/2087122464 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4943+0+0 (secure 0 0 0) 0x7f6af40973e0 con 0x7f6af80a9060 2024-05-15T16:41:53.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.106+0000 7f6aee7fc640 1 --2- 172.21.15.12:0/2087122464 >> [v2:172.21.15.84:6824/3067620602,v1:172.21.15.84:6825/3067620602] conn(0x7f6adc07c1e0 0x7f6adc07e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:53.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.106+0000 7f6aee7fc640 1 -- 172.21.15.12:0/2087122464 --> [v2:172.21.15.84:6824/3067620602,v1:172.21.15.84:6825/3067620602] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6af4016ec0 con 0x7f6adc07c1e0 2024-05-15T16:41:53.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.106+0000 7f6aee7fc640 1 -- 172.21.15.12:0/2087122464 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f6af409e050 con 0x7f6af80a9060 2024-05-15T16:41:53.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.106+0000 7f6afd5a7640 1 --2- 172.21.15.12:0/2087122464 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f6adc0762d0 0x7f6adc0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:53.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.106+0000 7f6afe5a9640 1 --2- 172.21.15.12:0/2087122464 >> [v2:172.21.15.84:6824/3067620602,v1:172.21.15.84:6825/3067620602] conn(0x7f6adc07c1e0 0x7f6adc07e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:53.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.106+0000 7f6afd5a7640 1 --2- 172.21.15.12:0/2087122464 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f6adc0762d0 0x7f6adc0787e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f6ae8034000 tx=0x7f6ae802e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T16:41:53.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.106+0000 7f6afe5a9640 1 --2- 172.21.15.12:0/2087122464 >> [v2:172.21.15.84:6824/3067620602,v1:172.21.15.84:6825/3067620602] conn(0x7f6adc07c1e0 0x7f6adc07e630 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T16:41:53.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.107+0000 7f6aee7fc640 1 -- 172.21.15.12:0/2087122464 <== osd.7 v2:172.21.15.84:6824/3067620602 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6af4016ec0 con 0x7f6adc07c1e0 2024-05-15T16:41:53.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.121+0000 7f6b0000c640 1 -- 172.21.15.12:0/2087122464 --> [v2:172.21.15.84:6824/3067620602,v1:172.21.15.84:6825/3067620602] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f6af8050940 con 0x7f6adc07c1e0 2024-05-15T16:41:53.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.121+0000 7f6aee7fc640 1 -- 172.21.15.12:0/2087122464 <== osd.7 v2:172.21.15.84:6824/3067620602 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f6af8050940 con 0x7f6adc07c1e0 2024-05-15T16:41:53.123 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-05-15T16:41:53.123 INFO:teuthology.orchestra.run.smithi012.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-15T16:41:53.123 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-05-15T16:41:53.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.122+0000 7f6b0000c640 1 -- 172.21.15.12:0/2087122464 >> [v2:172.21.15.84:6824/3067620602,v1:172.21.15.84:6825/3067620602] conn(0x7f6adc07c1e0 msgr2=0x7f6adc07e630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:53.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.122+0000 7f6b0000c640 1 --2- 172.21.15.12:0/2087122464 >> [v2:172.21.15.84:6824/3067620602,v1:172.21.15.84:6825/3067620602] conn(0x7f6adc07c1e0 0x7f6adc07e630 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:53.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.122+0000 7f6b0000c640 1 -- 172.21.15.12:0/2087122464 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f6adc0762d0 msgr2=0x7f6adc0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:53.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.122+0000 7f6b0000c640 1 --2- 172.21.15.12:0/2087122464 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f6adc0762d0 0x7f6adc0787e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f6ae8034000 tx=0x7f6ae802e000 comp rx=0 tx=0).stop 2024-05-15T16:41:53.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.122+0000 7f6b0000c640 1 -- 172.21.15.12:0/2087122464 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6af80a9060 msgr2=0x7f6af81d9560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:53.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.122+0000 7f6b0000c640 1 --2- 172.21.15.12:0/2087122464 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6af80a9060 0x7f6af81d9560 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f6af400c7f0 tx=0x7f6af400ccb0 comp rx=0 tx=0).stop 2024-05-15T16:41:53.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.122+0000 7f6afe5a9640 1 -- 172.21.15.12:0/2087122464 reap_dead start 2024-05-15T16:41:53.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.122+0000 7f6b0000c640 1 -- 172.21.15.12:0/2087122464 shutdown_connections 2024-05-15T16:41:53.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.122+0000 7f6b0000c640 1 -- 172.21.15.12:0/2087122464 >> 172.21.15.12:0/2087122464 conn(0x7f6af80c07c0 msgr2=0x7f6af8074560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T16:41:53.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.122+0000 7f6b0000c640 1 -- 172.21.15.12:0/2087122464 shutdown_connections 2024-05-15T16:41:53.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.122+0000 7f6b0000c640 1 -- 172.21.15.12:0/2087122464 wait complete. 2024-05-15T16:41:53.134 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-05-15T16:41:53.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.245+0000 7ff39922b640 1 Processor -- start 2024-05-15T16:41:53.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.245+0000 7ff39922b640 1 -- start start 2024-05-15T16:41:53.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.247+0000 7ff39922b640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff3940a0ba0 0x7ff394146380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:53.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.247+0000 7ff39922b640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff39414c8e0 0x7ff39414ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:53.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.247+0000 7ff39922b640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff394071150 con 0x7ff3940bc1c0 2024-05-15T16:41:53.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.247+0000 7ff39922b640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7ff39414c450 con 0x7ff39414c8e0 2024-05-15T16:41:53.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.247+0000 7ff39922b640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7ff39414c120 con 0x7ff3940a0ba0 2024-05-15T16:41:53.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.247+0000 7ff39359e640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff39414c8e0 0x7ff39414ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:53.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.247+0000 7ff392d9d640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7ff3940bc1c0 0x7ff394070a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:54020/0 (socket says 172.21.15.12:54020) 2024-05-15T16:41:53.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.247+0000 7ff392d9d640 1 -- 172.21.15.12:0/1642403402 learned_addr learned my addr 172.21.15.12:0/1642403402 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-05-15T16:41:53.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.247+0000 7ff39259c640 1 --2- 172.21.15.12:0/1642403402 >> v2:172.21.15.84:3300/0 conn(0x7ff3940a0ba0 0x7ff394146380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:53.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.247+0000 7ff39359e640 1 -- 172.21.15.12:0/1642403402 >> v2:172.21.15.84:3300/0 conn(0x7ff3940a0ba0 msgr2=0x7ff394146380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T16:41:53.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.247+0000 7ff39359e640 1 --2- 172.21.15.12:0/1642403402 >> v2:172.21.15.84:3300/0 conn(0x7ff3940a0ba0 0x7ff394146380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:53.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.247+0000 7ff39359e640 1 -- 172.21.15.12:0/1642403402 >> v1:172.21.15.12:6789/0 conn(0x7ff3940bc1c0 legacy=0x7ff394070a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:53.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.247+0000 7ff39359e640 1 -- 172.21.15.12:0/1642403402 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff394071e40 con 0x7ff39414c8e0 2024-05-15T16:41:53.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.247+0000 7ff391d9b640 1 -- 172.21.15.12:0/1642403402 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2531933096 0 0) 0x7ff38c001110 con 0x7ff3940bc1c0 2024-05-15T16:41:53.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.248+0000 7ff39359e640 1 --2- 172.21.15.12:0/1642403402 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff39414c8e0 0x7ff39414ccf0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7ff39414c5d0 tx=0x7ff38402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e06f725967be5113 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T16:41:53.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.248+0000 7ff391d9b640 1 -- 172.21.15.12:0/1642403402 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff384007740 con 0x7ff39414c8e0 2024-05-15T16:41:53.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.248+0000 7ff391d9b640 1 -- 172.21.15.12:0/1642403402 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3840078e0 con 0x7ff39414c8e0 2024-05-15T16:41:53.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.248+0000 7ff391d9b640 1 -- 172.21.15.12:0/1642403402 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff384007cb0 con 0x7ff39414c8e0 2024-05-15T16:41:53.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.249+0000 7ff39922b640 1 -- 172.21.15.12:0/1642403402 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff39414c8e0 msgr2=0x7ff39414ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:53.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.249+0000 7ff39922b640 1 --2- 172.21.15.12:0/1642403402 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff39414c8e0 0x7ff39414ccf0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7ff39414c5d0 tx=0x7ff38402a660 comp rx=0 tx=0).stop 2024-05-15T16:41:53.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.249+0000 7ff39922b640 1 -- 172.21.15.12:0/1642403402 shutdown_connections 2024-05-15T16:41:53.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.249+0000 7ff39922b640 1 --2- 172.21.15.12:0/1642403402 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff39414c8e0 0x7ff39414ccf0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:53.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.249+0000 7ff39922b640 1 --2- 172.21.15.12:0/1642403402 >> v2:172.21.15.84:3300/0 conn(0x7ff3940a0ba0 0x7ff394146380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:53.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.249+0000 7ff39922b640 1 -- 172.21.15.12:0/1642403402 >> 172.21.15.12:0/1642403402 conn(0x7ff3940c17c0 msgr2=0x7ff3940c1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T16:41:53.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.249+0000 7ff39922b640 1 -- 172.21.15.12:0/1642403402 shutdown_connections 2024-05-15T16:41:53.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.249+0000 7ff39922b640 1 -- 172.21.15.12:0/1642403402 wait complete. 2024-05-15T16:41:53.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.250+0000 7ff39922b640 1 Processor -- start 2024-05-15T16:41:53.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.250+0000 7ff39922b640 1 -- start start 2024-05-15T16:41:53.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.251+0000 7ff39922b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3940a0ba0 0x7ff394145140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:53.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.251+0000 7ff39922b640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff3940bc1c0 0x7ff3940a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:53.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.251+0000 7ff39922b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff39414c8e0 0x7ff39413fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:53.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.251+0000 7ff39922b640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7ff3940a0fb0 con 0x7ff3940a0ba0 2024-05-15T16:41:53.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.252+0000 7ff39922b640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ff3940716b0 con 0x7ff39414c8e0 2024-05-15T16:41:53.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.252+0000 7ff39922b640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7ff3940bd5f0 con 0x7ff3940bc1c0 2024-05-15T16:41:53.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.252+0000 7ff392d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3940a0ba0 0x7ff394145140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:53.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.252+0000 7ff392d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3940a0ba0 0x7ff394145140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46192/0 (socket says 172.21.15.12:46192) 2024-05-15T16:41:53.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.252+0000 7ff392d9d640 1 -- 172.21.15.12:0/2547721901 learned_addr learned my addr 172.21.15.12:0/2547721901 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T16:41:53.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.252+0000 7ff39359e640 1 --2- 172.21.15.12:0/2547721901 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff39414c8e0 0x7ff39413fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:53.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.252+0000 7ff39259c640 1 --2- 172.21.15.12:0/2547721901 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff3940bc1c0 0x7ff3940a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:53.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.252+0000 7ff392d9d640 1 -- 172.21.15.12:0/2547721901 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff3940bc1c0 msgr2=0x7ff3940a3830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:53.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.252+0000 7ff392d9d640 1 --2- 172.21.15.12:0/2547721901 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff3940bc1c0 0x7ff3940a3830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:53.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.252+0000 7ff392d9d640 1 -- 172.21.15.12:0/2547721901 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff39414c8e0 msgr2=0x7ff39413fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:53.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.252+0000 7ff392d9d640 1 --2- 172.21.15.12:0/2547721901 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff39414c8e0 0x7ff39413fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:53.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.252+0000 7ff392d9d640 1 -- 172.21.15.12:0/2547721901 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff394145680 con 0x7ff3940a0ba0 2024-05-15T16:41:53.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.252+0000 7ff39259c640 1 --2- 172.21.15.12:0/2547721901 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff3940bc1c0 0x7ff3940a3830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-15T16:41:53.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.252+0000 7ff392d9d640 1 --2- 172.21.15.12:0/2547721901 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3940a0ba0 0x7ff394145140 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7ff38c00c3e0 tx=0x7ff38c00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T16:41:53.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.252+0000 7ff38b7fe640 1 -- 172.21.15.12:0/2547721901 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff38c0074e0 con 0x7ff3940a0ba0 2024-05-15T16:41:53.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.252+0000 7ff38b7fe640 1 -- 172.21.15.12:0/2547721901 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff38c0047e0 con 0x7ff3940a0ba0 2024-05-15T16:41:53.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.252+0000 7ff39922b640 1 -- 172.21.15.12:0/2547721901 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3940a3d70 con 0x7ff3940a0ba0 2024-05-15T16:41:53.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.252+0000 7ff38b7fe640 1 -- 172.21.15.12:0/2547721901 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff38c004bd0 con 0x7ff3940a0ba0 2024-05-15T16:41:53.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.252+0000 7ff39922b640 1 -- 172.21.15.12:0/2547721901 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3940a4970 con 0x7ff3940a0ba0 2024-05-15T16:41:53.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.253+0000 7ff39922b640 1 -- 172.21.15.12:0/2547721901 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3940a7140 con 0x7ff3940a0ba0 2024-05-15T16:41:53.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.254+0000 7ff38b7fe640 1 -- 172.21.15.12:0/2547721901 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff38c011070 con 0x7ff3940a0ba0 2024-05-15T16:41:53.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.254+0000 7ff38b7fe640 1 --2- 172.21.15.12:0/2547721901 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7ff3740762d0 0x7ff3740787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:53.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.255+0000 7ff38b7fe640 1 -- 172.21.15.12:0/2547721901 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4943+0+0 (secure 0 0 0) 0x7ff38c096e00 con 0x7ff3940a0ba0 2024-05-15T16:41:53.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.255+0000 7ff39259c640 1 --2- 172.21.15.12:0/2547721901 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7ff3740762d0 0x7ff3740787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:53.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.255+0000 7ff39259c640 1 --2- 172.21.15.12:0/2547721901 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7ff3740762d0 0x7ff3740787e0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7ff394145b40 tx=0x7ff37c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T16:41:53.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.259+0000 7ff38b7fe640 1 -- 172.21.15.12:0/2547721901 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7ff394071150 con 0x7ff3940a0ba0 2024-05-15T16:41:53.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.451+0000 7ff39922b640 1 -- 172.21.15.12:0/2547721901 --> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7ff394149840 con 0x7ff3740762d0 2024-05-15T16:41:53.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.452+0000 7ff38b7fe640 1 -- 172.21.15.12:0/2547721901 <== mgr.4106 v2:172.21.15.84:6832/4173299311 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7ff394149840 con 0x7ff3740762d0 2024-05-15T16:41:53.454 INFO:teuthology.orchestra.run.smithi012.stderr:instructed osd(s) 7 to deep-scrub 2024-05-15T16:41:53.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.454+0000 7ff39922b640 1 -- 172.21.15.12:0/2547721901 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7ff3740762d0 msgr2=0x7ff3740787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:53.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.454+0000 7ff39922b640 1 --2- 172.21.15.12:0/2547721901 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7ff3740762d0 0x7ff3740787e0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7ff394145b40 tx=0x7ff37c008040 comp rx=0 tx=0).stop 2024-05-15T16:41:53.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.454+0000 7ff39922b640 1 -- 172.21.15.12:0/2547721901 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3940a0ba0 msgr2=0x7ff394145140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:53.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.454+0000 7ff39922b640 1 --2- 172.21.15.12:0/2547721901 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3940a0ba0 0x7ff394145140 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7ff38c00c3e0 tx=0x7ff38c00c8a0 comp rx=0 tx=0).stop 2024-05-15T16:41:53.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.454+0000 7ff39922b640 1 -- 172.21.15.12:0/2547721901 shutdown_connections 2024-05-15T16:41:53.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.454+0000 7ff39922b640 1 --2- 172.21.15.12:0/2547721901 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff39414c8e0 0x7ff39413fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:53.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.454+0000 7ff39922b640 1 --2- 172.21.15.12:0/2547721901 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff3940bc1c0 0x7ff3940a3830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:53.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.454+0000 7ff39922b640 1 --2- 172.21.15.12:0/2547721901 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7ff3740762d0 0x7ff3740787e0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:53.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.454+0000 7ff39922b640 1 --2- 172.21.15.12:0/2547721901 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3940a0ba0 0x7ff394145140 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:53.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.454+0000 7ff39922b640 1 -- 172.21.15.12:0/2547721901 >> 172.21.15.12:0/2547721901 conn(0x7ff3940c17c0 msgr2=0x7ff3940bdfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T16:41:53.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.455+0000 7ff39922b640 1 -- 172.21.15.12:0/2547721901 shutdown_connections 2024-05-15T16:41:53.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.455+0000 7ff39922b640 1 -- 172.21.15.12:0/2547721901 wait complete. 2024-05-15T16:41:53.467 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-15T16:41:53.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.576+0000 7f00d0fd5640 1 Processor -- start 2024-05-15T16:41:53.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.577+0000 7f00d0fd5640 1 -- start start 2024-05-15T16:41:53.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.578+0000 7f00d0fd5640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f00cc152180 0x7f00cc152590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:53.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.578+0000 7f00d0fd5640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00cc0bbc80 con 0x7f00cc074320 2024-05-15T16:41:53.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.578+0000 7f00d0fd5640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00cc0bbf60 con 0x7f00cc06c8c0 2024-05-15T16:41:53.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.578+0000 7f00d0fd5640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f00cc151a10 con 0x7f00cc152180 2024-05-15T16:41:53.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.578+0000 7f00cad9d640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f00cc074320 0x7f00cc074730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:54022/0 (socket says 172.21.15.12:54022) 2024-05-15T16:41:53.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.578+0000 7f00cad9d640 1 -- 172.21.15.12:0/869204240 learned_addr learned my addr 172.21.15.12:0/869204240 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-05-15T16:41:53.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.578+0000 7f00c9d9b640 1 --2- 172.21.15.12:0/869204240 >> v2:172.21.15.84:3300/0 conn(0x7f00cc152180 0x7f00cc152590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:53.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.578+0000 7f00c959a640 1 -- 172.21.15.12:0/869204240 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3620057516 0 0) 0x7f00cc0bbc80 con 0x7f00cc074320 2024-05-15T16:41:53.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.578+0000 7f00c959a640 1 -- 172.21.15.12:0/869204240 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f00b4003520 con 0x7f00cc074320 2024-05-15T16:41:53.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.578+0000 7f00c959a640 1 -- 172.21.15.12:0/869204240 <== mon.1 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1856292345 0 0) 0x7f00cc0bbf60 con 0x7f00cc06c8c0 2024-05-15T16:41:53.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.578+0000 7f00c959a640 1 -- 172.21.15.12:0/869204240 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f00cc0bbc80 con 0x7f00cc06c8c0 2024-05-15T16:41:53.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.578+0000 7f00c9d9b640 1 -- 172.21.15.12:0/869204240 >> v1:172.21.15.84:6789/0 conn(0x7f00cc06c8c0 legacy=0x7f00cc0bb4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:53.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.578+0000 7f00c9d9b640 1 -- 172.21.15.12:0/869204240 >> v1:172.21.15.12:6789/0 conn(0x7f00cc074320 legacy=0x7f00cc074730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:53.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.578+0000 7f00c9d9b640 1 -- 172.21.15.12:0/869204240 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00cc151c60 con 0x7f00cc152180 2024-05-15T16:41:53.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.579+0000 7f00c9d9b640 1 --2- 172.21.15.12:0/869204240 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00cc152180 0x7f00cc152590 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f00c00097a0 tx=0x7f00c002a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=66e5561d195daee server_cookie=0 in_seq=0 out_seq=0 2024-05-15T16:41:53.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.579+0000 7f00c959a640 1 -- 172.21.15.12:0/869204240 <== mon.1 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00c0037070 con 0x7f00cc152180 2024-05-15T16:41:53.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.579+0000 7f00c959a640 1 -- 172.21.15.12:0/869204240 <== mon.1 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00c0032440 con 0x7f00cc152180 2024-05-15T16:41:53.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.579+0000 7f00c959a640 1 -- 172.21.15.12:0/869204240 <== mon.1 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00c00327f0 con 0x7f00cc152180 2024-05-15T16:41:53.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.580+0000 7f00d0fd5640 1 -- 172.21.15.12:0/869204240 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00cc152180 msgr2=0x7f00cc152590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:53.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.580+0000 7f00d0fd5640 1 --2- 172.21.15.12:0/869204240 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00cc152180 0x7f00cc152590 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f00c00097a0 tx=0x7f00c002a230 comp rx=0 tx=0).stop 2024-05-15T16:41:53.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.580+0000 7f00d0fd5640 1 -- 172.21.15.12:0/869204240 shutdown_connections 2024-05-15T16:41:53.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.580+0000 7f00d0fd5640 1 --2- 172.21.15.12:0/869204240 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00cc152180 0x7f00cc152590 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:53.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.580+0000 7f00d0fd5640 1 -- 172.21.15.12:0/869204240 >> 172.21.15.12:0/869204240 conn(0x7f00cc0bd0f0 msgr2=0x7f00cc0bd500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T16:41:53.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.580+0000 7f00d0fd5640 1 -- 172.21.15.12:0/869204240 shutdown_connections 2024-05-15T16:41:53.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.580+0000 7f00d0fd5640 1 -- 172.21.15.12:0/869204240 wait complete. 2024-05-15T16:41:53.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.582+0000 7f00d0fd5640 1 Processor -- start 2024-05-15T16:41:53.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.582+0000 7f00d0fd5640 1 -- start start 2024-05-15T16:41:53.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.583+0000 7f00d0fd5640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f00cc06c8c0 0x7f00cc148ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:53.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.583+0000 7f00d0fd5640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f00cc074320 0x7f00cc148170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:53.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.583+0000 7f00d0fd5640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00cc152180 0x7f00cc1e4200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:53.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.583+0000 7f00d0fd5640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f00cc06ccd0 con 0x7f00cc074320 2024-05-15T16:41:53.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.583+0000 7f00d0fd5640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f00cc0bb090 con 0x7f00cc152180 2024-05-15T16:41:53.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.583+0000 7f00d0fd5640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f00cc06ce50 con 0x7f00cc06c8c0 2024-05-15T16:41:53.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.583+0000 7f00c9d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f00cc074320 0x7f00cc148170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:53.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.583+0000 7f00c9d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f00cc074320 0x7f00cc148170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46208/0 (socket says 172.21.15.12:46208) 2024-05-15T16:41:53.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.583+0000 7f00c9d9b640 1 -- 172.21.15.12:0/2711060165 learned_addr learned my addr 172.21.15.12:0/2711060165 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T16:41:53.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.583+0000 7f00cad9d640 1 --2- 172.21.15.12:0/2711060165 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00cc152180 0x7f00cc1e4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:53.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.583+0000 7f00ca59c640 1 --2- 172.21.15.12:0/2711060165 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f00cc06c8c0 0x7f00cc148ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:53.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.583+0000 7f00c9d9b640 1 -- 172.21.15.12:0/2711060165 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f00cc06c8c0 msgr2=0x7f00cc148ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:53.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.583+0000 7f00c9d9b640 1 --2- 172.21.15.12:0/2711060165 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f00cc06c8c0 0x7f00cc148ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:53.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.583+0000 7f00c9d9b640 1 -- 172.21.15.12:0/2711060165 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00cc152180 msgr2=0x7f00cc1e4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:53.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.583+0000 7f00c9d9b640 1 --2- 172.21.15.12:0/2711060165 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00cc152180 0x7f00cc1e4200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:53.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.583+0000 7f00c9d9b640 1 -- 172.21.15.12:0/2711060165 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00cc149420 con 0x7f00cc074320 2024-05-15T16:41:53.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.583+0000 7f00cad9d640 1 --2- 172.21.15.12:0/2711060165 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00cc152180 0x7f00cc1e4200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-15T16:41:53.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.583+0000 7f00ca59c640 1 --2- 172.21.15.12:0/2711060165 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f00cc06c8c0 0x7f00cc148ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-15T16:41:53.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.584+0000 7f00c9d9b640 1 --2- 172.21.15.12:0/2711060165 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f00cc074320 0x7f00cc148170 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f00c0000c00 tx=0x7f00c00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T16:41:53.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.584+0000 7f00baffd640 1 -- 172.21.15.12:0/2711060165 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00c0041030 con 0x7f00cc074320 2024-05-15T16:41:53.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.584+0000 7f00baffd640 1 -- 172.21.15.12:0/2711060165 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00c003d4e0 con 0x7f00cc074320 2024-05-15T16:41:53.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.584+0000 7f00d0fd5640 1 -- 172.21.15.12:0/2711060165 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00cc0a1fa0 con 0x7f00cc074320 2024-05-15T16:41:53.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.584+0000 7f00baffd640 1 -- 172.21.15.12:0/2711060165 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00c0037040 con 0x7f00cc074320 2024-05-15T16:41:53.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.584+0000 7f00d0fd5640 1 -- 172.21.15.12:0/2711060165 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00cc14c310 con 0x7f00cc074320 2024-05-15T16:41:53.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.585+0000 7f00d0fd5640 1 -- 172.21.15.12:0/2711060165 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00cc0be3f0 con 0x7f00cc074320 2024-05-15T16:41:53.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.586+0000 7f00baffd640 1 -- 172.21.15.12:0/2711060165 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f00c0044070 con 0x7f00cc074320 2024-05-15T16:41:53.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.586+0000 7f00baffd640 1 --2- 172.21.15.12:0/2711060165 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f00ac0762d0 0x7f00ac0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:41:53.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.586+0000 7f00baffd640 1 -- 172.21.15.12:0/2711060165 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4943+0+0 (secure 0 0 0) 0x7f00c00b7970 con 0x7f00cc074320 2024-05-15T16:41:53.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.586+0000 7f00ca59c640 1 --2- 172.21.15.12:0/2711060165 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f00ac0762d0 0x7f00ac0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:41:53.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.587+0000 7f00ca59c640 1 --2- 172.21.15.12:0/2711060165 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f00ac0762d0 0x7f00ac0787e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f00c40014a0 tx=0x7f00c4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T16:41:53.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.591+0000 7f00baffd640 1 -- 172.21.15.12:0/2711060165 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f00c00815e0 con 0x7f00cc074320 2024-05-15T16:41:53.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.776+0000 7f00d0fd5640 1 -- 172.21.15.12:0/2711060165 --> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f00cc0a1620 con 0x7f00ac0762d0 2024-05-15T16:41:53.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.777+0000 7f00baffd640 1 -- 172.21.15.12:0/2711060165 <== mgr.4106 v2:172.21.15.84:6832/4173299311 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13361 (secure 0 0 0) 0x7f00cc0a1620 con 0x7f00ac0762d0 2024-05-15T16:41:53.778 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-05-15T16:41:53.779 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-05-15T16:41:53.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.779+0000 7f00d0fd5640 1 -- 172.21.15.12:0/2711060165 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f00ac0762d0 msgr2=0x7f00ac0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:53.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.779+0000 7f00d0fd5640 1 --2- 172.21.15.12:0/2711060165 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f00ac0762d0 0x7f00ac0787e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f00c40014a0 tx=0x7f00c4009040 comp rx=0 tx=0).stop 2024-05-15T16:41:53.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.779+0000 7f00d0fd5640 1 -- 172.21.15.12:0/2711060165 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f00cc074320 msgr2=0x7f00cc148170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:41:53.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.779+0000 7f00d0fd5640 1 --2- 172.21.15.12:0/2711060165 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f00cc074320 0x7f00cc148170 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f00c0000c00 tx=0x7f00c00046c0 comp rx=0 tx=0).stop 2024-05-15T16:41:53.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.779+0000 7f00d0fd5640 1 -- 172.21.15.12:0/2711060165 shutdown_connections 2024-05-15T16:41:53.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.779+0000 7f00d0fd5640 1 --2- 172.21.15.12:0/2711060165 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00cc152180 0x7f00cc1e4200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:53.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.779+0000 7f00d0fd5640 1 --2- 172.21.15.12:0/2711060165 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f00ac0762d0 0x7f00ac0787e0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:53.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.779+0000 7f00d0fd5640 1 --2- 172.21.15.12:0/2711060165 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f00cc074320 0x7f00cc148170 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:53.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.779+0000 7f00d0fd5640 1 --2- 172.21.15.12:0/2711060165 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f00cc06c8c0 0x7f00cc148ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:41:53.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.779+0000 7f00d0fd5640 1 -- 172.21.15.12:0/2711060165 >> 172.21.15.12:0/2711060165 conn(0x7f00cc0bd0f0 msgr2=0x7f00cc0bd500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T16:41:53.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.779+0000 7f00d0fd5640 1 -- 172.21.15.12:0/2711060165 shutdown_connections 2024-05-15T16:41:53.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:41:53.779+0000 7f00d0fd5640 1 -- 172.21.15.12:0/2711060165 wait complete. 2024-05-15T16:41:53.791 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":1902,"stamp":"2024-05-15T16:41:53.554284+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":997904,"kb_used_data":4840,"kb_used_omap":12,"kb_used_meta":992947,"kb_avail":753976816,"statfs":{"total":773094113280,"available":772072259584,"internally_reserved":0,"allocated":4956160,"data_stored":2685216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":1016778291},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002869"},"pg_stats":[{"pgid":"1.0","version":"18'72","reported_seq":175,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-15T16:37:54.798671+0000","last_change":"2024-05-15T15:39:42.584601+0000","last_active":"2024-05-15T16:37:54.798671+0000","last_peered":"2024-05-15T16:37:54.798671+0000","last_clean":"2024-05-15T16:37:54.798671+0000","last_became_active":"2024-05-15T15:39:42.584129+0000","last_became_peered":"2024-05-15T15:39:42.584129+0000","last_unstale":"2024-05-15T16:37:54.798671+0000","last_undegraded":"2024-05-15T16:37:54.798671+0000","last_fullsized":"2024-05-15T16:37:54.798671+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T15:39:41.378107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T15:39:41.378107+0000","last_clean_scrub_stamp":"2024-05-15T15:39:41.378107+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:23:25.285669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510189,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":99608,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94272232,"statfs":{"total":96636764160,"available":96534765568,"internally_reserved":0,"allocated":471040,"data_stored":188060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":101513675},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424510189,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":117660,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":117182,"kb_avail":94254180,"statfs":{"total":96636764160,"available":96516280320,"internally_reserved":0,"allocated":471040,"data_stored":188060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":119994822},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424510190,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":68256,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":94303584,"statfs":{"total":96636764160,"available":96566870016,"internally_reserved":0,"allocated":1064960,"data_stored":778428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68811205},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424510189,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":125976,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":125502,"kb_avail":94245864,"statfs":{"total":96636764160,"available":96507764736,"internally_reserved":0,"allocated":471040,"data_stored":188060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":128514503},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510189,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":148188,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":147710,"kb_avail":94223652,"statfs":{"total":96636764160,"available":96485019648,"internally_reserved":0,"allocated":471040,"data_stored":188060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":151255493},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510190,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":144604,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":143550,"kb_avail":94227236,"statfs":{"total":96636764160,"available":96488689664,"internally_reserved":0,"allocated":1064960,"data_stored":778428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":146995654},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510189,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":103768,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":103294,"kb_avail":94268072,"statfs":{"total":96636764160,"available":96530505728,"internally_reserved":0,"allocated":471040,"data_stored":188060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":105773510},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575598,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":189844,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":189374,"kb_avail":94181996,"statfs":{"total":96636764160,"available":96442363904,"internally_reserved":0,"allocated":471040,"data_stored":188060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":193919429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-15T16:41:53.795 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-05-15T15:39:41.378107+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=15, tm_min=39, tm_sec=41, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=16, tm_min=41, tm_sec=48, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T16:41:53.795 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-15T16:42:12.796 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:42:12.800 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:42:12.803 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:42:13.796 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-15T16:42:13.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:13.920+0000 7fce88184640 1 Processor -- start 2024-05-15T16:42:13.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:13.920+0000 7fce88184640 1 -- start start 2024-05-15T16:42:13.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:13.922+0000 7fce88184640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fce8014e360 0x7fce801522d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:42:13.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:13.922+0000 7fce88184640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fce80148770 0x7fce800c0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:42:13.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:13.922+0000 7fce88184640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce800c0620 con 0x7fce800bf9b0 2024-05-15T16:42:13.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:13.922+0000 7fce88184640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fce80151e40 con 0x7fce80148770 2024-05-15T16:42:13.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:13.922+0000 7fce88184640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fce80151ad0 con 0x7fce8014e360 2024-05-15T16:42:13.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:13.922+0000 7fce8571f640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fce80148770 0x7fce800c0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:42:13.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:13.922+0000 7fce8571f640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fce80148770 0x7fce800c0c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53034/0 (socket says 172.21.15.12:53034) 2024-05-15T16:42:13.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:13.922+0000 7fce8571f640 1 -- 172.21.15.12:0/921456041 learned_addr learned my addr 172.21.15.12:0/921456041 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T16:42:13.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:13.922+0000 7fce85f20640 1 --2- 172.21.15.12:0/921456041 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fce8014e360 0x7fce801522d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:42:13.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:13.922+0000 7fce8571f640 1 -- 172.21.15.12:0/921456041 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fce8014e360 msgr2=0x7fce801522d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T16:42:13.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:13.922+0000 7fce8571f640 1 --2- 172.21.15.12:0/921456041 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fce8014e360 0x7fce801522d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:42:13.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:13.922+0000 7fce8571f640 1 -- 172.21.15.12:0/921456041 >> v1:172.21.15.84:6789/0 conn(0x7fce800bf9b0 legacy=0x7fce800bfdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:42:13.925 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:13.922+0000 7fce8571f640 1 -- 172.21.15.12:0/921456041 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce80152810 con 0x7fce80148770 2024-05-15T16:42:13.925 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:13.922+0000 7fce84f1e640 1 -- 172.21.15.12:0/921456041 <== mon.1 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1812179473 0 0) 0x7fce800c0620 con 0x7fce800bf9b0 2024-05-15T16:42:13.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:13.923+0000 7fce8571f640 1 --2- 172.21.15.12:0/921456041 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce80148770 0x7fce800c0c80 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fce740098a0 tx=0x7fce7402a320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6d2bb9b4eede83c server_cookie=0 in_seq=0 out_seq=0 2024-05-15T16:42:13.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:13.923+0000 7fce84f1e640 1 -- 172.21.15.12:0/921456041 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce74037070 con 0x7fce80148770 2024-05-15T16:42:13.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:13.923+0000 7fce84f1e640 1 -- 172.21.15.12:0/921456041 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce74032640 con 0x7fce80148770 2024-05-15T16:42:13.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:13.923+0000 7fce84f1e640 1 -- 172.21.15.12:0/921456041 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce74032a10 con 0x7fce80148770 2024-05-15T16:42:13.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:13.924+0000 7fce88184640 1 -- 172.21.15.12:0/921456041 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce80148770 msgr2=0x7fce800c0c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:42:13.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:13.924+0000 7fce88184640 1 --2- 172.21.15.12:0/921456041 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce80148770 0x7fce800c0c80 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fce740098a0 tx=0x7fce7402a320 comp rx=0 tx=0).stop 2024-05-15T16:42:13.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:13.924+0000 7fce88184640 1 -- 172.21.15.12:0/921456041 shutdown_connections 2024-05-15T16:42:13.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:13.924+0000 7fce88184640 1 --2- 172.21.15.12:0/921456041 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce80148770 0x7fce800c0c80 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:42:13.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:13.924+0000 7fce88184640 1 --2- 172.21.15.12:0/921456041 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fce8014e360 0x7fce801522d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:42:13.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:13.924+0000 7fce88184640 1 -- 172.21.15.12:0/921456041 >> 172.21.15.12:0/921456041 conn(0x7fce800c17c0 msgr2=0x7fce800c1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T16:42:13.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:13.924+0000 7fce88184640 1 -- 172.21.15.12:0/921456041 shutdown_connections 2024-05-15T16:42:13.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:13.924+0000 7fce88184640 1 -- 172.21.15.12:0/921456041 wait complete. 2024-05-15T16:42:13.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:13.926+0000 7fce88184640 1 Processor -- start 2024-05-15T16:42:13.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:13.926+0000 7fce88184640 1 -- start start 2024-05-15T16:42:13.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:13.927+0000 7fce88184640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fce800bf9b0 0x7fce801428c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:42:13.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:13.927+0000 7fce88184640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fce80148770 0x7fce80071850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:42:13.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:13.927+0000 7fce88184640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce8014e360 0x7fce8013bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:42:13.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:13.927+0000 7fce88184640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fce80158cc0 con 0x7fce8014e360 2024-05-15T16:42:13.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:13.927+0000 7fce88184640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fce800c13d0 con 0x7fce80148770 2024-05-15T16:42:13.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:13.927+0000 7fce88184640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7fce80158e40 con 0x7fce800bf9b0 2024-05-15T16:42:13.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:13.927+0000 7fce86721640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce8014e360 0x7fce8013bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:42:13.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:13.927+0000 7fce86721640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce8014e360 0x7fce8013bc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53044/0 (socket says 172.21.15.12:53044) 2024-05-15T16:42:13.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:13.927+0000 7fce86721640 1 -- 172.21.15.12:0/633056847 learned_addr learned my addr 172.21.15.12:0/633056847 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T16:42:13.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:13.927+0000 7fce8571f640 1 --2- 172.21.15.12:0/633056847 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fce80148770 0x7fce80071850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:42:13.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:13.927+0000 7fce85f20640 1 --2- 172.21.15.12:0/633056847 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fce800bf9b0 0x7fce801428c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:42:13.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:13.927+0000 7fce86721640 1 -- 172.21.15.12:0/633056847 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fce800bf9b0 msgr2=0x7fce801428c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:42:13.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:13.927+0000 7fce86721640 1 --2- 172.21.15.12:0/633056847 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fce800bf9b0 0x7fce801428c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:42:13.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:13.927+0000 7fce86721640 1 -- 172.21.15.12:0/633056847 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fce80148770 msgr2=0x7fce80071850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:42:13.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:13.927+0000 7fce86721640 1 --2- 172.21.15.12:0/633056847 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fce80148770 0x7fce80071850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:42:13.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:13.927+0000 7fce86721640 1 -- 172.21.15.12:0/633056847 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce80142e00 con 0x7fce8014e360 2024-05-15T16:42:13.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:13.927+0000 7fce86721640 1 --2- 172.21.15.12:0/633056847 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce8014e360 0x7fce8013bc40 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fce7000c760 tx=0x7fce7000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T16:42:13.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:13.927+0000 7fce7e7fc640 1 -- 172.21.15.12:0/633056847 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce70003da0 con 0x7fce8014e360 2024-05-15T16:42:13.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:13.928+0000 7fce7e7fc640 1 -- 172.21.15.12:0/633056847 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce7000ce10 con 0x7fce8014e360 2024-05-15T16:42:13.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:13.928+0000 7fce88184640 1 -- 172.21.15.12:0/633056847 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce80071d90 con 0x7fce8014e360 2024-05-15T16:42:13.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:13.928+0000 7fce7e7fc640 1 -- 172.21.15.12:0/633056847 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce700052b0 con 0x7fce8014e360 2024-05-15T16:42:13.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:13.928+0000 7fce88184640 1 -- 172.21.15.12:0/633056847 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce800b7fb0 con 0x7fce8014e360 2024-05-15T16:42:13.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:13.929+0000 7fce88184640 1 -- 172.21.15.12:0/633056847 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce80140c90 con 0x7fce8014e360 2024-05-15T16:42:13.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:13.929+0000 7fce7e7fc640 1 -- 172.21.15.12:0/633056847 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fce70005450 con 0x7fce8014e360 2024-05-15T16:42:13.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:13.930+0000 7fce7e7fc640 1 --2- 172.21.15.12:0/633056847 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fce6c0762d0 0x7fce6c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:42:13.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:13.930+0000 7fce7e7fc640 1 -- 172.21.15.12:0/633056847 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4943+0+0 (secure 0 0 0) 0x7fce70097210 con 0x7fce8014e360 2024-05-15T16:42:13.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:13.930+0000 7fce85f20640 1 --2- 172.21.15.12:0/633056847 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fce6c0762d0 0x7fce6c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:42:13.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:13.930+0000 7fce85f20640 1 --2- 172.21.15.12:0/633056847 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fce6c0762d0 0x7fce6c0787e0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fce78009a30 tx=0x7fce78008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T16:42:13.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:13.935+0000 7fce7e7fc640 1 -- 172.21.15.12:0/633056847 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fce80140c90 con 0x7fce8014e360 2024-05-15T16:42:14.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.123+0000 7fce88184640 1 -- 172.21.15.12:0/633056847 --> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fce80158aa0 con 0x7fce6c0762d0 2024-05-15T16:42:14.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.124+0000 7fce7e7fc640 1 -- 172.21.15.12:0/633056847 <== mgr.4106 v2:172.21.15.84:6832/4173299311 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13365 (secure 0 0 0) 0x7fce80158aa0 con 0x7fce6c0762d0 2024-05-15T16:42:14.125 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-05-15T16:42:14.126 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-05-15T16:42:14.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.126+0000 7fce88184640 1 -- 172.21.15.12:0/633056847 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fce6c0762d0 msgr2=0x7fce6c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:42:14.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.126+0000 7fce88184640 1 --2- 172.21.15.12:0/633056847 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fce6c0762d0 0x7fce6c0787e0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fce78009a30 tx=0x7fce78008040 comp rx=0 tx=0).stop 2024-05-15T16:42:14.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.126+0000 7fce88184640 1 -- 172.21.15.12:0/633056847 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce8014e360 msgr2=0x7fce8013bc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:42:14.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.126+0000 7fce88184640 1 --2- 172.21.15.12:0/633056847 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce8014e360 0x7fce8013bc40 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fce7000c760 tx=0x7fce7000cc20 comp rx=0 tx=0).stop 2024-05-15T16:42:14.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.126+0000 7fce88184640 1 -- 172.21.15.12:0/633056847 shutdown_connections 2024-05-15T16:42:14.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.126+0000 7fce88184640 1 --2- 172.21.15.12:0/633056847 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7fce6c0762d0 0x7fce6c0787e0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:42:14.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.126+0000 7fce88184640 1 --2- 172.21.15.12:0/633056847 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce8014e360 0x7fce8013bc40 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:42:14.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.126+0000 7fce88184640 1 --2- 172.21.15.12:0/633056847 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fce80148770 0x7fce80071850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:42:14.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.126+0000 7fce88184640 1 --2- 172.21.15.12:0/633056847 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fce800bf9b0 0x7fce801428c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:42:14.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.126+0000 7fce88184640 1 -- 172.21.15.12:0/633056847 >> 172.21.15.12:0/633056847 conn(0x7fce800c17c0 msgr2=0x7fce80140580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T16:42:14.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.126+0000 7fce88184640 1 -- 172.21.15.12:0/633056847 shutdown_connections 2024-05-15T16:42:14.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.126+0000 7fce88184640 1 -- 172.21.15.12:0/633056847 wait complete. 2024-05-15T16:42:14.138 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":1912,"stamp":"2024-05-15T16:42:13.558473+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":997892,"kb_used_data":4840,"kb_used_omap":12,"kb_used_meta":992947,"kb_avail":753976828,"statfs":{"total":773094113280,"available":772072271872,"internally_reserved":0,"allocated":4956160,"data_stored":2685216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":1016778291},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002487"},"pg_stats":[{"pgid":"1.0","version":"41'74","reported_seq":187,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-15T16:41:51.213421+0000","last_change":"2024-05-15T16:41:51.213421+0000","last_active":"2024-05-15T16:41:51.213421+0000","last_peered":"2024-05-15T16:41:51.213421+0000","last_clean":"2024-05-15T16:41:51.213421+0000","last_became_active":"2024-05-15T15:39:42.584129+0000","last_became_peered":"2024-05-15T15:39:42.584129+0000","last_unstale":"2024-05-15T16:41:51.213421+0000","last_undegraded":"2024-05-15T16:41:51.213421+0000","last_fullsized":"2024-05-15T16:41:51.213421+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'74","last_scrub_stamp":"2024-05-15T16:41:51.213317+0000","last_deep_scrub":"41'74","last_deep_scrub_stamp":"2024-05-15T16:41:51.213317+0000","last_clean_scrub_stamp":"2024-05-15T16:41:51.213317+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:59:19.555361+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510193,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":99608,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94272232,"statfs":{"total":96636764160,"available":96534765568,"internally_reserved":0,"allocated":471040,"data_stored":188060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":101513675},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424510193,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":117660,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":117182,"kb_avail":94254180,"statfs":{"total":96636764160,"available":96516280320,"internally_reserved":0,"allocated":471040,"data_stored":188060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":119994822},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424510194,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":68248,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":94303592,"statfs":{"total":96636764160,"available":96566878208,"internally_reserved":0,"allocated":1064960,"data_stored":778428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68811205},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424510193,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":125976,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":125502,"kb_avail":94245864,"statfs":{"total":96636764160,"available":96507764736,"internally_reserved":0,"allocated":471040,"data_stored":188060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":128514503},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510193,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":148188,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":147710,"kb_avail":94223652,"statfs":{"total":96636764160,"available":96485019648,"internally_reserved":0,"allocated":471040,"data_stored":188060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":151255493},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510194,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":144600,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":143550,"kb_avail":94227240,"statfs":{"total":96636764160,"available":96488693760,"internally_reserved":0,"allocated":1064960,"data_stored":778428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":146995654},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510193,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":103768,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":103294,"kb_avail":94268072,"statfs":{"total":96636764160,"available":96530505728,"internally_reserved":0,"allocated":471040,"data_stored":188060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":105773510},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575602,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":189844,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":189374,"kb_avail":94181996,"statfs":{"total":96636764160,"available":96442363904,"internally_reserved":0,"allocated":471040,"data_stored":188060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":193919429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-15T16:42:14.139 DEBUG:teuthology.orchestra.run.smithi012:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-05-15T16:42:14.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.249+0000 7f739d8e0640 1 Processor -- start 2024-05-15T16:42:14.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.249+0000 7f739d8e0640 1 -- start start 2024-05-15T16:42:14.252 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.250+0000 7f739d8e0640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f73980bb490 0x7f73980b57f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:42:14.252 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.250+0000 7f739d8e0640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f73980b4500 0x7f73980b9ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:42:14.252 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.250+0000 7f739d8e0640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f739806faa0 0x7f73980a4080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:42:14.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.250+0000 7f739d8e0640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f73980bbd60 con 0x7f73980bb490 2024-05-15T16:42:14.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.250+0000 7f739d8e0640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f73980ba420 con 0x7f739806faa0 2024-05-15T16:42:14.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.250+0000 7f739d8e0640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f73980bba80 con 0x7f73980b4500 2024-05-15T16:42:14.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.250+0000 7f7396ffd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f73980bb490 0x7f73980b57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:42:14.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.250+0000 7f7396ffd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f73980bb490 0x7f73980b57f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53054/0 (socket says 172.21.15.12:53054) 2024-05-15T16:42:14.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.250+0000 7f7396ffd640 1 -- 172.21.15.12:0/207136666 learned_addr learned my addr 172.21.15.12:0/207136666 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T16:42:14.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.250+0000 7f73977fe640 1 --2- 172.21.15.12:0/207136666 >> v2:172.21.15.84:3300/0 conn(0x7f739806faa0 0x7f73980a4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:42:14.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.250+0000 7f738ffff640 1 --2- 172.21.15.12:0/207136666 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f73980b4500 0x7f73980b9ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:42:14.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.250+0000 7f7396ffd640 1 -- 172.21.15.12:0/207136666 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f73980b4500 msgr2=0x7f73980b9ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T16:42:14.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.250+0000 7f7396ffd640 1 --2- 172.21.15.12:0/207136666 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f73980b4500 0x7f73980b9ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:42:14.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.250+0000 7f7396ffd640 1 -- 172.21.15.12:0/207136666 >> v2:172.21.15.84:3300/0 conn(0x7f739806faa0 msgr2=0x7f73980a4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T16:42:14.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.250+0000 7f7396ffd640 1 --2- 172.21.15.12:0/207136666 >> v2:172.21.15.84:3300/0 conn(0x7f739806faa0 0x7f73980a4080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:42:14.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.250+0000 7f7396ffd640 1 -- 172.21.15.12:0/207136666 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73980b4ff0 con 0x7f73980bb490 2024-05-15T16:42:14.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.250+0000 7f73977fe640 1 --2- 172.21.15.12:0/207136666 >> v2:172.21.15.84:3300/0 conn(0x7f739806faa0 0x7f73980a4080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-15T16:42:14.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.250+0000 7f738ffff640 1 --2- 172.21.15.12:0/207136666 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f73980b4500 0x7f73980b9ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-15T16:42:14.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.251+0000 7f7396ffd640 1 --2- 172.21.15.12:0/207136666 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f73980bb490 0x7f73980b57f0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f739814f7c0 tx=0x7f738802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c62682aefc17261 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T16:42:14.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.251+0000 7f73967fc640 1 -- 172.21.15.12:0/207136666 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7388037070 con 0x7f73980bb490 2024-05-15T16:42:14.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.251+0000 7f73967fc640 1 -- 172.21.15.12:0/207136666 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7388032440 con 0x7f73980bb490 2024-05-15T16:42:14.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.251+0000 7f73967fc640 1 -- 172.21.15.12:0/207136666 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7388032810 con 0x7f73980bb490 2024-05-15T16:42:14.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.252+0000 7f739d8e0640 1 -- 172.21.15.12:0/207136666 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f73980bb490 msgr2=0x7f73980b57f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:42:14.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.252+0000 7f739d8e0640 1 --2- 172.21.15.12:0/207136666 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f73980bb490 0x7f73980b57f0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f739814f7c0 tx=0x7f738802a140 comp rx=0 tx=0).stop 2024-05-15T16:42:14.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.252+0000 7f739d8e0640 1 -- 172.21.15.12:0/207136666 shutdown_connections 2024-05-15T16:42:14.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.252+0000 7f739d8e0640 1 --2- 172.21.15.12:0/207136666 >> v2:172.21.15.84:3300/0 conn(0x7f739806faa0 0x7f73980a4080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:42:14.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.252+0000 7f739d8e0640 1 --2- 172.21.15.12:0/207136666 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f73980b4500 0x7f73980b9ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:42:14.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.252+0000 7f739d8e0640 1 --2- 172.21.15.12:0/207136666 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f73980bb490 0x7f73980b57f0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:42:14.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.252+0000 7f739d8e0640 1 -- 172.21.15.12:0/207136666 >> 172.21.15.12:0/207136666 conn(0x7f73980a1ac0 msgr2=0x7f73980bbfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T16:42:14.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.252+0000 7f739d8e0640 1 -- 172.21.15.12:0/207136666 shutdown_connections 2024-05-15T16:42:14.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.252+0000 7f739d8e0640 1 -- 172.21.15.12:0/207136666 wait complete. 2024-05-15T16:42:14.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.254+0000 7f739d8e0640 1 Processor -- start 2024-05-15T16:42:14.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.254+0000 7f739d8e0640 1 -- start start 2024-05-15T16:42:14.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.255+0000 7f739d8e0640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f739806faa0 0x7f7398143410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:42:14.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.255+0000 7f739d8e0640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f73980b4500 0x7f73981e7e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:42:14.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.255+0000 7f739d8e0640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f73980bb490 0x7f739809ff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:42:14.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.255+0000 7f739d8e0640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f739806feb0 con 0x7f73980b4500 2024-05-15T16:42:14.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.255+0000 7f739d8e0640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f73980a4a50 con 0x7f739806faa0 2024-05-15T16:42:14.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.255+0000 7f739d8e0640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f7398070030 con 0x7f73980bb490 2024-05-15T16:42:14.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.255+0000 7f738ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f73980b4500 0x7f73981e7e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:42:14.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.255+0000 7f738ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f73980b4500 0x7f73981e7e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53058/0 (socket says 172.21.15.12:53058) 2024-05-15T16:42:14.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.255+0000 7f738ffff640 1 -- 172.21.15.12:0/828097870 learned_addr learned my addr 172.21.15.12:0/828097870 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T16:42:14.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.255+0000 7f7396ffd640 1 --2- 172.21.15.12:0/828097870 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f739806faa0 0x7f7398143410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:42:14.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.255+0000 7f73977fe640 1 --2- 172.21.15.12:0/828097870 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f73980bb490 0x7f739809ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:42:14.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.255+0000 7f738ffff640 1 -- 172.21.15.12:0/828097870 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f73980bb490 msgr2=0x7f739809ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:42:14.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.255+0000 7f738ffff640 1 --2- 172.21.15.12:0/828097870 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f73980bb490 0x7f739809ff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:42:14.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.255+0000 7f738ffff640 1 -- 172.21.15.12:0/828097870 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f739806faa0 msgr2=0x7f7398143410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:42:14.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.255+0000 7f738ffff640 1 --2- 172.21.15.12:0/828097870 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f739806faa0 0x7f7398143410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:42:14.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.255+0000 7f738ffff640 1 -- 172.21.15.12:0/828097870 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73980a0470 con 0x7f73980b4500 2024-05-15T16:42:14.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.255+0000 7f7396ffd640 1 --2- 172.21.15.12:0/828097870 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f739806faa0 0x7f7398143410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-15T16:42:14.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.255+0000 7f738ffff640 1 --2- 172.21.15.12:0/828097870 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f73980b4500 0x7f73981e7e10 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f738000c7f0 tx=0x7f738000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T16:42:14.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.256+0000 7f7394ff9640 1 -- 172.21.15.12:0/828097870 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7380015070 con 0x7f73980b4500 2024-05-15T16:42:14.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.256+0000 7f7394ff9640 1 -- 172.21.15.12:0/828097870 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7380007820 con 0x7f73980b4500 2024-05-15T16:42:14.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.256+0000 7f7394ff9640 1 -- 172.21.15.12:0/828097870 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7380007bd0 con 0x7f73980b4500 2024-05-15T16:42:14.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.256+0000 7f739d8e0640 1 -- 172.21.15.12:0/828097870 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f739814b7d0 con 0x7f73980b4500 2024-05-15T16:42:14.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.256+0000 7f739d8e0640 1 -- 172.21.15.12:0/828097870 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f739814ab30 con 0x7f73980b4500 2024-05-15T16:42:14.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.257+0000 7f739d8e0640 1 -- 172.21.15.12:0/828097870 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73980a2690 con 0x7f73980b4500 2024-05-15T16:42:14.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.257+0000 7f7394ff9640 1 -- 172.21.15.12:0/828097870 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7380018070 con 0x7f73980b4500 2024-05-15T16:42:14.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.258+0000 7f7394ff9640 1 --2- 172.21.15.12:0/828097870 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f73780762d0 0x7f73780787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:42:14.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.258+0000 7f7394ff9640 1 -- 172.21.15.12:0/828097870 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4943+0+0 (secure 0 0 0) 0x7f7380097490 con 0x7f73980b4500 2024-05-15T16:42:14.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.258+0000 7f7396ffd640 1 --2- 172.21.15.12:0/828097870 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f73780762d0 0x7f73780787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:42:14.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.259+0000 7f7396ffd640 1 --2- 172.21.15.12:0/828097870 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f73780762d0 0x7f73780787e0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f7388034000 tx=0x7f738802e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T16:42:14.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.263+0000 7f7394ff9640 1 -- 172.21.15.12:0/828097870 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f7380061050 con 0x7f73980b4500 2024-05-15T16:42:14.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.459+0000 7f739d8e0640 1 -- 172.21.15.12:0/828097870 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f73980bce70 con 0x7f73980b4500 2024-05-15T16:42:14.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.462+0000 7f7394ff9640 1 -- 172.21.15.12:0/828097870 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v12)=0 v12) ==== 123+0+0 (secure 0 0 0) 0x7f7380060950 con 0x7f73980b4500 2024-05-15T16:42:14.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.463+0000 7f7394ff9640 1 -- 172.21.15.12:0/828097870 <== mon.0 v2:172.21.15.12:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f7380060460 con 0x7f73980b4500 2024-05-15T16:42:14.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.465+0000 7f739d8e0640 1 -- 172.21.15.12:0/828097870 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f73780762d0 msgr2=0x7f73780787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:42:14.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.465+0000 7f739d8e0640 1 --2- 172.21.15.12:0/828097870 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f73780762d0 0x7f73780787e0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f7388034000 tx=0x7f738802e000 comp rx=0 tx=0).stop 2024-05-15T16:42:14.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.465+0000 7f739d8e0640 1 -- 172.21.15.12:0/828097870 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f73980b4500 msgr2=0x7f73981e7e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:42:14.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.465+0000 7f739d8e0640 1 --2- 172.21.15.12:0/828097870 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f73980b4500 0x7f73981e7e10 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f738000c7f0 tx=0x7f738000ccb0 comp rx=0 tx=0).stop 2024-05-15T16:42:14.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.465+0000 7f739d8e0640 1 -- 172.21.15.12:0/828097870 shutdown_connections 2024-05-15T16:42:14.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.465+0000 7f739d8e0640 1 --2- 172.21.15.12:0/828097870 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f73980bb490 0x7f739809ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:42:14.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.465+0000 7f739d8e0640 1 --2- 172.21.15.12:0/828097870 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f73780762d0 0x7f73780787e0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:42:14.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.465+0000 7f739d8e0640 1 --2- 172.21.15.12:0/828097870 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f73980b4500 0x7f73981e7e10 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:42:14.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.465+0000 7f739d8e0640 1 --2- 172.21.15.12:0/828097870 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f739806faa0 0x7f7398143410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:42:14.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.465+0000 7f739d8e0640 1 -- 172.21.15.12:0/828097870 >> 172.21.15.12:0/828097870 conn(0x7f73980a1ac0 msgr2=0x7f73980b56f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T16:42:14.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.465+0000 7f739d8e0640 1 -- 172.21.15.12:0/828097870 shutdown_connections 2024-05-15T16:42:14.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.465+0000 7f739d8e0640 1 -- 172.21.15.12:0/828097870 wait complete. 2024-05-15T16:42:14.477 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-15T16:42:14.477 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-15T16:42:14.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.587+0000 7f7f6feaf640 1 Processor -- start 2024-05-15T16:42:14.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.587+0000 7f7f6feaf640 1 -- start start 2024-05-15T16:42:14.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.588+0000 7f7f6feaf640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f7f680bf9b0 0x7f7f680bfdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:42:14.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.588+0000 7f7f6feaf640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f680c1390 con 0x7f7f6814e360 2024-05-15T16:42:14.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.588+0000 7f7f6feaf640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f680c0620 con 0x7f7f68148770 2024-05-15T16:42:14.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.588+0000 7f7f6feaf640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f7f68151e40 con 0x7f7f680bf9b0 2024-05-15T16:42:14.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.589+0000 7f7f6dc4b640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f7f6814e360 0x7f7f681522d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:36902/0 (socket says 172.21.15.12:36902) 2024-05-15T16:42:14.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.589+0000 7f7f6dc4b640 1 -- 172.21.15.12:0/3472900627 learned_addr learned my addr 172.21.15.12:0/3472900627 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-05-15T16:42:14.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.589+0000 7f7f6e44c640 1 --2- 172.21.15.12:0/3472900627 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f7f680bf9b0 0x7f7f680bfdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:42:14.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.589+0000 7f7f6cc49640 1 -- 172.21.15.12:0/3472900627 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4049331765 0 0) 0x7f7f60001110 con 0x7f7f6814e360 2024-05-15T16:42:14.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.589+0000 7f7f6cc49640 1 -- 172.21.15.12:0/3472900627 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7f50003520 con 0x7f7f6814e360 2024-05-15T16:42:14.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.589+0000 7f7f6cc49640 1 -- 172.21.15.12:0/3472900627 <== mon.1 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4226612194 0 0) 0x7f7f680c0620 con 0x7f7f68148770 2024-05-15T16:42:14.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.589+0000 7f7f6cc49640 1 -- 172.21.15.12:0/3472900627 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7f60001110 con 0x7f7f68148770 2024-05-15T16:42:14.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.589+0000 7f7f6cc49640 1 -- 172.21.15.12:0/3472900627 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3759905837 0 0) 0x7f7f50003520 con 0x7f7f6814e360 2024-05-15T16:42:14.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.589+0000 7f7f6cc49640 1 -- 172.21.15.12:0/3472900627 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f7f680bf9b0 msgr2=0x7f7f680bfdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T16:42:14.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.589+0000 7f7f6cc49640 1 --2- 172.21.15.12:0/3472900627 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f7f680bf9b0 0x7f7f680bfdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:42:14.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.589+0000 7f7f6cc49640 1 -- 172.21.15.12:0/3472900627 >> v1:172.21.15.84:6789/0 conn(0x7f7f68148770 legacy=0x7f7f680c0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:42:14.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.589+0000 7f7f6cc49640 1 -- 172.21.15.12:0/3472900627 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f68151ad0 con 0x7f7f6814e360 2024-05-15T16:42:14.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.589+0000 7f7f6cc49640 1 -- 172.21.15.12:0/3472900627 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 38171736 0 0) 0x7f7f600018e0 con 0x7f7f6814e360 2024-05-15T16:42:14.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.589+0000 7f7f6cc49640 1 -- 172.21.15.12:0/3472900627 >> v1:172.21.15.12:6789/0 conn(0x7f7f6814e360 legacy=0x7f7f681522d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:42:14.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.589+0000 7f7f6cc49640 1 --2- 172.21.15.12:0/3472900627 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7f50003c10 0x7f7f50004060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:42:14.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.589+0000 7f7f6cc49640 1 --2- 172.21.15.12:0/3472900627 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f50004800 0x7f7f50004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:42:14.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.589+0000 7f7f6cc49640 1 --2- 172.21.15.12:0/3472900627 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f7f680bf9b0 0x7f7f500052c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:42:14.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.589+0000 7f7f6cc49640 1 -- 172.21.15.12:0/3472900627 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f7f68151e40 con 0x7f7f50003c10 2024-05-15T16:42:14.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.589+0000 7f7f6cc49640 1 -- 172.21.15.12:0/3472900627 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f7f5000bbc0 con 0x7f7f50004800 2024-05-15T16:42:14.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.589+0000 7f7f6cc49640 1 -- 172.21.15.12:0/3472900627 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f7f5000bdc0 con 0x7f7f680bf9b0 2024-05-15T16:42:14.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.589+0000 7f7f6dc4b640 1 --2- 172.21.15.12:0/3472900627 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7f50003c10 0x7f7f50004060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:42:14.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.589+0000 7f7f6d44a640 1 --2- 172.21.15.12:0/3472900627 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f50004800 0x7f7f50004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:42:14.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.589+0000 7f7f6e44c640 1 --2- 172.21.15.12:0/3472900627 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f7f680bf9b0 0x7f7f500052c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:42:14.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.590+0000 7f7f6dc4b640 1 -- 172.21.15.12:0/3472900627 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f7f680bf9b0 msgr2=0x7f7f500052c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T16:42:14.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.590+0000 7f7f6dc4b640 1 --2- 172.21.15.12:0/3472900627 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f7f680bf9b0 0x7f7f500052c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:42:14.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.590+0000 7f7f6dc4b640 1 -- 172.21.15.12:0/3472900627 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f50004800 msgr2=0x7f7f50004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T16:42:14.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.590+0000 7f7f6dc4b640 1 --2- 172.21.15.12:0/3472900627 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f50004800 0x7f7f50004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:42:14.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.590+0000 7f7f6dc4b640 1 -- 172.21.15.12:0/3472900627 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f50003520 con 0x7f7f50003c10 2024-05-15T16:42:14.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.590+0000 7f7f6dc4b640 1 --2- 172.21.15.12:0/3472900627 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7f50003c10 0x7f7f50004060 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f7f6000c490 tx=0x7f7f50005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f4ba0bf9f20d462 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T16:42:14.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.590+0000 7f7f6cc49640 1 -- 172.21.15.12:0/3472900627 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f60036070 con 0x7f7f50003c10 2024-05-15T16:42:14.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.590+0000 7f7f6cc49640 1 -- 172.21.15.12:0/3472900627 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f7f60005ad0 con 0x7f7f50003c10 2024-05-15T16:42:14.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.590+0000 7f7f6cc49640 1 -- 172.21.15.12:0/3472900627 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f6000c0e0 con 0x7f7f50003c10 2024-05-15T16:42:14.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.591+0000 7f7f6feaf640 1 -- 172.21.15.12:0/3472900627 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7f50003c10 msgr2=0x7f7f50004060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:42:14.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.591+0000 7f7f6feaf640 1 --2- 172.21.15.12:0/3472900627 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7f50003c10 0x7f7f50004060 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f7f6000c490 tx=0x7f7f50005830 comp rx=0 tx=0).stop 2024-05-15T16:42:14.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.591+0000 7f7f6e44c640 1 -- 172.21.15.12:0/3472900627 reap_dead start 2024-05-15T16:42:14.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.591+0000 7f7f6feaf640 1 -- 172.21.15.12:0/3472900627 shutdown_connections 2024-05-15T16:42:14.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.591+0000 7f7f6feaf640 1 -- 172.21.15.12:0/3472900627 >> 172.21.15.12:0/3472900627 conn(0x7f7f680c17c0 msgr2=0x7f7f680c1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T16:42:14.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.591+0000 7f7f6feaf640 1 -- 172.21.15.12:0/3472900627 shutdown_connections 2024-05-15T16:42:14.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.591+0000 7f7f6feaf640 1 -- 172.21.15.12:0/3472900627 wait complete. 2024-05-15T16:42:14.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.593+0000 7f7f6feaf640 1 Processor -- start 2024-05-15T16:42:14.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.593+0000 7f7f6feaf640 1 -- start start 2024-05-15T16:42:14.600 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.594+0000 7f7f6feaf640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f50003c10 0x7f7f68071ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:42:14.600 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.594+0000 7f7f6feaf640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7f681e8240 0x7f7f681d7b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:42:14.600 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.594+0000 7f7f6feaf640 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f7f680b7c70 0x7f7f680b8080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:42:14.600 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.594+0000 7f7f6feaf640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f7f680c0190 con 0x7f7f681e8240 2024-05-15T16:42:14.600 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.594+0000 7f7f6feaf640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f7f680c0010 con 0x7f7f50003c10 2024-05-15T16:42:14.600 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.594+0000 7f7f6feaf640 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 -- 0x7f7f680c0310 con 0x7f7f680b7c70 2024-05-15T16:42:14.600 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.594+0000 7f7f6d44a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7f681e8240 0x7f7f681d7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:42:14.600 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.594+0000 7f7f6d44a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7f681e8240 0x7f7f681d7b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53068/0 (socket says 172.21.15.12:53068) 2024-05-15T16:42:14.601 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.594+0000 7f7f6d44a640 1 -- 172.21.15.12:0/366844615 learned_addr learned my addr 172.21.15.12:0/366844615 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-05-15T16:42:14.601 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.594+0000 7f7f6dc4b640 1 --2- 172.21.15.12:0/366844615 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f50003c10 0x7f7f68071ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:42:14.601 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.594+0000 7f7f6e44c640 1 --2- 172.21.15.12:0/366844615 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f7f680b7c70 0x7f7f680b8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:42:14.601 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.594+0000 7f7f6d44a640 1 -- 172.21.15.12:0/366844615 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f7f680b7c70 msgr2=0x7f7f680b8080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:42:14.601 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.594+0000 7f7f6d44a640 1 --2- 172.21.15.12:0/366844615 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f7f680b7c70 0x7f7f680b8080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:42:14.601 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.594+0000 7f7f6d44a640 1 -- 172.21.15.12:0/366844615 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f50003c10 msgr2=0x7f7f68071ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:42:14.601 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.594+0000 7f7f6d44a640 1 --2- 172.21.15.12:0/366844615 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f50003c10 0x7f7f68071ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:42:14.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.594+0000 7f7f6d44a640 1 -- 172.21.15.12:0/366844615 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f68072220 con 0x7f7f681e8240 2024-05-15T16:42:14.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.594+0000 7f7f6dc4b640 1 --2- 172.21.15.12:0/366844615 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f50003c10 0x7f7f68071ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-15T16:42:14.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.594+0000 7f7f6e44c640 1 --2- 172.21.15.12:0/366844615 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f7f680b7c70 0x7f7f680b8080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-15T16:42:14.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.594+0000 7f7f6d44a640 1 --2- 172.21.15.12:0/366844615 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7f681e8240 0x7f7f681d7b70 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c00f820 tx=0x7f7f5c00fce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T16:42:14.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.595+0000 7f7f667fc640 1 -- 172.21.15.12:0/366844615 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f5c0052e0 con 0x7f7f681e8240 2024-05-15T16:42:14.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.595+0000 7f7f667fc640 1 -- 172.21.15.12:0/366844615 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f7f5c018070 con 0x7f7f681e8240 2024-05-15T16:42:14.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.595+0000 7f7f6feaf640 1 -- 172.21.15.12:0/366844615 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f681e8770 con 0x7f7f681e8240 2024-05-15T16:42:14.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.595+0000 7f7f667fc640 1 -- 172.21.15.12:0/366844615 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f5c00d930 con 0x7f7f681e8240 2024-05-15T16:42:14.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.595+0000 7f7f6feaf640 1 -- 172.21.15.12:0/366844615 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f681d91f0 con 0x7f7f681e8240 2024-05-15T16:42:14.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.596+0000 7f7f6feaf640 1 -- 172.21.15.12:0/366844615 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f681e8c90 con 0x7f7f681e8240 2024-05-15T16:42:14.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.596+0000 7f7f667fc640 1 -- 172.21.15.12:0/366844615 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7f5c00dad0 con 0x7f7f681e8240 2024-05-15T16:42:14.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.597+0000 7f7f667fc640 1 --2- 172.21.15.12:0/366844615 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f7f540762d0 0x7f7f540787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T16:42:14.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.597+0000 7f7f667fc640 1 -- 172.21.15.12:0/366844615 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4943+0+0 (secure 0 0 0) 0x7f7f5c097310 con 0x7f7f681e8240 2024-05-15T16:42:14.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.597+0000 7f7f6dc4b640 1 --2- 172.21.15.12:0/366844615 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f7f540762d0 0x7f7f540787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T16:42:14.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.598+0000 7f7f6dc4b640 1 --2- 172.21.15.12:0/366844615 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f7f540762d0 0x7f7f540787e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f7f60033000 tx=0x7f7f60009030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T16:42:14.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.602+0000 7f7f667fc640 1 -- 172.21.15.12:0/366844615 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f7f5c060e40 con 0x7f7f681e8240 2024-05-15T16:42:14.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.828+0000 7f7f6feaf640 1 -- 172.21.15.12:0/366844615 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7f6814d5f0 con 0x7f7f681e8240 2024-05-15T16:42:14.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.829+0000 7f7f667fc640 1 -- 172.21.15.12:0/366844615 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+3041 (secure 0 0 0) 0x7f7f5c060740 con 0x7f7f681e8240 2024-05-15T16:42:14.830 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-05-15T16:42:14.830 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":18,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4577,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/1749847216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1749847216},{"type":"v1","addr":"172.21.15.84:6835","nonce":1749847216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4580,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/3678098513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6833","nonce":3678098513},{"type":"v1","addr":"172.21.15.12:6835","nonce":3678098513}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":5058,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6834/128675380","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":128675380},{"type":"v1","addr":"172.21.15.12:6834","nonce":128675380}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18}],"filesystems":[]} 2024-05-15T16:42:14.830 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 18 2024-05-15T16:42:14.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.831+0000 7f7f6feaf640 1 -- 172.21.15.12:0/366844615 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f7f540762d0 msgr2=0x7f7f540787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:42:14.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.831+0000 7f7f6feaf640 1 --2- 172.21.15.12:0/366844615 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f7f540762d0 0x7f7f540787e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f7f60033000 tx=0x7f7f60009030 comp rx=0 tx=0).stop 2024-05-15T16:42:14.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.831+0000 7f7f6feaf640 1 -- 172.21.15.12:0/366844615 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7f681e8240 msgr2=0x7f7f681d7b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T16:42:14.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.831+0000 7f7f6feaf640 1 --2- 172.21.15.12:0/366844615 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7f681e8240 0x7f7f681d7b70 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c00f820 tx=0x7f7f5c00fce0 comp rx=0 tx=0).stop 2024-05-15T16:42:14.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.831+0000 7f7f6feaf640 1 -- 172.21.15.12:0/366844615 shutdown_connections 2024-05-15T16:42:14.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.831+0000 7f7f6feaf640 1 --2- 172.21.15.12:0/366844615 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f7f680b7c70 0x7f7f680b8080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:42:14.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.831+0000 7f7f6feaf640 1 --2- 172.21.15.12:0/366844615 >> [v2:172.21.15.84:6832/4173299311,v1:172.21.15.84:6833/4173299311] conn(0x7f7f540762d0 0x7f7f540787e0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:42:14.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.831+0000 7f7f6feaf640 1 --2- 172.21.15.12:0/366844615 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7f681e8240 0x7f7f681d7b70 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:42:14.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.831+0000 7f7f6feaf640 1 --2- 172.21.15.12:0/366844615 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f50003c10 0x7f7f68071ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T16:42:14.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.831+0000 7f7f6feaf640 1 -- 172.21.15.12:0/366844615 >> 172.21.15.12:0/366844615 conn(0x7f7f680c17c0 msgr2=0x7f7f680c1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T16:42:14.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.831+0000 7f7f6feaf640 1 -- 172.21.15.12:0/366844615 shutdown_connections 2024-05-15T16:42:14.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-05-15T16:42:14.831+0000 7f7f6feaf640 1 -- 172.21.15.12:0/366844615 wait complete. 2024-05-15T16:42:14.843 DEBUG:tasks.cephfs.filesystem:already dead... 2024-05-15T16:42:14.843 INFO:teuthology.misc:Shutting down mds daemons... 2024-05-15T16:42:14.843 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-15T16:42:14.843 INFO:teuthology.orchestra.run:waiting for 300 2024-05-15T16:42:14.853 INFO:tasks.ceph.mds.a:Stopped 2024-05-15T16:42:14.853 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-05-15T16:42:14.853 INFO:teuthology.orchestra.run:waiting for 300 2024-05-15T16:42:14.905 INFO:tasks.ceph.mds.c:Stopped 2024-05-15T16:42:14.905 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-15T16:42:14.906 INFO:teuthology.orchestra.run:waiting for 300 2024-05-15T16:42:14.918 INFO:tasks.ceph.mds.b:Stopped 2024-05-15T16:42:14.918 INFO:teuthology.misc:Shutting down osd daemons... 2024-05-15T16:42:14.918 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-05-15T16:42:14.918 INFO:teuthology.orchestra.run:waiting for 300 2024-05-15T16:42:14.990 INFO:tasks.ceph.osd.0:Stopped 2024-05-15T16:42:14.990 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-05-15T16:42:14.990 INFO:teuthology.orchestra.run:waiting for 300 2024-05-15T16:42:15.040 INFO:tasks.ceph.osd.1:Stopped 2024-05-15T16:42:15.041 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-05-15T16:42:15.041 INFO:teuthology.orchestra.run:waiting for 300 2024-05-15T16:42:15.083 INFO:tasks.ceph.osd.2:Stopped 2024-05-15T16:42:15.084 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-05-15T16:42:15.084 INFO:teuthology.orchestra.run:waiting for 300 2024-05-15T16:42:15.127 INFO:tasks.ceph.osd.3:Stopped 2024-05-15T16:42:15.128 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-05-15T16:42:15.128 INFO:teuthology.orchestra.run:waiting for 300 2024-05-15T16:42:15.170 INFO:tasks.ceph.osd.4:Stopped 2024-05-15T16:42:15.170 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-05-15T16:42:15.171 INFO:teuthology.orchestra.run:waiting for 300 2024-05-15T16:42:15.211 INFO:tasks.ceph.osd.5:Stopped 2024-05-15T16:42:15.211 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-05-15T16:42:15.211 INFO:teuthology.orchestra.run:waiting for 300 2024-05-15T16:42:15.293 INFO:tasks.ceph.osd.6:Stopped 2024-05-15T16:42:15.293 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-05-15T16:42:15.293 INFO:teuthology.orchestra.run:waiting for 300 2024-05-15T16:42:15.339 INFO:tasks.ceph.osd.7:Stopped 2024-05-15T16:42:15.339 INFO:teuthology.misc:Shutting down mgr daemons... 2024-05-15T16:42:15.339 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-05-15T16:42:15.339 INFO:teuthology.orchestra.run:waiting for 300 2024-05-15T16:42:15.364 INFO:tasks.ceph.mgr.y:Stopped 2024-05-15T16:42:15.365 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-05-15T16:42:15.365 INFO:teuthology.orchestra.run:waiting for 300 2024-05-15T16:42:15.394 INFO:tasks.ceph.mgr.x:Stopped 2024-05-15T16:42:15.394 INFO:teuthology.misc:Shutting down mon daemons... 2024-05-15T16:42:15.394 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-05-15T16:42:15.394 INFO:teuthology.orchestra.run:waiting for 300 2024-05-15T16:42:15.418 INFO:tasks.ceph.mon.a:Stopped 2024-05-15T16:42:15.418 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-05-15T16:42:15.418 INFO:teuthology.orchestra.run:waiting for 300 2024-05-15T16:42:15.447 INFO:tasks.ceph.mon.b:Stopped 2024-05-15T16:42:15.447 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-05-15T16:42:15.447 INFO:teuthology.orchestra.run:waiting for 300 2024-05-15T16:42:15.500 INFO:tasks.ceph.mon.c:Stopped 2024-05-15T16:42:15.500 INFO:tasks.ceph:Checking cluster log for badness... 2024-05-15T16:42:15.501 DEBUG:teuthology.orchestra.run.smithi012:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-05-15T16:42:15.531 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi012.front.sepia.ceph.com 2024-05-15T16:42:15.531 DEBUG:teuthology.orchestra.run.smithi012:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-05-15T16:42:15.782 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi012.front.sepia.ceph.com 2024-05-15T16:42:15.782 DEBUG:teuthology.orchestra.run.smithi012:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-05-15T16:42:15.882 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi012.front.sepia.ceph.com 2024-05-15T16:42:15.882 DEBUG:teuthology.orchestra.run.smithi012:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-05-15T16:42:15.940 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi012.front.sepia.ceph.com 2024-05-15T16:42:15.940 DEBUG:teuthology.orchestra.run.smithi012:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-05-15T16:42:16.005 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi084.front.sepia.ceph.com 2024-05-15T16:42:16.005 DEBUG:teuthology.orchestra.run.smithi084:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-05-15T16:42:16.160 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi084.front.sepia.ceph.com 2024-05-15T16:42:16.160 DEBUG:teuthology.orchestra.run.smithi084:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-05-15T16:42:16.273 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi084.front.sepia.ceph.com 2024-05-15T16:42:16.274 DEBUG:teuthology.orchestra.run.smithi084:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-05-15T16:42:16.335 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi084.front.sepia.ceph.com 2024-05-15T16:42:16.335 DEBUG:teuthology.orchestra.run.smithi084:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-05-15T16:42:16.393 INFO:tasks.ceph:Archiving mon data... 2024-05-15T16:42:16.394 DEBUG:teuthology.misc:Transferring archived files from smithi012:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/pdonnell-2024-05-15_15:16:14-fs:fscrypt-wip-pdonnell-testing-20240515.023933-debug-distro-default-smithi/7707268/data/mon.a.tgz 2024-05-15T16:42:16.395 DEBUG:teuthology.orchestra.run.smithi012:> mktemp 2024-05-15T16:42:16.410 INFO:teuthology.orchestra.run.smithi012.stdout:/tmp/tmp.dGX8a7j3tA 2024-05-15T16:42:16.411 DEBUG:teuthology.orchestra.run.smithi012:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.dGX8a7j3tA 2024-05-15T16:42:16.532 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 0666 /tmp/tmp.dGX8a7j3tA 2024-05-15T16:42:16.615 DEBUG:teuthology.orchestra.remote:smithi012:/tmp/tmp.dGX8a7j3tA is 232KB 2024-05-15T16:42:16.709 DEBUG:teuthology.orchestra.run.smithi012:> rm -fr /tmp/tmp.dGX8a7j3tA 2024-05-15T16:42:16.725 DEBUG:teuthology.misc:Transferring archived files from smithi084:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/pdonnell-2024-05-15_15:16:14-fs:fscrypt-wip-pdonnell-testing-20240515.023933-debug-distro-default-smithi/7707268/data/mon.b.tgz 2024-05-15T16:42:16.725 DEBUG:teuthology.orchestra.run.smithi084:> mktemp 2024-05-15T16:42:16.741 INFO:teuthology.orchestra.run.smithi084.stdout:/tmp/tmp.BRRQvtcLXb 2024-05-15T16:42:16.741 DEBUG:teuthology.orchestra.run.smithi084:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.BRRQvtcLXb 2024-05-15T16:42:16.860 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 0666 /tmp/tmp.BRRQvtcLXb 2024-05-15T16:42:16.942 DEBUG:teuthology.orchestra.remote:smithi084:/tmp/tmp.BRRQvtcLXb is 237KB 2024-05-15T16:42:17.036 DEBUG:teuthology.orchestra.run.smithi084:> rm -fr /tmp/tmp.BRRQvtcLXb 2024-05-15T16:42:17.050 DEBUG:teuthology.misc:Transferring archived files from smithi084:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/pdonnell-2024-05-15_15:16:14-fs:fscrypt-wip-pdonnell-testing-20240515.023933-debug-distro-default-smithi/7707268/data/mon.c.tgz 2024-05-15T16:42:17.050 DEBUG:teuthology.orchestra.run.smithi084:> mktemp 2024-05-15T16:42:17.104 INFO:teuthology.orchestra.run.smithi084.stdout:/tmp/tmp.AsROThRPw5 2024-05-15T16:42:17.104 DEBUG:teuthology.orchestra.run.smithi084:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.AsROThRPw5 2024-05-15T16:42:17.208 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 0666 /tmp/tmp.AsROThRPw5 2024-05-15T16:42:17.288 DEBUG:teuthology.orchestra.remote:smithi084:/tmp/tmp.AsROThRPw5 is 237KB 2024-05-15T16:42:17.382 DEBUG:teuthology.orchestra.run.smithi084:> rm -fr /tmp/tmp.AsROThRPw5 2024-05-15T16:42:17.397 INFO:tasks.ceph:Cleaning ceph cluster... 2024-05-15T16:42:17.397 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-15T16:42:17.400 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-15T16:42:17.438 DEBUG:teuthology.orchestra.run.smithi104:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-15T16:42:17.537 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-05-15T16:42:17.552 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-05-15T16:42:17.608 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-05-15T16:42:17.608 INFO:tasks.ceph:Archiving crash dumps... 2024-05-15T16:42:17.610 DEBUG:teuthology.misc:Transferring archived files from smithi012:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-05-15_15:16:14-fs:fscrypt-wip-pdonnell-testing-20240515.023933-debug-distro-default-smithi/7707268/remote/smithi012/crash 2024-05-15T16:42:17.611 DEBUG:teuthology.orchestra.run.smithi012:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-15T16:42:17.639 DEBUG:teuthology.misc:Transferring archived files from smithi084:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-05-15_15:16:14-fs:fscrypt-wip-pdonnell-testing-20240515.023933-debug-distro-default-smithi/7707268/remote/smithi084/crash 2024-05-15T16:42:17.640 DEBUG:teuthology.orchestra.run.smithi084:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-15T16:42:17.664 DEBUG:teuthology.misc:Transferring archived files from smithi104:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-05-15_15:16:14-fs:fscrypt-wip-pdonnell-testing-20240515.023933-debug-distro-default-smithi/7707268/remote/smithi104/crash 2024-05-15T16:42:17.664 DEBUG:teuthology.orchestra.run.smithi104:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-15T16:42:17.749 INFO:tasks.ceph:Shutting down logrotate 2024-05-15T16:42:17.749 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:42:17.752 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:42:17.755 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:42:17.865 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-05-15T16:42:17.893 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-05-15T16:42:17.916 DEBUG:teuthology.orchestra.run.smithi104:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-05-15T16:42:18.004 INFO:tasks.ceph:Compressing logs... 2024-05-15T16:42:18.004 DEBUG:teuthology.orchestra.run.smithi012:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-15T16:42:18.007 DEBUG:teuthology.orchestra.run.smithi084:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-15T16:42:18.010 DEBUG:teuthology.orchestra.run.smithi104:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-15T16:42:18.030 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37479.log 2024-05-15T16:42:18.030 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-05-15T16:42:18.030 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.37479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37519.log 2024-05-15T16:42:18.033 INFO:teuthology.orchestra.run.smithi084.stderr: 88.2%/var/log/ceph/ceph.log: -- replaced with /var/log/ceph/ceph-client.admin.37479.log.gz 2024-05-15T16:42:18.033 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-05-15T16:42:18.034 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-05-15T16:42:18.034 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-05-15T16:42:18.034 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.37519.log: /var/log/ceph/ceph.audit.log: /var/log/ceph/ceph-osd.7.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37519.log.gz 2024-05-15T16:42:18.034 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-05-15T16:42:18.034 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-05-15T16:42:18.034 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-mds.b.log: /var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37690.log 2024-05-15T16:42:18.034 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-05-15T16:42:18.034 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.37690.log: 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-05-15T16:42:18.035 INFO:teuthology.orchestra.run.smithi084.stderr: 2024-05-15T16:42:18.035 INFO:teuthology.orchestra.run.smithi084.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37690.log.gz 2024-05-15T16:42:18.042 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-mgr.x.log: 95.0% -- replaced with /var/log/ceph/ceph.log.gz 2024-05-15T16:42:18.060 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-05-15T16:42:18.060 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37569.log 2024-05-15T16:42:18.060 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37730.log 2024-05-15T16:42:18.060 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.37569.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.37569.log.gz 2024-05-15T16:42:18.061 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37439.log 2024-05-15T16:42:18.061 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.37730.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.37730.log.gz 2024-05-15T16:42:18.061 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37610.log 2024-05-15T16:42:18.061 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.37439.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37439.log.gz 2024-05-15T16:42:18.061 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37650.log 2024-05-15T16:42:18.061 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.37610.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37610.log.gz 2024-05-15T16:42:18.061 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-05-15T16:42:18.061 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.37650.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37650.log.gz 2024-05-15T16:42:18.083 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-mon.b.log: 94.6% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-05-15T16:42:18.090 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51235.log 2024-05-15T16:42:18.090 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44913.log 2024-05-15T16:42:18.090 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44077.log 2024-05-15T16:42:18.090 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.51235.log: /var/log/ceph/ceph-client.admin.44913.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51235.log.gz 2024-05-15T16:42:18.090 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46664.log 2024-05-15T16:42:18.091 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.44077.log: gzip -5 88.8% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.44913.log.gz /var/log/ceph/ceph-client.admin.45631.log 2024-05-15T16:42:18.091 INFO:teuthology.orchestra.run.smithi012.stderr: 2024-05-15T16:42:18.091 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.46664.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44077.log.gz 2024-05-15T16:42:18.091 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43614.log 2024-05-15T16:42:18.091 INFO:teuthology.orchestra.run.smithi012.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.46664.log.gz 2024-05-15T16:42:18.091 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.45631.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45757.log 2024-05-15T16:42:18.091 INFO:teuthology.orchestra.run.smithi012.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45631.log.gz 2024-05-15T16:42:18.091 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.43614.log: -- /var/log/ceph/ceph-client.admin.45013.log 2024-05-15T16:42:18.091 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.45757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46917.log 2024-05-15T16:42:18.092 INFO:teuthology.orchestra.run.smithi012.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43614.log.gz 2024-05-15T16:42:18.092 INFO:teuthology.orchestra.run.smithi012.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.45757.log.gz 2024-05-15T16:42:18.092 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.45013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47262.log 2024-05-15T16:42:18.092 INFO:teuthology.orchestra.run.smithi012.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45013.log.gz 2024-05-15T16:42:18.092 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.46917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45011.log 2024-05-15T16:42:18.092 INFO:teuthology.orchestra.run.smithi012.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.46917.log.gz/var/log/ceph/ceph-client.admin.47262.log: 2024-05-15T16:42:18.092 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47569.log 2024-05-15T16:42:18.092 INFO:teuthology.orchestra.run.smithi012.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47262.log.gz 2024-05-15T16:42:18.093 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.45011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48512.log 2024-05-15T16:42:18.093 INFO:teuthology.orchestra.run.smithi012.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45011.log.gz 2024-05-15T16:42:18.093 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.47569.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44343.log 2024-05-15T16:42:18.093 INFO:teuthology.orchestra.run.smithi012.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47569.log.gz 2024-05-15T16:42:18.093 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50983.log 2024-05-15T16:42:18.093 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.48512.log: /var/log/ceph/ceph-client.admin.44343.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43572.log 2024-05-15T16:42:18.093 INFO:teuthology.orchestra.run.smithi012.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48512.log.gz 2024-05-15T16:42:18.093 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.50983.log: gzip 88.4% -5 -- replaced with /var/log/ceph/ceph-client.admin.44343.log.gz --verbose 2024-05-15T16:42:18.094 INFO:teuthology.orchestra.run.smithi012.stderr: -- /var/log/ceph/ceph-client.admin.51839.log 2024-05-15T16:42:18.094 INFO:teuthology.orchestra.run.smithi012.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50983.log.gz 2024-05-15T16:42:18.094 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.43572.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-05-15T16:42:18.094 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.51839.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43572.log.gz 2024-05-15T16:42:18.094 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43512.log 2024-05-15T16:42:18.094 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.51839.log.gz 2024-05-15T16:42:18.094 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46478.log 2024-05-15T16:42:18.095 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.43512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44668.log 2024-05-15T16:42:18.095 INFO:teuthology.orchestra.run.smithi012.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43512.log.gz 2024-05-15T16:42:18.095 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.46478.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48554.log 2024-05-15T16:42:18.095 INFO:teuthology.orchestra.run.smithi012.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46478.log.gz 2024-05-15T16:42:18.095 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.44668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45673.log 2024-05-15T16:42:18.095 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.48554.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44914.log 2024-05-15T16:42:18.095 INFO:teuthology.orchestra.run.smithi012.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44668.log.gz 2024-05-15T16:42:18.095 INFO:teuthology.orchestra.run.smithi012.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48554.log.gz 2024-05-15T16:42:18.096 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.45673.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-05-15T16:42:18.096 INFO:teuthology.orchestra.run.smithi012.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45673.log.gz 2024-05-15T16:42:18.096 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48470.log 2024-05-15T16:42:18.096 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.44914.log: /var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51151.log 2024-05-15T16:42:18.096 INFO:teuthology.orchestra.run.smithi012.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44914.log.gz 2024-05-15T16:42:18.096 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.48470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47218.log 2024-05-15T16:42:18.096 INFO:teuthology.orchestra.run.smithi012.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48470.log.gz 2024-05-15T16:42:18.096 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.51151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45211.log 2024-05-15T16:42:18.096 INFO:teuthology.orchestra.run.smithi012.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.51151.log.gz 2024-05-15T16:42:18.097 INFO:teuthology.orchestra.run.smithi012.stderr:gzip/var/log/ceph/ceph-client.admin.47218.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.47971.log 2024-05-15T16:42:18.097 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.45211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46310.log 2024-05-15T16:42:18.097 INFO:teuthology.orchestra.run.smithi012.stderr: 90.7% -- replaced with /var/log/ceph/ceph.log.gz 2024-05-15T16:42:18.097 INFO:teuthology.orchestra.run.smithi012.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47218.log.gz 2024-05-15T16:42:18.097 INFO:teuthology.orchestra.run.smithi012.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45211.log.gz 2024-05-15T16:42:18.097 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.47971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44336.log 2024-05-15T16:42:18.097 INFO:teuthology.orchestra.run.smithi012.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47971.log.gz 2024-05-15T16:42:18.097 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.46310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45331.log 2024-05-15T16:42:18.098 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.44336.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46310.log.gz 2024-05-15T16:42:18.098 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43866.log 2024-05-15T16:42:18.098 INFO:teuthology.orchestra.run.smithi012.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44336.log.gz 2024-05-15T16:42:18.098 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.45331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47779.log 2024-05-15T16:42:18.098 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.43866.log: 88.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.45331.log.gz 2024-05-15T16:42:18.098 INFO:teuthology.orchestra.run.smithi012.stderr: -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-05-15T16:42:18.098 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.47779.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43866.log.gz 2024-05-15T16:42:18.099 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46520.log 2024-05-15T16:42:18.099 INFO:teuthology.orchestra.run.smithi012.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47779.log.gz 2024-05-15T16:42:18.099 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45370.log 2024-05-15T16:42:18.099 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.46520.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44676.log 2024-05-15T16:42:18.099 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.45370.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46520.log.gz 2024-05-15T16:42:18.099 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45328.log 2024-05-15T16:42:18.099 INFO:teuthology.orchestra.run.smithi012.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45370.log.gz 2024-05-15T16:42:18.099 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48283.log 2024-05-15T16:42:18.099 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.44676.log: 89.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-05-15T16:42:18.100 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.45328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43424.log 2024-05-15T16:42:18.100 INFO:teuthology.orchestra.run.smithi012.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44676.log.gz 2024-05-15T16:42:18.100 INFO:teuthology.orchestra.run.smithi012.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45328.log.gz 2024-05-15T16:42:18.100 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.48283.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44340.log 2024-05-15T16:42:18.100 INFO:teuthology.orchestra.run.smithi012.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48283.log.gz 2024-05-15T16:42:18.100 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.43424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45991.log 2024-05-15T16:42:18.100 INFO:teuthology.orchestra.run.smithi012.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43424.log.gz 2024-05-15T16:42:18.100 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46562.log 2024-05-15T16:42:18.101 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.44340.log: /var/log/ceph/ceph-client.admin.45991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46867.log 2024-05-15T16:42:18.101 INFO:teuthology.orchestra.run.smithi012.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44340.log.gz 2024-05-15T16:42:18.101 INFO:teuthology.orchestra.run.smithi012.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45991.log.gz 2024-05-15T16:42:18.101 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.46562.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43468.log 2024-05-15T16:42:18.101 INFO:teuthology.orchestra.run.smithi012.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46562.log.gz 2024-05-15T16:42:18.101 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.46867.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-05-15T16:42:18.101 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.43468.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46867.log.gz 2024-05-15T16:42:18.101 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50857.log 2024-05-15T16:42:18.102 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-osd.3.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43468.log.gz 2024-05-15T16:42:18.102 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47397.log 2024-05-15T16:42:18.102 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.50857.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43340.log 2024-05-15T16:42:18.102 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.47397.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.50857.log.gz 2024-05-15T16:42:18.102 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51361.log 2024-05-15T16:42:18.102 INFO:teuthology.orchestra.run.smithi012.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47397.log.gz 2024-05-15T16:42:18.102 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46159.log 2024-05-15T16:42:18.103 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.43340.log: /var/log/ceph/ceph-client.admin.51361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43656.log 2024-05-15T16:42:18.103 INFO:teuthology.orchestra.run.smithi012.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43340.log.gz 2024-05-15T16:42:18.103 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.46159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50899.log 2024-05-15T16:42:18.103 INFO:teuthology.orchestra.run.smithi012.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51361.log.gz 2024-05-15T16:42:18.103 INFO:teuthology.orchestra.run.smithi012.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46159.log.gz 2024-05-15T16:42:18.103 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.43656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46436.log 2024-05-15T16:42:18.103 INFO:teuthology.orchestra.run.smithi012.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43656.log.gz 2024-05-15T16:42:18.103 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.50899.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51529.log 2024-05-15T16:42:18.103 INFO:teuthology.orchestra.run.smithi012.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50899.log.gz 2024-05-15T16:42:18.104 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43258.log 2024-05-15T16:42:18.105 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.46436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44119.log 2024-05-15T16:42:18.106 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.51529.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46436.log.gz 2024-05-15T16:42:18.106 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.43258.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-05-15T16:42:18.106 INFO:teuthology.orchestra.run.smithi012.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51529.log.gz 2024-05-15T16:42:18.106 INFO:teuthology.orchestra.run.smithi012.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.43258.log.gz 2024-05-15T16:42:18.106 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.44119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45250.log 2024-05-15T16:42:18.106 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47527.log 2024-05-15T16:42:18.106 INFO:teuthology.orchestra.run.smithi012.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44119.log.gz 2024-05-15T16:42:18.106 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.45250.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51655.log 2024-05-15T16:42:18.107 INFO:teuthology.orchestra.run.smithi012.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45250.log.gz 2024-05-15T16:42:18.107 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.47527.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47821.log 2024-05-15T16:42:18.107 INFO:teuthology.orchestra.run.smithi012.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47527.log.gz 2024-05-15T16:42:18.107 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.51655.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-05-15T16:42:18.107 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47090.log 2024-05-15T16:42:18.107 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.47821.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.51655.log.gz 2024-05-15T16:42:18.107 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-05-15T16:42:18.107 INFO:teuthology.orchestra.run.smithi012.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47821.log.gz 2024-05-15T16:42:18.108 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.47090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46352.log 2024-05-15T16:42:18.108 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-mgr.y.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47090.log.gz 2024-05-15T16:42:18.108 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45589.log 2024-05-15T16:42:18.108 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.46352.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45949.log 2024-05-15T16:42:18.108 INFO:teuthology.orchestra.run.smithi012.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46352.log.gz 2024-05-15T16:42:18.108 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.45589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43992.log 2024-05-15T16:42:18.108 INFO:teuthology.orchestra.run.smithi012.stderr: 87.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51571.log 2024-05-15T16:42:18.108 INFO:teuthology.orchestra.run.smithi012.stderr: -- replaced with /var/log/ceph/ceph-client.admin.45589.log.gz 2024-05-15T16:42:18.109 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.45949.log: /var/log/ceph/ceph-client.admin.43992.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45949.log.gz 2024-05-15T16:42:18.109 INFO:teuthology.orchestra.run.smithi012.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43992.log.gz 2024-05-15T16:42:18.109 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-05-15T16:42:18.109 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.51571.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47485.log 2024-05-15T16:42:18.109 INFO:teuthology.orchestra.run.smithi012.stderr: 88.4%/var/log/ceph/ceph-osd.0.log: -- replaced with /var/log/ceph/ceph-client.admin.51571.log.gz 2024-05-15T16:42:18.109 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44161.log 2024-05-15T16:42:18.109 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.47485.log: -- /var/log/ceph/ceph-client.admin.38001.log 2024-05-15T16:42:18.109 INFO:teuthology.orchestra.run.smithi012.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47485.log.gz 2024-05-15T16:42:18.110 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.44161.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47737.log 2024-05-15T16:42:18.110 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.38001.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44161.log.gz 2024-05-15T16:42:18.110 INFO:teuthology.orchestra.run.smithi012.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.38001.log.gz 2024-05-15T16:42:18.110 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51193.log 2024-05-15T16:42:18.110 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48409.log 2024-05-15T16:42:18.110 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.51193.log: /var/log/ceph/ceph-client.admin.47737.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47737.log.gz 2024-05-15T16:42:18.110 INFO:teuthology.orchestra.run.smithi012.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.51193.log.gz 2024-05-15T16:42:18.110 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44669.log 2024-05-15T16:42:18.111 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.48409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46075.log 2024-05-15T16:42:18.111 INFO:teuthology.orchestra.run.smithi012.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.48409.log.gz 2024-05-15T16:42:18.111 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.44669.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47355.log 2024-05-15T16:42:18.111 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.46075.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44669.log.gz 2024-05-15T16:42:18.111 INFO:teuthology.orchestra.run.smithi012.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46075.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47006.log 2024-05-15T16:42:18.111 INFO:teuthology.orchestra.run.smithi012.stderr: 2024-05-15T16:42:18.111 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.47355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47905.log 2024-05-15T16:42:18.111 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.47006.log: 89.4% 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47355.log.gz 2024-05-15T16:42:18.112 INFO:teuthology.orchestra.run.smithi012.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47006.log.gz 2024-05-15T16:42:18.112 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45547.log 2024-05-15T16:42:18.112 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.47905.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48325.log 2024-05-15T16:42:18.112 INFO:teuthology.orchestra.run.smithi012.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.47905.log.gz 2024-05-15T16:42:18.112 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.45547.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45547.log.gz 2024-05-15T16:42:18.112 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48199.log 2024-05-15T16:42:18.112 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.48325.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48325.log.gz 2024-05-15T16:42:18.112 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-05-15T16:42:18.112 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46744.log 2024-05-15T16:42:18.113 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-mon.a.log: /var/log/ceph/ceph-client.admin.48199.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48199.log.gz 2024-05-15T16:42:18.113 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45009.log 2024-05-15T16:42:18.113 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.46744.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46744.log.gz 2024-05-15T16:42:18.113 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37898.log 2024-05-15T16:42:18.113 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.45009.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45009.log.gz 2024-05-15T16:42:18.113 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48115.log 2024-05-15T16:42:18.113 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.37898.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.37898.log.gz 2024-05-15T16:42:18.113 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46824.log 2024-05-15T16:42:18.114 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.48115.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48115.log.gz 2024-05-15T16:42:18.114 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43081.log 2024-05-15T16:42:18.114 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.46824.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46824.log.gz 2024-05-15T16:42:18.114 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48241.log 2024-05-15T16:42:18.114 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.43081.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43081.log.gz 2024-05-15T16:42:18.114 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47695.log 2024-05-15T16:42:18.114 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.48241.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48241.log.gz 2024-05-15T16:42:18.114 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47863.log 2024-05-15T16:42:18.115 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.47695.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47695.log.gz 2024-05-15T16:42:18.115 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45799.log 2024-05-15T16:42:18.115 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.47863.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47863.log.gz 2024-05-15T16:42:18.115 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44342.log 2024-05-15T16:42:18.115 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.45799.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45799.log.gz 2024-05-15T16:42:18.115 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51445.log 2024-05-15T16:42:18.115 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.44342.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44342.log.gz 2024-05-15T16:42:18.115 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48367.log 2024-05-15T16:42:18.116 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.51445.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.51445.log.gz 2024-05-15T16:42:18.116 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47653.log 2024-05-15T16:42:18.116 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.48367.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48367.log.gz 2024-05-15T16:42:18.116 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45330.log 2024-05-15T16:42:18.116 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.47653.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47653.log.gz 2024-05-15T16:42:18.116 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51319.log 2024-05-15T16:42:18.120 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.31082.log 2024-05-15T16:42:18.121 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.31078.log 2024-05-15T16:42:18.121 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.0.31082.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.31082.log.gz 2024-05-15T16:42:18.121 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.30644.log 2024-05-15T16:42:18.121 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.0.31078.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.31078.log.gz 2024-05-15T16:42:18.121 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.30663.log 2024-05-15T16:42:18.121 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.0.30644.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.30644.log.gz 2024-05-15T16:42:18.122 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.0.30663.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.30663.log.gz 2024-05-15T16:42:18.122 INFO:teuthology.orchestra.run.smithi104.stderr: 2024-05-15T16:42:18.122 INFO:teuthology.orchestra.run.smithi104.stderr:real 0m0.038s 2024-05-15T16:42:18.122 INFO:teuthology.orchestra.run.smithi104.stderr:user 0m0.009s 2024-05-15T16:42:18.122 INFO:teuthology.orchestra.run.smithi104.stderr:sys 0m0.061s 2024-05-15T16:42:18.157 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.45330.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.45330.log.gz 2024-05-15T16:42:18.158 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43162.log 2024-05-15T16:42:18.158 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.51319.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.51319.log.gz 2024-05-15T16:42:18.158 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37634.log 2024-05-15T16:42:18.158 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.43162.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43162.log.gz 2024-05-15T16:42:18.158 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51697.log 2024-05-15T16:42:18.158 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.37634.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.37634.log.gz 2024-05-15T16:42:18.158 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44339.log 2024-05-15T16:42:18.158 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.51697.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51697.log.gz 2024-05-15T16:42:18.159 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44341.log 2024-05-15T16:42:18.159 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.44339.log: 95.1% 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44339.log.gz 2024-05-15T16:42:18.159 INFO:teuthology.orchestra.run.smithi012.stderr: -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-05-15T16:42:18.159 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47313.log 2024-05-15T16:42:18.159 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46226.log 2024-05-15T16:42:18.159 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.44341.log: /var/log/ceph/ceph-client.admin.47313.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44341.log.gz 2024-05-15T16:42:18.159 INFO:teuthology.orchestra.run.smithi012.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47313.log.gz 2024-05-15T16:42:18.159 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46268.log 2024-05-15T16:42:18.160 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46033.log 2024-05-15T16:42:18.160 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.46268.log: /var/log/ceph/ceph-client.admin.46226.log: 88.0% 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46226.log.gz 2024-05-15T16:42:18.160 INFO:teuthology.orchestra.run.smithi012.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46268.log.gz 2024-05-15T16:42:18.160 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46963.log 2024-05-15T16:42:18.160 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43740.log/var/log/ceph/ceph-client.admin.46033.log: 2024-05-15T16:42:18.160 INFO:teuthology.orchestra.run.smithi012.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46033.log.gz 2024-05-15T16:42:18.160 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.46963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43824.log 2024-05-15T16:42:18.160 INFO:teuthology.orchestra.run.smithi012.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46963.log.gz 2024-05-15T16:42:18.160 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.43740.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43740.log.gz 2024-05-15T16:42:18.161 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45251.log 2024-05-15T16:42:18.161 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.43824.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45015.log 2024-05-15T16:42:18.161 INFO:teuthology.orchestra.run.smithi012.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43824.log.gz 2024-05-15T16:42:18.161 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.45251.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51403.log 2024-05-15T16:42:18.161 INFO:teuthology.orchestra.run.smithi012.stderr: 88.5%/var/log/ceph/ceph-client.admin.45015.log: -- replaced with /var/log/ceph/ceph-client.admin.45251.log.gz 2024-05-15T16:42:18.161 INFO:teuthology.orchestra.run.smithi012.stderr: 88.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43698.log 2024-05-15T16:42:18.161 INFO:teuthology.orchestra.run.smithi012.stderr: -- replaced with /var/log/ceph/ceph-client.admin.45015.log.gz 2024-05-15T16:42:18.162 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43782.log 2024-05-15T16:42:18.162 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.51403.log: /var/log/ceph/ceph-client.admin.43698.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51403.log.gz 2024-05-15T16:42:18.162 INFO:teuthology.orchestra.run.smithi012.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43698.log.gz 2024-05-15T16:42:18.162 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50941.log 2024-05-15T16:42:18.162 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47611.log 2024-05-15T16:42:18.162 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.43782.log: /var/log/ceph/ceph-client.admin.50941.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43782.log.gz 2024-05-15T16:42:18.162 INFO:teuthology.orchestra.run.smithi012.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.50941.log.gz 2024-05-15T16:42:18.162 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45907.log 2024-05-15T16:42:18.162 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51487.log 2024-05-15T16:42:18.163 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.47611.log: /var/log/ceph/ceph-client.admin.45907.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47611.log.gz 2024-05-15T16:42:18.163 INFO:teuthology.orchestra.run.smithi012.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45907.log.gz 2024-05-15T16:42:18.163 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51277.log 2024-05-15T16:42:18.163 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.51487.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.51487.log.gz 2024-05-15T16:42:18.163 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47132.log 2024-05-15T16:42:18.163 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.51277.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43950.log 2024-05-15T16:42:18.163 INFO:teuthology.orchestra.run.smithi012.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.51277.log.gz 2024-05-15T16:42:18.163 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.47132.log: gzip 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47132.log.gz 2024-05-15T16:42:18.164 INFO:teuthology.orchestra.run.smithi012.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.44678.log 2024-05-15T16:42:18.164 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.43950.log: /var/log/ceph/ceph-client.admin.47443.log 2024-05-15T16:42:18.164 INFO:teuthology.orchestra.run.smithi012.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43950.log.gz 2024-05-15T16:42:18.164 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.44678.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46117.log 2024-05-15T16:42:18.164 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.47443.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44678.log.gz 2024-05-15T16:42:18.164 INFO:teuthology.orchestra.run.smithi012.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47443.log.gz 2024-05-15T16:42:18.164 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.31779.log 2024-05-15T16:42:18.164 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.46117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45329.log 2024-05-15T16:42:18.165 INFO:teuthology.orchestra.run.smithi012.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.46117.log.gz 2024-05-15T16:42:18.165 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph.tmp-client.admin.31779.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.31779.log.gz 2024-05-15T16:42:18.165 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45715.log 2024-05-15T16:42:18.165 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.45329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47174.log 2024-05-15T16:42:18.165 INFO:teuthology.orchestra.run.smithi012.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45329.log.gz 2024-05-15T16:42:18.165 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.45715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44673.log 2024-05-15T16:42:18.165 INFO:teuthology.orchestra.run.smithi012.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45715.log.gz 2024-05-15T16:42:18.165 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51757.log 2024-05-15T16:42:18.166 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.47174.log: /var/log/ceph/ceph-client.admin.44673.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.47174.log.gz 2024-05-15T16:42:18.166 INFO:teuthology.orchestra.run.smithi012.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44673.log.gz 2024-05-15T16:42:18.166 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48157.log 2024-05-15T16:42:18.166 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.51757.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51757.log.gz 2024-05-15T16:42:18.166 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43908.log 2024-05-15T16:42:18.166 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.48157.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51613.log 2024-05-15T16:42:18.166 INFO:teuthology.orchestra.run.smithi012.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.48157.log.gz 2024-05-15T16:42:18.167 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.43908.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51109.log 2024-05-15T16:42:18.167 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.51613.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43908.log.gz 2024-05-15T16:42:18.167 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44672.log 2024-05-15T16:42:18.167 INFO:teuthology.orchestra.run.smithi012.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51613.log.gz 2024-05-15T16:42:18.167 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.51109.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44677.log 2024-05-15T16:42:18.167 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.44672.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51109.log.gz 2024-05-15T16:42:18.167 INFO:teuthology.orchestra.run.smithi012.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44672.log.gz 2024-05-15T16:42:18.167 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44915.log 2024-05-15T16:42:18.168 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-05-15T16:42:18.168 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.44677.log: /var/log/ceph/ceph-client.admin.44915.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44677.log.gz 2024-05-15T16:42:18.168 INFO:teuthology.orchestra.run.smithi012.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44915.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44679.log 2024-05-15T16:42:18.168 INFO:teuthology.orchestra.run.smithi012.stderr: 2024-05-15T16:42:18.168 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51025.log 2024-05-15T16:42:18.168 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.44679.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44679.log.gz 2024-05-15T16:42:18.168 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51797.log 2024-05-15T16:42:18.168 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.51025.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.51025.log.gz 2024-05-15T16:42:18.168 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45014.log 2024-05-15T16:42:18.169 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.51797.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.51797.log.gz 2024-05-15T16:42:18.169 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44335.log 2024-05-15T16:42:18.169 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.45014.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45014.log.gz 2024-05-15T16:42:18.169 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46622.log 2024-05-15T16:42:18.169 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.44335.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.44335.log.gz 2024-05-15T16:42:18.169 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47048.log 2024-05-15T16:42:18.169 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.46622.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46622.log.gz 2024-05-15T16:42:18.169 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51067.log 2024-05-15T16:42:18.169 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.47048.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47048.log.gz 2024-05-15T16:42:18.170 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46394.log 2024-05-15T16:42:18.170 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.51067.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.51067.log.gz 2024-05-15T16:42:18.170 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48073.log 2024-05-15T16:42:18.170 INFO:teuthology.orchestra.run.smithi012.stderr: 94.1% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-05-15T16:42:18.170 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.46394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44035.log 2024-05-15T16:42:18.170 INFO:teuthology.orchestra.run.smithi012.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.46394.log.gz 2024-05-15T16:42:18.170 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.48073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44337.log 2024-05-15T16:42:18.171 INFO:teuthology.orchestra.run.smithi012.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48073.log.gz/var/log/ceph/ceph-client.admin.44035.log: 2024-05-15T16:42:18.171 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43382.log 2024-05-15T16:42:18.171 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.44337.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44035.log.gz 2024-05-15T16:42:18.171 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48596.log 2024-05-15T16:42:18.171 INFO:teuthology.orchestra.run.smithi012.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44337.log.gz 2024-05-15T16:42:18.171 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.43382.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45841.log 2024-05-15T16:42:18.171 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.48596.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43382.log.gz 2024-05-15T16:42:18.171 INFO:teuthology.orchestra.run.smithi012.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48596.log.gz 2024-05-15T16:42:18.171 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.45841.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.45841.log.gz 2024-05-15T16:42:18.536 INFO:teuthology.orchestra.run.smithi084.stderr: 92.1% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-05-15T16:42:18.929 INFO:teuthology.orchestra.run.smithi084.stderr: 92.8% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-05-15T16:42:19.178 INFO:teuthology.orchestra.run.smithi084.stderr: 92.7% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-05-15T16:42:20.293 INFO:teuthology.orchestra.run.smithi012.stderr: 90.4% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-05-15T16:42:20.785 INFO:teuthology.orchestra.run.smithi012.stderr: 94.1% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-05-15T16:42:23.892 INFO:teuthology.orchestra.run.smithi084.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-05-15T16:42:28.050 INFO:teuthology.orchestra.run.smithi084.stderr: 92.7% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-05-15T16:42:29.276 INFO:teuthology.orchestra.run.smithi084.stderr: 92.7% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-05-15T16:42:29.313 INFO:teuthology.orchestra.run.smithi012.stderr: 92.6% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-05-15T16:42:29.760 INFO:teuthology.orchestra.run.smithi012.stderr: 92.4% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-05-15T16:42:31.596 INFO:teuthology.orchestra.run.smithi012.stderr: 92.3% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-05-15T16:42:31.838 INFO:teuthology.orchestra.run.smithi012.stderr: 92.3% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-05-15T16:42:31.840 INFO:teuthology.orchestra.run.smithi012.stderr: 2024-05-15T16:42:31.840 INFO:teuthology.orchestra.run.smithi012.stderr:real 0m13.819s 2024-05-15T16:42:31.840 INFO:teuthology.orchestra.run.smithi012.stderr:user 0m53.807s 2024-05-15T16:42:31.840 INFO:teuthology.orchestra.run.smithi012.stderr:sys 0m1.614s 2024-05-15T16:42:33.490 INFO:teuthology.orchestra.run.smithi084.stderr: 92.2% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-05-15T16:42:33.491 INFO:teuthology.orchestra.run.smithi084.stderr: 2024-05-15T16:42:33.492 INFO:teuthology.orchestra.run.smithi084.stderr:real 0m15.470s 2024-05-15T16:42:33.492 INFO:teuthology.orchestra.run.smithi084.stderr:user 0m43.664s 2024-05-15T16:42:33.492 INFO:teuthology.orchestra.run.smithi084.stderr:sys 0m1.420s 2024-05-15T16:42:33.492 INFO:tasks.ceph:Archiving logs... 2024-05-15T16:42:33.493 DEBUG:teuthology.misc:Transferring archived files from smithi012:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-05-15_15:16:14-fs:fscrypt-wip-pdonnell-testing-20240515.023933-debug-distro-default-smithi/7707268/remote/smithi012/log 2024-05-15T16:42:33.494 DEBUG:teuthology.orchestra.run.smithi012:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-15T16:42:41.120 DEBUG:teuthology.misc:Transferring archived files from smithi084:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-05-15_15:16:14-fs:fscrypt-wip-pdonnell-testing-20240515.023933-debug-distro-default-smithi/7707268/remote/smithi084/log 2024-05-15T16:42:41.121 DEBUG:teuthology.orchestra.run.smithi084:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-15T16:42:47.818 DEBUG:teuthology.misc:Transferring archived files from smithi104:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-05-15_15:16:14-fs:fscrypt-wip-pdonnell-testing-20240515.023933-debug-distro-default-smithi/7707268/remote/smithi104/log 2024-05-15T16:42:47.819 DEBUG:teuthology.orchestra.run.smithi104:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-15T16:42:47.909 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-05-15T16:42:47.918 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-05-15T16:42:47.918 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-15T16:42:47.921 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-15T16:42:47.923 DEBUG:teuthology.orchestra.run.smithi104:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-15T16:42:48.078 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-05-15T16:42:48.086 INFO:teuthology.task.clock:Checking final clock skew... 2024-05-15T16:42:48.087 DEBUG:teuthology.orchestra.run.smithi012:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-15T16:42:48.089 DEBUG:teuthology.orchestra.run.smithi084:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-15T16:42:48.092 DEBUG:teuthology.orchestra.run.smithi104:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-15T16:42:48.103 INFO:teuthology.orchestra.run.smithi084.stderr:bash: line 1: ntpq: command not found 2024-05-15T16:42:48.104 INFO:teuthology.orchestra.run.smithi012.stderr:bash: line 1: ntpq: command not found 2024-05-15T16:42:48.107 INFO:teuthology.orchestra.run.smithi084.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-15T16:42:48.107 INFO:teuthology.orchestra.run.smithi084.stdout:=============================================================================== 2024-05-15T16:42:48.107 INFO:teuthology.orchestra.run.smithi084.stdout:^* hv01.front.sepia.ceph.com 3 7 377 74 +305us[ +593us] +/- 50ms 2024-05-15T16:42:48.107 INFO:teuthology.orchestra.run.smithi084.stdout:^+ hv02.front.sepia.ceph.com 3 8 377 203 -2334us[-2037us] +/- 55ms 2024-05-15T16:42:48.107 INFO:teuthology.orchestra.run.smithi084.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 7 +2251us[+2251us] +/- 68ms 2024-05-15T16:42:48.107 INFO:teuthology.orchestra.run.smithi084.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-05-15T16:42:48.108 INFO:teuthology.orchestra.run.smithi012.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-15T16:42:48.108 INFO:teuthology.orchestra.run.smithi012.stdout:=============================================================================== 2024-05-15T16:42:48.109 INFO:teuthology.orchestra.run.smithi012.stdout:^* hv01.front.sepia.ceph.com 3 7 377 75 +309us[ +598us] +/- 50ms 2024-05-15T16:42:48.109 INFO:teuthology.orchestra.run.smithi012.stdout:^+ hv02.front.sepia.ceph.com 3 7 377 76 -2354us[-2065us] +/- 57ms 2024-05-15T16:42:48.109 INFO:teuthology.orchestra.run.smithi012.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 8 +2253us[+2253us] +/- 68ms 2024-05-15T16:42:48.109 INFO:teuthology.orchestra.run.smithi012.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-05-15T16:42:48.145 INFO:teuthology.orchestra.run.smithi104.stderr:bash: line 1: ntpq: command not found 2024-05-15T16:42:48.154 INFO:teuthology.orchestra.run.smithi104.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-15T16:42:48.155 INFO:teuthology.orchestra.run.smithi104.stdout:=============================================================================== 2024-05-15T16:42:48.155 INFO:teuthology.orchestra.run.smithi104.stdout:^* hv01.front.sepia.ceph.com 3 8 377 73 +295us[ +590us] +/- 50ms 2024-05-15T16:42:48.155 INFO:teuthology.orchestra.run.smithi104.stdout:^+ hv02.front.sepia.ceph.com 3 8 377 12 -2374us[-2374us] +/- 58ms 2024-05-15T16:42:48.155 INFO:teuthology.orchestra.run.smithi104.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 6 +2258us[+2258us] +/- 68ms 2024-05-15T16:42:48.155 INFO:teuthology.orchestra.run.smithi104.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-05-15T16:42:48.156 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-05-15T16:42:48.165 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-05-15T16:42:48.166 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-05-15T16:42:48.174 DEBUG:teuthology.orchestra.run.smithi012:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-15T16:42:48.248 DEBUG:teuthology.orchestra.run.smithi084:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-15T16:42:48.308 DEBUG:teuthology.orchestra.run.smithi104:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-15T16:42:48.472 DEBUG:teuthology.orchestra.run.smithi012:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-15T16:42:48.505 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-15T16:42:48.505 DEBUG:teuthology.orchestra.run.smithi084:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-15T16:42:48.531 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-15T16:42:48.531 DEBUG:teuthology.orchestra.run.smithi104:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-15T16:42:48.620 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-15T16:42:48.621 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-05-15T16:42:48.630 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-05-15T16:42:48.652 INFO:teuthology.task.internal:Duration was 4325.897691 seconds 2024-05-15T16:42:48.653 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-05-15T16:42:48.689 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-05-15T16:42:48.690 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-15T16:42:48.692 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-15T16:42:48.695 DEBUG:teuthology.orchestra.run.smithi104:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-15T16:42:48.729 INFO:teuthology.orchestra.run.smithi084.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-15T16:42:48.735 INFO:teuthology.orchestra.run.smithi012.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-15T16:42:48.822 INFO:teuthology.orchestra.run.smithi104.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-15T16:42:49.067 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-05-15T16:42:49.067 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi012.front.sepia.ceph.com 2024-05-15T16:42:49.067 DEBUG:teuthology.orchestra.run.smithi012:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-15T16:42:49.092 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi084.front.sepia.ceph.com 2024-05-15T16:42:49.092 DEBUG:teuthology.orchestra.run.smithi084:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-15T16:42:49.119 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi104.front.sepia.ceph.com 2024-05-15T16:42:49.119 DEBUG:teuthology.orchestra.run.smithi104:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-15T16:42:49.188 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-05-15T16:42:49.189 DEBUG:teuthology.orchestra.run.smithi012:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-15T16:42:49.192 DEBUG:teuthology.orchestra.run.smithi084:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-15T16:42:49.194 DEBUG:teuthology.orchestra.run.smithi104:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-15T16:42:49.271 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-05-15T16:42:49.271 DEBUG:teuthology.orchestra.run.smithi012:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-15T16:42:49.274 DEBUG:teuthology.orchestra.run.smithi084:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-15T16:42:49.277 DEBUG:teuthology.orchestra.run.smithi104:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-15T16:42:49.473 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-05-15T16:42:49.482 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-05-15T16:42:49.483 DEBUG:teuthology.orchestra.run.smithi012:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-15T16:42:49.508 DEBUG:teuthology.orchestra.run.smithi084:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-15T16:42:49.531 DEBUG:teuthology.orchestra.run.smithi104:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-15T16:42:49.617 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-05-15T16:42:49.625 DEBUG:teuthology.orchestra.run.smithi012:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-15T16:42:49.628 DEBUG:teuthology.orchestra.run.smithi084:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-15T16:42:49.630 DEBUG:teuthology.orchestra.run.smithi104:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-15T16:42:49.649 INFO:teuthology.orchestra.run.smithi012.stdout:kernel.core_pattern = core 2024-05-15T16:42:49.649 INFO:teuthology.orchestra.run.smithi084.stdout:kernel.core_pattern = core 2024-05-15T16:42:49.728 INFO:teuthology.orchestra.run.smithi104.stdout:kernel.core_pattern = core 2024-05-15T16:42:49.771 DEBUG:teuthology.orchestra.run.smithi012:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-15T16:42:49.786 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-15T16:42:49.786 DEBUG:teuthology.orchestra.run.smithi084:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-15T16:42:49.800 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-15T16:42:49.801 DEBUG:teuthology.orchestra.run.smithi104:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-15T16:42:49.854 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-15T16:42:49.855 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-05-15T16:42:49.865 INFO:teuthology.task.internal:Transferring archived files... 2024-05-15T16:42:49.865 DEBUG:teuthology.misc:Transferring archived files from smithi012:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-05-15_15:16:14-fs:fscrypt-wip-pdonnell-testing-20240515.023933-debug-distro-default-smithi/7707268/remote/smithi012 2024-05-15T16:42:49.866 DEBUG:teuthology.orchestra.run.smithi012:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-15T16:42:49.900 DEBUG:teuthology.misc:Transferring archived files from smithi084:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-05-15_15:16:14-fs:fscrypt-wip-pdonnell-testing-20240515.023933-debug-distro-default-smithi/7707268/remote/smithi084 2024-05-15T16:42:49.900 DEBUG:teuthology.orchestra.run.smithi084:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-15T16:42:49.931 DEBUG:teuthology.misc:Transferring archived files from smithi104:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-05-15_15:16:14-fs:fscrypt-wip-pdonnell-testing-20240515.023933-debug-distro-default-smithi/7707268/remote/smithi104 2024-05-15T16:42:49.932 DEBUG:teuthology.orchestra.run.smithi104:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-15T16:42:50.028 INFO:teuthology.task.internal:Removing archive directory... 2024-05-15T16:42:50.028 DEBUG:teuthology.orchestra.run.smithi012:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-15T16:42:50.031 DEBUG:teuthology.orchestra.run.smithi084:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-15T16:42:50.034 DEBUG:teuthology.orchestra.run.smithi104:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-15T16:42:50.091 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-05-15T16:42:50.100 INFO:teuthology.task.internal:Not uploading archives. 2024-05-15T16:42:50.101 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-05-15T16:42:50.142 INFO:teuthology.task.internal:Tidying up after the test... 2024-05-15T16:42:50.142 DEBUG:teuthology.orchestra.run.smithi012:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-15T16:42:50.145 DEBUG:teuthology.orchestra.run.smithi084:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-15T16:42:50.147 DEBUG:teuthology.orchestra.run.smithi104:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-15T16:42:50.158 INFO:teuthology.orchestra.run.smithi012.stdout: 262161 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 15 16:42 /home/ubuntu/cephtest 2024-05-15T16:42:50.159 INFO:teuthology.orchestra.run.smithi084.stdout: 262161 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 15 16:42 /home/ubuntu/cephtest 2024-05-15T16:42:50.204 INFO:teuthology.orchestra.run.smithi104.stdout: 393249 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 15 16:42 /home/ubuntu/cephtest 2024-05-15T16:42:50.207 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-05-15T16:42:50.217 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-05-15T16:42:50.299 INFO:teuthology.nuke:Checking targets against current locks 2024-05-15T16:42:50.327 DEBUG:teuthology.nuke:shortname: smithi012 2024-05-15T16:42:50.327 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-15T16:42:50.354 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi012.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-05-15_15:16:14-fs:fscrypt-wip-pdonnell-testing-20240515.023933-debug-distro-default-smithi/7707268', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-15 15:22:05.544884', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBG2i70EpL77oPbG/6MA++NCF0uVUZz0Qn3hgynP6Ra4eXFERNjfmD4+oGS3/ks6eG9cLo+CrJySNJ851dnkVdTE='} 2024-05-15T16:42:50.357 DEBUG:teuthology.nuke:shortname: smithi084 2024-05-15T16:42:50.358 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-15T16:42:50.380 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi084.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-05-15_15:16:14-fs:fscrypt-wip-pdonnell-testing-20240515.023933-debug-distro-default-smithi/7707268', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-15 15:22:05.546537', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKg91V/Kmfd0ek4z720g3qcttaon7aGfKZ+BIb1+EKkDr9Gi4zWlwDedklEjb0y5tvPJuIr5sWgiZgBWyW7yCbU='} 2024-05-15T16:42:50.384 DEBUG:teuthology.nuke:shortname: smithi104 2024-05-15T16:42:50.384 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-15T16:42:50.411 INFO:teuthology.orchestra.console.smithi012:Power off 2024-05-15T16:42:50.411 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-05-15T16:42:50.419 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi104.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-05-15_15:16:14-fs:fscrypt-wip-pdonnell-testing-20240515.023933-debug-distro-default-smithi/7707268', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-15 15:22:05.542983', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBA4rmZ4S3yNGHZiN5a6YvUTX8tOaCaaM2ddSiIfEAwKC/OMYTIuvWJ8ySpMZHCU+ukEuoQ7sP/V69xi1K/P4tvk='} 2024-05-15T16:42:50.436 DEBUG:teuthology.orchestra.console.smithi012:power off output: Chassis Power Control: Down/Off 2024-05-15T16:42:50.436 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-15T16:42:50.451 INFO:teuthology.orchestra.console.smithi084:Power off 2024-05-15T16:42:50.452 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-05-15T16:42:50.466 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is on 2024-05-15T16:42:50.476 DEBUG:teuthology.orchestra.console.smithi084:power off output: Chassis Power Control: Down/Off 2024-05-15T16:42:50.476 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-15T16:42:50.491 INFO:teuthology.orchestra.console.smithi104:Power off 2024-05-15T16:42:50.491 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-05-15T16:42:50.507 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is on 2024-05-15T16:42:50.512 DEBUG:teuthology.orchestra.console.smithi104:power off output: Chassis Power Control: Down/Off 2024-05-15T16:42:50.513 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-15T16:42:50.537 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is on 2024-05-15T16:42:54.467 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-15T16:42:54.508 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-15T16:42:54.538 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-15T16:42:54.578 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is on 2024-05-15T16:42:54.619 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is on 2024-05-15T16:42:54.650 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is on 2024-05-15T16:42:58.580 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-15T16:42:58.621 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-15T16:42:58.651 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-15T16:42:58.692 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is on 2024-05-15T16:42:58.731 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is off 2024-05-15T16:42:58.762 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is off 2024-05-15T16:42:58.833 INFO:teuthology.orchestra.console.smithi084:Power off completed 2024-05-15T16:42:58.863 INFO:teuthology.orchestra.console.smithi104:Power off completed 2024-05-15T16:43:02.694 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-15T16:43:02.805 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is off 2024-05-15T16:43:02.906 INFO:teuthology.orchestra.console.smithi012:Power off completed 2024-05-15T16:43:03.012 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 42e114f04cb046558abf08b436bd2a0497043042 description: fs:fscrypt/{begin/{0-install 1-ceph 2-logrotate 3-modules} bluestore-bitmap clusters/1-mds-1-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} overrides/{ignorelist_health ignorelist_health_more ignorelist_wrongly_marked_down osd pg-warn pg_health} tasks/{0-client 1-tests/fscrypt-common}} duration: 4325.897690534592 failure_reason: 'Test failure: test_fscrypt_basic_mount (tasks.cephfs.test_fscrypt.TestFSCrypt)' flavor: default owner: scheduled_pdonnell@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=5d045ddea2704f3b9bb7751ed049579e status: fail success: false 2024-05-15T16:43:03.012 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-15T16:43:03.096 INFO:teuthology.run:FAIL